SOLVED- I changed the bit of wood to a much thinner peice and the pins just pulled out nice and easy! The bearing pins were pretty dirty with not much grease in them.
One set has come out though, so I now need to figure out how to reassemble the bearings inside the housing, which is my next puzzle 😶