Avoid pointless pointers

Passing OFVector3D by reference is annoying and is worse at passing via
registers.