Issues with anchoring a model offset from the target image

I am testing anchoring a large model onto an image tracker. It anchors well when the model is at the same position as the target image. It is not working when I try to position the model off to the side of the target image. It keeps moving as I turn the camera. I remember us speaking about this in person and I thought I remembered you or Joel saying it was possible to offset the model. I read another post where you said the following:

Wondering if that is a hard rule or if there is a workaround there, thanks!

Something like this?

Can you show your Image Target? It could be that the Target isn’t detailed enough and is having a hard time tracking. If you can show a video that would be great as well.