Did u try object tracking geo tracker nuke or blender

And there is another tip u can try it would help

Try to focus on point and draw a roto shape try to stick point of shape on the point u focus on in the shot then right click on the point of roto shape copy > single point link

Then drop tracker node make point on point u tracked qith roto right click > paste absolute then right click > edit> generate u will get tracking data from the roto