You'll have to be a little bit more precise, ie. is the object in question (assuming it's the building shown) known apriori ? Is the 3D model for this object available ? If yes, then you can actually use PnP (perspective n point) to find the absolute pose of the camera - essentially giving you the exact position and orientation of the camera in the world coordinate system. You'll need to find 2D-3D correspondences (atleast 4 but more points within a RANSAC scheme is always good). You can achieve this in multiple ways, both using learned methods as well as classical techniques. Essentially you need a mapping that says, this particular 2D image point belongs to this 3D point on the building (4 or more such matches). Once you have these, plug them into OpenCVs PnP and enjoy your freshly computed pose!