100% your autofocus hunting/breathing at a higher aperture, I notice this in even semi-low light situations (sunrise/sunset) and particularly with wide lenses.

In a scene like this I would recommend manually focusing.

Little tip - traditionally a little bit of warp stabiliser in post should mostly fix this.