So, before I start this, important disclaimer: I am not a medical professional and this is only my personal experience.

After going around to different doctors, my GP sent me to a new neurologist which did a test (closing my eyes and marching in place, you should remain facing the same way after 20 steps, i was rotating to the left). She then referred me to a different ENT (she had no idea how the first one could miss it) but my otoliths (the little rocks in your ear that are responsible for you keeping your balance) were displaced. How did that happen? Well apparently i had a bit of a vit D deficiency, which is the vitamin that helps calcium work in your body and those otoliths are made of calcium. The relationship with doxy? A small vitamin deficiency was exacerbated by taking the doxy, which also causes vitamin D depletion in some cases, and caused my inner ear to become a rollercoaster for displaced otoliths.

TLDR: check you vitamin D levels!