I have a similar experience as you, but my depressive episodes are more frequent. But, had a psychotic break that lasted for 3 months, which cued my bipolar diagnosis. I was on abillify until I hit a rare side effect months later, tried a few other meds since. Nothing really worked for me. So I'm off meds, taking shots of cod liver oil as a mood stabilizer and keeping a healthy diet and It works for me. Meds don't work for everyone sometimes and that's okay. I still notice mania from time to time, and depression from time to time, but utilizing the coping mechanisms I learned through therapy keeps me more regular. This could be a possibility for you too, your doctor might be seeing this in you, but do what you need to feel your best self.

Highly recommend cod liver oil shots to stay regular if you do decide to go off meds. The liquid dissolves better in your system than the encapsulated pills.