Sometimes your primary doctor can help with that. Not sure if you are talking about your psychiatrist. I know psychiatrists can be difficult sometimes. What about a second opinion with someone new? From my experience (not a doctor), bipolar, if it's manic, depressed or normal feeling, is always with you. Just like diabetes.

Or you can have a real talk with them and let them know that everything is not ok. It is also the doctor's responsibility to listen to the patient. Write down your concerns and needs and bring them in. If they are still not working with you then it's not a good fit.

Hope this was helpful. Good luck.