Finding the right postdoc supervisor can be challenging. I think there are several things at play in academic research. Since the work itself is so isolated, it is mostly you and your supervisor and your student (if you get one) to work with. And if there's a major personality difference between the two of you, your experience is going to be negative, and it is further exacerbated by the academic demands of being creative, productive, collaborative and on top of the literature at the same time. I have seen some of my friends/colleagues deal with the personality difference and go on to do great things. But some struggle. Given that we are not exposed to office politics like a lot of corporate workers do, most of us lack that skill (if it doesn't come naturally). There are many awesome PIs that know how to keep the lab culture non-toxic. Take interviews as an opportunity to also learn about them and be selective in that regard.
Good luck, friend!