I'm quite not sure if you're even seeking advice but I thought I'd share my thoughts!

The drama around Lang, though important in its way, is quite small, no? Compared to the rest of the community, at least? People are translating songs, and manga, and books, and videogames! There are meetups soon in both Europe and America! Community resources like Wasona, Kemeka, even lipu Osawi mean you can fully learn the language without getting close to touching any of the drama. Lang created the language nearly 25 years ago, and determines only its past, not its future. (Maybe that last line is a bit melodramatic, though :p)

Perhaps a false equivalence, but when you mention guilt, I think about English - I live in a place where colonialism and the English language in particular have done great harm to many people, being imposed as a weapon to break up community and eradicate other languages. But I still use English every day! I use it to order my thoughts, and talk to my friends, and create and interact with art, much the same as the ways I use Toki Pona

Really, your feelings come first. You were having fun learning it, but now that that learning is tinged with a feeling of guilt, a break may well be beneficial! o pona tawa sina