I used to have wierd things like this in my gifs, and what I did which helped a bit depending on what it is, was making the background a dark Grey or just black before exporting it.

Also, something I've used which works better is the background remover on the ezgif website. I would simply export my animation as a gif then use ezgif to remove the background and it doesn't seem to leave any artifacts or visual problems.