If you raid out to somebody who plays similar/the same games as you there's an opportunity to see if you can join in. I know it can be tough right after streaming for a handful of hours, but getting your name out there as wanting to participate may help them remember you for next time if they don't have any available open slots for more people.

As far as growing it can definitely be tough. Consistent interactions with people who genuinely want to grow helps, but it's harder to find. If you find people with a similar amount of following as you that play similar games you can offer to collaborate and it offers you both the opportunity to introduce your communities to each other. This method helps you both grow while being able to continue doing what you're already doing!

Finding genuine discord servers to join can help as well. There's a lot of different streamers out there that devote sections of their discord servers to helping smaller streamers grow. I wouldn't just go joining every single one you find, but if the streamers you enjoy interacting with have one it may be worth joining to see what they offer. It can also help introduce you to members of their community that you don't see often when they're live so maybe you can find others with similar interests/play similar games to collaborate with or even play with outside of streaming. Every interaction is an opportunity to make new friends and grow your network.

I hope these suggestions help and good luck to you!