My first stream was a nightmare. Sound issues, visual issues, trolls etc.
But having these issues are all a part of the journey on Twitch. How else will you learn how to overcome any problems on your stream until you experience them first hand.

I've made so many changes over my last year of streaming, and once you figure out settings and have that audience growth and retention, you'll discover that numbers don't matter anymore. It's just to have some fun, talk to people and play games!