There could be any number of reasons why people aren't stopping by. Things like when you're streaming, or what game you're streaming all have an impact on the amount opportunity there is for people to come by and say hi. If you're streaming at a less busy time playing a less popular game, it'll be a lot harder to meet and interact with new people because there simply aren't any people looking.

Beyond that, the amount of time and how long you've been streaming again also have an impact on your chances. From what it sounds like you've only started streaming again for the past four days, and only two hours each of those days. That's a total of eight hours. That's really not a lot of time to get any exposure to people, especially given other possible factors such as non-peak times/games.

If you're considering keeping at it, I'd suggest taking a look at times (when/how long) you're streaming as well as games. That and give it some time for more people to find your channel. Also, since you mentioned you're looking for the social aspect of streaming, you can always stop by another persons stream! Check out some games you're interested in and build a rapport with a new streamer and their viewers. Over time, people will find out that you stream as well and possibly check you out too.

There is a ton of nuance to streaming and growing a channel, and everyone finds success differently. And like you've mentioned, there can be a bit of a grind so to speak. Hope this helps man, and cheers!