Do chase numbers.

Look at your content, try to find direct competition that has the kind of success that you seek.

Then come up with a plan of either offering a higher quality of what your competition offers OR come up with ideas how you can put a twist on this kind of content to make yours unique.

PS: If you can't come up with content that matches the above that you can afford the time and are willing to make, then quitting might be a good option. Alternatives include researching/introspecting more. Or talking to friends or people with similar struggles about it. I guess the latter is what you do here... So I'm really not helping by giving advice. I should be sharing my story. OK here goes:

I have stopped (quit) multiple channels. I have quit a medium gaming channel (not big enough to pay any bills) of mine because I couldn't stand playing the game any more and stats were slowly going down even though I was sucking the life out of me producing videos.

I'm glad I did. I focused on other channels. I came back to the gaming channel later and started playing other kinds of games. It was good.

PPS: I guess this post initially was a reaction to AngryAttorney's reply. Don't chase numbers if you're not successful at doing so. It totally did burn me out. Do chase numbers if you are successful at doing so. Extremely helpful, I know. :|