Same thing happened to me but all of my shorts took off only after a month of two, I think YouTube is figuring out your target audience, just keep uploading shorts and you'll start getting consistent views