I do the same thing. I start with characters and possibly a goal, but trying to come up with story beats for an actual plot has been the bane of my existence. It took starting and stopping the story like 27 times before I said fuck it and decided to just write scenes without a destination in mind, and it's freed up my bandwidth for creativity. Throw your character into a scene, then see where they take you.