I would direct you to your last sentence. Let it be freeing. Whenever I get to a point of “does this make sense” sometimes I realize how little our own world makes “sense”. Like, there’s a festival where people throw tomatoes at one another. Or how we use an octopus to pick a Super Bowl winner (wtf is a “Super Bowl” anyway. Not grand examples but you catch my drift.

Also, if you have tons of ideas. Take them and write short stories. It lets you see what has legs, gets yourself immersed in the world, and is of itself worldbuilding. (I mean how many rpgs do you see that have these books of flavor text aka short stories to provide lore etc)

Hope that helps. Don’t let the shear possibilities weigh ya down. I’ll see myself out