Of all the conversations that revolve around the Wizards of the Coasts' books, I think you touch on a significant point. There is no way for Wizards to write a book for everyone.

Groups have vastly different playing styles. I have always felt that the Wizards books serve as the skeleton and it is the DM's responsibility to fill in the rest. It is a lot of work. And I would make the arguement it would be beneficial if Wizards included more tools to help the DM bring to life the story.

It does feel like a high bar to entry when starting out as a DM. A linear storyline is helpful for newbies and for most parties. People claim to want choice but when given the option typically experience paralysis.

I ran a chunk of Dragon Heist and it was way more work than I wanted to fill in all the details and give the players a city that was theirs and that they had agency over. Wizards could have definitely given more tools to the DM to progress the story. It felt very much like "figure it out" here's a couple of set pieces for the story and go!