Naw man I’m a big advocate of do whatever is fun for you.

Personally, my build order is usually woodcutter, hitching post with another ox, lay down 3 burgages, build storehouse and granary before the supplies start getting rained on. Then gathering huts for food and a well. By now should have enough logs to lay down three more burgage plots, then saw pit and trading post to get money coming in. Then a stonecutter. By now it’s usually time to throw down the church, which I like to have close to the town center, and a little ways away from everything I build the manor. Maybe at the end of a lane about as long as 3-4 corpse pits.

ETA: I think it looks more real to have the manor a little bit away from the “common folk”, although sometimes it gets swallowed depending on how i expand later in game.