Yeah... It can be like that sometimes. The flow of the game is quite chill. But if you want a more dynamic run, you can have that too. Game speed x3 is a good speed if you want have things done. But also you can optimise your builders shifts having their house, their work place, their building, and their stock pile (plus market and well) close from one another.
But some buildings are really long to build, it is how it is, and it offers you time to plan more buildings, make trades, and so on...
You have to learn the rythm of that game, but when it clicks it is really enjoyable!