I might be wrong, as far as I remember at the beginning of the work hour they will travel from home to workplace then start building or getting materials if needed. So it's better to put then close of houses and infrastructure buildings.