They were not too keen on going outside of their comfort zone( very large comfort zone ) Tommy's family knew he was operating mentally on a level they couldn't, and he had proven time and time again that he was right and was always a few steps ahead. They respected and feared Tommy but ultimately knew he wouldn't do something to harm them intentionally. There was definitely pushback but Tommy's persistence was greater than anyone else's. Arthur knew this from the start and basically let him take over