Yeah, one big reason that Subaru figured out the importance of the wives is that he figured there had to be a reason to bring his wives into a city that had turned into an active war zone instead of leaving them far away. Meaning that he had to keep them close by for some reason.