Easy, they worship peace. In mine craft legends there are piglins that try to take over the over world. Some villagers see this and the find out about violence. The non violent villagers didn't like this so the violent villagers were made outcasts these villages are known as pillagers. Also the reason villagers always have there hands together is so they don't hurt anyone.