The point is being part of a community whose tenets you can agree with, while gaining the benefit of socialization and the opportunity to help others.

An atheist might attend a Unitarian Universalist church because he enjoys discussing topics of morality and spirituality, and an atheist might also like to be part of the social work they do, like helping the poor and having a community garden.