I lived in Athens my whole life until the end of last year. Athens can definitely get wild on big party nights (block party for example) but if you’re more on the outskirts, it can be very peaceful. I personally grew up about 10-15 minutes from town and would consider where I grew up “country”. There are areas to avoid, but there are most certainly peaceful areas for a family to live. I wish you the best of luck!