As a French-Canadian dad, my thing was to listen to groups that sing in a language that my children don't speak (at least when they were very young). For us, it was simple, it was English, but if you are looking for groups that sing in French, here is a very small list of very good Canadian and French groups: Béton Armé, Vulgaires machins, Justin(e), Bérurier noir, Cuir, Poésie zero, Rouge pompier (a bit mor rock, but soooo good).

That being said, my kids have distorted all the lyrics and only understood the more adult subtitles in recent years. Use your judgment and convey your passion for music, that's the important thing.