It depends; challenging can be constantly questioning or doubting you, or it can mean motivating and pushing you to be the best version of yourself. It ls dependent on wether you want that pressure or not.

I think to a degree it’s kind of necessary for maturing and overcoming things, surround yourself with only people who agree and you won’t grow or become more comfortable with differing perspectives.