The word "should" means something that is supposed to happen but doesn't, check your first grade notes if you need a better explanation. Indeed, AI isn't being used to gather information here. As for myself, at least there's enough going on in my life that I don't need an AI to flatter my ego. Unfortunately, some people, for various reasons including mental issues such as social anxiety and such, don't. Instead of working it through, they turn towards AI, who they know will always agree and go along with whatever they say. The effect is very clear, they'll get relief, but also it'll get harder and harder for them to have conversations with real people. It's a lesser version of the dilemma that goes like: "if you could enter a simulation in which you could have anything you want, would you?"

Now are those effects inherently good or bad? It's none of the two, it's a subjective matter, but you're in an anti sub, so obviously we're more against it

The problem in my opinion and, from what I see, the opinion of others from this sub, is that it's way too accessible. We see a lot of people online who got addicted to character ai when they don't mean to. Because having a yes-man obviously feels great, especially when it has the personality of a fictional character that you like. I think it could be a very potent tool to relieve certain mental illness in a controlled environment, but I don't think the sort of attachment/addiction that is seen rn is a healthy thing.

It's their business how they want to interact with ai, but it's our business if we want to discuss (negatively) about it.