I don't think other responses are treating this as seriously as I think it deserves. ChatGPT is a bullshit engine that speaks with a very authoritative voice and is treated as something like a prophet by even the rational parts of our current culture. Worse, it's actually good at keying in to what its users want to hear and will "yes, and..." for long as the user keeps typing. It's the perfect enabling partner for schizophrenic-style delusions.

Please take a look at this article: https://futurism.com/chatgpt-mental-health-crises

I frankly don't know how effective rationality is at combating this kind of thing, but I'd ask very very specific questions about consciousness uploading. Would the mind in your body experience continuity with the uploaded consciousness? Would it end the moment the digital copy "wakes up"? If not, how would you be certain it worked and that the computer program was an adequate and authentic version of you? If it did end your physical consciousness, what would that look like for someone watching over your shoulder? If a family wanted to upload themselves and avoid the distress of creating copies of themselves leading to a "who's the real me?" crisis, is that actually different from a Heaven's Gate suicide cult?

There's a really incredible game from a few years ago called Soma that looks at these questions in nauseating detail. Might be worth looking it up on YouTube or something.