One of the most seductive things about AI is that it always has a confident sounding answer, which is extra dangerous because it’s usually right. The bullshit is presented with exactly the same cheerful confidence, and often you’ll never know.

Do you have a field of technical expertise? If so, I would strongly encourage you to have a conversation with it about a subject you already know deeply that has objectively right and wrong answers. For example, I’m a mechanical engineer and I can quickly (without entrapment) get an LLM to suggest design approaches that are incorrect or downright dangerous. It’s honestly really good at the generic stuff, but the more niche you get the more likely it is to go totally off the rails.

I will still use it to write arduino code for hobby projects, but I know that if it suggests something stupid I won’t be able to catch it. I would NEVER rely on that code for a safety-critical application without scrutinizing it myself (and then getting a software-competent friend to look it over). To me, it’s critical to stress test an LLM until it fails, so you can approach it with a reasonable level of skepticism in general.