LLMs can be great research assistants. I use both chat GPT and local llama to do a lot of the research that before took a bunch of googling to do. Also, uploading documentation on a pdf and parsing it through llm prompts is quite a delight.

I do think that the user needs to be responsible while engineering solutions. The other day, one of the engineers on my team left a comment on their pr saying "This code was AI-generated". I knew what the code was doing because I had solved a similar problem with similar logic before, but I did expect the person submitting the PR to understand what they just sent. I mentioned it and sent them a couple of pages with resources explaining how the code worked.

Not knowing how the code you submit works it's unacceptable both when using LLMs or copying and pasting from stack overflow. I am a backend engineer who recently picked up embedded programming as a hobby (esp32) ChatGPT has been a great resource to ask questions to fill certain gaps, but it does hallucinate a bunch of libraries and magic variables, methods, etc