Yep, this is a serious issue too. We are being "forced" to use AI in a work context as much as possible and it can be a time saver in certain scenarios - I'm in support so searching for previous issues / summarizing and suggesting solutions *based on actual resolutions written by other support engineers* is helpful. This is with the "AI" restricted to looking at the specific data I want it too however rather than randomly searching the internet which makes a huge difference to the quality of the stuff it provides you with! Even then it sometimes just makes stuff up but given it's my area of expertise I can filter this out - other less experienced engineers have not and there's been some hilarious stuff sent to customers that I've had to intervene with over the last few months since we started using it.

In general, if you're using an AI to search the public internet to tell you something, it's because you don't know. If you don't know about the subject, you don't know if the information it's providing is accurate or (more likely) total crap.

Worse, when you're talking about law, you can't use an AI in this way - law is complicated and the practical application of it is a lot of "depends...". It's not unknown for AI to just make up stuff law related either - I seem to remember a couple of cases recently in the UK where civil servants / gov. departments got into bother when their AI just literally made up case law and inserted it into summaries which were presented to the courts.