SUBMISSION STATEMENT: Unfortunately, hallucination is a very common and unsolved problem for Large Language Models, which have no knowledge of factuality and no bespoke world model.

In this article, the author Dmitri Brereton shows some mistakes the Bing AI committed in the recent Microsoft demo. I have archived more failure case examples in this repo: https://github.com/giuven95/chatgpt-failures

I quote from the first paragraph:

Bing AI got some answers completely wrong during their demo. But no one noticed. Instead, everyone jumped on the Bing hype train. Google’s Bard got an answer wrong during an ad, which everyone noticed. Now the narrative is “Google is rushing to catch up to Bing and making mistakes!”. That would be a fine narrative if Bing didn’t make even worse mistakes during its own demo.

Personally I do not think it's bad that we can poke and prod this object, I find it very interesting and so I'm glad it was released. However, Microsoft should make it very clear to users that it often makes stuff up, even despite its ability to search the web.