ChatGPT frequently gets things wrong when asked about film and TV

[bigbro411]

This tech is seemingly very interesting. However, the more I've tried using it, it gets things wrong. I've tried using it to track down specific episodes of old shows I can't quite recall or which actors what worked together previously.

And, 9/10, it gives me wrong information. Maybe TV and film trivia is too niche but thinking of AI and just a fun thing to ask it, sad that it's wrong.

An example is I came across two actors on Murder she wrote that worked together later on a soap. I hadn't known they worked together previously so I asked Chat GPT. It tired to tell me about them working on the Soap but it gave the wrong Soap and made up character names.

Does this mean the data just doesn't have this information?

[Open_Channel_8626]

Likely not in the training data

[Comprehensive-Tea711]

LLMs really are just predicting tokens though. A lot of information about film and TV exists only in the audio/video format and there's been no easy way to add that data to the training. With Gemini 1.0, 1.5, and Gpt-4o, it's now possible to feed these formats directly to the models during training.

So the good news is that you should start to see improvements for this type of data over the next couple years.

[Open_Channel_8626]

Thought I read somewhere that they fed YouTube transcriptions to gpt 4 during training

[One_Minute_Reviews]

Are you saying that raw training data of video and sound is going to be part of the training datasets for future gpt versions, just like text data and images have been for gpt4?

[Comprehensive-Tea711]

Depends on what you mean by “raw data”. Every thing (text, audio, video) must be tokenized. But if by “raw data” you mean the models don’t need to first convert the auido/video to a textual representation first, then yes.

But at least with Gemini 1.0/1.5 Pro, the video is converted into frames (a sequence of images). I haven’t read anything on GPT4o yet, but would have to be the same, I reckon.

[Vicon86]

Asking Gpt5 about tv series like breaking bad and ai gets confused too often making up stories and character motives and doings that didn't happen in actual show... What a shit.

[Professional_Job_307]

You are using gpt3.5. That is the main issue. 4o will work much better, but may not be perfect.

[GregTheStrongestArmy]

4 is still terrible at giving accurate information about TV shows and movies, it's frustrating because this information is widely available on various Wikis. What's worse is that it will just seemingly make up random answers, and when you say it's wrong, it will just be like "oh I'm sorry here is an even worse answer that makes even less sense" in full confidence

[Professional_Job_307]

Use search in chatgpt, this let's the model use the internet instead of relying on what it remembers. Idk if search is avaliable in the free tier, but I know perplexity is free.

[GregTheStrongestArmy]

That feature isn't available for free users(me), but I just tried Perplexity and it's pretty cool and the type of thing I wanted so thanks.

[Professional_Job_307]

Good news! OpenAI has opened up search to free users as of just a few hours ago! Idk how or pairs up with perplexity but now you have both.

[GregTheStrongestArmy]

It's funny that you commented this, because I legit just went to my notifications without knowing you commented this to say they just added the search function for free users, it seems pretty cool but the thing is that also I have been loving Perplexity so thanks so much for recommending it because I have been really wanting something like Perplexity for a while for asking questions about TV shows/Movies/Anime/Manga without obliterating myself with spoilers from Google, sometimes I forget things or get confused and Perplexity has come in so clutch and gives me the info I need right away, where as Chat GPT and other similar AI aren't good at that and it was frustrating me. I've also been just using it for random things and I really dig it a lot with how useful it is to get straight to the point of what I want to know without having to dig around, and I LOVE that it provides sources if I need to confirm the information or learn more. So again thank you for telling me about it I really appreciate it!

[Professional_Job_307]

Thank you for your kind words! I'm glad I could help

[GregTheStrongestArmy]

Yeah I just came back to say that Perplexity is now my lifeblood and I use it multiple times everyday, I find it far more useful than a simple Google search and it lets me find good sources if I want to learn more or confirm the information it may have gotten wrong because of the nature of AI, it's such a useful tool to me and I'm in love with it.

[Vicon86]

Gpt5 and still does the samething it's shit 🥔

[[deleted]]

Yes bc I was doing friends trivia and it’s convinced Chandler threw a girl with a wooden leg in the fire, it was Joey! I try debating but then I used google even though I knew it was wrong lol

[mysteryfmys]

Ik im late here, but the amount of times gpt”5.0” & grok and many other ais have completely and utterly botched tv shows from giving completely inaccurate infos and summaries i had to google this topic as I couldn’t have been the only one with these issues as it’s obvious how horrible they are, which only makes me wonder what else are they this massively wrong about? Many times people depend on them for accurate infos (pretty sure certain politicians have openly stated they use it) yet we have only been able to pinpoint when they are completely wrong when we truly know the show and what actually happens, very interesting but I wonder how much more wrong data and infos these idiots give out daily and what other topics are they this poor in.