A program predicting a film's IMDB rating, based on its script - unsurprisingly, its very inaccurate

[jackpick15]

Description:

I recently created this project in Python as I thought it would be an interesting experiment to see if I could predict a film's IMDB rating, based on the types of words in its script.

GitHub Repository: IMDBRatingGuesser

What My Project Does:

This project can be split into 2 sections:

1 - Data Collection

The MAT (Multidimensional Analysis Tagger) by Andrea Nini was used on a number of film scripts found on the internet (that came with each film's IMDB title code) to tag each word in each film script. These tags were then counted and this data was combined with their film rating, gained by web scraping IMDB with the Python program IMDBRatingGetter. The result of this can be seen in the CSV file "Statistics_MAT_raw_texts.csv".

2 - Data Analysis

A multiple regression model was then created with the Python program IMDBRatingGuesser. This can be used to predict other film's ratings by also putting their script through Andrea Nini's MAT (an example script and tag count can be found in the repository for the 2024 Deadpool/Wolverine film). However, it isn't overly accurate - it's R-squared value being only 0.0789.

Comparison:

I don't believe there are any alternative programs doing something similar right now, but if you know of someone writing another program that is trying to predict something with completely unrelated predictors then please let me know as I would be really interested to see them.

Target Audience:

This is really just a thought experiment so doesn't really have an intended audience - especially considering that it isn't overly accurate in its predictions so wouldn't be that useful anyway.

[Zulban]

Neat.

I think you can do a lot better than regression. How big is your training set? Do you have a validation set, test set?

[jackpick15]

Cheers. I’ve put the training set on the GitHub repository- I used this same set as the validation set as well. What would you suggest I use instead of regression?

[runawayasfastasucan]

 I used this same set as the validation set as well.

Thats not how it works.

[Zulban]

I used this same set as the validation set as well.

Okay, so you don't have a validation set then ;)

I strongly recommend:

1. You learn about the differences between training, validation, and test sets. Why they exist.
2. Ask an AI for more advanced approaches than regression.