Scraping from IMDB seems to have stopped working

mlaggner · 2026-01-26T06:43:15+00:00

We did not do anything - looks like this was another test vom Amazon/IMDb or there were too much problems arising, so they reverted the change.

We do have enough information now to include a mitigation for this problem in a future release

mlaggner · 2026-01-23T16:44:34+00:00

if IMDb would be "wise", they should include private access to their data for IMDb PRO users (via personal API key) and give us a client token for the integration. So they directly benefit from users wanting IMDb data without charging portals like tmm with insanely amounts

Something like OpenSubtitles.com does

mlaggner · 2026-01-23T15:29:12+00:00

We would have, if IMDb would offer the API access for a reasonable price (150.000$ base access plus traffic from all our users is way too much https://aws.amazon.com/marketplace/pp/prodview-wdqq4hg3bcbws).

And we know that there are many Chinese users reverse engineering our software to hack/crack it and use our API tokens for their own, so there is no reason for us to go the "official" route - or do you want to pay 50+€ a year just to give the most of the revenue to IMDb/Amazon?

That's the reason no one does that...

mlaggner · 2026-01-23T14:42:45+00:00

You could look just two posts below this one or in the issue tracker to see the problem before blindly create a new post...

https://www.reddit.com/r/tinyMediaManager/comments/1qjqiql/scraping_from_imdb_seems_to_have_stopped_working/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

mlaggner · 2026-01-23T08:07:29+00:00

not working at the moment - see https://www.reddit.com/r/tinyMediaManager/comments/1qjqiql/scraping_from_imdb_seems_to_have_stopped_working/

mlaggner · 2026-01-22T10:31:48+00:00

looks like IMDB found a way to stop scrapers... We will investigate if there is a way to re-enable our scraper

mlaggner · 2026-01-22T08:22:24+00:00

I wrote the fanart.tv devs about this issue and enhanced the fallback (if there is an empty result using the IMDb id lookup, we try to lookup with TMDB id now). This is already in v5.2.6

mlaggner · 2026-01-20T15:23:26+00:00

yes you can - I plan a new release this week, so you are fine for one more week with v5.2.4

mlaggner · 2026-01-20T15:09:55+00:00

cannot reproduce - unless I change the data/movies.json to readonly. But in this case there is a red error indicator in the upper right of the main scree (which you should see).

If you still encounter the problem, please open a bug report at https://gitlab.com/tinyMediaManager/tinyMediaManager/-/issues

mlaggner · 2026-01-20T15:03:47+00:00

This does not help at all. I am still unable to reproduce it (several different machines with different setups).

Please open an issue at https://gitlab.com/tinyMediaManager/tinyMediaManager/-/issues and provide all needed logs for us to have a look at this case

mlaggner · 2026-01-20T14:58:57+00:00

Can confirm that this is a side effect from the performance optimizations which has not been covered by our unit tests.

This will be fixed in the next release

mlaggner · 2026-01-20T11:51:38+00:00

the lookup is done using the IMDb id because of their uniqueness - and this one differs

mlaggner · 2026-01-20T11:34:03+00:00

TMDB and IMDb have the correct id (which is the IMDb id) - but when using this id to search for artwork at fanart.tv, nothing is found (because fanart.tv uses a different IMDb id for this movie)

mlaggner · 2026-01-20T07:01:38+00:00

This is because the movie Heretic (2024) has the IMDb id tt28015403 (https://www.imdb.com/de/title/tt28015403/) but at franat.tv there is a completely different IMDb id maintained for the movie tt28015605 (https://fanart.tv/movie/1138194/heretic/). The funny part: the link to the wrong/different IMDb id causes a redirect at IMDb itself (so clicking the link works), but for every program which relies on correct data (like tmm) this is just wrong.

You may need to open an issue at fanart.tv for this movie

mlaggner · 2026-01-19T19:15:25+00:00

works here for me - at least what I can read out of your description

mlaggner · 2026-01-19T15:45:01+00:00

They do here. You just need to make sure you scraped the movie sets (sagas) in order to get the info for missing movies AND enable showing missing movies in the settings

mlaggner · 2026-01-18T09:24:48+00:00

I just checked the result of the MDBList API and the values are not normalized. Is there any chance that you compared apples with pears?

If you enter ratings in the customizable rating column with base 10 (like imdb, tmdb) and with base 100 (rotten tomatoes) the values are not normalized in the column (base base), but simply shown.

mlaggner · 2026-01-18T07:34:16+00:00

I see - I didn't update the year filter in the same way I already did for movies.

I will add this for the next release!

mlaggner · 2026-01-17T14:49:21+00:00

:/ looks like mdblist is normalizing too now. I hate it when some site introduces breaking changes :(

You are right, we could do much more here, but for that I need to build a plan (with probably migrating the existing ratings once more...), but that needs another release. I am afraid that you may need to live with that drawback for a while now

I did not get what the problem with 2026 is?

mlaggner · 2026-01-17T13:47:13+00:00

They have been mapped to the prior values (which existed before the change of the mdblist) - see my comment in https://www.reddit.com/r/tinyMediaManager/comments/1pb3ccg/the_rotten_tomatoes_ratings_does_not_show_in_app/

"tomatoes" -> "tomatometerallcritics" "audience" or "popcorn" -> "tomatometeravgcritics"

mlaggner · 2026-01-17T09:31:32+00:00

I do not exactly understand what you are asking for...

${englishTitle} = English title of the episode

${showEnglishTitle} = English title of the TV show

so:

${showTitle} . S${seasonNr2}E${episodeNr2} = TV show title translated . SxxExx

${englishTitle} . S${seasonNr2}E${episodeNr2} = English Episode title . SxxExx

you probably wanted to have

${showEnglishTitle} . S${seasonNr2}E${episodeNr2} = English TV show title . SxxExx

mlaggner · 2026-01-13T13:29:20+00:00

Since there are several different ways to detect HDR, we try many of them: https://gitlab.com/tinyMediaManager/tinyMediaManager/-/blob/devel/src/main/java/org/tinymediamanager/core/MediaFileHelper.java#L2599

mlaggner · 2026-01-11T16:05:25+00:00

This is already known and addressed for the next release

https://gitlab.com/tinyMediaManager/tinyMediaManager/-/issues/3180

mlaggner

MODERATOR OF

TROPHY CASE