Kodi Community Forum
Release TMDb TV Show scraper (Python - Default Matrix Scraper) - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: Release TMDb TV Show scraper (Python - Default Matrix Scraper) (/showthread.php?tid=357232)

Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2024-02-28

(2024-02-28, 15:03)sallenko Wrote: TMDB scraper scrapes episode 1, 2, 3 etc in that language. Would it be possible to add a second and sort of backup language from where to scrape the episode names from.
It's a TMDB problem. We have requested a fix for a few years, still waiting...
https://www.themoviedb.org/talk/60020206cb3084003ed9e30c


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Fuchs2468 - 2024-02-28

(2024-02-28, 15:03)sallenko Wrote: When scraping tv show episodes from TMDB in e.g. a language from the Nordic european countries (when no episode names have been given in that language on TMDB) TMDB scraper scrapes episode 1, 2, 3 etc in that language. Would it be possible to add a second and sort of backup language from where to scrape the episode names from.
For quite a few tv shows no episode names in the nordic language exist, i.e. the episode name is in English. However, we do often have translated show titles.

I takes a lot of time to just copy paste every english episode name on TMDB instead of scraping a second episode language.

I do believe that the TVDB scraper has had this functionality for quite some time. It would be much appreciated if a similar scraping functionality could be implemented on the TMDB scraper.

A very simple solution to your problem is to log in to TMDB and add the missing translations for your country.
The same applies to TVDB.
I've been doing it this way for years, and after 2 days at the latest, the data you updated is available via the API.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - sallenko - 2024-02-28

I have also done so for a couple of years as well, but it is getting quite tiering, especially when a solution would be quite simple. As always it is a priority. Hopefully it might get implemented some time this year.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2024-02-29

(2024-02-28, 22:55)sallenko Wrote: I have also done so for a couple of years as well, but it is getting quite tiering, especially when a solution would be quite simple. As always it is a priority. Hopefully it might get implemented some time this year.
With all due respect, the solution is not simple.  The idea of the solution is simple, but the implementation is not.  I'm the only one maintaining this scraper, and I have a full time job and a family.  I will try and find some time to look at it, but what you want adds complexity to both the code and the UI for the scraper to solve a very specific desire.  If anyone wants to take a stab at a solution, I'd be happy to review a PR.  All the code is here:

https://github.com/xbmc/metadata.tvshows.themoviedb.org.python


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - sallenko - 2024-02-29

(2024-02-29, 03:25)pkscout Wrote:
(2024-02-28, 22:55)sallenko Wrote: I have also done so for a couple of years as well, but it is getting quite tiering, especially when a solution would be quite simple. As always it is a priority. Hopefully it might get implemented some time this year.
With all due respect, the solution is not simple.  The idea of the solution is simple, but the implementation is not.  I'm the only one maintaining this scraper, and I have a full time job and a family.  I will try and find some time to look at it, but what you want adds complexity to both the code and the UI for the scraper to solve a very specific desire.  If anyone wants to take a stab at a solution, I'd be happy to review a PR.  All the code is here:

https://github.com/xbmc/metadata.tvshows.themoviedb.org.python

I actually did not refer your work but the changes that TMDB must perform with the API.

I do presume that you are correct regarding the amount of work. The idea is simple, but adds complexity to the scraper. Your voluntary work is very much appreciated, I did not mean to offend. I do not suggest trying to implement anything in the scraper before TMDB has done changes on their side. Unfortunately, at the moment it is not yet a prioritized issue for them.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Little_goliath84 - 2024-04-16

Good morning,
Kodi 21, Aeon Nox Silvo 10.0.0 on Shield TV Pro.

Yesterday after updating to new skin version, got an error after initializing TV Show scraping with TMDB TV Show scraper.

Debug Log


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2024-04-16

(2024-04-16, 08:21)Little_goliath84 Wrote: Yesterday after updating to new skin version, got an error after initializing TV Show scraping with TMDB TV Show scraper.
Hello @Little_goliath84
Should be a simple fix.
The error is on line 600...
error <general>: [metadata.tvshows.themoviedb.org.python (1.6.5)]: *** Unhandled exception detected: <class 'RuntimeError'> No TMDb TV show id found in episode guide, this show should be refreshed or rescraped ***

For Vikings.2013, simply delete the TV show from your library and scrape it again.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Little_goliath84 - 2024-04-16

Thx will try


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - burekas - 2024-04-26

Thanks @pkscout

I just noticed that my PR has been pushed to the latest version 1.6.6.
(https://github.com/xbmc/metadata.tvshows.themoviedb.org.python/pull/115)


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - burekas - 2024-04-26

(2024-02-28, 20:16)Karellen Wrote:
(2024-02-28, 15:03)sallenko Wrote: TMDB scraper scrapes episode 1, 2, 3 etc in that language. Would it be possible to add a second and sort of backup language from where to scrape the episode names from.
It's a TMDB problem. We have requested a fix for a few years, still waiting...
https://www.themoviedb.org/talk/60020206cb3084003ed9e30c
Actually since 2019 :/

If I remember correctly it was in "Up Next" and at some point was probably moved back to the backlog.

https://trello.com/c/UV1IGYfN/3-add-support-to-fallback-translation-queries


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Fuchs2468 - 2024-05-07

I noticed today that the last update of the scraper, version 1.6.6, destroyed the setup.
This means that all folders that were created with a version earlier than version 1.6.6 no longer receive the correct information.

With incorrect information I mean only English texts are displayed (plot,...).
The problem is that the scraper setting is saved when the directory is created.

up to version 1.6.5:
Code:
setting id="language"

from version 1.6.6:
Code:
setting id="languageDetails"

This means you have to re-read the entire directory so that everything is displayed correctly again.
For many TV shows, this process can take a long time.
I don't think that was the intention with this update to version 1.6.6.

I ask that you reverse the update as quickly as possible!!!
I think you could also integrate the new function without destroying the old setup.

Current solution to the problem is downgrading to version 1.6.5


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2024-05-07

(2024-05-07, 03:13)Fuchs2468 Wrote: The problem is that the scraper setting is saved when the directory is created.
I can see the change and it seems to have come from this PR... https://github.com/xbmc/metadata.tvshows.themoviedb.org.python/pull/115
But it was merged back in July 2023.

I am not noticing any problems, but that isn't saying much as I don't use my main Kodi install for scraping, instead use my test setups, then transfer the nfo files to my storage.
What exact problems are you having?
Isn't it just a matter of changing to a different scraper on the source, then changing back, which should save the new settings?


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Fuchs2468 - 2024-05-07

(2024-05-07, 04:42)Karellen Wrote: What exact problems are you having?

Try the following to reproduce the problem.

Here is a common use case.
As an example, let's take "The Rookie (2018)" and "Tracker (2024)".

“metadata.tvshows.themoviedb.org.python” version 1.6.5 or lower language setting is German is installed.

- as a source we have a folder “My TV Shows”
- Contents "The Rookie (2018)" seasons 1-5.
- Read content into database
- result everything OK
- now update "metadata.tvshows.themoviedb.org.python" to version 1.6.6.
- add new content
- "The Rookie (2018)" Season 6 Episode 1
- add new TV show "Tracker (2024)"
- update video database
- result language is English

Now see where the problem is.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2024-05-07

(2024-05-07, 03:13)Fuchs2468 Wrote: I noticed today that the last update of the scraper, version 1.6.6, destroyed the setup.
This means that all folders that were created with a version earlier than version 1.6.6 no longer receive the correct information.

With incorrect information I mean only English texts are displayed (plot,...).
The problem is that the scraper setting is saved when the directory is created.

up to version 1.6.5:
Code:
setting id="language"

from version 1.6.6:
Code:
setting id="languageDetails"

This means you have to re-read the entire directory so that everything is displayed correctly again.
For many TV shows, this process can take a long time.
I don't think that was the intention with this update to version 1.6.6.

I ask that you reverse the update as quickly as possible!!!
I think you could also integrate the new function without destroying the old setup.

Current solution to the problem is downgrading to version 1.6.5

That PR was old but just made it into a release.  I've not had any problems with this change during testing or on my production system, but I think I see why now.  The bottom line is that the setting name changed (which I really shouldn't have done), so the settings you have saved don't have the new setting, thus it uses English as the default.  The easiest way to fix this is to go into each source, change the language to something else, save it, then open the settings again for the source, and save the correct language.  You can also make that change to the addon settings so that each new source gets the right settings.  That should resolve the issue.

My apologies for introducing a breaking change to the scraper.  Unfortunately now that it's out, changing it to try and not break things will just break things again.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Fuchs2468 - 2024-05-08

(2024-05-07, 13:26)pkscout Wrote: The easiest way to fix this is to go into each source, change the language to something else, save it, then open the settings again for the source, and save the correct language.  You can also make that change to the addon settings so that each new source gets the right settings.  That should resolve the issue.

My apologies for introducing a breaking change to the scraper.  Unfortunately now that it's out, changing it to try and not break things will just break things again.

I was able to solve the problem with version 1.6.6.

My problem was that I only have one folder with all the TV shows as a source.
Which would mean having to scan all TV shows again with the new settings.
And that usually takes a very long time.
To be honest, I didn't feel like doing that.

But I have now found a simple and quick solution for myself without having to rescan all the TV shows.
I have the old setting in the video database with the new setting from version 1.6.6
overwritten.
Works perfectly for me and it took less than 10 minutes.

Image