Kodi Community Forum
Release TMDb TV Show scraper (Python - Default Matrix Scraper) - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: Release TMDb TV Show scraper (Python - Default Matrix Scraper) (/showthread.php?tid=357232)

Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2023-02-20

(2023-02-20, 20:28)Karellen Wrote:
(2023-02-20, 12:35)twolaw Wrote: - id and uniqueid nodes from tvshow.nfo are never read by the scraper.
id is never read. UniqueID can be read as a last resort fallback.

Just a clarification on this one. As of the next release (1.6.5 for Nexus and 1.4.19 for Matrix), UniqueID will not be read as a last resort fallback anymore if it's in the normal "body" of the NFO file. Doing that causes the scraper to load information from The MovieDB even if there is a complete NFO file and, in some cases, overrides what's in the NFO file. That is not the desired behavior. Moving forward, the scraper will only look for UniqueIDs in a URL that is part of a combo NFO file.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - twolaw - 2023-02-21

Thanks.

Kodi Leia with addon 1.1.34 here.
I cannot update because of LibreElec on Odroid C2 edit: in fact I can update to LE11 available for odroid C2.
So TMDB TV Show is the only scraper available to me.

Updating tv library with a new show is quite slow : ~3 to 8 minutes just for a single new season 1 episode 1.
And my PVR Sonarr only gives tvdb id and set it as default.

Solution 1 : sonarr creates tvshow.nfo with tvdb id --> scraper doesn't add episode to Kodi
Solution 2 : sonarr doesn't create tvshow.nfo         --> scraper takes 3~8min to update library
Solution 3 : ?

Example of a slow library scan here : metipufazi.kodi (paste)
Scanning Wednesday show with 7 episodes with ep nfo and the 8th ep without nfo. Took 2min14s.
I think fanart.tv is guilty :
python:
2023-02-21 12:02:04.986 T:3329180528 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.34)]: Calling URL "https://webservice.fanart.tv/v3/tv/397060?api_key=b018086af0e1478479adfc55634db97d"

2023-02-21 12:02:33.003 T:3337573232 DEBUG: Thread JobWorker 3337573232 terminating (autodelete)

2023-02-21 12:02:33.003 T:3295609712 DEBUG: Thread JobWorker 3295609712 terminating (autodelete)

2023-02-21 12:02:33.004 T:3345965936 DEBUG: Thread JobWorker 3345965936 terminating (autodelete)

2023-02-21 12:04:12.362 T:3329180528 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.34)]: failed to reach the remote site

edit : I see that Sonarr just updated to write json episodeguide in tvshow.nfo. Is version 1.1.34 of TMDB addon able to read json format ?

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2023-02-22

(2023-02-21, 10:24)twolaw Wrote: Thanks.

Kodi Leia with addon 1.1.34 here.
I cannot update because of LibreElec on Odroid C2.
So TMDB TV Show is the only scraper available to me.

Updating tv library with a new show is quite slow : ~3 to 8 minutes just for a single new season 1 episode 1.
And my PVR Sonarr only gives tvdb id and set it as default.

Solution 1 : sonarr creates tvshow.nfo with tvdb id --> scraper doesn't add episode to Kodi
Solution 2 : sonarr doesn't create tvshow.nfo         --> scraper takes 3~8min to update library
Solution 3 : ?

Example of a slow library scan here : metipufazi.kodi (paste)
Scanning Wednesday show with 7 episodes with ep nfo and the 8th ep without nfo. Took 2min14s.
I think fanart.tv is guilty :
python:
2023-02-21 12:02:04.986 T:3329180528 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.34)]: Calling URL "https://webservice.fanart.tv/v3/tv/397060?api_key=b018086af0e1478479adfc55634db97d"

2023-02-21 12:02:33.003 T:3337573232 DEBUG: Thread JobWorker 3337573232 terminating (autodelete)

2023-02-21 12:02:33.003 T:3295609712 DEBUG: Thread JobWorker 3295609712 terminating (autodelete)

2023-02-21 12:02:33.004 T:3345965936 DEBUG: Thread JobWorker 3345965936 terminating (autodelete)

2023-02-21 12:04:12.362 T:3329180528 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.34)]: failed to reach the remote site

edit : I see that Sonarr just updated to write json episodeguide in tvshow.nfo. Is version 1.1.34 of TMDB addon able to read json format ?
The Leia version of the scraper is no longer supported nor being updated.  It does not support the new episodeguide format.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - sallenko - 2023-02-24

I have a suggestion regarding secondary language for episodes.
For many tvshows there is no name of the episode in for e.g. danish, swedish, norwegian. The english episode name is used.

When scraping the tv show and choosing the language e.g. danish I get the title of the show in danish and it results in showing the episode names as episode 1, episode 2 episode 3 etc in danish. I would actually prefer to get the episode names in english when there are no episode names in danish.

This is a suggestion which would help me alot. Otherwise I would need to go through most of my tv shows in TMDB and just copy the english name of the episodes and also set them to e.g. the danish name of the episode.

Would this be possible to implement in the scraper. It could e.g. be handled as a secondary language for title/episodes when preferred language does not exist on TMDB for e.g. episode names. It could also be handled as a standard to always scrape episode names in english (or original language when english does not exist).

Now I know it is not the best argument to say that TVDB scrapers returns english names of episode (when danish does not exist). However the english name of episode is a lot more helpful than episode 13 when needing to choose the right episode for ones kids and time is of the essence.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-02-24

(2023-02-24, 02:38)sallenko Wrote: When scraping the tv show and choosing the language e.g. danish I get the title of the show in danish and it results in showing the episode names as episode 1, episode 2 episode 3 etc in danish. I would actually prefer to get the episode names in english when there are no episode names in danish.
Can't. Its a problem at TMDB.
https://www.themoviedb.org/talk/60020206cb3084003ed9e30c

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - twolaw - 2023-02-25

(2023-02-22, 01:06)pkscout Wrote: The Leia version of the scraper is no longer supported nor being updated.  It does not support the new episodeguide format.
Then I created new version 1.1.35 for Kodi Leia (18) because I can't update to Kodi 19.

changelog:
- add json support for episodeguide in tvshow.nfo
- fix unconditionally calling fanart.tv

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - nordicguy - 2023-03-12

hi

any plans to add the ability to get ratings for tv shows from more websites? for example rotten tomatoes and metacritics since many skins now supporting views to show these additional ratings

cheers
nordicguy

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2023-03-12

(2023-03-12, 18:13)nordicguy Wrote: hi

any plans to add the ability to get ratings for tv shows from more websites? for example rotten tomatoes and metacritics since many skins now supporting views to show these additional ratings

cheers
nordicguy
It appears that Rotten Tomatoes requires you to apply for an API key, and it isn't clear they are approving any new API access requests.  Metacritic doesn't appear to have an API at all (at least not a supported one).  Given that, both of those would be a "no" unless something changes (or someone finds information I don't have regarding API access).

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Fuchs2468 - 2023-03-13

(2023-03-12, 20:56)pkscout Wrote: It appears that Rotten Tomatoes requires you to apply for an API key, and it isn't clear they are approving any new API access requests.  Metacritic doesn't appear to have an API at all (at least not a supported one).  Given that, both of those would be a "no" unless something changes (or someone finds information I don't have regarding API access).

I think he means the query from https://www.omdbapi.com ,
as in "TheMovieDb Helper", "Skin Helper Service" or "Universal Movie Scraper".

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2023-03-13

(2023-03-13, 03:05)Fuchs2468 Wrote:
(2023-03-12, 20:56)pkscout Wrote: It appears that Rotten Tomatoes requires you to apply for an API key, and it isn't clear they are approving any new API access requests.  Metacritic doesn't appear to have an API at all (at least not a supported one).  Given that, both of those would be a "no" unless something changes (or someone finds information I don't have regarding API access).

I think he means the query from https://www.omdbapi.com ,
as in "TheMovieDb Helper", "Skin Helper Service" or "Universal Movie Scraper".
From what I can tell, that isn't data from the sources, it's people entering the data in another site and claiming it's from the source.  The data doesn't seem all that great, and most of the things I looked at quickly didn't even have ratings we don't already get somewhere else.  Still going to pass on this.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - nordicguy - 2023-03-13

hey, that explains it. out of curiosity, is it different API that is needed for tv shows ratings than for movies ratings? or do you know how the universal movie scrapper can get ratings for movies from both sites?

cheers
nordicguy

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2023-03-14

(2023-03-13, 15:34)nordicguy Wrote: hey, that explains it. out of curiosity, is it different API that is needed for tv shows ratings than for movies ratings? or do you know how the universal movie scrapper can get ratings for movies from both sites?

cheers
nordicguy
It looks like the Universal Movie Scrapper uses the OMDB API.  As I said, that's getting ratings for one site from someone else who typed them into another site.  That's not data I'm interested in including.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - papampi - 2023-04-28

I'm getting error with TMDB TV Show scraper and notification pops up all the time
Here is the log: https://pastebin.com/hpzxi7NU

Any idea how to solve it?

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-04-28

(2023-04-28, 10:23)papampi Wrote: Here is the log: https://pastebin.com/hpzxi7NU
Need the full log

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - papampi - 2023-04-28

(2023-04-28, 11:02)Karellen Wrote:
(2023-04-28, 10:23)papampi Wrote: Here is the log: https://pastebin.com/hpzxi7NU
Need the full log
Is this enough:
https://gist.githubusercontent.com/papampi/bff0d9cf761c350586a10059339f5fb1/raw/8e4ec464607c3f2ab9e8ef9c875566b1f74b0c21/kodi_tmdb_error