Kodi Community Forum
Release TMDb TV Show scraper (Python - Default Matrix Scraper) - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: Release TMDb TV Show scraper (Python - Default Matrix Scraper) (/showthread.php?tid=357232)

Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - doomedtx - 2024-06-16

I had a similar issue as Mikeul above, but mine was pure buffoonery. I'm posting here in case it helps anyone else. I was setting up a new install and decided to add the NAS TV shows first. The nfs folders "TV" and "KidsTV" were correctly selected, but I made the mistake of choosing the "This folder contains a single show" option which looks similar enough to the "Each folder contains a separate movie" option in the movies section that I messed up and accidentally selected it. Since the scraper goes in alphabetical order, it started with "KidsTV" and matched all 500+ episodes to a Youtube channel called KidsTV that has a TVDB entry. I'm now waiting for it to finish scraping so that I can re-scan with the correct setting and hopefully get it right this time.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Fuchs2468 - 2024-08-29

Hello @pkscout .

Function request:
I would like a function that allows me to set the "uniqueid" myself in the settings (tmdb, imdb or tvdb) see "episodeguide".
The reason why I need this function is I want access to the TVDB API, but for that I need an IMDB or TVDB unique ID.
An example of addons that require an IMDB or TVDB "uniqueid" would be the "Skin Helper Service" or "TV Show - Next Aired".
As I like to use TMDB but would also like to have additional information from the TVDB API, I find it a useful function.

I know that it works, I have tested it and no major changes would be necessary.

In line 132 of "data_utils.py", "tmdb_id" should be a setting variable (tmdb_id, imdb_id or tvdb_id).

I have 3 TV shows to test in the database, one with tmdb_id, imdb_id and tvdb_id as "uniqueid" and also an example of what the settings could look like.


ImageImage

ImageImage


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2024-08-29

(2024-08-29, 00:54)Fuchs2468 Wrote: Hello @pkscout .

Function request:
I would like a function that allows me to set the "uniqueid" myself in the settings (tmdb, imdb or tvdb) see "episodeguide".
The reason why I need this function is I want access to the TVDB API, but for that I need an IMDB or TVDB unique ID.
An example of addons that require an IMDB or TVDB "uniqueid" would be the "Skin Helper Service" or "TV Show - Next Aired".
As I like to use TMDB but would also like to have additional information from the TVDB API, I find it a useful function.
Sorry, that's not going to happen.  There is no guarantee that a show will have an IMDB or TVDB ID, so you'd have to fall back to the TMDb ID.  And there are known instances where the IDs for shows are not unique across services (i.e. a show on TVDB has a unique ID that is the same as the TMDb ID of a different show).  So you'd never be able to be sure you've stored an actually unique ID.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Fuchs2468 - 2024-08-29

(2024-08-29, 12:30)pkscout Wrote: Sorry, that's not going to happen.  There is no guarantee that a show will have an IMDB or TVDB ID, so you'd have to fall back to the TMDb ID.  And there are known instances where the IDs for shows are not unique across services (i.e. a show on TVDB has a unique ID that is the same as the TMDb ID of a different show).  So you'd never be able to be sure you've stored an actually unique ID.

In the case of TVDB_Id and TMDB_id I agree.
There shouldn't be any problems with IMDB, as imdb is always unique, compared to tvdb and tmdb.
It would be enough to limit this function to tmdb_id and imdb_id and in case there is no imdb_id, fallback to tmdb_id.
This should avoid any problems that might arise.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2024-08-30

(2024-08-29, 18:36)Fuchs2468 Wrote:
(2024-08-29, 12:30)pkscout Wrote: Sorry, that's not going to happen.  There is no guarantee that a show will have an IMDB or TVDB ID, so you'd have to fall back to the TMDb ID.  And there are known instances where the IDs for shows are not unique across services (i.e. a show on TVDB has a unique ID that is the same as the TMDb ID of a different show).  So you'd never be able to be sure you've stored an actually unique ID.

In the case of TVDB_Id and TMDB_id I agree.
There shouldn't be any problems with IMDB, as imdb is always unique, compared to tvdb and tmdb.
It would be enough to limit this function to tmdb_id and imdb_id and in case there is no imdb_id, fallback to tmdb_id.
This should avoid any problems that might arise.
It's still a no.  It is exceptionally bad practice to use a foreign key as the unique ID for anything.  TMDb has no control over what someone puts in the IMDB field, and it can change after the show has been created.  What you want would create unneeded complexity and weird support issues.  If an add-on needs or wants the IMDB number, there is a way to get it from the Kodi JSON API.  If the add-on is assuming the unique ID of a show in Kodi is from TVDB, there's nothing I can do about that.  You should discuss that with the add-on developer.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Olivier JC - 2024-09-07

Hello @pkscout,

According to wiki, "Scrapers can optionally lookup via filename identifiers since Omega (v21) if the scraper supports it. As of v21, TheMovieDB Python, TMDB TV Shows, and TV Maze scrapers support ID's in the folder or filename." Is this feature really implemented ? I was unable to scrap TV Shows as long as {tmdb=XXXXX} was in the name of folder and files. It seems to retrieve the exact TV Show, but the scrapper can't, for some reason, get informations from TMDB. 
I can't see anything relevant in log file, only some warnings also raised when scrapping is fine, explaining that some functions are deprecated (ListItem.setInfo(), ListItem.setUniqueIDs() and ListItem.setCast()).

Example :
TV Show Title (2024) {tmdb=1972}
. Season 01
.. TV Show Title (2024) {tmdb=1972}.S01E01.mkv

Thanks for your attention.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2024-09-07

(2024-09-07, 02:43)Olivier JC Wrote: I was unable to scrap TV Shows as long as {tmdb=XXXXX} was in the name of folder and files
Please provide the Debug Log that captures the problem. Ensure debug mode is enabled otherwise it is no good.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Olivier JC - 2024-09-07

Here is the log : kodi.log [Debug Mode actived]


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Olivier JC - 2024-09-07

Call to metadata.tvshows.themoviedb.org.python start at line 2195.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2024-09-07

(2024-09-07, 02:58)Olivier JC Wrote: Here is the log : kodi.log [Debug Mode actived]
Thanks.
You are using an old version of the scraper... [metadata.tvshows.themoviedb.org.python (1.6.0)]
Update to [metadata.tvshows.themoviedb.org.python (1.6.6)]


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Olivier JC - 2024-09-07

I thought updates are automatic... my mistake... Angel
Thanks for your help !


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2024-09-07

(2024-09-07, 03:15)Olivier JC Wrote: I thought updates are automatic
They are unless you have disabled automatic updates.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Olivier JC - 2024-09-07

The setting was only on notification... Thanks ! This filename identifiers function is great  Smile


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - junitodx - 2024-09-27

Hi,
Hope someone can help. I am trying to scrape the show Mocro Maffia and TMDb scraper does not pick up all the artwork. In particular there is nothing being pulled for series Poster Art and no season Poster Art for season 5. I assume this is happening because there is no English art for those but I thought if I had "Use different language for images" checked, it would look for English art first and if there was no English art then give me the option to choose one of the foreign language arts.
Here is the link to the series:
https://www.themoviedb.org/tv/83062-mocro-maffia?language=en-US
 
1. Am using TMDB TV Show Scraper v1.6.6
2. I have Preferred language set to en-US, Use different language for images checked, Preferred language (images) set to en-US


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2024-09-27

(2024-09-27, 14:00)junitodx Wrote: Hi,
Hope someone can help. I am trying to scrape the show Mocro Maffia and TMDb scraper does not pick up all the artwork. In particular there is nothing being pulled for series Poster Art and no season Poster Art for season 5. I assume this is happening because there is no English art for those but I thought if I had "Use different language for images" checked, it would look for English art first and if there was no English art then give me the option to choose one of the foreign language arts.
Here is the link to the series:
https://www.themoviedb.org/tv/83062-mocro-maffia?language=en-US
 
1. Am using TMDB TV Show Scraper v1.6.6
2. I have Preferred language set to en-US, Use different language for images checked, Preferred language (images) set to en-US
The scraper will look for poster images in the language set (either preferred language or preferred language - images), then for English posters as a fall back.  That's the opposite of what you thought apparently.  I don't understand why you have the preferred language and the preferred language (images) set to the same thing.  That's the same as just setting the preferred language.  And since it's set to en-US, you will only get images that have English posters.