Kodi Community Forum
Release TMDb TV Show scraper (Python - Default Matrix Scraper) - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: Release TMDb TV Show scraper (Python - Default Matrix Scraper) (/showthread.php?tid=357232)

Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-01-12

(2023-01-12, 00:43)pkscout Wrote: Someone would need to verify that process will leave you with your preferred fanart and stuff though
Use Artwork Dump. It will download the original artwork to local folders, if it still exists at the scraper site... https://forum.kodi.tv/showthread.php?tid=360078

I think the easiest solution is to ask the YouTube addon developer to look at the issue you are experiencing... https://forum.kodi.tv/showthread.php?tid=356934


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - User 476552 - 2023-01-12

I did attempt to provide a solution on this yesterday.

https://forum.kodi.tv/showthread.php?tid=355993&pid=3131626#pid3131626

The DB-Fu mentioned https://forum.kodi.tv/showthread.php?tid=370994

https://sqlitebrowser.org/


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - cscott1 - 2023-01-12

(2023-01-12, 01:31)nymdbwdp Wrote: I did attempt to provide a solution on this yesterday.

https://forum.kodi.tv/showthread.php?tid=355993&pid=3131626#pid3131626

The DB-Fu mentioned https://forum.kodi.tv/showthread.php?tid=370994

https://sqlitebrowser.org/

Yes you did and I appreciate the guidance. I was looking for an easier method something within my skillset which is not very advanced sadly. I thought this was a more suitable place to ask the question as its addon that assigned the youtube player for the trailers.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - cscott1 - 2023-01-12

(2023-01-12, 01:23)Karellen Wrote:
(2023-01-12, 00:43)pkscout Wrote: Someone would need to verify that process will leave you with your preferred fanart and stuff though
Use Artwork Dump. It will download the original artwork to local folders, if it still exists at the scraper site... https://forum.kodi.tv/showthread.php?tid=360078

I think the easiest solution is to ask the YouTube addon developer to look at the issue you are experiencing... https://forum.kodi.tv/showthread.php?tid=356934
Thank you for the response. I'm hesitant to use artwork dump as it creates a very large sized library not suitable for the storage limited devices I use. I don't use local artwork, I just use whatever is scraped. I will in a last ditch effort take your advice and ask the YouTube addon developer if they have any advice on my problem. @anxdpanic


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Angelinas - 2023-01-12

https://forum.kodi.tv/showthread.php?tid=158775
Image


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Rouzax - 2023-01-20

(2023-01-07, 19:54)Karellen Wrote:
(2023-01-07, 19:29)Rouzax Wrote: Managed to fix it.
Needed to disable the episodeguide option in TMM, this will remove the episodeguide from tvshow.nfo
Sounds good.
As long as you have nfo files for all your episodes, then the episodeguide is not needed.
Still running into an issue of scanning all the nfo files into the database. I cannot get everything found

Two examples:
  • Looney Tunes - S1933E14 - The Dish Ran Away with the Spoon (is found)
  • Looney Tunes - S1933E15 - We're in the Money (is not found)
On the File system
Image

In Kodi
Image

The nfo files
show.nfo
Looney Tunes - S1933E14 - The Dish Ran Away with the Spoon
Looney Tunes - S1933E15 - We're in the Money

Debug log for Kodi during scrape
https://paste.kodi.tv/eroturocag.kodi

Can't for the life of me figure out why I cannot get all episodes in the database
let me know what else you might need to figure this out


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Rouzax - 2023-01-20

Think I have found the bug/issue.

In the episode.nfo there is this:
Code:
  <id>89051</id>
  <uniqueid default="false" type="tvdb">89051</uniqueid>
  <uniqueid default="true" type="imdb">tt0024756</uniqueid>

Then in the debug log it is finding the unique tvdb id, but it is calling the themoviedb API with that ID


See line 470 in the debug log
Code:

2023-01-20 14:35:22.102 T:5882    DEBUG <general>: [metadata.tvshows.themoviedb.org.python (1.4.18)]: <uniqueid.+?type="(tvdb|imdb)".*?>([t\d]+?)</uniqueid>
2023-01-20 14:35:22.104 T:5882    DEBUG <general>: [metadata.tvshows.themoviedb.org.python (1.4.18)]: match group 1: tvdb
2023-01-20 14:35:22.104 T:5882    DEBUG <general>: [metadata.tvshows.themoviedb.org.python (1.4.18)]: match group 2: 89051
2023-01-20 14:35:22.105 T:5882    DEBUG <general>: [metadata.tvshows.themoviedb.org.python (1.4.18)]: Calling URL "https://api.themoviedb.org/3/find/89051?api_key=af3a53eb387d57fc935e9128468b1899&language=nl-NL&external_source=tvdb_id"

Don't really understand why it is trying to fetch that data while all info is in the nfo file for this episode and other ones are working while the have the same information


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-01-20

@Rouzax

I need the full log as you have cut off parts that I need to see.

Also, can you change to TheTVDB v4 scraper and check if the problem still exists.
Even though it shouldn't matter, your nfo files are created with TVDB data, but you are using TMDB scraper to scan.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - izprtxqkft - 2023-01-20

(2023-01-20, 16:09)Rouzax Wrote: Don't really understand why it is trying to fetch that data while all info is in the nfo file for this episode and other ones are working while the have the same information
i think you have to set the information provider to "local information only" in the media source in order for it to ONLY look at nfo files


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-01-20

(2023-01-20, 20:41)jepsizofye Wrote: i think you have to set the information provider to "local information only" in the media source in order for it to ONLY look at nfo files
Nope. It shouldn't matter. There is something else going wrong.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - izprtxqkft - 2023-01-20

(2023-01-20, 20:58)Karellen Wrote:
(2023-01-20, 20:41)jepsizofye Wrote: i think you have to set the information provider to "local information only" in the media source in order for it to ONLY look at nfo files
Nope. It shouldn't matter. There is something else going wrong.
my mistake


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Rouzax - 2023-01-20

(2023-01-20, 20:37)Karellen Wrote: @Rouzax

I need the full log as you have cut off parts that I need to see.

Also, can you change to TheTVDB v4 scraper and check if the problem still exists.
Even though it shouldn't matter, your nfo files are created with TVDB data, but you are using TMDB scraper to scan.

Thanks for looking at this.
I thought everything pertinent was there as it starts from the place where it hits the Looney Tunes folder, my mistake.
Will create a new debug log, might be able to do that tomorrow.

I use TMDB for everything, but for Disney shorts and Looney Tunes TMDB does not have a good collection.

That is why I use TVDB for these these two, but since I don't have a subscription there I create the NFO files with TMM.
The rest of that kids folder is scanned online using tmdb


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-01-20

(2023-01-20, 22:06)Rouzax Wrote: That is why I use TVDB for these these two, but since I don't have a subscription there I create the NFO files with TMM.
You don't need a subscription. Kodi was able to negotiate a deal for our scrapers to access their site at no charge. So change scraper and see if there is a difference. Do this first before creating a new log. It might fix whatever the problem is.

(2023-01-20, 22:06)Rouzax Wrote: Will create a new debug log, might be able to do that tomorrow.
If you can delete the entire show and rescan it back, it will be more helpful. I might be able to spot the differences between those episodes that scraped and those that didn't.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Rouzax - 2023-01-21

(2023-01-20, 22:11)Karellen Wrote:
(2023-01-20, 22:06)Rouzax Wrote: That is why I use TVDB for these these two, but since I don't have a subscription there I create the NFO files with TMM.
You don't need a subscription. Kodi was able to negotiate a deal for our scrapers to access their site at no charge. So change scraper and see if there is a difference. Do this first before creating a new log. It might fix whatever the problem is.

(2023-01-20, 22:06)Rouzax Wrote: Will create a new debug log, might be able to do that tomorrow.
If you can delete the entire show and rescan it back, it will be more helpful. I might be able to spot the differences between those episodes that scraped and those that didn't.

Did not know that about tvdb in KODI, however my PVR doesn't support it anymore so I'd rather stick with tmdb going forward (also don't like how tvdb handled that transition but that is a personal opinion).
That is why I switched to tmdb for everything (except these few shows as there is no good equivalent on tmdb)

Will try to do a test today by deleting Looney tunes and only placing back 2 episodes, 1 that works and 1 that doesn't and capture debug logs.

Again thanks for the help.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-01-21

@Rouzax

If you have nfo files for all your episodes, can you also try using the Local Information Scraper as suggested by @jepsizofye. It will help narrow down the issue.
You'll need to delete the <episodeguide> tag out of the tvshow.nfo file first, though.