Kodi Community Forum
Release TMDb TV Show scraper (Python - Default Matrix Scraper) - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: Release TMDb TV Show scraper (Python - Default Matrix Scraper) (/showthread.php?tid=357232)

Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2021-11-30

(2021-11-30, 01:01)hugepants Wrote: That's a good idea.

In the meantime, if I manually edit the MAXIMAGES value in settings.py, what value would you recommend based on my debug log with Family Guy?

Thanks
I honestly don't know.  I did some testing, and there is something weird going on with Family Guy.  No matter how small the image number I give it, the size of the field keeps going **up**.  I'm going to have to look into it more later.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2021-11-30

(2021-11-30, 01:01)hugepants Wrote: That's a good idea.

In the meantime, if I manually edit the MAXIMAGES value in settings.py, what value would you recommend based on my debug log with Family Guy?

Thanks
I found the problem and have updated the logic for the image count reduction to better deal with shows with lots of seasons.  If you'd like to give it a try, you can download it from:

https://github.com/xbmc/metadata.tvshows.themoviedb.org.python/tree/matrix

and then install it from the zip file.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - hugepants - 2021-11-30

It works!
Thanks for the swift response and fix.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2021-11-30

(2021-11-30, 12:39)hugepants Wrote: It works!
Thanks for the swift response and fix.

Thanks for the feedback.  I'm going to do a little more testing and then push this out.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - hugepants - 2021-11-30

I've just finished scraping the rest of my TV Shows (with the latest fixed scraper version) and I may have found another (unrelated) bug.

The show is Hospital (2017) and it is being detected as The Good Karma Hospital (2017) and the episode I have (s6e1) fails to scrape, presumably because the latter show doesn't have a Season 6. But of course even if it did, the show would still be incorrect.

Debug log


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2021-11-30

(2021-11-30, 21:33)hugepants Wrote: I've just finished scraping the rest of my TV Shows (with the latest fixed scraper version) and I may have found another (unrelated) bug.

The show is Hospital (2017) and it is being detected as The Good Karma Hospital (2017) and the episode I have (s6e1) fails to scrape, presumably because the latter show doesn't have a Season 6. But of course even if it did, the show would still be incorrect.

Debug log
That's not a bug.  The scraper uses the TVDb API for searches and uses the first item in the list (which TVDB believes is the best match).  You can refresh the show which will allow you to pick from a list of matches or use a parsing nfo file to tell Kodi what TV Show the directory is.

https://kodi.wiki/view/NFO_files/Parsing


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - hugepants - 2021-12-01

Good to know, thanks.

I see that the TMDB API search doesn't necessarily return the best match as the first result, and other factors such as popularity can influence its ranking.
The thread suggests that a true best match would need to be handled at the client side, which I suppose is now possible with Python scrapers, but probably unnecessary in this particular case as it would only occur very rarely.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2021-12-01

@hugepants

In addition to rescraping and picking the correct result from the offered list or using the parsing nfo file, you can also use the methods shown here... https://kodi.wiki/view/Add-on:TMDb_TV_Shows#Search

Also, I guess you know that pkscout meant TMDB API, not TVDB API


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - robertus - 2021-12-13

19.3 doesn't works any thetvdb scraper, old and new.

Is normal?


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2021-12-13

(2021-12-13, 15:42)robertus Wrote: 19.3 doesn't works any thetvdb scraper
Then you should ask your question in the TVDB thread.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - isamudaison - 2021-12-14

(2021-11-30, 03:32)pkscout Wrote:
(2021-11-30, 01:01)hugepants Wrote: WThat's a good idea.

In the meantime, if I manually edit the MAXIMAGES value in settings.py, what value would you recommend based on my debug log with Family Guy?

Thanks
I found the problem and have updated the logic for the image count reduction to better deal with shows with lots of seasons.  If you'd like to give it a try, you can download it from:

https://github.com/xbmc/metadata.tvshows.themoviedb.org.python/tree/matrix

and then install it from the zip file.

What was the exact fix for this? Family guy is working fine now, but The Simpsons now has the same issue...


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2021-12-14

(2021-12-14, 01:30)isamudaison Wrote: What was the exact fix for this? Family guy is working fine now, but The Simpsons now has the same issue...
https://github.com/xbmc/metadata.tvshows.themoviedb.org.python/commit/017952f2100741bc004ac7e9a3517651e5b6334a

Can you provide a Debug Log thanks. Neither pkscout or myself have a mysql setup.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2021-12-16

(2021-12-14, 02:37)Karellen Wrote:
(2021-12-14, 01:30)isamudaison Wrote: What was the exact fix for this? Family guy is working fine now, but The Simpsons now has the same issue...
https://github.com/xbmc/metadata.tvshows.themoviedb.org.python/commit/017952f2100741bc004ac7e9a3517651e5b6334a

Can you provide a Debug Log thanks. Neither pkscout or myself have a mysql setup.
I don't have mySQL/MariaDB for testing, but I do have a way to see how large the field gets to make sure it's under the requirement for MySQL/MariaDB.  I tested Family Guy and The Simpsons with the update (which should be in the repo now and available for update - it would auto update unless you turn that off), at the both worked fine.  I even checked the Simpsons again just now.  The total character count for the image list is 49835, which is definitely below the 64K allowed in the MySQL/MariaDB field definition for that field.  If you're having a problem with the Simpsons, it shouldn't be because of the image list.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - isamudaison - 2021-12-18

Here's my debug (it has a buncha osmc stuff but the actual kodi log is in there too)
https://paste.osmc.tv/muteyojeya

Mainly looks like these errors:
`ERROR <general>: VideoInfoScanner: Asked to lookup episode /mnt/animation/TV/The Simpsons/Season 29/The.Simpsons.S29E18.HD.TV-postbot.mkv online, but we have no episode guide. Check your tvshow.nfo and make sure the <episodeguide> tag is in place.`

No idea what that means?

edit: Just to show there are no .nfo files :

osmc@osmc:~$ find /mnt/animation/TV/ -name "*.nfo"
osmc@osmc:~$


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2021-12-18

@isamudaison

Wrong thread. Your log shows you are using the TVDB scraper.
The TVDB scrapers have not implemented code to limit artwork.
Your best solution is to swap to the TMDB python scraper (this thread) or make the MySQL adjustments detailed in this Issue report... https://github.com/xbmc/xbmc/issues/15768