Kodi Community Forum
Release TMDb TV Show scraper (Python - Default Matrix Scraper) - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: Release TMDb TV Show scraper (Python - Default Matrix Scraper) (/showthread.php?tid=357232)

Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2021-08-19

(2021-08-19, 02:50)iJays Wrote: debug log:https://paste.kodi.tv/hulumivasu.kodi
Looking at lines 378-426 of your log, if that is an example of how your TV Shows are setup, then you will never scrape them into the library.

Follow the guide to correctly set up your tv shows, seasons and episodes... https://kodi.wiki/view/Naming_video_files/TV_shows

Plus the fact that you have movies and episodes mixed together.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - iJays - 2021-08-20

(2021-08-19, 08:49)Karellen Wrote:
(2021-08-19, 02:50)iJays Wrote: debug log:https://paste.kodi.tv/hulumivasu.kodi
Looking at lines 378-426 of your log, if that is an example of how your TV Shows are setup, then you will never scrape them into the library.

Follow the guide to correctly set up your tv shows, seasons and episodes... https://kodi.wiki/view/Naming_video_files/TV_shows

Plus the fact that you have movies and episodes mixed together.

Thanks for the reply.
The structure of the folder is fine. I manually scan the folder to the media library. The scraper can correctly identify the episode, but an error occurs when loading the episode information. No matter whether it is manual or automatic scanning before, there is no problem.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2021-08-20

(2021-08-20, 04:13)iJays Wrote: No matter whether it is manual or automatic scanning before, there is no problem.
As already requested by pkscout, we need a full Debug Log that captures the problem.

-->> Debug Log <<-- this is a link.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - iJays - 2021-08-20

(2021-08-20, 05:36)Karellen Wrote:
(2021-08-20, 04:13)iJays Wrote: No matter whether it is manual or automatic scanning before, there is no problem.
As already requested by pkscout, we need a full Debug Log that captures the problem.

-->> Debug Log <<-- this is a link.


https://paste.kodi.tv/tixitahafu.kodi

I tried it just now and it can be used now.
However, this problem often recurs.

The TVDB episode scraper can only be used temporarily


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2021-08-20

(2021-08-20, 12:25)iJays Wrote: https://paste.kodi.tv/tixitahafu.kodi

I tried it just now and it can be used now.
However, this problem often recurs.

The TVDB episode scraper can only be used temporarily
Still not a Debug Log. Why did you skip Step 1?

It looks like you have SSL issues, so you need to update to v18.9 at least. But I strongly urge you to update to v19.1 as this scraper will no longer be updated for v18.

You need to update because it has the fix for the SSL errors. pkscout has already asked you to update.

We can't help you if you don't listen to the advice we are giving you.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - kofii12345 - 2021-09-26

How to download clearart logo from tmdb instead od fanart?


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2021-09-27

(2021-09-26, 16:48)kofii12345 Wrote: How to download clearart logo from tmdb instead od fanart?

I'm not 100% sure I understand your question, but in Kodi 19 the scraper uses the application artwork settings.  Go to:

Settings > Media Settings > Videos > Artwork Level

You can use one of the predefined levels or choose custom and then enable the art you want to download during a scrape. Any TV show you've already scraped would have to be re-scraped to get the new artwork.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - bossanova808 - 2021-09-28

So these days, without Artwork Beef (sadly missed!)...it seems in fact the only way to get Kodi to pick up new artwork (either locally downloaded, or now available via a scraper...) - is to force a refresh on the library entry right?  I know if you manually add artwork to the folder (e.g. using a media manager) - it is not picked up.   Which, TBH, I find quite strange - I would have thought Kodi would also pick up/check for artwork changes any time it detects a change to a folder - e.g. it re-scans, because a new episode has appeared or whatever.  But apparently not.

So this means, in effect, that you get only the artwork that is available with a show when it is first added, and never anything more, without further manual intervention.  Which isn't great, as the artwork tends to improve and gets fleshed out over time, and having to manually refresh a bunch of shows is just not something I'd imagine most folks will ever get around to doing.

Or am I missing something, or mis-configuring something?  With Kodi < 19, and using Artwork Beef, library art was refreshed/renewed, and new things picked up, all the time, automatically.  Which was very cool. Something I am definitely missing with Kodi 19, although in theory it has more artowkr support (set to 'Maximum' etc) - in practise, it doesn't actually work so well (currently), without a lot of intervention.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2021-09-28

@bossanova808

No, you have not missed anything.

Artwork is scraped at the same time as the media file. There is no dedicated artwork scraper. When the media is scraped, artwork links are also scraped, and those links is what Choose Art and Artwork Dump use.

Can you imagine the abuse of a dedicated artwork scraper (as was happening with artwork beef)? There are already members here that (judging by their posts) seem to scrape their entire library on a weekly basis. I have seen users run an entire Library Update on 1000 + movies because a particular movie had a new poster added....


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2021-09-28

(2021-09-26, 16:48)kofii12345 Wrote: How to download clearart logo from tmdb instead od fanart?
pkscout has looked into the code. It looks like the scraper will grab clearlogo from TMDB first, then try fanart.tv.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - bossanova808 - 2021-09-28

(2021-09-28, 01:13)Karellen Wrote: @bossanova808

No, you have not missed anything.

Artwork is scraped at the same time as the media file. There is no dedicated artwork scraper. When the media is scraped, artwork links are also scraped, and those links is what Choose Art and Artwork Dump use.

Can you imagine the abuse of a dedicated artwork scraper (as was happening with artwork beef)? There are already members here that (judging by their posts) seem to scrape their entire library on a weekly basis. I have seen users run an entire Library Update on 1000 + movies because a particular movie had a new poster added....

You mean abuse of the online services, I guess?  I do see your point.  But some sort of periodic update thing would be nice.   Still, might indeed make for way too much service use.

But if artwork is manually added to a folder (so e.g. I use an external media manager, that can use my own fanart.tv account, and is smart enough only to fill in gaps, for example...) - it would be super nice if that, being there already, would be picked up by Kodi without the need for manual intervention.  That's the bit, mainly, that surprises me... I'd have thought when it does the hash on the folder and see the change, part of that would include checking for new artwork files in addition to episodes.  Doesn't seem like too crazy an idea?


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2021-09-28

Improvements to artwork was discussed extensively by @rmrector and @DaveBlake before v19 was released. It's been quite a while now and I don't remember all the pertinent points for and against. Maybe rmrector might remember.

Are you having ideas for a new addon?


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - bossanova808 - 2021-09-28

Well...maybe, I guess.  Feels like it should really be something Kodi does by default, though - use artwork that is available.  Feels more like it should be part of the media scanning process really, than a bolt on.

I guess the first step is to be sure about what does and what should happen, before deciding on an approach...


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - rmrector - 2021-09-29

ya, it makes sense for Kodi itself to add new local artwork during a library scan.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - kofii12345 - 2021-09-29

(2021-09-28, 01:14)Karellen Wrote:
(2021-09-26, 16:48)kofii12345 Wrote: How to download clearart logo from tmdb instead od fanart?
pkscout has looked into the code. It looks like the scraper will grab clearlogo from TMDB first, then try fanart.tv.
It doesnt seem to work. I will check the code in free time.