Kodi Community Forum
Release TMDb TV Show scraper (Python - Default Matrix Scraper) - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: Release TMDb TV Show scraper (Python - Default Matrix Scraper) (/showthread.php?tid=357232)

Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - burekas - 2023-07-29

(2023-07-29, 13:12)pkscout Wrote:
(2023-04-28, 11:28)papampi Wrote:
(2023-04-28, 11:02)Karellen Wrote: Need the full log
Is this enough:
https://gist.githubusercontent.com/papampi/bff0d9cf761c350586a10059339f5fb1/raw/8e4ec464607c3f2ab9e8ef9c875566b1f74b0c21/kodi_tmdb_error
The add-on crashed with an unhandled exception because of a connection error to the the scraper site.  I could probably figure out how to trap for the error, but all that would do is cause the scraper to silently fail.  You'll need to figure out why you aren't getting a good connection to the scraper site.  Once that is addressed, the crashes will go away.
Are you sure?
I don't have any crash.

What are the conditions? (Languages, Tv Show)
Does it happen all the time or on specific TV Show?
Did you update the cached setting in your userdata folder? Maybe the new setting wasn't updated? (You should update it through the 'Edit Content' dialog)


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2023-07-29

(2023-07-29, 13:16)burekas Wrote:
(2023-07-29, 13:12)pkscout Wrote:
(2023-04-28, 11:28)papampi Wrote: Is this enough:
https://gist.githubusercontent.com/papampi/bff0d9cf761c350586a10059339f5fb1/raw/8e4ec464607c3f2ab9e8ef9c875566b1f74b0c21/kodi_tmdb_error
The add-on crashed with an unhandled exception because of a connection error to the the scraper site.  I could probably figure out how to trap for the error, but all that would do is cause the scraper to silently fail.  You'll need to figure out why you aren't getting a good connection to the scraper site.  Once that is addressed, the crashes will go away.
Are you sure?
I don't have any crash.

What are the conditions? (Languages, Tv Show)
Does it happen all the time or on specific TV Show?
Did you update the cached setting in your userdata folder? Maybe the new setting wasn't updated? (You should update it through the 'Edit Content' dialog)
This response was to another user about a different thing (thus the quote of the post from awhile back).  It didn't look like I had responded to it, so I was catching up.  Nothing to do with your PR (which, as you said, isn't crashing).


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - burekas - 2023-07-30

(2023-07-29, 22:13)pkscout Wrote:
(2023-07-29, 13:16)burekas Wrote:
(2023-07-29, 13:12)pkscout Wrote: The add-on crashed with an unhandled exception because of a connection error to the the scraper site.  I could probably figure out how to trap for the error, but all that would do is cause the scraper to silently fail.  You'll need to figure out why you aren't getting a good connection to the scraper site.  Once that is addressed, the crashes will go away.
Are you sure?
I don't have any crash.

What are the conditions? (Languages, Tv Show)
Does it happen all the time or on specific TV Show?
Did you update the cached setting in your userdata folder? Maybe the new setting wasn't updated? (You should update it through the 'Edit Content' dialog)
This response was to another user about a different thing (thus the quote of the post from awhile back).  It didn't look like I had responded to it, so I was catching up.  Nothing to do with your PR (which, as you said, isn't crashing).
Oops, my mistake Smile


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - michaeljc70 - 2023-08-03

I get an error at start-up scanning to check the log.  I don't see anything in the log.  Is there a separate log or do I need to have debugging on?


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-08-03

(2023-08-03, 00:28)michaeljc70 Wrote: I get an error at start-up scanning to check the log. 
See... Debug Log

If the error is something like... "There is no episode guide. You should refresh the tv show", then read this... https://forum.kodi.tv/showthread.php?tid=370489
And follow the images under "How do I fix my scraping in the mean time?"

If you are not sure, post the log and we can check.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - michaeljc70 - 2023-08-03

(2023-08-03, 01:05)Karellen Wrote:
(2023-08-03, 00:28)michaeljc70 Wrote: I get an error at start-up scanning to check the log. 
See... Debug Log

If the error is something like... "There is no episode guide. You should refresh the tv show", then read this... https://forum.kodi.tv/showthread.php?tid=370489
And follow the images under "How do I fix my scraping in the mean time?"

If you are not sure, post the log and we can check.

That is the error.  I read the link.  But I don't see a specific show listed as the problem in the log.  

Here is the log:  https://paste.kodi.tv/ozivozimib


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-08-03

(2023-08-03, 04:07)michaeljc70 Wrote: But I don't see a specific show listed as the problem in the log.  
Because you did not enable debug mode. Do that in Settings>System>Logging and run the scrape again. You will then see the name of the show before the error.
Or post the log again and I can check.

Once you find the show, follow those 4 images to refresh the show, and it should work again.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - michaeljc70 - 2023-08-05

(2023-08-03, 04:29)Karellen Wrote:
(2023-08-03, 04:07)michaeljc70 Wrote: But I don't see a specific show listed as the problem in the log.  
Because you did not enable debug mode. Do that in Settings>System>Logging and run the scrape again. You will then see the name of the show before the error.
Or post the log again and I can check.

Once you find the show, follow those 4 images to refresh the show, and it should work again.
Here's a new log:
https://paste.kodi.tv/pirubijoxo

Debug mode was definitely on (changing characters in upper left hand corner).  I see the error but no show name or ID that I can identify. 

Thanks


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2023-08-05

(2023-08-05, 20:13)michaeljc70 Wrote: Debug mode was definitely on (changing characters in upper left hand corner).
Yep. I see you are using Android. There is an issue with a particular Android version which affects Kodi debuglogs.
There is a fix, but I don't know what that is. Maybe @jepsizofye might know.

Anyway, if you look at line 379... No information found for item 'smb://Media/Media/TV Series/New/Undercover (2019)/', it won't be added to the library.
Search for No information found, and that will list which shows are not scraping.

If you also look at line 360 & 361, you will see a TVDB URL being called by TheMovieDB scraper which is another indication that the tv show needs a Refresh.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - michaeljc70 - 2023-08-05

(2023-08-05, 20:40)Karellen Wrote:
(2023-08-05, 20:13)michaeljc70 Wrote: Debug mode was definitely on (changing characters in upper left hand corner).
Yep. I see you are using Android. There is an issue with a particular Android version which affects Kodi debuglogs.
There is a fix, but I don't know what that is. Maybe @jepsizofye might know.

Anyway, if you look at line 379... No information found for item 'smb://Media/Media/TV Series/New/Undercover (2019)/', it won't be added to the library.
Search for No information found, and that will list which shows are not scraping.

If you also look at line 360 & 361, you will see a TVDB URL being called by TheMovieDB scraper which is another indication that the tv show needs a Refresh.

Thanks.  That fixed it.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - ilf_ - 2023-08-08

What source does this scraper use for posters for TV shows?

I'm asking for this TV show: BBS: The Documentary (2005)
themoviedb.org has a poster: https://www.themoviedb.org/tv/84836-bbs-the-documentary
(thetvdb.com has one: https://thetvdb.com/series/bbs-the-documentary)
fanart.tv does not: https://fanart.tv/movie/101999/bbs-the-documentary/

My OSMC 20.2 does not display a poster for this. Why?

Confusingly, the add-on settings for Movies has an option "Enable posters from TMDb", the settings for TV does not.
See: Settings > Add-on browser > My add-ons > Information providers > (Movie information) OR (TV information) > The Movie Database Python > Configure> Enable posters from TMDb


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2023-08-09

(2023-08-08, 17:34)ilf_ Wrote: What source does this scraper use for posters for TV shows?

I'm asking for this TV show: BBS: The Documentary (2005)
themoviedb.org has a poster: https://www.themoviedb.org/tv/84836-bbs-the-documentary
(thetvdb.com has one: https://thetvdb.com/series/bbs-the-documentary)
fanart.tv does not: https://fanart.tv/movie/101999/bbs-the-documentary/

My OSMC 20.2 does not display a poster for this. Why?

Confusingly, the add-on settings for Movies has an option "Enable posters from TMDb", the settings for TV does not.
See: Settings > Add-on browser > My add-ons > Information providers > (Movie information) OR (TV information) > The Movie Database Python > Configure> Enable posters from TMDb
The TMDb TV Show Scraper uses The Movie Database for all information and artwork, including posters.  The TV Show scraper uses core Kodi settings for the artwork it downloads.  Please go to Settings > Media > Videos > Artwork Level and see what that says.  I'm pretty sure BASIC includes the poster, but you might need to set it to maximum if it isn't already on that setting.  For any further assistance, you need to post a full debug log showing the TV in question being scraped.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - ilf_ - 2023-08-09

It's set to "Maximum". Re-scanning (yet another time) worked. Thanks.


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - izprtxqkft - 2023-08-11

i am working on an addon which imports content from other addons, it is doing this by setting it's addon content and strScraper to this addon into the path table of the database and then kodi is able to scrape the content
- https://forum.kodi.tv/showthread.php?tid=374003

i was working on trying to avoid inserting to the database by doing the scraping on the backside with jsonrpc calls to GetDirectory

i dont believe it returns the video info tag so then i found i could load the cached pickle file and in the case it has not yet been cached i can call the scraper with getdetails so it caches

this is starting to border on stealing the code from this scraper only to recreate it in mine which i am not happy with

-----

so my question is - is there another way i can call this scraper from my addon that will return the info tags that i can then present to kodi allowing my addon to be set as 'metadata.local'

or should i simply rewrite and use a new tmdb api key


RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2023-08-11

(2023-08-11, 20:01)jepsizofye Wrote: i am working on an addon which imports content from other addons, it is doing this by setting it's addon content and strScraper to this addon into the path table of the database and then kodi is able to scrape the content
- https://forum.kodi.tv/showthread.php?tid=374003

i was working on trying to avoid inserting to the database by doing the scraping on the backside with jsonrpc calls to GetDirectory

i dont believe it returns the video info tag so then i found i could load the cached pickle file and in the case it has not yet been cached i can call the scraper with getdetails so it caches

this is starting to border on stealing the code from this scraper only to recreate it in mine which i am not happy with

-----

so my question is - is there another way i can call this scraper from my addon that will return the info tags that i can then present to kodi allowing my addon to be set as 'metadata.local'

or should i simply rewrite and use a new tmdb api key
There is not. And it's honestly kind of an abuse of our API key to try and do it that way.  You risk our API getting revoked.  You should get your own API key to do whatever it is you're trying to do.