Release - TMDb TV Show scraper (Python - Default Matrix Scraper)

Release TMDb TV Show scraper (Python - Default Matrix Scraper) - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: Release TMDb TV Show scraper (Python - Default Matrix Scraper) (/showthread.php?tid=357232)

Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2022-03-12

(2022-03-12, 01:44)ether123 Wrote: and i noticed i had to correct much more of the scrapings than before

Don't know why that is. I've been using this for over two years and it has only ever scraped the wrong show twice, and that is because it confused the original with the remake.
You might want to check how you are naming the tv show folders.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - ether123 - 2022-03-12

And yes I want to apogolize the my harsh words. I love Kodi and its my favourite media software and has been for years. I was just really surprised how slow the scraping was... I even thought the problem was in my computer.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - ether123 - 2022-03-12

(2022-03-12, 01:52)Karellen Wrote:
(2022-03-12, 01:44)ether123 Wrote: and i noticed i had to correct much more of the scrapings than before
Don't know why that is. I've been using this for over two years and it has only ever scraped the wrong show twice, and that is because it confused the original with the remake.
You might want to check how you are naming the tv show folders.

Mostly it is how the scraper always defaults the tv series to the most current one if the is a new version... And there is a lot of those, I hate that. I would love that the default version is the older, most known one.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - Karellen - 2022-03-12

(2022-03-12, 01:57)ether123 Wrote: Mostly it is how the scraper always defaults the tv series to the most current one if the is a new version

Can you give me a recent example?
Also show me how you named the tv show folder for that show.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - junitodx - 2022-03-12

(2022-03-12, 01:36)Karellen Wrote:
(2022-01-26, 02:10)junitodx Wrote: Let's see if I can show this correctly:
Sorry, I somehow missed your reply. (I don't mind being pinged if I haven't responded in a few days)
If you have only 1 Season, then the TV Show gets flattened, and you don't see the Season level. This is the default setting.
You can change that setting so you always see Seasons in setting 3.6 here... https://kodi.wiki/view/Settings/Media/Videos#Flatten_TV_show_seasons Set it to Never

Wow, thanks for circling back around to this. This is a great work around that lets me do exactly what I want. It does look a little silly to not flatten the series if there is only one season so I can definitely see why it is set like that by default. I can however set it to "never", which gives me the option to select the specific poster I want for season 1, then set it back to "if only one season" and it maintains my poster selection even though the series is now flattened again, perfect.
Thank a ton.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2022-03-12

(2022-03-12, 01:57)ether123 Wrote:
(2022-03-12, 01:52)Karellen Wrote:
(2022-03-12, 01:44)ether123 Wrote: and i noticed i had to correct much more of the scrapings than before
Don't know why that is. I've been using this for over two years and it has only ever scraped the wrong show twice, and that is because it confused the original with the remake.
You might want to check how you are naming the tv show folders.
Mostly it is how the scraper always defaults the tv series to the most current one if the is a new version... And there is a lot of those, I hate that. I would love that the default version is the older, most known one.

It defaults to the one returned first by the API, which is based on an algorithm at TMDb for which there is, to my knowledge, no public information other than to say it's based on "popularity." Many times that is the newer series, but I know of at least a few that give you back the older series (like Magnum, P.I.). That is often true when the remake first comes on, but over time you may see that the newer show becomes the first one returned. If I remember that chunk of the code correctly, you can get a specific version of the show by including the year in the show title.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - ohmy - 2022-05-21

Hi. TMDb has recently started to show the exact playing time of episodes on the website.
https://www.themoviedb.org/tv/60059-better-call-saul/season/6

According to this post, this info is now also in the API.
https://www.themoviedb.org/talk/625ba4fe2da8460066bfc42b

Are there any plans to include the info in the scraper?

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2022-05-22

(2022-05-21, 19:25)ohmy Wrote: Hi. TMDb has recently started to show the exact playing time of episodes on the website.
https://www.themoviedb.org/tv/60059-better-call-saul/season/6

According to this post, this info is now also in the API.
https://www.themoviedb.org/talk/625ba4fe2da8460066bfc42b

Are there any plans to include the info in the scraper?

I’ll look into this. I know Kodi reads the duration from the file at scan, and I’m not sure if setting it in the scraper will just get overridden. Even if it does, there is still a good use case for adding the episode duration - when you’re scraping disc stubs or stream links.

If I do add it, it may only be for Nexus. I’ve already moved all my dev environments to Nexus for alpha testing, so testing a back port might be hard for me.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - ohmy - 2022-05-22

Thanks for taking a look at this. That would actually be very useful for the library integration of .strm links from the Netflix and Prime Video addons.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2022-05-30

(2022-05-22, 16:21)ohmy Wrote: Thanks for taking a look at this. That would actually be very useful for the library integration of .strm links from the Netflix and Prime Video addons.

And done. I did some quick testing with my development library, and for streams the scraper now brings in and shows the duration on Estuary. If you scrape a show with a recognized video type (like an mkv file) and have "Extract Video Info from Files" turned on in Settings > Media > Videos, then the information from the video file will override the information from the scraper. There isn't any way to fix that except to turn of "Extract Video Info from Files," but I think it's the correct behavior anyway. The scraper will provide an episode length to be used if no other information is provided.

I've submitted a PR to get this into the Nexus repo, but if you are on the Nexus alpha and want to try it now, you can get a copy to install manually from:

https://github.com/xbmc/metadata.tvshows.themoviedb.org.python/tree/nexus

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2022-05-30

@ohmy I went ahead and back ported this to Matrix as well and submitted a pull request to the Matrix scraper repo. Once it's reviewed by someone on the team and merged, it'll be available as an update. You do have to refresh the info for any episode that you want to get the duration for, and not every episode at The MovieDb has duration information. But I tested it on my main Kodi machine in my living room (which is running Matrix), and everything worked as expected.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - ohmy - 2022-06-01

Hey @pkscout , this is awesome. I tested it with the Nexus alpha and it works like a charm. Thank you very much.

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - ohmy - 2022-06-01

Hi. One thing does not seem to fit quite yet. I first thought the duration '00:51' is 'hh-mm' and therefore correct. But apparently the episode info shows 'mm-ss', so this episode with '00:51' would be only 51 seconds long.
Apparently the episode length has to be converted to seconds before it is saved to myvideos.db, right?

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2022-06-02

(2022-06-01, 19:27)ohmy Wrote: Hi. One thing does not seem to fit quite yet. I first thought the duration '00:51' is 'hh-mm' and therefore correct. But apparently the episode info shows 'mm-ss', so this episode with '00:51' would be only 51 seconds long.
Apparently the episode length has to be converted to seconds before it is saved to myvideos.db, right?

The documentation for the episode duration is exceptionally inconsistent, and unfortunately there is no visual way to tell the difference between hh:mm and mm Confused

s. It's pretty trivial to fix that, and I'll look at doing that yet this evening. Out of curiosity, Where did you find information indicating that episodes are in minutes and seconds?

RE: TMDb TV Show scraper (Python - Default Matrix Scraper) - pkscout - 2022-06-02

@ohmy There is an update for Nexus at the same link as above. The only change is that it multiplies the result from the API by 60 before storing it. That seems to fix the issue.