Guest - Testers are needed for the reworked CDateTime core component. See... https://forum.kodi.tv/showthread.php?tid=378981 (September 29) x
  • 1
  • 25
  • 26
  • 27(current)
  • 28
  • 29
  • 47
Release TMDb TV Show scraper (Python - Default Matrix Scraper)
https://paste.kodi.tv/uwikadumaz
Thank you for help
Reply
@Freitag73

There are a number of problems with your log...

1. You are packed full of Banned Add-ons (wiki). These need to be removed for assistance on this forum. They may even be the cause of your issues.
2. You did not enable debug mode, so there is nothing for us to see anyway.
3. You did not scrape the show, again nothing for us to see.

The forum moderators have determined that banned addons (wiki) are present on your system. To receive assistance here, these banned items must be removed. If a clean log is not submitted within 3 days, then the relevant post(s) will be removed after this time.
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
(2020-10-14, 07:21)Karellen Wrote:
(2020-10-06, 19:08)ramis52 Wrote: Hi,

i just switched over from thetvdb to tmdb scraper. is there any option in tmdb scraper to set a fallback language like in ttvb scraper? Maybe it is already set in the Background to en-us when there are no Information in the prefered Language available.
My question is because if i set the Language to de-de and the scraper didnt find any Translation for German, it will add the Plot in english. thats greatSmile But the Title of the Episode is Episode1 Episode2. Would be great if the Title will then Fallback to English too instead of adding it as Episode1 episode2 and so on. Dunno if its a bug or if its a fail on my sideSmile

regards
r
After quite a bit of work @pkscout has found a way to work around the problem at TheMovieDB.

The fix has been implemented in the new Python version of the scraper, not the XML version you are currently using.

Could you please download and install via zip this test build here and let us know if it is working correctly for you... https://github.com/xbmc/metadata.tvshows...-707891646

In case you don't know how to download a zip file. Step 1 is by clicking on the above link.

Image

Sorry bring up this old issue but I haven't found a solution in any scraper yet.

I have set the "Preferred language" to "nl-NL" but whether I enable "Keep original title" or not a lot of episodes are named "Aflevering x" (where x is the episodenumber and "Aflevering" is the dutch word for Episode).
And although for all episodes where this happens the synopsis is in english, the episode name does not to fall back to english.

Would it possible to add a configurable option for an "Episode name fallback language"? With either "default" or a language of choice?
Reply
(2022-01-13, 14:07)IanPH Wrote:
(2020-10-14, 07:21)Karellen Wrote:
(2020-10-06, 19:08)ramis52 Wrote: Hi,

i just switched over from thetvdb to tmdb scraper. is there any option in tmdb scraper to set a fallback language like in ttvb scraper? Maybe it is already set in the Background to en-us when there are no Information in the prefered Language available.
My question is because if i set the Language to de-de and the scraper didnt find any Translation for German, it will add the Plot in english. thats greatSmile But the Title of the Episode is Episode1 Episode2. Would be great if the Title will then Fallback to English too instead of adding it as Episode1 episode2 and so on. Dunno if its a bug or if its a fail on my sideSmile

regards
r
After quite a bit of work @pkscout has found a way to work around the problem at TheMovieDB.

The fix has been implemented in the new Python version of the scraper, not the XML version you are currently using.

Could you please download and install via zip this test build here and let us know if it is working correctly for you... https://github.com/xbmc/metadata.tvshows...-707891646

In case you don't know how to download a zip file. Step 1 is by clicking on the above link.

Image

Sorry bring up this old issue but I haven't found a solution in any scraper yet.

I have set the "Preferred language" to "nl-NL" but whether I enable "Keep original title" or not a lot of episodes are named "Aflevering x" (where x is the episodenumber and "Aflevering" is the dutch word for Episode).
And although for all episodes where this happens the synopsis is in english, the episode name does not to fall back to english.

Would it possible to add a configurable option for an "Episode name fallback language"? With either "default" or a language of choice?

Unfortunately, no. Because the generic episode name is language specific, it’s a significant amount of work to check the episode string for every language combination. TMDb used to send the generic episode name only in English, so it was easy to figure that out. Now they don’t, so now it isn’t. There is a feature request in with TMDb to provide fallback information as part of the API call. If they implement that then you will be able to have fallback episode names. That’s request has sat in the queue for several months, so it’s hard to say when, or if, it will get done.
Reply
(2022-01-13, 15:46)pkscout Wrote:
(2022-01-13, 14:07)IanPH Wrote:
(2020-10-14, 07:21)Karellen Wrote: After quite a bit of work @pkscout has found a way to work around the problem at TheMovieDB.

The fix has been implemented in the new Python version of the scraper, not the XML version you are currently using.

Could you please download and install via zip this test build here and let us know if it is working correctly for you... https://github.com/xbmc/metadata.tvshows...-707891646

In case you don't know how to download a zip file. Step 1 is by clicking on the above link.

Image

Sorry bring up this old issue but I haven't found a solution in any scraper yet.

I have set the "Preferred language" to "nl-NL" but whether I enable "Keep original title" or not a lot of episodes are named "Aflevering x" (where x is the episodenumber and "Aflevering" is the dutch word for Episode).
And although for all episodes where this happens the synopsis is in english, the episode name does not to fall back to english.

Would it possible to add a configurable option for an "Episode name fallback language"? With either "default" or a language of choice?

Unfortunately, no. Because the generic episode name is language specific, it’s a significant amount of work to check the episode string for every language combination. TMDb used to send the generic episode name only in English, so it was easy to figure that out. Now they don’t, so now it isn’t. There is a feature request in with TMDb to provide fallback information as part of the API call. If they implement that then you will be able to have fallback episode names. That’s request has sat in the queue for several months, so it’s hard to say when, or if, it will get done.

Okay I understand what you mean. But maybe instead of being a fallback language it could be that you can select in what language the Episode name needs to be scraped and in what language all the other information should be scraped? That way we might also get rid of these "Aflevering x" or "Episode x" names. It's so annoying that for instance with Batwoman season 2 all episodes have normal names except for the last 4 episodes which are called "Aflevering x".
Reply
@IanPH

This is the discussion at TMDB... https://www.themoviedb.org/talk/60020206...003ed9e30c

(2022-01-13, 16:09)IanPH Wrote: It's so annoying that for instance with Batwoman season 2 all episodes have normal names except for the last 4 episodes which are called "Aflevering x".
You could add the missing info at TMDB. Somebody has to do it...
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
(2022-01-13, 16:09)IanPH Wrote:
(2022-01-13, 15:46)pkscout Wrote:
(2022-01-13, 14:07)IanPH Wrote: Sorry bring up this old issue but I haven't found a solution in any scraper yet.

I have set the "Preferred language" to "nl-NL" but whether I enable "Keep original title" or not a lot of episodes are named "Aflevering x" (where x is the episodenumber and "Aflevering" is the dutch word for Episode).
And although for all episodes where this happens the synopsis is in english, the episode name does not to fall back to english.

Would it possible to add a configurable option for an "Episode name fallback language"? With either "default" or a language of choice?

Unfortunately, no. Because the generic episode name is language specific, it’s a significant amount of work to check the episode string for every language combination. TMDb used to send the generic episode name only in English, so it was easy to figure that out. Now they don’t, so now it isn’t. There is a feature request in with TMDb to provide fallback information as part of the API call. If they implement that then you will be able to have fallback episode names. That’s request has sat in the queue for several months, so it’s hard to say when, or if, it will get done.

Okay I understand what you mean. But maybe instead of being a fallback language it could be that you can select in what language the Episode name needs to be scraped and in what language all the other information should be scraped? That way we might also get rid of these "Aflevering x" or "Episode x" names. It's so annoying that for instance with Batwoman season 2 all episodes have normal names except for the last 4 episodes which are called "Aflevering x".
That would require an entire separate set of API calls and slow down the scraper significantly.  Never mind the complexity of the settings.  I just can't justify spending time trying to write code to work around a data problem.  As was mentioned, if people enter the episode information (and translate them), then that information is there for everyone.  And if TMDb would provide language fallback as part of the API response, then this problem would mostly go away.
Reply
Hello.

Here is the problem that I initially encountered 10 days ago:
I have Season 01 of a TV show in my library with artwork, season poster, episode posters etc.
With the new season on air, when scrapping s02e01, it does fetch the episode details (poster, summary etc.) but not the Season 02 poster.
To fetch it I have to refresh the whole show and then the new season poster is fetched.
I am using version 1.4.10.
Does anyone have a hint?
Thanks in advance.

edit: typo
Reply
I have two questions one is somewhat similar to zer0ner0.
  1. When Artwork Beef was fully supported you could have it pull new art either manually or on a schedule. Is there a way to do this with TMDb TV Show Scraper or is the only way to pull new art to rescrape an entire series? That kinda sucks when a series has tons of episodes
  2. Sorry, another Artwork Beef reference. With AB you were able to choose season posters no matter what episodes you have. With TMDb TV Show Scraper you need to have episodes from multiple seasons to choose season posters or else TMDb Scraper will just choose a poster and the option to choose a different season poster is not available.
         Example: I scrape one episode of The Wire S01 and TMDB Scraper assigns a S01 poster and I don't have an option to change it. If I then scrape an episode for S02 I have the option of selecting different posters for S01.
Reply
(2022-01-25, 16:27)junitodx Wrote: When Artwork Beef was fully supported you could have it pull new art either manually or on a schedule. Is there a way to do this with TMDb TV Show Scraper or is the only way to pull new art to rescrape an entire series? That kinda sucks when a series has tons of episodes
There is no way to do that with the scraper.
Yes you need to rescrape for new artwork. But you are asked if you want to rescrape "all episodes" answer no, and only the tv show is re-scraped, not the episodes.

(2022-01-25, 16:27)junitodx Wrote: With AB you were able to choose season posters no matter what episodes you have. With TMDb TV Show Scraper you need to have episodes from multiple seasons to choose season posters or else TMDb Scraper will just choose a poster and the option to choose a different season poster is not available.
That does not sound right. The scraper downloads artwork links for the tv show. It does not matter which episodes you have.
But there is always the chance that when you scraped S01, only one poster was available. Then 3 months later you scrape S02, users have added more posters for S01. You need to check what is available at TMDB the next time you scrape.
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
(2022-01-25, 20:56)Karellen Wrote: at does not sound right. The scraper downloads artwork links for the tv show. It does not matter which episodes you have.
But there is always the chance that when you scraped S01, only one poster was available. Then 3 months later you scrape S02, users have added more posters for S01. You need to check what is available at TMDB the next time you scrape.

Let's see if I can show this correctly:
1. Only one season of the show has been scraped and whether I try manage or info on the entire show or the individual episodes I don't get an option to choose the specific poster I want for S03. I can only choose for the poster for the entire series
Image
Image
Image
2. But if I add one episode from S01 I can then go to Manage on the S03 directory, select Choose Art and can see there are multiple S03 posters available that I could not choose when there were only episodes for one season
ImageImage

Man I really wish I could figure out how to add multiple Imgur images into one box with the little arrow so you could just click next like the skinners do when they want to post like 25 screenshots Confused
Reply
So I have not followed the scraper changes for a while and for my last database scrapings i have been using the tvdb scraper... But now I had to scrape my whole database again and i noticed the default scraper had changed... I thought yes, improvement! Oh I was so wrong... I have a medium size of a database, so I thought better accurasy and faster speed... What I found with that Tmdb tv show scraper that it is utter garbage... Horribly horribly slow, in my estimate about 5-10 times slower than the tvdb scraper and for what? Even more inaccurate scrapings? I Can just ask why the hell, how is this better? So for my 30000 episodes, i will never ever use the tmdb tv show scraper again.
Reply
(2022-01-26, 02:10)junitodx Wrote: Let's see if I can show this correctly:
Sorry, I somehow missed your reply. (I don't mind being pinged if I haven't responded in a few days)
If you have only 1 Season, then the TV Show gets flattened, and you don't see the Season level. This is the default setting.
You can change that setting so you always see Seasons in setting 3.6 here... https://kodi.wiki/view/Settings/Media/Vi...ow_seasons Set it to Never
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
(2022-03-12, 01:31)ether123 Wrote: What I found with that Tmdb tv show scraper that it is utter garbage
Show some respect. It is not "garbage". It is a very accurate and reliable scraper. I would love to see your scraper...
The slowness issue affects all Python scrapers. It is an issue we are aware of, but to fix it requires the removal of the older XML scrapers, which we are not prepared to do yet.

And tread carefully using the TVDB scraper as it is unmaintained and unsupported.
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
(2022-03-12, 01:40)Karellen Wrote:
(2022-03-12, 01:31)ether123 Wrote: What I found with that Tmdb tv show scraper that it is utter garbage
Show some respect. It is not "garbage". It is a very accurate and reliable scraper. I would love to see your scraper...
The slowness issue affects all Python scrapers. It is an issue we are aware of, but to fix it requires the removal of the older XML scrapers, which we are not prepared to do yet.

And tread carefully using the TVDB scraper as it is unmaintained and unsupported.

Ok maybe there was some harsh words, and i know its not easy to make a scraper... but in my opinion if you make something new to replace old one, it should be better in atleast some ways, but unfortunately it is not. And with my size of database actually every second counts and i noticed i had to correct much more of the scrapings than before
Reply
  • 1
  • 25
  • 26
  • 27(current)
  • 28
  • 29
  • 47

Logout Mark Read Team Forum Stats Members Help
TMDb TV Show scraper (Python - Default Matrix Scraper)0