+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: Release TMDb TV Show scraper (Python - Default Matrix Scraper) (/showthread.php?tid=357232)
RE: TheMovieDB Python - TV Show scraper - SrTaronja - 2020-11-15
Recently I am also having the "no information" problem with new episodes; not only for new TV shows but also for shows for which I already added episodes in the past.
This happens with both "the movie database" (v3.5.5) and "The TVDB" (v3.2.8) addons running in Kodi v18.9. They are both configured with the auto-update option.
This is the log: https://paste.kodi.tv/jajeyakude.kodi
If I open the URLs with a web browser, I receive the episode content in JSON.
Any suggestion will be highly appreciated.
Thank you and best regards.
RE: TheMovieDB Python - TV Show scraper - Karellen - 2020-11-15
@SrTaronja
TheMovieDB v3.5.5 is still partly broken. Change to this scraper which is the thread you posted in... https://kodi.wiki/view/Add-on:TMDb_TV_Shows and try scraping again.
TVDB does not work for you because you originally scraped The Mandalorian with TheMovieDB so Kodi is still searching TVDB using TheMovieDB data. If you want to use TVDB, then you need to rescrape the TV Show.
RE: TheMovieDB Python - TV Show scraper - SrTaronja - 2020-11-15
(2020-11-15, 11:43)Karellen Wrote: @SrTaronja
TheMovieDB v3.5.5 is still partly broken. Change to this scraper which is the thread you posted in... https://kodi.wiki/view/Add-on:TMDb_TV_Shows and try scraping again.
TVDB does not work for you because you originally scraped The Mandalorian with TheMovieDB so Kodi is still searching TVDB using TheMovieDB data. If you want to use TVDB, then you need to rescrape the TV Show.
My bad, I thought that by "changing content" and saying "no" to re-scan the whole show, only the new episodes would be scanned with tvdb.
But you are right: in the log file I provided it can be seen that it always asks to moviedb
Now I have re-scanned the whole Mandalorian show against tvdb and the chapter has been successfully added (the art was changed though, but I set it back to my preferred one).
Thank you very much for your support, and waiting for a new version of moviedb (I prefer it rather than tvdb).
Keep on with your great job!
RE: TheMovieDB Python - TV Show scraper - ramis52 - 2020-11-15
hi,
matrix alpha 3 + metadata.tvshows.themoviedb.org.python (1.3.2). iam trying to scrape The Crown S04. Its not working at all. I cant even provide any log file, because scraping this season generates a log with 113000 lines. i cant upload it to hastebin or similar services. is there another way to provide logs?
adding some other new Episodes (Lovecraft Country S01E02) results in the same.
RE: TheMovieDB Python - TV Show scraper - pkscout - 2020-11-15
(2020-11-15, 10:41)roidy Wrote: @pkscout Seems I'm now getting a different error on some TV Shows
Line 1371 - https://paste.kodi.tv/uwocupacat.kodi
I've fixed that, but I'm not submitting an update yet, as I have another bug I need to try and squash before submitting an update. In the interim, you can download updated addon from:
Leia: https://github.com/xbmc/metadata.tvshows.themoviedb.org.python/tree/leia
Matrix: https://github.com/xbmc/metadata.tvshows.themoviedb.org.python/tree/matrix
and install from zip.
RE: TheMovieDB Python - TV Show scraper - pkscout - 2020-11-15
(2020-11-15, 09:29)Karellen Wrote:I'll try. Honestly, Unicode in Python 2.x is just about my least favorite thing in the entire world. I end up just randomly trying things until something finally works.(2020-11-15, 09:24)MeC!as Wrote: The Python scraper works, I apparently used an example with umlauts (mysteriöse Mordfälle). This one did not work.Thanks. I have tried and it errors for me also. I thought we fixed this.
@pkscout anything can be done about this? Line 1254...https://paste.kodi.tv/ususoyanor.kodi
RE: TheMovieDB Python - TV Show scraper - Karellen - 2020-11-15
(2020-11-15, 13:59)SrTaronja Wrote: Now I have re-scanned the whole Mandalorian show against tvdb and the chapter has been successfully added (the art was changed though, but I set it back to my preferred one).Maybe I wasn't clear but I did not want you to change to TVDB. I wanted you to change to the scraper detailed in the wiki page and whose thread you are posting in now.
Thank you very much for your support, and waiting for a new version of moviedb (I prefer it rather than tvdb).
RE: TheMovieDB Python - TV Show scraper - roidy - 2020-11-15
(2020-11-15, 18:42)pkscout Wrote:(2020-11-15, 10:41)roidy Wrote: @pkscout Seems I'm now getting a different error on some TV Shows
Line 1371 - https://paste.kodi.tv/uwocupacat.kodi
I've fixed that, but I'm not submitting an update yet, as I have another bug I need to try and squash before submitting an update. In the interim, you can download updated addon from:
Leia: https://github.com/xbmc/metadata.tvshows.themoviedb.org.python/tree/leia
Matrix: https://github.com/xbmc/metadata.tvshows.themoviedb.org.python/tree/matrix
and install from zip.
Unfortunately I'm still getting the same error.
Code:
2020-11-15 18:56:28.094 T:3145974656 ERROR: [metadata.tvshows.themoviedb.org.python (1.1.19)]: **** End diagnostic info ****
2020-11-15 18:56:28.099 T:3145974656 ERROR: EXCEPTION Thrown (PythonToCppException) : -->Python callback/script returned the following error<--
- NOTE: IGNORING THIS CAN LEAD TO MEMORY LEAKS!
Error Type: <type 'exceptions.AttributeError'>
Error Contents: 'NoneType' object has no attribute 'lower'
Traceback (most recent call last):
File "/storage/.kodi/addons/metadata.tvshows.themoviedb.org.python/main.py", line 32, in <module>
router(sys.argv[2][1:])
File "/storage/.kodi/addons/metadata.tvshows.themoviedb.org.python/libs/actions.py", line 202, in router
get_episode_details(params['url'])
File "/storage/.kodi/addons/metadata.tvshows.themoviedb.org.python/libs/actions.py", line 149, in get_episode_details
decoded_ids['show_id'], decoded_ids['episode_id']
File "/storage/.kodi/addons/metadata.tvshows.themoviedb.org.python/libs/tmdb.py", line 220, in load_episode_info
if (ep_return['overview'] == '' or ep_return['name'].lower().startswith('episode')) and settings.LANG != 'en-US':
AttributeError: 'NoneType' object has no attribute 'lower'
-->End of Python script error report<--RE: TheMovieDB Python - TV Show scraper - jads - 2020-11-15
Sorry if this isn't the right topic to ask on, but do you expect to eventually support scraping using episode groups? I was playing around with switching from the old TMDB scraper to this new one and discovered that they don't seem to work.
RE: TheMovieDB Python - TV Show scraper - Karellen - 2020-11-15
@jads
They worked while we were testing before release.
Please provide the link to the tv show you are trying to scrape and I will have a look.
RE: TheMovieDB Python - TV Show scraper - pkscout - 2020-11-15
(2020-11-15, 20:58)roidy Wrote:Could you please post an entire log with debug on? The first one didn't seem to be in debug mode and was cut off right where the error would have been reported, and this snippet is helping even less.(2020-11-15, 18:42)pkscout Wrote:(2020-11-15, 10:41)roidy Wrote: @pkscout Seems I'm now getting a different error on some TV Shows
Line 1371 - https://paste.kodi.tv/uwocupacat.kodi
I've fixed that, but I'm not submitting an update yet, as I have another bug I need to try and squash before submitting an update. In the interim, you can download updated addon from:
Leia: https://github.com/xbmc/metadata.tvshows.themoviedb.org.python/tree/leia
Matrix: https://github.com/xbmc/metadata.tvshows.themoviedb.org.python/tree/matrix
and install from zip.
Unfortunately I'm still getting the same error.
RE: TheMovieDB Python - TV Show scraper - jads - 2020-11-15
(2020-11-15, 23:18)Karellen Wrote: @jads
They worked while we were testing before release.
Please provide the link to the tv show you are trying to scrape and I will have a look.
One example was with https://www.themoviedb.org/tv/1437-firefly/episode_group/5acfb484c3a368738a004068. When I scrape with the old TMDB scraper it picks up all 14 episodes + the movie just fine, but if I try the same scrape with the new one it gives me no episodes.
I was just trying a run where I captured my metadata, and then re-scraped using the new plugin and captured a new snapshot, to see how well it worked. It worked just fine except for the handful of shows where I used groups, so I just assumed that wasn't supported with the new scraper. A mistake, it would seem.
RE: TheMovieDB Python - TV Show scraper - Karellen - 2020-11-15
(2020-11-15, 23:31)jads Wrote: One example was with https://www.themoviedb.org/tv/1437-firef...738a004068.Ha, that is the show I used for testing. And it still works for me.
xml:2020-11-16 08:39:40.304 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: performing getepisodelist action
2020-11-16 08:39:40.304 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: Getting episode list for show id 1437
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: using cached show info
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E1 - Serenity to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E2 - The Train Job to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E3 - Bushwhacked to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E4 - Shindig to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E5 - Safe to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E6 - Our Mrs. Reynolds to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E7 - Jaynestown to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E8 - Out of Gas to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E9 - Ariel to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E10 - War Stories to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E11 - Trash to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E12 - The Message to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E13 - Heart of Gold to list item
2020-11-16 08:39:40.306 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E14 - Objects in Space to list item
2020-11-16 08:39:40.306 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E15 - Serenity to list item
2020-11-16 08:39:40.306 T:2520 INFO: CPythonInvoker(5, C:\Users\Master\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org.python\main.py): script successfully run
2020-11-16 08:39:40.306 T:2520 DEBUG: CPythonInvoker::onExecutionDone(5, C:\Users\Master\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org.python\main.py)
Step out your process and I'll try to spot the mistake in what you are doing.
RE: TheMovieDB Python - TV Show scraper - jads - 2020-11-15
(2020-11-15, 23:44)Karellen Wrote:Well, I just tried to re-run everything with debug logging turned on and now the problem is gone. I'm not sure if it was PEBKAC (I don't think so, I ran through the same sequence of steps multiple times), or if there was something that flaked out on the TMDB side. I think the API cache in the plugin created the illusion that the problem was more reproducible than it was.(2020-11-15, 23:31)jads Wrote: One example was with https://www.themoviedb.org/tv/1437-firef...738a004068.Ha, that is the show I used for testing. And it still works for me.
xml:2020-11-16 08:39:40.304 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: performing getepisodelist action
2020-11-16 08:39:40.304 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: Getting episode list for show id 1437
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: using cached show info
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E1 - Serenity to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E2 - The Train Job to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E3 - Bushwhacked to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E4 - Shindig to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E5 - Safe to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E6 - Our Mrs. Reynolds to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E7 - Jaynestown to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E8 - Out of Gas to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E9 - Ariel to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E10 - War Stories to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E11 - Trash to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E12 - The Message to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E13 - Heart of Gold to list item
2020-11-16 08:39:40.306 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E14 - Objects in Space to list item
2020-11-16 08:39:40.306 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E15 - Serenity to list item
2020-11-16 08:39:40.306 T:2520 INFO: CPythonInvoker(5, C:\Users\Master\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org.python\main.py): script successfully run
2020-11-16 08:39:40.306 T:2520 DEBUG: CPythonInvoker::onExecutionDone(5, C:\Users\Master\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org.python\main.py)
Step out your process and I'll try to spot the mistake in what you are doing.
I'm still a little weirded out by the problem only being on shows with episode groups (https://www.themoviedb.org/tv/615-futurama/episode_group/5ad2557a0e0a266c25015a52 is another example that broke, but it now also works fine). But since everything works now I'll just not think about it too much. Sorry for the trouble.
RE: TheMovieDB Python - TV Show scraper - Karellen - 2020-11-16
(2020-11-15, 23:54)jads Wrote: and now the problem is goneGreat. No problems, TheMovieDB made some changes yesterday that ended up being reverted so it is a high chance you got caught up in the changes.