Kodi Community Forum
trying to figure out where my scraping is not working - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: General Support (https://forum.kodi.tv/forumdisplay.php?fid=111)
+---- Forum: OS independent / Other (https://forum.kodi.tv/forumdisplay.php?fid=228)
+---- Thread: trying to figure out where my scraping is not working (/showthread.php?tid=349957)

Pages: 1 2

trying to figure out where my scraping is not working - canadave - 2019-12-10

I'm trying to figure out something that's suddenly not working after it worked before.

I have two FireTV sticks. At one point a few months ago, I updated my library using the TVDB scraper and got my "K-ON!" tv show to scrape into my Kodi library correctly (using Leia 18.4). Now I'm trying to scrape on my other FireTV stick on Leia 18.5, and instead of scraping "K-ON!" from TVDB, it's scraping "Kong". I tried refreshing from the Information screen, and the list of choices it gives me for the names of TV shows includes about 20 shows, but none are "K-ON!".

I have the folder named "K-ON!", which matches the TVDB show title (https://www.thetvdb.com/series/k-on). Inside that folder, I have "Season 1" and "Season 2" folders, which have files in them named such as "K-ON! - s01e01.mp4". I have no other files like .nfo or anything like that.

I'm stumped as to what's going wrong here. The only thing I can think of is either the TVDB update a while ago, or the fact that the listing on TVDB seems to include Japanese names for the episode listings in the "breadcrumbs" showing the file paths in the TVDB database...but when you click on one of the Japanese character "breadcrumbs", it takes you to a page that contains the regular English name.

EDIT: I was just able to get it to scrape by changing the folder and file names on my NAS to the Japanese title. Despite the Japanese characters in the folder and file names, it scraped in as "K-ON!", and all the episode names are showing in English. Weird. I would much rather have the folder/file names in English, if that's possible....

RE: trying to figure out where my scraping is not working - Karellen - 2019-12-10

@canadave

The TVDB API is not returning that show in the search results. At a guess its most likely an issue with the original title being non-english. Might be a good idea to report it at the TVDB forum.

I was able to easily scrape it using a Parsing NFO file.

RE: trying to figure out where my scraping is not working - canadave - 2019-12-10

(2019-12-10, 08:28)Karellen Wrote: @canadave

The TVDB API is not returning that show in the search results. At a guess its most likely an issue with the original title being non-english. Might be a good idea to report it at the TVDB forum.

I was able to easily scrape it using a Parsing NFO file.

I'll raise the issue over there. Thanks.

RE: trying to figure out where my scraping is not working - Karellen - 2019-12-11

Thanks for reporting that. I saw your post.

For your immediate fix, did you use the Parsing NFO method?

RE: trying to figure out where my scraping is not working - canadave - 2019-12-13

(2019-12-11, 03:07)Karellen Wrote: Thanks for reporting that. I saw your post.

For your immediate fix, did you use the Parsing NFO method?
Sorry, it didn't work. I'm sure I'm doing it wrong. I take it it's more than just having a tvshow.nfo text file with nothing but "https://thetvdb.com/series/k-on" in it? I saw the wiki but I wasn't able to find how to name it or what to put in it other than the URL.

RE: trying to figure out where my scraping is not working - Karellen - 2019-12-13

That is all you need. Name the file tvshow.nfo and paste the URL in the file and save it. That is all. No codes, no tags, nothing else. Then scan.

Have a look at the image in Sect 2 here... https://kodi.wiki/view/TV-Show_artwork#Local_TV_Show_Artwork

RE: trying to figure out where my scraping is not working - canadave - 2019-12-13

Hmmmm....interesting. It did not work. I have the tvshow.nfo file in my "K-ON!" folder...the only thing in the .nfo file is "https://thetvdb.com/series/k-on" (no quotes obviously).

Let me pull the log and see if there's a clue there.

RE: trying to figure out where my scraping is not working - Karellen - 2019-12-13

Just check the file encoding. It should be UTF-8

Image

RE: trying to figure out where my scraping is not working - canadave - 2019-12-13

(2019-12-13, 05:51)Karellen Wrote: Just check the file encoding. It should be UTF-8

Image
Odd...it is set to UTF-8. I'm editing it with BBEdit on my Mac....it's saving it as "Unicode (UTF-8)". Next to that it says "Unix (LF)". I'll have to look at that...perhaps I have to change that latter part to something else.

RE: trying to figure out where my scraping is not working - canadave - 2019-12-13

Still not working...changed the encoding to UTF-8 with "Windows (CRLF)" selected. This is so odd...

RE: trying to figure out where my scraping is not working - Karellen - 2019-12-13

How are you updating? Are you using Update Library or are you using Information?

Go to Videos>Files, highlight your tv show, then press the i button on your keyboard. If that does not work, provide the Debug Log and I might see what the problem is.

RE: trying to figure out where my scraping is not working - canadave - 2019-12-13

(2019-12-13, 07:10)Karellen Wrote: How are you updating? Are you using Update Library or are you using Information?

Go to Videos>Files, highlight your tv show, then press the i button on your keyboard. If that does not work, provide the Debug Log and I might see what the problem is.

I can't use the Information method, as the show isn't scraped at all (it's completely missing from the video library). I'm just doing "Update Library".

***EDIT***: OK, I'm an idiot Smile I see what you meant now. I went into the files, found the folder, refreshed info via the Information button, and now I see the show and all is well. Interesting....so Update Library doesn't work for Parsing NFO files, is that it?

RE: trying to figure out where my scraping is not working - Karellen - 2019-12-13

Oh, you have numerous Banned Add-ons (wiki) installed. They need to be removed for assistance. Plus there is no scraping in the log and debug mode was not enabled so nothing to see in it.

(2019-12-13, 08:01)canadave Wrote: I can't use the Information method, as the show isn't scraped at all (it's completely missing from the video library). I'm just doing "Update Library".
You might be surprised if you follow my instructions... Who knows what may happen
(2019-12-13, 07:10)Karellen Wrote: Go to Videos>Files, highlight your tv show, then press the i button on your keyboard.


The forum moderators have determined that banned addons (wiki) are present on your system. To receive assistance here, these banned items must be removed. If a clean log is not submitted within 3 days, then the relevant post(s) will be removed after this time.

RE: trying to figure out where my scraping is not working - canadave - 2019-12-13

(2019-12-13, 08:12)Karellen Wrote: Oh, you have numerous Banned Add-ons (wiki) installed. They need to be removed for assistance. Plus there is no scraping in the log and debug mode was not enabled so nothing to see in it.
(2019-12-13, 08:01)canadave Wrote: I can't use the Information method, as the show isn't scraped at all (it's completely missing from the video library). I'm just doing "Update Library".
You might be surprised if you follow my instructions... Who knows what may happen
(2019-12-13, 07:10)Karellen Wrote: Go to Videos>Files, highlight your tv show, then press the i button on your keyboard.


The forum moderators have determined that banned addons (wiki) are present on your system. To receive assistance here, these banned items must be removed. If a clean log is not submitted within 3 days, then the relevant post(s) will be removed after this time. 

My apologies. Those addons are from a while ago, I don't use them anymore, and I just never bothered to remove them; I'll do so right away.  Also, it's been a while since I had to post a debug log, so apologies also for not posting it properly Smile

Anyway, in any case it's all moot...I had edited my previous post before you replied to it--I did update the show via the Information button and that worked. Not sure why Update Library didn't pick up the Parsing NFO file, but if that's just not how it works, I'll remember how to do it for next time Wink I really appreciate your assistance....cheers.

RE: trying to figure out where my scraping is not working - canadave - 2019-12-13

OK, I think I've got those old banned addons removed. Can you have a look at my log to verify I got everything off? I value the help of the Kodi team and wouldn't want an unknown remnant preventing that help next time Smile Thanks!

https://paste.kodi.tv/xupilixiya.kodi