+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302)
+----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821)
Pages:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
RE: Universal Movie Scraper - movie78 - 2018-04-16
(2018-04-16, 00:07)Karellen Wrote: Unfortunately no. Maybe olympia can offer some suggestions when he returns. I assume you are using v18?Kodi Leia, tried it on 3 different platform and all produce the same results.
LibreElec Leia Intel NUC hardware
Amlogic LibreElec Leia
Nvidia Sheild Android Kodi Leia
All running the latest updates.
RE: Universal Movie Scraper - olympia - 2018-04-16
CDart;FanArt;ClearLogo;Banner are all coming from fanart.tv.
I's not your Kodi instance - Fanart.tv is unfortunately not very fast.
RE: Universal Movie Scraper - movie78 - 2018-04-16
(2018-04-16, 17:15)olympia Wrote: CDart;FanArt;ClearLogo;Banner are all coming from fanart.tv.Is there a way to save CDart; FanArt; ClearLogo; Banner etc., on a local or network drive so it can load a little bit faster?
I's not your Kodi instance - Fanart.tv is unfortunately not very fast.
RE: Universal Movie Scraper - host505 - 2018-04-16
(2018-04-16, 17:15)olympia Wrote: CDart;FanArt;ClearLogo;Banner are all coming from fanart.tv.
I's not your Kodi instance - Fanart.tv is unfortunately not very fast.
Would the use of personal fanart.tv API keys be of any help for this?
RE: Universal Movie Scraper - willemd - 2018-04-23
I reinstalled Kodi 17.6. Some movies that I now scrape, return strange, unwanted titles. The scraper returns the right movie all right (right year, plot, actors), but the title is some AKA from the IMDb I guess. I tried both 'original' and 'USA' titles in the settings (set from the source).
For example:
Film: Harry Potter and the Half Blood Prince.
Kodi calls it: HP and the HBP (it's in here as 'informal title': https://www.imdb.com/title/tt0417741/releaseinfo?ref_=tt_dt_dt#akas)
Film: The Quiet American
Kodi calls it: Graham Greene's the Quiet American (also as 'informal title': https://www.imdb.com/title/tt0258068/releaseinfo?ref_=tt_dt_dt#akas)
I'm sure I'm missing some setting. What could it be?
RE: Universal Movie Scraper - willemd - 2018-04-23
Another example:
Harold and Kumar Go To White Castle
Kodi makes it: Harold and Kumar get the munchies ('European English title', whatever that is: https://www.imdb.com/title/tt0366551/releaseinfo?ref_=tt_dt_dt#akas)
Relevant debug log part: https://pastebin.com/hHApbPuk
Code:
14:56:30.556 T:5532 DEBUG: ADDON::CScraper::GetVideoDetails: Reading movie 'http://akas.imdb.com/title/tt0366551/|accept-language=en-us' using Universal Movie Scraper scraper (file: 'C:\Users\userh\AppData\Roaming\Kodi\addons\metadata.universal', content: 'movies', version: '5.2.2')
14:56:30.567 T:5532 DEBUG: CurlFile::ParseAndCorrectUrl() adding custom header option 'accept-language: en-us'
14:56:30.567 T:5532 DEBUG: CurlFile::Open(243A6710) http://akas.imdb.com/title/tt0366551/
14:56:31.357 T:5532 DEBUG: CCurlFile::Open - effective URL: <https://www.imdb.com/title/tt0366551/>
14:56:31.709 T:5532 DEBUG: CScraperUrl::Get: Using "UTF-8" charset for HTML "http://akas.imdb.com/title/tt0366551/|accept-language=en-us"
14:56:32.185 T:5532 DEBUG: scraper: GetDetails returned <details><uniqueid type="imdb" default="true">tt0366551</uniqueid><originaltitle>Harold & Kumar Go to White Castle</originaltitle><chain function="GetTMDBPremieredByIdChain">tt0366551::en</chain><chain function="GetIMDBAKATitlesById">tt0366551</chain><chain function="GetIMDBCountryCert">tt0366551</chain><runtime>88</runtime><chain function="GetIMDBRatingsById">tt0366551|default</chain><chain function="GetIMDBTOP250ById">tt0366551</chain><chain function="GetIMDBGenresById">tt0366551</chain><chain function="GetIMDBStudioById">tt0366551</chain><chain function="GetIMDBCountryById">tt0366551</chain><chain function="GetIMDBOutlineById">tt0366551</chain><chain function="GetIMDBPlotById">tt0366551</chain><chain function="GetIMDBTaglineById">tt0366551</chain><chain function="GetIMDBFullCastById">tt0366551</chain><chain function="GetIMDBFullDirectorsById">tt0366551</chain><chain function="GetIMDBFullWritersById">tt0366551</chain><chain function="GetFanartTvThumbsByIdChain">tt0366551::en</chain><chain function="GetTMDBThumbsByIdChain">tt0366551::en</chain><chain function="GetFanartTvFanartByIdChain">tt0366551</chain><chain function="GetTMDBFanartByIdChain">tt0366551::en</chain><chain function="GetTMDBTrailerByIdChain">tt0366551::en</chain><chain function="GetIMDBThumbsById">tt0366551</chain></details>
14:56:32.185 T:5532 DEBUG: scraper: GetTMDBPremieredByIdChain returned <details><url function="ParseTMDBPremiered" cache="tmdb-en-tt0366551.json">https://api.tmdb.org/3/movie/tt0366551?api_key=92db8778ccb39d825150332b0a46061d&language=en</url></details>
14:56:32.186 T:5532 DEBUG: CurlFile::Open(243A6710) https://api.tmdb.org/3/movie/tt0366551?api_key=92db8778ccb39d825150332b0a46061d&language=en
14:56:32.306 T:5532 DEBUG: CScraperUrl::Get: Using "UTF-8" charset for "https://api.tmdb.org/3/movie/tt0366551?api_key=92db8778ccb39d825150332b0a46061d&language=en"
14:56:32.308 T:5532 DEBUG: scraper: ParseTMDBPremiered returned <details><premiered>2004-05-30</premiered></details>
14:56:32.308 T:5532 DEBUG: scraper: GetIMDBAKATitlesById returned <details><url cache="tt0366551-releaseinfo.html" function="ParseIMDBAKATitles">http://www.imdb.com/title/tt0366551/releaseinfo|accept-language=en-us</url></details>
14:56:32.308 T:5532 DEBUG: CurlFile::ParseAndCorrectUrl() adding custom header option 'accept-language: en-us'
14:56:32.308 T:5532 DEBUG: CurlFile::Open(243A6710) http://www.imdb.com/title/tt0366551/releaseinfo
14:56:32.763 T:5532 DEBUG: CCurlFile::Open - effective URL: <https://www.imdb.com/title/tt0366551/releaseinfo>
14:56:32.869 T:5532 DEBUG: CScraperUrl::Get: Using "UTF-8" charset for HTML "http://www.imdb.com/title/tt0366551/releaseinfo|accept-language=en-us"
14:56:33.127 T:5532 DEBUG: scraper: ParseIMDBAKATitles returned <details><title>Harold & Kumar Get the Munchies</title></details>Is this a bug or is it somehow intended?
RE: Universal Movie Scraper - olympia - 2018-04-23
Not intended, but not really fixable. IMDb is not consistent in the titles and I believe whoever thinks it is great to develop a new "title type", he can do it...
Best bet is to use TMDb for titles...
RE: Universal Movie Scraper - willemd - 2018-04-23
Thanks! I'll try that.
RE: Universal Movie Scraper - vitorsemeano - 2018-04-25
Hi there,
I was trying to scrape the movie "Espectáculo Bugs Bunny 1 V1" but Universal Movie Scraper can't find it in themoviedb.
Looking further into the logs, i see this happening:
Code:
DEBUG: ADDON::CScraper::FindMovie: Searching for 'Espectáculo Bugs Bunny 1 V1' using Universal Movie Scraper scraper (path: 'C:\<removed path>\addons\metadata.universal', content: 'movies', version: '4.1.8')DEBUG: scraper: CreateSearchUrl returned <url>http://api.tmdb.org/3/search/movie?api_key=92db8778ccb39d825150332b0a46061d&query=Espect%c3%a1culo%20Bugs%20Bunny%201%20V1&year=</url>DEBUG: CurlFile::Open(11DA9680) http://api.tmdb.org/3/search/movie?api_key=92db8778ccb39d825150332b0a46061d&query=Espect%c3%a1culo%20Bugs%20Bunny%201%20V1&year=DEBUG: CScraperUrl::Get: Using "UTF-8" charset for "http://api.tmdb.org/3/search/movie?api_key=92db8778ccb39d825150332b0a46061d&query=Espect%c3%a1culo%20Bugs%20Bunny%201%20V1&year="DEBUG: scraper: GetSearchResults returned <results></results>WARNING: No information found for item 'smb://<removed path>/Espectáculo Bugs Bunny 1 V1/Espectáculo Bugs Bunny 1 V1.avi', it won't be added to the library. So no results found. But if i copy paste the url "http://api.tmdb.org/3/search/movie?api_key=92db8778ccb39d825150332b0a46061d&query=Espect%c3%a1culo%20Bugs%20Bunny%201%20V1&year=" into the browser, i see the pretended results:
json:
{"page":1,"total_results":2,"total_pages":1,"results":[{"vote_count":0,"id":423459,"video":true,"vote_average":0,"title":"Warner Kids - Bugs Bunny - Volume 1-1","popularity":1.002363,"poster_path":"\/8FEzreG5YggWuO2LkPDE1Di3tyE.jpg","original_language":"en","original_title":"Warner Kids - Bugs Bunny - Volume 1-1","genre_ids":[16],"backdrop_path":null,"adult":false,"overview":"","release_date":""},{"vote_count":0,"id":356634,"video":true,"vote_average":0,"title":"Espectáculo Bugs Bunny 1 V1","popularity":1.000001,"poster_path":"\/vRft198TdgyD4HPIOpWxZttEKQd.jpg","original_language":"pt","original_title":"Espectáculo Bugs Bunny 1 V1","genre_ids":[16],"backdrop_path":null,"adult":false,"overview":"","release_date":""}]}
So this is a bug in Universal Movie Scrapper? If not, what i am doing wrong?
Let me know as soon as possible.
Best Regards,
Vitor Figueira
RE: Universal Movie Scraper - Karellen - 2018-04-25
Can you please post the link of the Bugs Bunny show from TMDB ... https://www.themoviedb.org/
RE: Universal Movie Scraper - vitorsemeano - 2018-04-25
Sure, there it is:
https://www.themoviedb.org/movie/356634-espect-culo-bugs-bunny-1-v1
Thanks
RE: Universal Movie Scraper - Karellen - 2018-04-25
Ok, so it exists, thanks.
What language do you have set in the scraper?
As you are linking to TMDB, can I assume you have all your scraper settings set to TMDB?
You will need to provide a Debug_Log (wiki). The instructions are in my signature. Use the Basic method. Once you have enabled debugging in Settings>System Settings>Logging, restart Kodi then replicate the problem. In your case, try to scrape the movie. Once done upload to https://pastebin.com/ or https://paste.ubuntu.com/ and link back here. Note: Full logs only. No partial or redacted logs
Interesting that it is listed as a movie, but it should be a TV Show.
RE: Universal Movie Scraper - vitorsemeano - 2018-04-25
Hi,
Sorry for the delay.
The preferred language set is en, because most of the movies and tv shows i have are in English.
Yes you can assume i have all scrapper settings pointing to TMDB.
the requested log is here:
https://paste.ubuntu.com/p/6wJMW2NVRt/
Note that some personal information i replaced with generic data, i think that would not affect the veracity of the log (base paths, ips, etc) for what we intend here.
As a matter of fact, that is considered a movie (video) because each one contains a compilation of episodes from Bugs Bunny Show, but dubbed in Portuguese, like a best of. I don't know if this was released like this outside of Portugal, but if equivalent could be found in English, like a official release in the same format, i would definitely use the English titles. This "movie" i actually have it in VHS format, so i know it was officially released in Portugal, at least.
Anything more that you want to know, just ask.
Thanks
RE: Universal Movie Scraper - Karellen - 2018-04-25
(2018-04-25, 11:37)vitorsemeano Wrote: i would definitely use the English titles. This "movie" i actually have it in VHS format,I haven't looked at the log yet, but there is an English version here... https://www.themoviedb.org/movie/423459-espectaculo-bugs-bunny-volume-1-1
Try this and see if it works. If it doesn't work, then I will look at the log.
RE: Universal Movie Scraper - vitorsemeano - 2018-04-25
Hi again,
I would not try fetching only that one in English, because there are 19 more released videos of this kind but i can only find a Portuguese reference to them. Even if i could fetch this one in English, the remaining i would have to fetch them in Portuguese.
But nevertheless, i will try fetching it in the English title, give me some moments.