+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302)
+----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821)
Pages:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
RE: [Release] Universal Scraper - chander - 2012-12-05
Is there a log where i can see which movies were/weren't scraped?
Thanks
RE: [Release] Universal Scraper - tungmeister - 2012-12-05
(2012-12-05, 08:58)olympia Wrote:(2012-12-04, 19:35)olympia Wrote:(2012-12-04, 16:29)tungmeister Wrote: It's not a network issue as I can scrape other films fine, and If i select a different film from the gui that will scrape fine. I'll post a debug log in a moment.
EDIT: debug log here.
OK, I see why this is happening. Actually a bug which I will need to address eventually...
Should only happen with movies which doesn't have an IMDb id registered on TMDb.
Should be fixed in v1.9.1
The issue still seems to be present, debug log here
RE: [Release] Universal Scraper - markhoney - 2012-12-05
My movies have an accompanying movie.nfo containing the IMDB URL for the movie. Scraping with the Universal Scraper no longer works properly, and newly scraped movies are missing all the info that I've setup the scraper to grab from IMDB. Is this just a consequence of the IMDB site update, and something that will be fixed eventually? In the meantime will changing my data source to TMDB for title, plot, etc work?
RE: [Release] Universal Scraper - olympia - 2012-12-05
Maybe you can provide a debug log, so I can have a look...
(It should work)
RE: [Release] Universal Scraper - chander - 2012-12-05
Answered.
RE: [Release] Universal Scraper - markhoney - 2012-12-05
Thanks for your help with this, olympia. Here's what I assume is the relevant portion of my log:
Code:
09:35:56 T:29952 DEBUG: CNFSFile::Open - opened mnt/media/Videos/Movies/1921/The Kid (1921)/movie.nfo
09:35:56 T:29952 DEBUG: CNFSFile::Close closing file mnt/media/Videos/Movies/1921/The Kid (1921)/movie.nfo
09:35:56 T:29952 DEBUG: scraper: NfoUrl returned <url>http://akas.imdb.com/title/tt0012349/</url><id>tt0012349</id>
09:35:56 T:29952 DEBUG: VideoInfoScanner: Found matching URL NFO file: nfs://media/mnt/media/Videos/Movies/1921/The Kid (1921)/movie.nfo
09:35:56 T:29952 DEBUG: VideoInfoScanner: Fetching url 'http://akas.imdb.com/title/tt0012349/' using Universal Scraper scraper (content: 'movies')
09:35:56 T:29952 DEBUG: ADDON::CScraper::GetVideoDetails: Reading movie 'http://akas.imdb.com/title/tt0012349/' using Universal Scraper scraper (file: 'C:\Users\Mark\AppData\Roaming\XBMC\addons\metadata.universal', content: 'movies', version: '1.9.1')
09:35:56 T:29952 DEBUG: CurlFile::Open(08E85C78) http://akas.imdb.com/title/tt0012349/
09:35:56 T:29952 INFO: XCURL::DllLibCurlGlobal::easy_aquire - Created session to http://akas.imdb.com
09:35:58 T:29952 DEBUG: scraper: GetDetails returned <details><id></id><originaltitle></originaltitle><year></year><chain function="GetIMDBAKATitlesById"></chain><chain function="GetIMDBCountryCert"></chain><chain function="GetIMDBRatingById"></chain><chain function="GetIMDBTOP250ById"></chain><chain function="GetIMDBGenresById"></chain><chain function="GetIMDBStudioById"></chain><chain function="GetIMDBCountryById"></chain><chain function="GetIMDBOutlineById"></chain><chain function="GetIMDBPlotById"></chain><chain function="GetIMDBTaglineById"></chain><chain function="GetIMDBCastById"></chain><chain function="GetIMDBDirectorsById"></chain><chain function="GetIMDBWritersById"></chain><chain function="GetTMDBSetByIdChain"></chain><chain function="GetYoutubeTrailer">=</chain><chain function="GetTMDBLangTrailerByIdChain"></chain><chain function="GetTRAKTTVTrailerByIdChain"></chain><chain function="GetHDTrailersnet480p"></chain></details>
09:35:58 T:29952 DEBUG: scraper: GetIMDBAKATitlesById returned <details><url cache="-combined.html" function="ParseIMDBAKATitles">http://akas.imdb.com/title//combined</url></details>
09:35:58 T:29952 DEBUG: CurlFile::Open(08E85C78) http://akas.imdb.com/title//combined
09:35:59 T:29952 WARNING: XFILE::CCurlFile::CReadState::FillBuffer: curl failed with code 22
09:35:59 T:29952 ERROR: CCurlFile::CReadState::Open, didn't get any data from stream.
09:35:59 T:29952 ERROR: ADDON::CScraper::Run: Unable to parse web site
09:35:59 T:29952 DEBUG: scraper: GetIMDBCountryCert returned <details><url cache="-combined.html" function="ParseIMDBCountryCert">http://akas.imdb.com/title//combined</url></details>
09:35:59 T:29952 DEBUG: CurlFile::Open(08E85C78) http://akas.imdb.com/title//combined
09:35:59 T:29952 WARNING: XFILE::CCurlFile::CReadState::FillBuffer: curl failed with code 22
09:35:59 T:29952 ERROR: CCurlFile::CReadState::Open, didn't get any data from stream.
09:35:59 T:29952 ERROR: ADDON::CScraper::Run: Unable to parse web site
09:35:59 T:29952 DEBUG: scraper: GetIMDBRatingById returned <details><url cache="-main.html" function="ParseIMDBRating">http://akas.imdb.com/title//</url></details>
09:35:59 T:29952 DEBUG: CurlFile::Open(08E85C78) http://akas.imdb.com/title//
09:36:00 T:29952 WARNING: XFILE::CCurlFile::CReadState::FillBuffer: curl failed with code 22
09:36:00 T:29952 ERROR: CCurlFile::CReadState::Open, didn't get any data from stream.
09:36:00 T:29952 ERROR: ADDON::CScraper::Run: Unable to parse web siteI've checked the URL, http://akas.imdb.com/title/tt0012349/, and it works fine in a browser from the same machine.
If you need more context, or a different part of the log, please let me know.
RE: [Release] Universal Scraper - olympia - 2012-12-05
pfffff... stupidity on my side... will get this fixed soon enough...
RE: [Release] Universal Scraper - markhoney - 2012-12-05
Thanks for the quick response! I've been trying to figure this out for days, and figured that as a last resort I'd ask the author. Thanks also for some great scrapers, and keep up the good work!
RE: [Release] Universal Scraper - olympia - 2012-12-06
Should be fixed in v1.9.2
RE: [Release] Universal Scraper - chander - 2012-12-06
Your scraper is so good that i've finally edited and even added some movies on tmdb ^^.
Just struggling with the original names for asiatic movies.
Re: RE: [Release] Universal Scraper - Martijn - 2012-12-06
(2012-12-06, 00:33)chander Wrote: Your scraper is so good that i finally edit and even added some movies on tmdb ^^.
Just struggling with the original names for asiatic movies.
Hopefully more people will do the same
RE: [Release] Universal Scraper - markhoney - 2012-12-06
Olympia, v1.9.2 has definitely fixed my problem. Thanks for the speedy update.
RE: [Release] Universal Scraper - sonic00 - 2012-12-06
Hi there,
having some installing problems. Everytime I click on "install" nothing happens - I also tried some others Scrapers from "XBMC.org Add-ons - Movie information" and it works just fine. Did I miss something!?
RE: [Release] Universal Scraper - jenma - 2012-12-06
sorry before for my bad english, i want to ask how to make mpaa rating in universal scrapper like in imdb scrapper
for example "rated r for strong graphic violence and drug use"
because when i use universal the mpaa rating just showing "rated r"
RE: [Release] Universal Scraper - Langston Hughes - 2012-12-06
I fear I am just being stupid, but...
I cannot get this scrapper to work. Does the file naming sequence have to be any different? I have my movies in individual folders ex:
Movies\Bad Lieutenant (1992)
Within that folder the movie is named: Bad Lieutenant (1992)
What am I missing here? When XMBC Library runs the auto update, nothing happens. XBMC sees the files there, under "files" but it doesnt get scrapped into the movies folder. When I manual update the library, nothing happens. Please advise.
Edit: Trying to add debug log, apparently I am not getting the correct link from pastebin.