+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302)
+----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821)
Pages:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
RE: [Release] Universal Movie Scraper - olympia - 2015-11-27
(2015-11-26, 12:02)willemd Wrote: Hi guys
The universal movie scraper stopped scraping IMDb Top 250 info for my movies. Is that normal?
I noticed it when I reloaded some movie information, and the Top 250 icon didn't show up anymore. (The skin supports Top 250 icons for those movies.) The rest of the movie information is scraped correctly from IMDb. I'm bypassing the problem by using this add-on: http://forum.kodi.tv/showthread.php?tid=167754 . After I run that, the Top 250 info is back. But I'm guessing this is either a bug in the scraper, or something the API now forbids?
(Using Windows 10, Isengard.)
This has been fixed in v2.7.0 (available now from the Repo).
...aaaaaaaand, v2.7.0 brings back scraping Rotten Tomato ratings via OMDBAPI.com - thanks for them!
RE: [Release] Universal Movie Scraper - smg669 - 2015-11-30
Is there a way to "re-scrape" movies that I added while the Rotten Tomatoes functionality was missing so I can update the movies that have a blank "rating" field?
RE: [Release] Universal Movie Scraper - wgstarks - 2015-11-30
(2015-11-30, 17:43)smg669 Wrote: Is there a way to "re-scrape" movies that I added while the Rotten Tomatoes functionality was missing so I can update the movies that have a blank "rating" field?There might be easier ways to do this, but the only way I know would be to remove the movies from the database and then re-add them.
Move the file to a folder that is not scanned by Kodi.
Update and clean the database.
Move the video files back to their original location.
Update the database again.
I know this could be rather labor intensive if it's a lot of movies. Perhaps someone knows a better way.
RE: [Release] Universal Movie Scraper - nickr - 2015-11-30
Click "refresh" in the info screen?
RE: [Release] Universal Movie Scraper - Cake Tiger - 2015-12-05
I see that movieposterdb.com is offline and has been for a couple of days. It seems to be causing problems for me when scraping new movies. My scraper was set up to get posters from that website only as I like it best. I have changed my settings so that it looks for posters from other sources too but it doesn't seem to be working.
Do I have to delete the films I have added since changing my settings and re-add them under the new settings? I would have thought that using "refresh" would have worked but it hasn't so far. Is there a setting I'm forgetting to change somewhere?
I'm continuing to tinker in the meantime.
Edit - movieposterdb.com is back online now and all seems to be well
RE: [Release] Universal Movie Scraper - Jay Lucky - 2015-12-11
New movies aren't getting ratings from IMDB it seems. Using latest version, 2.7.0, is this a known issue? Would also be nice if we could refresh everything instead of having to re-add the source or go movie by movie.
RE: [Release] Universal Movie Scraper - neurosis13 - 2015-12-12
(2015-12-11, 21:38)Jay Lucky Wrote: New movies aren't getting ratings from IMDB it seems. Using latest version, 2.7.0, is this a known issue? Would also be nice if we could refresh everything instead of having to re-add the source or go movie by movie.
i can confirm this issue, something is wrong with imdb.
try imdb rating updater from my signature.
it resolved this issue for me at the moment, untiltill this is fixed at least.
RE: [Release] Universal Movie Scraper - olympia - 2015-12-12
I cannot reproduce this, so fixing would be hard. Debug log would be useful.
RE: [Release] Universal Movie Scraper - great_vc - 2015-12-12
I can confirm that rating is not working since last night
here is the debug log
http://pastebin.com/xVgG9qbU
RE: [Release] Universal Movie Scraper - olympia - 2015-12-12
Thanks for the log!
This doesn't seem to be a scraper issue actually (PCRE: Match limit reached).
I cannot reproduce the issue on Linux and Windows (No OSX here). Are you Jay Lucky and neurosis13 also on OSX?
RE: [Release] Universal Movie Scraper - neurosis13 - 2015-12-12
(2015-12-12, 12:39)olympia Wrote: Thanks for the log!
This doesn't seem to be a scraper issue actually (PCRE: Match limit reached).
I cannot reproduce the issue on Linux and Windows (No OSX here). Are you Jay Lucky and neurosis13 also on OSX?
Hi Olympia,
yes i am on OS X, it could be that this occurred after i installed the latest os x update (10.11.2)
but i am not sure at all.
Here is a screenshot of what i get after scraping, i noticed that the field Country/original title get's filled with the german Name of the movie which is wrong, normally there should be the country name.
when i switch the scraper to the movie.db then it get's the country right but also without rating/votes
when i set the rating in the moved scraper to themoviedb then votes works:
RE: [Release] Universal Movie Scraper - great_vc - 2015-12-12
(2015-12-12, 19:22)neurosis13 Wrote:(2015-12-12, 12:39)olympia Wrote: Thanks for the log!
This doesn't seem to be a scraper issue actually (PCRE: Match limit reached).
I cannot reproduce the issue on Linux and Windows (No OSX here). Are you Jay Lucky and neurosis13 also on OSX?
Hi Olympia,
yes i am on OS X, it could be that this occurred after i installed the latest os x update (10.11.2)
I didn't did any update on either MacOS or Kodi, kodi add-ons.
ley us know how we can be of more help Olympia, it is getting on my OCD
RE: [Release] Universal Movie Scraper - olympia - 2015-12-12
Unfortunately I cannot be any help here. It is not an issue with the scraper, but Kodi core. Best I can suggest is to bring this up in the OSX forums.
RE: [Release] Universal Movie Scraper - Jay Lucky - 2015-12-12
(2015-12-12, 12:39)olympia Wrote: Thanks for the log!
This doesn't seem to be a scraper issue actually (PCRE: Match limit reached).
I cannot reproduce the issue on Linux and Windows (No OSX here). Are you Jay Lucky and neurosis13 also on OSX?
Not on OSX, I'm on OpenELEC 6.0.0, Kodi 15.2 Git:02e7013. What can I provide to assist? It only started with the update to the scraper.
RE: [Release] Universal Movie Scraper - Jay Lucky - 2015-12-12
Here's the relevant debug log if that helps, appears similar to above with a PCRE match error.
Code:
13:05:44 T:140689155286784 DEBUG: GetVideoDetails: Reading movie 'http://akas.imdb.com/title/tt0126029/' using Universal Movie Scraper scraper (file: '/storage/.kodi/addons/metadata.universal', content: 'movies', version: '2.7.0')
13:05:44 T:140689155286784 DEBUG: CurlFile::Open(0x6a6dcc0) http://akas.imdb.com/title/tt0126029/
13:05:45 T:140689155286784 DEBUG: Get: Using "UTF-8" charset for HTML "http://akas.imdb.com/title/tt0126029/"
13:05:45 T:140689155286784 DEBUG: scraper: GetDetails returned <details><id>tt0126029</id><originaltitle>Shrek</originaltitle><year>2001</year><chain function="GetIMDBAKATitlesById">tt0126029</chain><chain function="GetIMDBCountryCert">tt0126029</chain><runtime>90</runtime><chain function="GetI
13:05:45 T:140689155286784 DEBUG: scraper: GetIMDBAKATitlesById returned <details><url cache="tt0126029-combined.html" function="ParseIMDBAKATitles">http://akas.imdb.com/title/tt0126029/combined|accept-language=en-us</url></details>
13:05:45 T:140689155286784 DEBUG: CurlFile::Open(0x6a6dcc0) http://akas.imdb.com/title/tt0126029/combined
13:05:46 T:140689155286784 DEBUG: Get: Using "ISO-8859-1" charset for HTML "http://akas.imdb.com/title/tt0126029/combined|accept-language=en-us"
13:05:46 T:140689155286784 DEBUG: scraper: ParseIMDBAKATitles returned <details><title>Shrek</title></details>
13:05:46 T:140689155286784 DEBUG: scraper: GetIMDBCountryCert returned <details><url cache="tt0126029-combined.html" function="ParseIMDBCountryCert">http://akas.imdb.com/title/tt0126029/combined|accept-language=en-us</url></details>
13:05:46 T:140689155286784 DEBUG: scraper: ParseIMDBCountryCert returned <details><mpaa>Rated PG</mpaa></details>
13:05:46 T:140689155286784 DEBUG: scraper: GetIMDBRatingById returned <details><url cache="tt0126029-main.html" function="ParseIMDBRating">http://akas.imdb.com/title/tt0126029/|accept-language=en-us</url></details>
13:05:46 T:140689155286784 ERROR: PCRE: Match limit reached
13:05:46 T:140689155286784 DEBUG: scraper: ParseIMDBRating returned <details></details>
13:05:46 T:140689155286784 DEBUG: scraper: GetIMDBTOP250ById returned <details><url cache="tt0126029-main.html" function="ParseIMDBTOP250">http://akas.imdb.com/title/tt0126029/|accept-language=en-us</url></details>
13:05:46 T:140689155286784 DEBUG: scraper: ParseIMDBTOP250 returned <details></details>
13:05:46 T:140689155286784 DEBUG: scraper: GetIMDBGenresById returned <details><url cache="tt0126029-main.html" function="ParseIMDBGenres">http://akas.imdb.com/title/tt0126029/|accept-language=en-us</url></details>
13:05:46 T:140689155286784 DEBUG: scraper: ParseIMDBGenres returned <details><genre>Animation</genre><genre>Adventure</genre><genre>Comedy</genre><genre>Family</genre><genre>Fantasy</genre></details>
13:05:46 T:140689155286784 DEBUG: scraper: GetIMDBStudioById returned <details><url cache="tt0126029-main.html" function="ParseIMDBStudio">http://akas.imdb.com/title/tt0126029/|accept-language=en-us</url></details>
13:05:46 T:140689155286784 DEBUG: scraper: ParseIMDBStudio returned <details><studio>DreamWorks Animation</studio></details>
13:05:46 T:140689155286784 DEBUG: scraper: GetIMDBCountryById returned <details><url cache="tt0126029-main.html" function="ParseIMDBCountry">http://akas.imdb.com/title/tt0126029/|accept-language=en-us</url></details>
13:05:46 T:140689155286784 DEBUG: scraper: ParseIMDBCountry returned <details><country>USA</country></details>Full log if you need it - http://pastebin.com/dK8FMfpg