+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302)
+----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821)
Pages:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
RE: [Release] Universal Scraper - Martijn - 2012-06-24
TMDB api update:
api.themoviedb.org/3/search/movie?api_key=####&query=alien&year=1979
year can now be used as optional parameter.
http://help.themoviedb.org/kb/api/search-movies
RE: [Release] Universal Scraper - olympia - 2012-06-24
The Universal Scraper uses IMDb as a search engine.
However, I just updated the default TMDb scraper with this. Thanks for the pointer!
RE: [Release] Universal Scraper - krish_2k4 - 2012-06-30
hey just a quick question.
I just want to rescrape movie trailers as I just found out some of my movies have none. how do i do this without rescraping all the info/thumbs/fanart?
RE: [Release] Universal Scraper - olympia - 2012-06-30
you can't.
RE: [Release] Universal Scraper - krish_2k4 - 2012-07-01
(2012-06-30, 22:56)olympia Wrote: you can't.
ok, i think ember media manager allows you to rescrape all trailers.
Just hoped there was an easier way to do this with the scraper. like an option to rescrape all trailers only.
thanks anyway.
RE: [Release] Universal Scraper - olympia - 2012-07-01
Well, even if you re-scrape the trailers in EMM, you will need to re-scan everything in XBMC to import those links, so it's almost the same.
RE: [Release] Universal Scraper - krish_2k4 - 2012-07-01
(2012-07-01, 14:07)olympia Wrote: Well, even if you re-scrape the trailers in EMM, you will need to re-scan everything in XBMC to import those links, so it's almost the same.
EMM will tell me which trailers are missing so won't have to rescrape all the info/posters/fanart for each movie. I can just rescrape trailers only.
I just want to update all the trailers only, ill have to re-scan the movies into XBMC again but will have no choice but to do it!
It is kinda of my fault really, i should of just grabbed trailers from the start, mark it down as a lesson learned!
RE: [Release] Universal Scraper - truthlesshero - 2012-07-17
so..i'm having huge trouble with xbmc, as far as getting info and working it into a "media center"...
the videos play fine...but the library will not work for the life of me
i added the folder/source without a problem, but i wanted the rotten tomatoes rating, along with the imdb info (plot, cast, running time, etc)...so i set up the options as such in the universal scraper addon
the problem is that it won't even get the info...it just does nothing. The first time i loaded the source, it still got the imdb rating..it basically showed up as how it was before i installed the addon..so i disabled the default addon and used the universal scraper one instead, with the settings i chose
i added the content..and nothing happens, no info, nothing shows up..
i've tried deleting the source, readding it...nothing happens...thet "movies" options under videos doesn't even appear anymore...so..can anyone help me out...
thanks...
edit: nevermind, got it to work...had to reset a few things to get it to work....it now shows the imdb info + rt ratings...woohoo!
RE: [Release] Universal Scraper - zeppy - 2012-07-23
Hi all.
I've just started using XBMC, and I immediately found this great scraper that allows me to scrape rotten tomatoes scores. I've seen in previous posts, though, that the RT scraping part is not perfect due to some problems on RT side not directly correctable by the scraper.
I read the documentation on the wiki on the creation of scrapers and I see that some things cannot be done (like showing a second selection window only for RT), but I got some ideas while reading and I was wondering if one of these solutions may actually help in retrieving the correct result (perhaps letting the users decide in scarper settings which RT scraping method to use).
Method 1 - Use RT directly:
- get the usual stuff from IMDB
- query RT the standard way (i.e. http://www.rottentomatoes.com/search/?search={title + optionally year})
- on the resulting page, check all presented results through regexp looking for the one that matches the title AND the year (or whose year is closest - not sure this can be done)
- get the actual movie url and scrape data as usual
I'm not sure this is a viable option, it's a variation (simplification?) of what has already been proposed and said not possible. I was wondering though if, using nested regexp and custom functions, the whole searching-in-results thing was possible...
Method 2 - Use good, old google:
- get the usual stuff from IMDB
- search google for title, year and site (with site:rottentomatoes.com, something like: http://www.google.com/#hl=en&q={title}+{year} +site:rottentomatoes.com)
- get the very first result and hope for the best
I'm a bit more confident about the viability of this second option, even though I'm not sure the "double jump" (google first, RT later) is doable with the current framework. I wasn't able to find enough documentation on the wiki regarding this possibility...
Re: [Release] Universal Scraper - Martijn - 2012-07-23
IIRC this was already discussed and the outcome was that RT just needs to fix their site.
If we are gonna create difficult workaround they will never get things done.
RE: [Release] Universal Scraper - olympia - 2012-07-23
At least the viability of these ones are better
RE: [Release] Universal Scraper - olympia - 2012-07-25
Can you open another thread for your mod/fork please and modify your above post and have only the link in their for your new thread?
Thanks!
RE: [Release] Universal Scraper - Martijn - 2012-07-25
There you go
RE: [Release] Universal Scraper - zeppy - 2012-07-25
Thanks Martijn!
We almost overlapped in the edit!
RE: [Release] Universal Scraper - o.maille - 2012-07-25
I am yet to try this out but I do have one question; is it possible to have a scraper use more than one source for a field;
If the film name is not found on IMDB, it will then search RT etc......
If so could a local database be specified as a final source?
I have short movies and various other bits and pieces that will never be on IMDB etc. and it's irritating that they cannot be in the library.