Login at Kodi Home

Waffa · (This post was last modified: 2009-01-12, 22:33 by Waffa.)

Jester Wrote:BIG NOTICE !

From 17033 the IMDB scraper DOES NOT WORK ANY LONGER !

they do not allow scraping their web site and XBMC is complying with this.

the new default scraper is themoviedb.org which needs help filling, so please go there and help them (and thus yourself) out

Does this also means that Media Companion and Movie info plus are not allowed to scrape there anymore?

fekker · 2009-01-12, 23:16

My cached data is pulled from the imdb list files, it does not create an online database, is not a commercial application, it's not charging any fees, It does reference IMDB as the source of that data with links to there site.

MIP's cached data is in compliance with the imdb list file usage.

Quote:All data and software released by Internet Movie Database Ltd is
freely available to anyone within certain limitations. You are
encouraged to quote subsets of the database in USENET articles,
movie related FAQs, magazine articles etc. We do ask, however,
that you make reference to the source of the data and provide a
pointer to the database for the benefit of the reader.

MIP also does a standard http query and downloads the same full html page as any other browser, the difference is in how I display that data as I parse it into a different format again with reference to IMDB as the source of that data.

fekker · 2009-01-12, 23:17

My cached data is pulled from the imdb list files, it does not create an online database, is not a commercial application, it's not charging any fees, It does reference IMDB as the source of that data with links to there site.

MIP's cached data is in compliance with the imdb list file usage.

Quote:All data and software released by Internet Movie Database Ltd is
freely available to anyone within certain limitations. You are
encouraged to quote subsets of the database in USENET articles,
movie related FAQs, magazine articles etc. We do ask, however,
that you make reference to the source of the data and provide a
pointer to the database for the benefit of the reader.

MIP also does a standard http query and downloads the same full html page as any other browser, the difference is in how I display that data as I parse it into a different format again with reference to IMDB as the source of that data.

nekrosoft13 · 2009-01-12, 23:25

ultrabrutal Wrote:The first thing that springs to mind when looking at the site, is... Who owns the copyright of fanart and posters? I think there is a grey area there also I'm afraid

offtopic: spiff, have looked into the api info. looks easy to use. any indications on speed vs the others?

can you please be quite, once you are done everything will be a violation.

jmarshall · 2009-01-12, 23:38

Thanks for the heads up on the license issues. Team XBMC will contact IMDb directly and ask for their approval if they are willing to give it.

For the meantime, take the opportunity to contribute to an open database such as themoviedb. If each of us take the time (an hour or so ain't that much) to contribute 10 movies from our collections (obviously NOT just resubmitting IMDb data!) then their collection will swell extremely quickly.

After all, look at how awesome thetvdb is now, thanks to user contributions from people like you and me.

I'll post back once I hear back from IMDb.

Cheers,
Jonathan

ultrabrutal · 2009-01-12, 23:55

nekrosoft13 Wrote:can you please be quite, once you are done everything will be a violation.

You forgot the smiley

jmarshall Wrote:Thanks for the heads up on the license issues

Np I guess. Never thought that spiff would be that radical. Let's just hope imdb guys are cool

warwon · 2009-01-13, 00:03

I like to know more as to why this has to change.

The main reason I use these applications is to pull data from a website such as IMDB.

They have never sent out letters, emails, or anything to other projects.

Mythtv, Meedios are not reporting any issues.

Time to time IMDB changes that function, of scrapping but the coders keep up.

Frak.

Waffa · 2009-01-13, 00:14

fekker Thanx for the reply and aplication.

LaTropa64 · 2009-01-13, 00:14

fekker Wrote:My cached data is pulled from the imdb list files, it does not create an online database, is not a commercial application, it's not charging any fees, It does reference IMDB as the source of that data with links to there site.

MIP's cached data is in compliance with the imdb list file usage.

MIP also does a standard http query and downloads the same full html page as any other browser, the difference is in how I display that data as I parse it into a different format again with reference to IMDB as the source of that data.

I'm going to agree with this. I'm essentially just using XBMC to access imdb.com instead of FireFox or Internet Explorer.

jmarshall · (This post was last modified: 2009-01-13, 00:28 by jmarshall.)

As I said in the other thread, Team XBMC has contacted IMDb and will leave the IMDb scraper disabled until we hear from them. Note that we were not contacted from IMDb, but are simply responding to a users' request.

It is unclear to the team as to whether we're doing anything wrong or not, so given that, the wisest action is to cease distributing the scraper until we are certain that we are doing things correctly.

In the meantime, please spend some time contributing data to themoviedb so that it's available to others. If we all spend an hour or two submitting data (not just copy + pasted from IMDb, ofcourse!) on some of our own movies, it will benefit the entire community.

Thanks for your understanding.

Cheers,
Jonathan

rodalpho · 2009-01-13, 02:23

Not that any of us would knowingly violate their TOS, and I certainly didn't do it myself, but just for academic purposes, do you mind if I post how to reenable the scraper?

warwon · 2009-01-13, 02:45

This is odd, oh well no more updating until it gets back.

I refuse to lose that ability for imdb Tongue

mr.b · 2009-01-13, 02:51

not saying hoorah or anything for this latest development (although it is reversable if need be), but this may lead to some speed improvements if we end up with a setup that periodically keeps a local cached copy of imdb and periodically updates it (http://www.imdb.com/interfaces).

ultrabrutal · 2009-01-13, 09:55

rodalpho Wrote:just for academic purposes, do you mind if I post how to reenable the scraper?

Well you look at what spiff did in the revision where he disabled the scraper. Undo this to the source and rebuild

Gamester17 · 2009-01-13, 11:28

jmarshall Wrote:As I said in the other thread...

For reference, here is a link to that other thread => http://forum.xbmc.org/showthread.php?tid=43626