Kodi Community Forum
There's obviously been a slight change in akas.imdb.com - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Development (https://forum.kodi.tv/forumdisplay.php?fid=32)
+--- Forum: Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=60)
+--- Thread: There's obviously been a slight change in akas.imdb.com (/showthread.php?tid=53886)

Pages: 1 2

There's obviously been a slight change in akas.imdb.com - Nicezia - 2009-07-02

akas.imdb.com no longer pulls actor info...

if you change the second reg exp in GetMovieCast to

Code:
<img src="(?:([^"]*\.)[^"]*(\.jpg))?[^>]*[^"]*"nm"><a href="[^"]*[^>]*>([^<]*)<[^"]*"ddd"> ... [^"]*"char">(.*?)</td>

it works again

- jmarshall - 2009-07-02

This is the second proposed fix for this. Unless they're put on trac, they will be lost in the forum noise (just like the other one obviously already is!)

- Nicezia - 2009-07-02

how's about i just submit a patch?

as soon as i figure out how to do that

- jmarshall - 2009-07-02

That's exactly what I'm suggesting Smile

xbmc.org/trac

- Nicezia - 2009-07-02

ok i can't figure this out, i go to the trac page, and it sends me to the How to submit a patch wiki, and that sends me back to the trac page

- jmarshall - 2009-07-02

1. Login using forum credentials.
2. Click "New ticket".

- Nicezia - 2009-07-02

allrighty

done

now that i know how to do that i can submit a multitude of patches i've been sitting on

- ultrabrutal - 2009-07-02

cool, now you're at it and such a scraper shark by now Wink perhaps you can look at this problem? http://trac.xbmc.org/ticket/6821
I tried to figure out how to fix it myself, but I'm not familiar enough with the source

looking forward to your release of new scraperxml - so I can finish off my scraper in progress Smile

- Nicezia - 2009-07-02

The Scraper Editor should be able to help you finish your scraper, the scraperXML will be out soon, the problem i'm running into right now (I think my code is solid) is that the IMDB scraper is broken in quite a few places, and i'm usually use it to test since its the most complicated scraper in the litter.

What exactley are you trying to accomplish passwording the NFOUrl? i would suggest putting the passwording function in the actuall executing functions that work with content. NfoUrl if i understand works as a chain effect, in other words no settings are run because when the program checks a URL in a NFO it checks it against all the scrapers, and settings are not exactley neccesssary if this is the case since the scraper is only executed if there is a match.

Now I'm not exactley sure that this is the way things work, you'd have to ask spiff or one of the other coders, but if you want to use a password function that should probably go in GetDetails(if you want to block out the NFOUrl option) and CreateSearchUrl (which is the first real function to run with Settings, during a full scraper execution)

now if you're trying to create login info, i don't think that'll be possible in the NFOUrl

But i think this whole discussion falls under the heading of threadjacking

- ultrabrutal - 2009-07-02

well the site I use needs login/password for all functions, including searching for imdb no's - not only GetDetails. GetSearchResult works fine with params.
Perhaps I do not understand NfoUrl correctly. I look at CreateSearchUrl as a way to get a search for title where NfoUrl gives me a way to search for imdb no if I have one in a nfo file for example.
I don't understand why all scrapers would be probed if I have selected mine I don't really want it to use any other - but I can see that it does never the less.
I have modeled my scraper pretty much from tmdb as the site works in a very similar way - just with the added params for login/password for all functions.

tmdb NfoUrl:

<url function="GetTMDBId">http://api.themoviedb.org/2.0/Movie.imdbLookup?imdb_id=tt\2&amp;api_key=57983e31fb435df4df77afb854740ea9</url>

I wonder that the function="GetTMDBId" does? It outputs:

<url>http://api.themoviedb.org/2.0/Movie.getInfo?id=\1&amp;api_key=57983e31fb435df4df77afb854740ea9</url><id>\1</id>

Now my NfoUrl does this:

<url>https://api.mymovies.dk/Default.aspx?command=SearchIMDBId&imdbid=tt\2&username=$INFO[username]&password=$INFO[password]&country=$INFO[country]&includeenglish=$INFO[includeenglish]&includeadult=$INFO[includeadult]</url>

Perhaps I need to add the params to a GetTMDBId in a similar way? Might be my error

Sorry for hijacking your thread. Just thought it might be a problem for you too and your code, but of course not if I'm sidetracked in my implementation Wink

- spiff - 2009-07-02

as i already responded in the ticket, we currently do not pass settings to the NfoUrl function. it's a todo and until that is done all effort is useless.

- ultrabrutal - 2009-07-02

oh thanks spiff. didn't realise you had answered there. guess I have to postpone completing this long awaited scraper then or give the xbmc source a go again

- Nicezia - 2009-07-02

nfoUrl doesn't do anything but compare the website address in a file to the "Format" of the scraper's "Url" - just make a shadow to copy the "login" & password to its proper place in the nfo (in other words put that in the nfoUrl (on your own computer in your folder next to your file)


for instance

Code:
<NfoUrl dest ="7">
   <RegExp input="$$1" output=<url>http://\1:\[email protected]/\3 dest ="7">
        <expression>http:\\([^:]):([^@)@www.wherever.com/([^\.]*)\.html</expression>
  </RegExp>
</NfoUrl>

and the file on your computer would contain
Code:
http://$username$:$password$@www.wherever.com/whevetver.html


where $username$ and $password$ are your personal info
i think that would be the only way to use nfoUrl to do what you're trying

- Nicezia - 2009-07-02

more precisely implemented for your code as far as NfoUrl goes


Code:
<NfoUrl dest ="3">
   <RegExp input="$$1" output="&lt;url&gt;https://api.mymovies.dk/Default.aspx?command=SearchIMDBId&amp;imdbid=\1&amp;username=\2&amp;password=\3&amp;country=\4&amp;includeenglish=\5&amp;includeadult=\6&lt;/url&gt;" dest ="3">
        <expression>https://api.mymovies.dk/Default.aspx?command=SearchIMDBId&amp;imdbid=([t0-9]*)&amp;username=([^&amp;])&amp;password=([^&amp;])&amp;country=([^&amp;])&amp;includeenglish=(yes | no)&amp;includeadult=(yes | no)</expression>
  </RegExp>
</NfoUrl>
just use reg expressions to copy the info where its supposed to be in the url address... this doesn't at all seem neccessary to use settings to replace this info since all nfoUrl does is compare and copy info out of a Url to download

- ultrabrutal - 2009-07-03

Thanks Nicezia, but I am afraid that won't work Sad It is a requirement that username+password from scraper settings are used...

Code:
<GetSettings dest="3"><RegExp input="$$5" output="&lt;settings&gt;\1&lt;/settings&gt;" dest="3"><RegExp input="$$1" output="&lt;setting label=&quot;Username&quot; type=&quot;text&quot; id=&quot;username&quot;&gt;&lt;/setting&gt;" dest="5+"><expression></expression></RegExp><RegExp input="$$1" output="&lt;setting label=&quot;Password&quot; type=&quot;text&quot; option=&quot;hidden&quot; id=&quot;password&quot;&gt;&lt;/setting&gt;" dest="5+"><expression></expression></RegExp><RegExp input="$$1" output="&lt;setting type=&quot;sep&quot;&gt;&lt;/setting&gt;" dest="5+"><expression></expression></RegExp><RegExp input="$$1" output="&lt;setting label=&quot;Country&quot; type=&quot;labelenum&quot; values=&quot;Albania|Andorra|Argentina|Australia|Austria|Bahrain|Belarus|Belgium|Bosnia and Herzegovina|Brazil|Bulgaria|Canada|China|Croatia|Cyprus|Czech Republic|Denmark|El Salvador|Estonia|Faroe Islands|Finland|France|Georgia|Germany|Gibraltar|Greece|Greenland|Hong Kong SAR|Hungary|Iceland|India|Indonesia|Iran|Iraq|Ireland|Israel|Italy|Japan|Jordan|Korea|Korea, North|Kuwait|Latvia|Lebanon|Liechtenstein|Lithuania|Luxembourg|Macedonia, F.Y.R.O.|Malta|Mexico|Moldova|Monaco|Mongolia|Netherlands|New Zealand|Norway|Oman|Poland|Portugal|Qatar|Romania|Russia|San Marino|Saudi Arabia|Slovakia|Slovenia|South Africa|Spain|Sweden|Switzerland|Syria|Taiwan|Turkey|Ukraine|United Arab Emirates|United Kingdom|United States|Vatican City|Yemen&quot; id=&quot;country&quot; default=&quot;United States&quot;&gt;&lt;/setting&gt;" dest="5+"><expression></expression></RegExp><RegExp input="$$1" output="&lt;setting label=&quot;Include US, UK or AU titles&quot; type=&quot;bool&quot; id=&quot;includeenglish&quot; default=&quot;true&quot;&gt;&lt;/setting&gt;" dest="5+"><expression></expression></RegExp><RegExp input="$$1" output="&lt;setting label=&quot;Include adult movies&quot; type=&quot;bool&quot; id=&quot;includeadult&quot; default=&quot;false&quot;&gt;&lt;/setting&gt;" dest="5+"><expression></expression></RegExp><expression noclean="1"></expression></RegExp></GetSettings>

I guess I have to wait for Spiff to give this todo a priority or give it a crack myself again (have tried to fix it in the source).

I'm looking forward to your test application. Perhaps there will be a function to test NfoUrl also? Wink