User-agent question - Printable Version +- Kodi Community Forum (https://forum.kodi.tv) +-- Forum: Development (https://forum.kodi.tv/forumdisplay.php?fid=32) +--- Forum: Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=60) +--- Thread: User-agent question (/showthread.php?tid=61789) |
User-agent question - BAG_Ass - 2009-11-16 Hi guys! I have troubles with user agent on local site kinopoisk.ru (moviefinder) i have this error: Sorry - this address banned... Your IP: 1.1.1.1 UserAgent: XBMC/9.11-alpha1 r24368 (Mac OS X; Darwin 10.2.0; SVN r24368; http://www.xbmc.org) Referer: http://www.kinopoisk.ru/index.php?kp_query=Up Kinopoisk.ru. I think troubles with user-agent string cose i can load site from browsers (opera, safary, chrome) without troubles. Thanks for advices! - spiff - 2009-11-16 you can set the user-agent by tacking on |User-Agent=agent to the url. agent should be url encoded. - BAG_Ass - 2009-11-17 can u give me example how i should write url tag? and from which version it is work? Thanks! - spiff - 2009-11-17 if you want to set agent 'some-app v1 (Linux;andsoon)' for http://www.some.where/foo?bar=1 you do Code: http://www.some.where/foo?bar=1|User-Agent=some-app+v1+(Linux%3bandsoon) - BAG_Ass - 2009-11-17 tx i added to url |User-Agent: <RegExp input="$$1" output="<details><url function="GetKPPoster">http://www.kinopoisk.ru/level/17/film/\1|User-Agent=Mozila/4.0 (compatible; MSIE 7.0; Windows NT 6.0)</url></details>" dest="5"> Nothing happens - the same text in log. - DonJ - 2009-11-17 I'd first check if it's actually contingent on the User agent (use for example https://addons.mozilla.org/en-US/firefox/addon/59 to change you firefox user agent to XBMC/9.11-alpha1). If that's not the case maybe referrer spoofing is necessary (test with e.g. https://addons.mozilla.org/en-US/firefox/addon/953). - BAG_Ass - 2009-11-17 DonJ I need change XBMC user-agent to other (for example mozila) - DonJ - 2009-11-17 Bag_Ass, no you don't. I just tried to access http://www.kinopoisk.ru/index.php?kp_query=Up with a XBMC user agent using https://addons.mozilla.org/en-US/firefox/addon/59 and it worked fine. - BAG_Ass - 2009-11-17 DonJ Lets try to access to http://www.kinopoisk.ru/index.php?kp_query=Up and go by 1st url from scraper and if it will sucsess without additional tools i choose ur point of view. Now in windows Proximition - rulezzz but for mac |