2009-09-24, 11:32
I tried to write a scraper for a german adult movie site (not safe for work if somebody tries the url :o ), I've got everything done but I can't get the Search working.
I used wireshark and saw that it needs spoofing and I looked up some other examples (adultfilmdatabase, asiandb) but I can't get it working, although I used the data that I found with wireshark.
My Code looks like this:
Are there any more possible parameters like post="true" or what else could prevent the scraper from getting the data?
I used wireshark and saw that it needs spoofing and I looked up some other examples (adultfilmdatabase, asiandb) but I can't get it working, although I used the data that I found with wireshark.
My Code looks like this:
Code:
<url spoof="http://www.mascottefilm.com/12/Search-Movie" post="true">www.mascottefilm.com/12/Search-Movie?isSubmited=true&search=\1&rights=&Release=&FilmCategorieId=&FilmLabelId=&FilmProducerId=&FilmRegieId=</url>
Are there any more possible parameters like post="true" or what else could prevent the scraper from getting the data?