[Larry_Lobster]

Hello every one,

currently I try to write my first scraper (amazon.de) in order to parse album information.

It took me some time to recognize that my web browsers (IE and Firefox) return different web sites for the same request as the scraper does.

Does anyone know what's the reason for this behaviour. Maybe it's because of the locale of the browser?

Thanks fpr your help.

Kind regards
Larry_Lobster

[spiff]

this is likely based on user agent.

[Larry_Lobster]

this is likely based on user agent.

Is it possible to configure the user agent xbmc uses?

[artem]

Is it possible to configure the user agent xbmc uses?

add "|User-Agent=<your-user-agent>" after url

something like this:

Code:

http://www.kinopoisk.ru/index.php?level=7&from=forma&result=adv&m_act%5Bfrom%5D=forma&m_act%5Bwhat%5D=content&m_act%5Bfind%5D=\1&m_act%5Byear%5D=$$2|User-Agent=Mozilla%2F5.0%20(X11%3B%20U%3B%20Linux%20i686%3B%20en-US%3B%20rv%3A1.8.1.14)%20Gecko%2F20080418%20Ubuntu%2F7.10%20(gutsy)%20Firefox%2F2.0.0.14