Lovefilm.se (Swedish) scraper - search uses javascript, can that be bypassed?
#4
spiff Wrote:searching using google is the only workaround i'm aware of. btw, scrape.exe is utterly outdated, check the scraper editor.

Yeah, I saw that on the page. The scraper editor, would that be http://forum.xbmc.org/showthread.php?tid=52929 ? I tried that one using wine, but I needed to install mono through wine, and scrape.exe seemed to work properly for just testing. Guess I'll have to fix the Mono stuff for wine to be sure. I'll try using google search. Thanks.

The_Ghost16 Wrote:With the following url you can find a movie:
http://www.lovefilm.se/movieSearch.do?query=
Just paste the movietitle after query= and you will find the movies.
After that is done you can open the movie and you can scrape the result.
This doesn't look that hard.

Yeah, I know. But doing a search for "batman", i.e. http://www.lovefilm.se/movieSearch.do?query=batman gives me a few results. If I select some results, and check the DOM with firefox, I see them:
PHP Code:
<div id="resultAllMovie">
<
div class="resultRow">
<
div class="boxContentTiny">
<
a href="http://www.lovefilm.se/film/49546-Batman.do"
class="showMovieToolTip" rel="49546">
<
strong>Batman</strong> (Action)</a>
</
div

that's the first result.
But checking the source, I get this:
PHP Code:
        <div id="resultAllMovie"></div>
        <
div id="pagesMovie"></div

It's the same if I just wget the page. Am I missing something?
If I search for something that only yields one matching result, like "band of brothers", I get to that movie page directly, and there I can scrape the details. But I need to find the search results too.

Thanks for your replies!
Reply


Messages In This Thread
[No subject] - by spiff - 2010-01-20, 09:16
[No subject] - by The_Ghost16 - 2010-01-20, 11:06
[No subject] - by filigran - 2010-01-20, 12:43
[No subject] - by filigran - 2010-02-02, 23:06
[No subject] - by mkortstiege - 2010-02-03, 01:15
[No subject] - by filigran - 2010-02-03, 15:21
[No subject] - by spiff - 2010-02-03, 15:30
[No subject] - by filigran - 2010-02-05, 02:12
[No subject] - by spiff - 2010-02-05, 11:18
[No subject] - by filigran - 2010-02-06, 23:50
[No subject] - by jojje - 2010-04-20, 22:28
Logout Mark Read Team Forum Stats Members Help
Lovefilm.se (Swedish) scraper - search uses javascript, can that be bypassed?1