Lovefilm.se (Swedish) scraper - search uses javascript, can that be bypassed?
#7
vdrfan Wrote:Why not just use http://www.lovefilm.se/movieSearch.do?query=<keyword> ?

Like I said earlier:
filigran Wrote:Yeah, I know. But doing a search for "batman", i.e. http://www.lovefilm.se/movieSearch.do?query=batman gives me a few results. If I select some results, and check the DOM with firefox, I see them:
PHP Code:
<div id="resultAllMovie">
<
div class="resultRow">
<
div class="boxContentTiny">
<
a href="http://www.lovefilm.se/film/49546-Batman.do"
class="showMovieToolTip" rel="49546">
<
strong>Batman</strong> (Action)</a>
</
div

that's the first result.
But checking the source, I get this:
PHP Code:
        <div id="resultAllMovie"></div>
        <
div id="pagesMovie"></div

It's the same if I just wget the page. Am I missing something?
If I search for something that only yields one matching result, like "band of brothers", I get to that movie page directly, and there I can scrape the details. But I need to find the search results too.

Am I just being totally fucking dumb here?
Reply


Messages In This Thread
[No subject] - by spiff - 2010-01-20, 09:16
[No subject] - by The_Ghost16 - 2010-01-20, 11:06
[No subject] - by filigran - 2010-01-20, 12:43
[No subject] - by filigran - 2010-02-02, 23:06
[No subject] - by mkortstiege - 2010-02-03, 01:15
[No subject] - by filigran - 2010-02-03, 15:21
[No subject] - by spiff - 2010-02-03, 15:30
[No subject] - by filigran - 2010-02-05, 02:12
[No subject] - by spiff - 2010-02-05, 11:18
[No subject] - by filigran - 2010-02-06, 23:50
[No subject] - by jojje - 2010-04-20, 22:28
Logout Mark Read Team Forum Stats Members Help
Lovefilm.se (Swedish) scraper - search uses javascript, can that be bypassed?1