2011-01-31, 20:38
Hey there all,
I am working on a plugin that scrapes a site for links and then displays them in xbmc.
However, site itself is a content aggregation site that embeds videos from other sites (megavideo, etc etc) in their own webpages. So what ends up happening when I fetch the "most popular links of the last 7 days" is that I end up having to traverse each link, go to the local page with the embedded video on it then then goto the actual 3rd party site to get the file to play
As you can imagine its a bit slow loading. Is there anyway to speed up this fetching? Maybe via parallel fetching of the links on the page? Or any other way?
I know there are python libraries that do this but was wondering if anyone has any experience integrating them into xbmc.
Thanks.
I am working on a plugin that scrapes a site for links and then displays them in xbmc.
However, site itself is a content aggregation site that embeds videos from other sites (megavideo, etc etc) in their own webpages. So what ends up happening when I fetch the "most popular links of the last 7 days" is that I end up having to traverse each link, go to the local page with the embedded video on it then then goto the actual 3rd party site to get the file to play
As you can imagine its a bit slow loading. Is there anyway to speed up this fetching? Maybe via parallel fetching of the links on the page? Or any other way?
I know there are python libraries that do this but was wondering if anyone has any experience integrating them into xbmc.
Thanks.