get webpage content with html loaded by javascript
#1
how get any webpage content with html loaded by javascript
like this python example http://webscraping.com/blog/Scraping-Jav...th-webkit/
I know it's not possible, I want solutions
Reply
#2
You link is 404 Not Found

Not sure what you want to do... in add-ons there is something called Chrome Launcher, does lean back stuff etc. You might have to pick it up from the forums, still works for me with Kodi 15
Reply
#3
(2015-08-02, 21:57)PatK Wrote: You link is 404 Not Found

Not sure what you want to do... in add-ons there is something called Chrome Launcher, does lean back stuff etc. You might have to pick it up from the forums, still works for me with Kodi 15

Sorry, i send new link. i want one variable with website html and html loaded by javascript.
http://webscraping.com/blog/Scraping-Jav...th-webkit/
Reply
#4
You can use tools like the one you posted (or others like ghost, phantomjs or selenium) for your personal use (depending on the OS you're running) but it will be a pain in the ass (not to say impossible) to package and distribute your addon for others.
Another alternative is to create and host a webservice somewhere that runs one of those tools and that can be called from your python script as if it was an api (it won't probably work well if your addon has a lot of users).

Unfortunately, your best bet is to reverse the javascript code and port it to python, so your addon can resolve the final html code. In a distant future, with CEF probably incorporated (see: http://esmasol.de/open-source/kodi-add-o...b-browser/) kodi might support html5 based addons and solve this issue in a different way.

Cheers
Reply

Logout Mark Read Team Forum Stats Members Help
get webpage content with html loaded by javascript0