Javascript is required - Printable Version +- Kodi Community Forum (https://forum.kodi.tv) +-- Forum: Development (https://forum.kodi.tv/forumdisplay.php?fid=32) +--- Forum: Add-ons (https://forum.kodi.tv/forumdisplay.php?fid=26) +--- Thread: Javascript is required (/showthread.php?tid=312686) |
Javascript is required - antrrax - 2017-04-19 Reformulating the topic not to violate the rules of the forum: How to get html source code on sites that require Javascript without using Selenium WebDriver? Is there any other way? Skipmode A1 Wrote:You can run javascript with nodejs: see here https://github.com/Anorov/cloudflare-scrape I use Windows, and I installed cfscrape in python 2.7: Code: python -m pip install -U pip cfscrape And installed Node.JS Code: https://nodejs.org/dist/v7.9.0/node-v7.9.0-x86.msi I'm trying to get the source code of the site where javascript is required, eg sites hosted on Cloudflare first test in Python IDLE (Windows): Code: import cfscrape But it still did not open Javascript. Could you give me an example of how to use cfscrape with nodejs? Thanks RE: Javascript is required - Skipmode A1 - 2017-04-19 Here some code that seemed to work when i was messing with it a while back: Code: # Make a session RE: Javascript is required - pinoytracker - 2017-04-20 any update on this, Thanks RE: Javascript is required - Franc - 2018-06-03 How fast this method is? I've tried something like this, but it's slow. After 25-30 seconds I get the HTML content. (Cloudfare protection) Code: import cfscrape |