[RELEASE] Scraper Editor (Based on ScraperXML open source C# Library) - Help wanted!
#28
redtapemedia Wrote:Also, just played around briefly with your editor, but how does testing work? Is there a way I can just specify a movie name and then have it step through the scraper? Managed to get it to step through one function by pasting in the HTML of a website, but I can't get it to go through the entire thing.

ah not til i release the version i'm working on at the moment. currently you can only throw information at it on a per function basis....

actually if you start with the Create search results function you can step through a scraper quite easily, just (making sure you have version 2.15 which is up for download at my sourceforge ScraperXML site) click the Set Buffers checkbox in the tester, change one of the buffers to 1 - using the numeric up/down control on the left, type in the name and press url encode then set, and then run or step through the CreateSearchUrl Function copy and paste the return to the url textbox in the tester, and pres download to $$1, then run the getsearchresults function, from the details there copy one of the results url to url textbox change one of the buffers to $$2 and put in the id (if provided by the search results, and in the $$ put in the url of the page being downloaded, press download to $$1 and then execute the function or walk through it) my next release will have the ability to do this automatically.


redtapemedia Wrote:Another thing that would be useful to a regular expression noob like me is context highlighting of regular expressions, similiar to how http://gskinner.com/RegExr/ does it.

Thanks for all your hard work.

That's going to be some work there (I am STILL an amateur coder), but i'll work on it.

redtapemedia Wrote:I've been tearing my hair out for the last week trying to modify the IMDB scraper to return rotten tomatoes ratings, so creation of include files support would greatly benefit me.

the include files are a new feature coming to XBMC, its scraper functions that can be shared amongst scrapers, (Read the last few posts between me and spiff above).
ScraperXML Open Source Web Scraper Library compatible with XBMC XML Scrapers


I Suck, and if you act now by sending only $19.95 and a self addressed stamped envelop, so can you!

Image
Reply
 
Thread Rating:
  • 1 Vote(s) - 5 Average


Messages In This Thread
[No subject] - by spiff - 2009-06-16, 00:14
[No subject] - by DonJ - 2009-06-16, 00:46
[No subject] - by zag - 2009-06-16, 10:13
[No subject] - by Nicezia - 2009-06-17, 00:38
[No subject] - by C-Quel - 2009-06-17, 00:45
Nice Nicezia! - by Gamester17 - 2009-06-17, 12:11
[No subject] - by DonJ - 2009-06-17, 12:38
[No subject] - by Nicezia - 2009-06-18, 18:10
[No subject] - by Nicezia - 2009-06-20, 21:28
[No subject] - by DonJ - 2009-06-21, 13:40
[No subject] - by Nicezia - 2009-06-23, 00:34
[No subject] - by Nicezia - 2009-06-27, 23:46
[No subject] - by Eso Rimmer - 2009-07-18, 09:02
[No subject] - by Nicezia - 2009-07-18, 17:34
[No subject] - by Daniel Malmgren - 2009-07-20, 19:03
[No subject] - by Nicezia - 2009-07-21, 21:24
[No subject] - by spiff - 2009-07-28, 00:43
[No subject] - by spiff - 2009-07-28, 01:24
[No subject] - by Nicezia - 2009-07-28, 02:20
[No subject] - by spiff - 2009-07-28, 09:29
[No subject] - by spiff - 2009-07-28, 23:45
[No subject] - by Nicezia - 2009-07-29, 03:20
[No subject] - by Nicezia - 2009-08-04, 04:25
[No subject] - by seedzero - 2009-08-04, 04:38
[No subject] - by Nicezia - 2009-08-04, 05:19
[No subject] - by seedzero - 2009-08-04, 06:47
[No subject] - by spiff - 2009-08-04, 09:40
[No subject] - by seedzero - 2009-08-04, 09:58
[No subject] - by Nicezia - 2009-08-04, 10:20
[No subject] - by spiff - 2009-08-04, 10:33
[No subject] - by Nicezia - 2009-08-04, 12:45
[No subject] - by spiff - 2009-08-04, 12:49
[No subject] - by seedzero - 2009-08-04, 22:58
[No subject] - by spiff - 2009-08-04, 23:03
[No subject] - by Daniel Malmgren - 2009-08-12, 18:56
[No subject] - by Nicezia - 2009-08-12, 21:20
[No subject] - by Daniel Malmgren - 2009-08-12, 21:41
[No subject] - by Nicezia - 2009-08-12, 23:17
[No subject] - by Daniel Malmgren - 2009-08-13, 07:46
[No subject] - by flobbes - 2009-08-28, 09:46
[No subject] - by Daniel Malmgren - 2009-08-28, 19:09
[No subject] - by flobbes - 2009-08-28, 20:16
[No subject] - by Nicezia - 2009-08-29, 04:56
[No subject] - by jurr - 2009-09-07, 13:29
[No subject] - by Nicezia - 2009-09-07, 20:14
[No subject] - by Nicezia - 2009-09-07, 20:17
[No subject] - by Daniel Malmgren - 2009-09-27, 12:41
[No subject] - by Nicezia - 2009-10-06, 00:19
version 3.5 Release - by Nicezia - 2009-10-11, 11:38
[No subject] - by Daniel Malmgren - 2009-10-11, 16:26
[No subject] - by Nicezia - 2009-10-12, 03:27
[No subject] - by Daniel Malmgren - 2009-10-12, 19:28
[No subject] - by Nicezia - 2009-10-13, 19:38
[No subject] - by flobbes - 2009-10-16, 18:57
[No subject] - by seedzero - 2009-10-16, 19:03
[No subject] - by fekker - 2009-10-17, 01:56
[No subject] - by seedzero - 2009-10-17, 02:22
[No subject] - by seedzero - 2009-10-17, 13:16
[No subject] - by KoTiX - 2009-10-17, 19:55
[No subject] - by fekker - 2009-10-17, 19:56
[No subject] - by SantaFox - 2009-10-20, 14:34
[No subject] - by Nicezia - 2009-10-24, 00:13
[No subject] - by flobbes - 2009-10-28, 13:28
[No subject] - by Nicezia - 2009-10-28, 16:41
[No subject] - by Nicezia - 2009-10-28, 16:42
[No subject] - by flobbes - 2009-10-28, 17:05
[No subject] - by Nicezia - 2009-10-28, 17:08
[No subject] - by Nicezia - 2009-10-28, 17:10
[No subject] - by KoTiX - 2009-10-29, 00:03
[No subject] - by Nicezia - 2009-10-31, 03:42
[No subject] - by KoTiX - 2009-10-31, 10:04
[No subject] - by Nicezia - 2009-10-31, 17:23
[No subject] - by KoTiX - 2009-10-31, 17:35
[No subject] - by Nicezia - 2009-10-31, 19:10
allmusic.xml - by michael1t - 2009-11-05, 17:54
[No subject] - by Nicezia - 2009-11-05, 20:37
New Version Soon! - by Nicezia - 2009-12-20, 03:29
[No subject] - by MukiDA - 2009-12-20, 07:26
[No subject] - by MukiDA - 2009-12-23, 00:40
[No subject] - by Nicezia - 2009-12-23, 02:03
No Editor source in SVN? - by hojel - 2009-12-24, 08:00
[No subject] - by Nicezia - 2009-12-24, 11:26
[No subject] - by hojel - 2009-12-24, 13:02
[No subject] - by MukiDA - 2009-12-24, 15:20
[No subject] - by hojel - 2009-12-24, 23:25
[No subject] - by Nicezia - 2009-12-25, 01:29
[No subject] - by DuMbGuM - 2009-12-29, 06:07
[No subject] - by Nicezia - 2009-12-29, 22:31
[No subject] - by DuMbGuM - 2009-12-30, 01:45
[No subject] - by wikid - 2010-01-05, 19:34
[No subject] - by flobbes - 2010-01-27, 14:32
[No subject] - by Nicezia - 2010-01-28, 18:58
[No subject] - by flobbes - 2010-01-28, 20:39
[No subject] - by Nicezia - 2010-01-28, 23:51
[No subject] - by flobbes - 2010-01-29, 01:10
[No subject] - by Nicezia - 2010-01-29, 03:48
[No subject] - by Nicezia - 2010-01-29, 05:52
[No subject] - by flobbes - 2010-01-29, 13:00
[No subject] - by Nicezia - 2010-01-29, 21:28
[No subject] - by flobbes - 2010-01-30, 18:36
[No subject] - by Nicezia - 2010-01-30, 19:26
[No subject] - by flobbes - 2010-01-30, 23:23
[No subject] - by takoi - 2010-02-06, 15:57
[No subject] - by filigran - 2010-02-07, 00:07
[No subject] - by Nicezia - 2010-02-08, 04:38
[No subject] - by Nicezia - 2010-02-08, 04:55
[No subject] - by filigran - 2010-02-08, 23:18
[SOLVED] repeat function - by drascom - 2010-04-16, 15:47
[No subject] - by Nicezia - 2010-05-29, 20:16
[No subject] - by Nicezia - 2010-06-03, 02:45
[No subject] - by olympia - 2010-06-03, 16:52
[No subject] - by spiff - 2010-06-03, 16:55
[No subject] - by olympia - 2010-06-03, 17:22
[No subject] - by spiff - 2010-06-03, 17:24
[No subject] - by Nicezia - 2010-06-03, 22:32
[No subject] - by Nicezia - 2010-06-03, 22:34
[No subject] - by olympia - 2010-06-06, 16:10
[No subject] - by Nicezia - 2010-06-07, 02:56
[No subject] - by Nicezia - 2010-06-10, 20:41
Help Request: - by Nicezia - 2010-06-14, 03:05
[No subject] - by jmarshall - 2010-06-14, 04:52
[No subject] - by Nicezia - 2010-06-14, 06:12
[No subject] - by jmarshall - 2010-06-14, 06:38
[No subject] - by Nicezia - 2010-07-03, 23:51
[No subject] - by UsagiYojimbo - 2010-07-16, 20:21
[No subject] - by Nicezia - 2010-07-17, 00:41
[No subject] - by UsagiYojimbo - 2010-07-18, 20:26
[No subject] - by Nicezia - 2010-10-05, 00:23
[No subject] - by flobbes - 2010-10-05, 21:38
[No subject] - by Nicezia - 2010-11-28, 00:41
[No subject] - by UsagiYojimbo - 2011-03-07, 17:40
[No subject] - by mortstar - 2011-03-31, 02:53
[No subject] - by akuiraz - 2011-04-06, 08:20


Logout Mark Read Team Forum Stats Members Help
[RELEASE] Scraper Editor (Based on ScraperXML open source C# Library) - Help wanted!51