HOW-TO write Media Info Scrapers - Scraper creation for dummies

  Thread Rating:
  • 1 Vote(s) - 5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
budswell Offline
Junior Member
Posts: 37
Joined: Feb 2012
Reputation: 1
Post: #31
(2012-04-19 07:36)akuiraz Wrote:  Is there a replacement for scrap.exe as it seems to be retired? anything to make editing and testing the scraper along the way would be extremely helpful... i'm on windows. thanks in advance.
(2012-12-31 13:10)DiMag Wrote:  The likn to your tool to test scrapers, reported on page 1, is dead. As it is perhaps the most useful tool to any would-be scraper developer, can you update it/provide an alternative?

Use this one:
http://forum.xbmc.org/showthread.php?tid=145204

Did my first ever scraper yesterday. The tool was invaluable
find quote
PhAzE Offline
Junior Member
Posts: 27
Joined: Mar 2013
Reputation: 0
Post: #32
Has there been a scraper written yet with an auto update/refresh option? Say you scroll through your movie list, and stop on a movie, after a set time (say 5 or 10 seconds, can be set in the options) the scraper kicks in an does a refresh on that highlighted movie/show. There can be an option to get metadata locally only, or internet only so no user interaction is required for the refresh to occur.

Perhaps it can refresh other items in that movie list too when idle in the menu as to not use cpu cycles while users are scrolling around and stops after user interaction happens. Sorry if i posted this in the wrong thread, but I was curious if one exists that does this yet?
find quote
curswine Offline
Junior Member
Posts: 35
Joined: Jul 2013
Reputation: 2
Post: #33
I'm totally new at this and trying to learn how to create a scraper for some soccer events, the guide seems very thoughtful and I appreciate all the hard work put into it, but as a dummy (HTML editing is about my limit) I am finding it a little bit difficult to use.

- Some of the links are outdated (http://wiki.xbmc.org/?title=Scrap gets redirected) with the guide being six years old.
- I've noticed a piece of syntax is using a ) rather than a > so if there are others wrong I probably won't spot the problem.
- Also the use of a Spanish scraper in chapter two baffles me even further with coping with the change in language.

Is there an updated/reworked version of this guide available at all or any other resources that could help me figure everything out?

Thanksss
find quote
and7ey Offline
Member
Posts: 68
Joined: Jan 2014
Reputation: 0
Post: #34
(2008-08-27 13:41)pko66 Wrote:  Tool to test scrapers: http://wiki.xbmc.org/?title=Scrap (Download NOW both files, scrap.exe & libcurl.dll)
is there any similar tool to test scrapers on Mac?

Upd. ScraperEdit (http://forum.xbmc.org/showthread.php?tid=145204) works on Mac. Suggest to update the wiki/post.
(This post was last modified: 2014-03-13 09:30 by and7ey.)
find quote
Opium Offline
Junior Member
Posts: 21
Joined: Sep 2012
Reputation: 0
Post: #35
Where are the existing scrapers stored?

Forgive me if i'm blind and or stupid but I can't see this written anywhere. A search for *craper gives me:

/home/<user>/.xbmc/temp/scrapers
/usr/share/xbmc/addons/xbmc.metadata/scraper.xsd

Neither of which seem to be what i'm looking for: the temp scrapers folder seems to just be the return result of the scraper and the XSD is a schema?
find quote
Martijn Offline
Team Kodi
Posts: 16,923
Joined: Jul 2011
Reputation: 310
Location: Dawn of time
Post: #36
/usr/share/xbmc/addons/

and those are only the initial shipped version. any update end up in userdata

Read/follow the forum rules.
For troubleshooting and bug reporting, read this first
Interested in seeing some YouTube videos about Kodi? Go here and subscribe
(This post was last modified: 2014-09-11 11:16 by Martijn.)
find quote
Opium Offline
Junior Member
Posts: 21
Joined: Sep 2012
Reputation: 0
Post: #37
(2014-09-11 11:16)Martijn Wrote:  /usr/share/xbmc/addons/

and those are only the initial shipped version. any update end up in userdata

Ah! Thanks Martijn. Now for the hard part... Smile
find quote
Post Reply