[Music Scraper] An alternative, like ex. discogs.com, musicbrainz.org, or amazon.com?

  Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
MOAI Offline
Junior Member
Posts: 20
Joined: Jun 2008
Reputation: 0
Question  [Music Scraper] An alternative, like ex. discogs.com, musicbrainz.org, or amazon.com?
Post: #1
allmusic is great, but there's a couple of artists (mostly foreign) that don't have thumbnails or bios, whereas they have both on Last.fm

How hard would it be for someone to code a scraper for these?

Thanks to anyone who replies Laugh
find quote
spiff Offline
Retired Developer
Posts: 12,386
Joined: Nov 2003
Post: #2
i have considered it but i do not feel comfortable scraping a site that provides open api's. that being said, anyone else is ofc free to do it
find quote
MOAI Offline
Junior Member
Posts: 20
Joined: Jun 2008
Reputation: 0
Post: #3
Sorry, what's open api?
find quote
spiff Offline
Retired Developer
Posts: 12,386
Joined: Nov 2003
Post: #4
API's which are available to the public
find quote
steve1977 Offline
Posting Freak
Posts: 1,980
Joined: Dec 2006
Reputation: 0
Question  [Music Scraper] Alternative(s) to allmusic.com, like ex. discogs.com, or amazon.com?
Post: #5
Is there any alternative to allmusic.com as scraper for music and how can I set it up?

My problem is that the allmusic.com website is blocked in China (and thats where I happen to live). Another scraper could solve my problem.

Thoughts? Many thanks!!!

Server: Asus Sabertooth Z77 | Intel Core i5 3.4 GHz | 12 GB DDR3 | 256 GB SSD, 40 TB (1 x 4 TB, 6 x 3TB, 9 x 2 TB)
HTPC 1: Apple Mac Mini (mid-2011) | Intel Core i5 2.5 GHz | 4GB DDR3 | 500 GB
HTPC 2: Apple Mac Mini (mid-2007) | Intel Core 2 Duo 2.0 GHz | 4 GB DDR2 | 16 GB SSD
find quote
rwparris2 Offline
Team-XBMC Python Developer
Posts: 1,333
Joined: Jan 2008
Reputation: 2
Location: US
Post: #6
I'm started working on a Last.FM Scraper... do you get last.fm in china?

Always read the XBMC online-manual, FAQ and search and search the forum before posting.
For troubleshooting and bug reporting please read how to submit a proper bug report.

If you're interested in writing addons for xbmc, read docs and how-to for plugins and scripts ||| http://code.google.com/p/xbmc-addons/
find quote
steve1977 Offline
Posting Freak
Posts: 1,980
Joined: Dec 2006
Reputation: 0
Post: #7
rwparris2 Wrote:I'm started working on a Last.FM Scraper... do you get last.fm in china?

Yes, just checked and last.fm is working here. That would be terrific!!! Already any thoughts when this new scraper would "go live"?

Server: Asus Sabertooth Z77 | Intel Core i5 3.4 GHz | 12 GB DDR3 | 256 GB SSD, 40 TB (1 x 4 TB, 6 x 3TB, 9 x 2 TB)
HTPC 1: Apple Mac Mini (mid-2011) | Intel Core i5 2.5 GHz | 4GB DDR3 | 500 GB
HTPC 2: Apple Mac Mini (mid-2007) | Intel Core 2 Duo 2.0 GHz | 4 GB DDR2 | 16 GB SSD
find quote
Hack_kid Offline
Fan
Posts: 646
Joined: Jan 2007
Reputation: 4
Post: #8
thats weak that china sensors its internet
find quote
rwparris2 Offline
Team-XBMC Python Developer
Posts: 1,333
Joined: Jan 2008
Reputation: 2
Location: US
Post: #9
steve1977 Wrote:Yes, just checked and last.fm is working here. That would be terrific!!! Already any thoughts when this new scraper would "go live"?

I've never done a scraper before and I don't have a lot of free time to sit down and get into it at the moment, so no, I have no idea, sorry.

Always read the XBMC online-manual, FAQ and search and search the forum before posting.
For troubleshooting and bug reporting please read how to submit a proper bug report.

If you're interested in writing addons for xbmc, read docs and how-to for plugins and scripts ||| http://code.google.com/p/xbmc-addons/
find quote
xb2iris Offline
Skilled Skinner
Posts: 586
Joined: Jun 2008
Reputation: 0
Location: London, UK
Post: #10
i reckon, and this may sounds weird, but the best source of music information is wikipedia... seriously, i have an extremely large amount of music and all my info comes from there... well... wish i knew how to create scrapers... nyways... just a thought
find quote
Gamester17 Offline
Team-XBMC Forum Moderator
Posts: 10,523
Joined: Sep 2003
Reputation: 10
Location: Sweden
Post: #11
Wikipedia.org does not use a unified standard which is a must for a scraper to work.

amazon.com could work as a source as they use a standard for all their pages.

Nod

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.
find quote
xb2iris Offline
Skilled Skinner
Posts: 586
Joined: Jun 2008
Reputation: 0
Location: London, UK
Post: #12
cool... cool... amazon is pretty wicked as well... by the way, you look a lot like fred durst... hmmm...
find quote
Jeroen Offline
Skilled Skinner
Posts: 2,499
Joined: Feb 2008
Reputation: 23
Location: The Netherlands
Post: #13
http://www.discogs.com/
I use a plugin for this site in the Foobar mediaplayer on my desktop pc, it literally finds everything I throw at it.
find quote
steve1977 Offline
Posting Freak
Posts: 1,980
Joined: Dec 2006
Reputation: 0
Post: #14
Thanks for all your replies. Both last.fm and amazon.com work well also in China. Would be awesome if the world of XBMC would see on of these scrapers in the future!!!

Many thanks again and best regards!!!

Server: Asus Sabertooth Z77 | Intel Core i5 3.4 GHz | 12 GB DDR3 | 256 GB SSD, 40 TB (1 x 4 TB, 6 x 3TB, 9 x 2 TB)
HTPC 1: Apple Mac Mini (mid-2011) | Intel Core i5 2.5 GHz | 4GB DDR3 | 500 GB
HTPC 2: Apple Mac Mini (mid-2007) | Intel Core 2 Duo 2.0 GHz | 4 GB DDR2 | 16 GB SSD
find quote
theuni Offline
Team-XBMC Communication Manager
Posts: 1,105
Joined: Oct 2007
Reputation: 2
Location: Atlanta, Ga, USA
Post: #15
There's also an API for the site, maybe worth looking at:

http://www.discogs.com/help/api

TheUni
find quote
Post Reply