discogs.com music scraper - development help and bug reports wanted!
#1
Thumbs Up 
hey,

after seeing all the polite and constructive requests, as well as some not so constructive whining, for a better music scraper, i finally gave in and did it myself.

r16773

let the bug reporting commence
Reply
#2
Wow nice, thank you for the work you did!
I had a quick go with it and it seems to work.. 4 new albums got scraped nicely using 'Update library'. 1 album came back with false results, though. I'll try to figure out what went wrong later today and report back.
Reply
#3
Aahh, excellent! I was hoping for a discogs scraper Smile
Working great so far, much much better results than with allmusic.
Still need to do a full scan, will report on how that goes.
Thanks a lot spiff!
Reply
#4
nice, just tried it today on a rather small collection of music, just one thing to report.

discography doesn't work for any artist.
Reply
#5
artist scrapes i have hardly worked on, personally i still use allmusic for artists
Reply
#6
Finally had some time to do more testing; I cleared my music library today and ran album lookups using the discogs scraper on 50+ albums. All mp3s have proper id3 tags, i always use musicbrainz picard before anything is added to the library.

Think I've found one bug, which looks fixable. Not sure though if it's the scraper or XBMC's scraper framework which is broken. The details for Albums with a single quote in their name are never fetched from discogs. That is: the GetAlbumSearchResults thingy is executed (i have wireshark and strace logs that show the discogs HTTP request and response), but the album details lookup is never executed.

When looking up the album details XBMC briefly shows the 'Looking up album names..' dialog, which then disappears without further notice.

I'll try to create a patch and submit it.
Reply
#7
Where can I get the file ??
Reply
#8
it's in svn
Reply
#9
im not clear on how to get this or how to install...
can someone please help...thanks
Reply
#10
no. we won't help lazy ppl. everything you need is in the manual, and i bet google is available at your location.

besides, this is a DEV forum.
Quote:Scraper Development Developers forum for meta data scrapers. Scraper developers only!
Not for posting feature requests or end-user support requests!
Reply
#11
yeah spiff.. once again you've made my day. this is a real reason to update to the latest svn - thanks! i'll report asap.
cheers,azido :;):
Reply
#12
hey spiff,

not sure if you're still interested in maintaining this scraper,
but fetching album info / album artwork does not work anymore.

grabbing artist info / artist thumb still works without a problem.
Reply
#13
create a ticket please and we'll see if it pops up on top
Reply
#14
change the <GetAlbumSearchResults> expression to

\n&lt;a href=&quot;([^&quot;]*/release/[^&quot;]*)&quot;.*?&gt;(.*?) - (.*?)&lt;/a&gt;
Reply
#15
thanx to the both of you for the quick replies.
i grapped the modified scraper from svn, but no luck.

to make it work, i had to change the regex to:
&lt;a href=&quot;([^&quot;]*/release/[^&quot;]*)&quot;.*?&gt;(.*?) - (.*?)&lt;/a&gt;
Reply

Logout Mark Read Team Forum Stats Members Help
discogs.com music scraper - development help and bug reports wanted!0