Kodi Community Forum
Release Universal Scraper for Music Albums - Printable Version

Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Music Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=303)
----- Thread: Release Universal Scraper for Music Albums (/showthread.php?tid=133547)

Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34


RE: [Release] Universal Scraper for Music Albums - n1md4 - 2013-11-06

That worked. One more question, not a scraper question per say, but, is it possible to remove individual albums from a library? I can do this with videos, but unable to do the same with music.


RE: [Release] Universal Scraper for Music Albums - n1md4 - 2013-11-13

(2013-11-06, 12:40)n1md4 Wrote: .. is it possible to remove individual albums from a library? I can do this with videos, but unable to do the same with music.

This.


RE: [Release] Universal Scraper for Music Albums - n1md4 - 2013-11-13

I've noticed clean database does parts of what I want, along with moving the album from the music directory; I should be able to deal with that.

Another issue: I have Jimi Hendrix: 10 tracks from the Albert Hall:-

http://musicbrainz.org/release-group/ed56d8ca-4017-3a66-8a89-2705e0fa15f5

But, art work does not scrape, it's available from theaudiodb.com. Not only does it not get the artwork, when refreshing the album it says "Downloading Album Information failed", despite the logs looking like they succeed:-

http://xbmclogs.com/show.php?id=84005

Any ideas?


RE: [Release] Universal Scraper for Music Albums - jz1276 - 2013-11-24

(2013-09-10, 19:25)gnenad Wrote: When i try to "quary info for all albums" - nothing happend
When i enter "album informatio" and "reload" i got all infos for album.
Why "quary info for all albums" does not work? Thx

I have the same issue. A lot of my albums are missing data. I can reload the albums separately and the info loads but when I 'query info for all albums' I get nothing. Help please,


RE: [Release] Universal Scraper for Music Albums - zag - 2013-11-24

If you guys find reproduceable bugs with XBMC (not this scraper) then make a TRAC ticket and copy in night199uk


RE: [Release] Universal Scraper for Music Albums - night199uk - 2013-11-24

n1md4: yes, that looks like a bug in the scraper.

01:03:23 T:139730960217856 DEBUG: scraper: CreateAlbumSearchUrl returned <url>http://search.musicbrainz.org/ws/2/release/?fmt=xml&query=release:"10%20Tracks%20at%20the%20Albert%20Hall%20from%20the%20Sunday%20Times"%20AND%20artist:"Jimi%20Hendrix"</url>
01:03:23 T:139730960217856 DEBUG: CurlFile::Open(0x39d9850) http://search.musicbrainz.org/ws/2/release/?fmt=xml&query=release:"10%20Tracks%20at%20the%20Albert%20Hall%20from%20the%20Sunday%20Times"%20AND%20artist:"Jimi%20Hendrix"
01:03:23 T:139730960217856 DEBUG: scraper: GetAlbumSearchResults returned <results sorted="yes"></results>

i.e. an empty result set was returned by the scraper. I threw the URL into a browser and indeed we see an album match - so this probably is something up with the scraper. probably one for olympia.


RE: [Release] Universal Scraper for Music Albums - night199uk - 2013-11-24

jz1276: please open a trac and include:
a copy of your full xbmc.log with debug logging enable during the initial scan (which shows the issue) and another xbmc.log from hitting the album information button. the 2 calls use pretty much the same function so shouldn't respond differently.


RE: [Release] Universal Scraper for Music Albums - jz1276 - 2013-11-24

Dont know what opening a trac means, but here are the log files...

Query Info For All Albums
Exceeding 500kb. Had to separate into 2 separate pastes
http://pastebin.com/MnSA2a5W

http://pastebin.com/0WKstczs

After rebooting, I reloaded info for one album that didnt have any info (except for whatever was in the tag). BTW, I had to try 2 or 3 albums before I chose one that was able to load info.

http://pastebin.com/DitjsSrU


RE: [Release] Universal Scraper for Music Albums - vijayk416 - 2013-11-24

When I try to get Trouble Will Find Me by The National to scan in, XBMC crashes.
http://musicbrainz.org/release-group/a5a2875f-41cb-4c48-9a72-e845d224db96


RE: [Release] Universal Scraper for Music Albums - scudlee - 2013-11-24

(2013-11-24, 14:40)night199uk Wrote: n1md4: yes, that looks like a bug in the scraper.

01:03:23 T:139730960217856 DEBUG: scraper: CreateAlbumSearchUrl returned <url>http://search.musicbrainz.org/ws/2/release/?fmt=xml&query=release:"10%20Tracks%20at%20the%20Albert%20Hall%20from%20the%20Sunday%20Times"%20AND%20artist:"Jimi%20Hendrix"</url>
01:03:23 T:139730960217856 DEBUG: CurlFile::Open(0x39d9850) http://search.musicbrainz.org/ws/2/release/?fmt=xml&query=release:"10%20Tracks%20at%20the%20Albert%20Hall%20from%20the%20Sunday%20Times"%20AND%20artist:"Jimi%20Hendrix"
01:03:23 T:139730960217856 DEBUG: scraper: GetAlbumSearchResults returned <results sorted="yes"></results>

i.e. an empty result set was returned by the scraper. I threw the URL into a browser and indeed we see an album match - so this probably is something up with the scraper. probably one for olympia.

From what I can tell, it fails because the scraper only accepts releases that have a <status> of "Official", whereas 10 Tracks at the Albert Hall from the Sunday Times has a <status> of "Promotion".

From the docs the possible statuses are "Official", "Promotion", "Bootleg", and "Pseudo-release".

@olympia, @zag: Should we just blanket accept any status, or are we deliberately excluding some? I'm guessing "pseudo-release" (whatever the precise meaning of that is) is the genuine sticky one?


RE: [Release] Universal Scraper for Music Albums - zag - 2013-11-24

(2013-11-24, 22:46)scudlee Wrote: @olympia, @zag: Should we just blanket accept any status, or are we deliberately excluding some? I'm guessing "pseudo-release" (whatever the precise meaning of that is) is the genuine sticky one?

Sure thing, we allow them on TADB so I don't see any reason not to scrape them (unless its for some kind of accuracy reasons).

http://www.theaudiodb.com/album/2139869


RE: [Release] Universal Scraper for Music Albums - n1md4 - 2013-11-25

Hi. Well, I hope that will clear up some scraping issues. I have another one here. The album appears in my library [files, but no meta data], but attempts to get album info fail, with "Downloading album information failed".

http://xbmclogs.com/show.php?id=89531

http://search.musicbrainz.org/ws/2/release/?fmt=xml&query=release:%22Beginner%27s%20Guide%20to%20World%20Music%22%20AND%20artist:%22Various%20Artists%22

http://theaudiodb.com/album/2184627

http://fanart.tv/fanart/music/89ad4ac3-39f7-470e-963a-56509c546377/albumcover/beginners-guide-to-world-music-52894b7b1d8b9.jpg

Any help appreciated! Smile


RE: [Release] Universal Scraper for Music Albums - olympia - 2013-11-25

(2013-11-24, 22:46)scudlee Wrote:
(2013-11-24, 14:40)night199uk Wrote: n1md4: yes, that looks like a bug in the scraper.

01:03:23 T:139730960217856 DEBUG: scraper: CreateAlbumSearchUrl returned <url>http://search.musicbrainz.org/ws/2/release/?fmt=xml&query=release:"10%20Tracks%20at%20the%20Albert%20Hall%20from%20the%20Sunday%20Times"%20AND%20artist:"Jimi%20Hendrix"</url>
01:03:23 T:139730960217856 DEBUG: CurlFile::Open(0x39d9850) http://search.musicbrainz.org/ws/2/release/?fmt=xml&query=release:"10%20Tracks%20at%20the%20Albert%20Hall%20from%20the%20Sunday%20Times"%20AND%20artist:"Jimi%20Hendrix"
01:03:23 T:139730960217856 DEBUG: scraper: GetAlbumSearchResults returned <results sorted="yes"></results>

i.e. an empty result set was returned by the scraper. I threw the URL into a browser and indeed we see an album match - so this probably is something up with the scraper. probably one for olympia.

From what I can tell, it fails because the scraper only accepts releases that have a <status> of "Official", whereas 10 Tracks at the Albert Hall from the Sunday Times has a <status> of "Promotion".

From the docs the possible statuses are "Official", "Promotion", "Bootleg", and "Pseudo-release".

@olympia, @zag: Should we just blanket accept any status, or are we deliberately excluding some? I'm guessing "pseudo-release" (whatever the precise meaning of that is) is the genuine sticky one?

Nice catch! I think we can add all those. Do you have time to do it?


RE: [Release] Universal Scraper for Music Albums - scudlee - 2013-11-25

(2013-11-25, 07:44)olympia Wrote: Nice catch! I think we can add all those. Do you have time to do it?

Added in version 2.2.1.


RE: [Release] Universal Scraper for Music Albums - olympia - 2013-11-25

Great! However, now that I think twice if I remember correctly I added this to avoid Bootleg or Promotion releases to be linked with most of the albums due to the fact that actually there is no possibility to select between releases (not even in case of refreshing) - XBMC selects the first closes match. So in case there is e.g. both Official and Promotion releases are available and Promotion is listed earlier in the search results then it will be prioritized over the Official. Not sure what would be the best to handle this.


This forum uses Lukasz Tkacz MyBB addons.