Kodi Community Forum
Release Universal Scraper for Music Artists - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Music Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=303)
+----- Thread: Release Universal Scraper for Music Artists (/showthread.php?tid=132623)

Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42


RE: [Release] Universal Scraper for Music Artists - demonnerd - 2013-12-22

Ah i see thats too bad
but how about adding discogs.com
API to your scraper
http://www.discogs.com/developers/
I am all for giving back to the community
ill even do the info of 60 or 70 of my albums to TheAudioDB
but doing 600 is insane
ll even find a list of musicdb's you may be able to use the API from
http://developer.jamendo.com/v3.0
http://developer.echonest.com/
https://developer.gracenote.com/web-api
https://developer.decibel.net/

I do not know if that helps any but at least i tried


RE: [Release] Universal Scraper for Music Artists - zag - 2013-12-22

(2013-12-22, 10:09)demonnerd Wrote: ill even do the info of 60 or 70 of my albums to TheAudioDB
but doing 600 is insane

No it isn't, I've done over 30,000 lol Smile


RE: [Release] Universal Scraper for Music Artists - demonnerd - 2013-12-22

zag Wrote:No it isn't, I've done over 30,000 lol Smile

OK.... I am lost for words.


RE: [Release] Universal Scraper for Music Artists - Kblev - 2013-12-22

Hi all,
Just installed xbmc after quite some time. Everything downloaded great, movies, music. I'm using Aeon Nox for now. My movies picked up all fanart, posters, etc.. My music only picked up the cd cover. I've tried everything I can think of. Note.. I'm not the brightest techie!Huh All the scrapers are updated and tried turning off visualization. I've uploaded to library with library mode off. I have no idea what else I can try. If someone can lead this blind man in the right direction I would appreciate the help.Nod


RE: [Release] Universal Scraper for Music Artists - djfred93 - 2013-12-29

I have a problem when i scan my library with your scraper. One of the album i have is from B.o.B but your scraper show me BOB! and a other is from 88-keys but he show me Dr. 88-keys.

Sorry for my poor english.


RE: [Release] Universal Scraper for Music Artists - A-Swiss - 2013-12-30

(2013-12-29, 04:26)djfred93 Wrote: I have a problem when i scan my library with your scraper. One of the album i have is from B.o.B but your scraper show me BOB! and a other is from 88-keys but he show me Dr. 88-keys.

Sorry for my poor english.

Create a NFO File for these Artists... and check online on the DB if they are found correctly...


RE: [Release] Universal Scraper for Music Artists - FerryS - 2014-01-03

(2013-11-18, 17:30)zag Wrote:
(2013-11-18, 17:08)cw-kid Wrote: Any idea why artists I have previously added to TheAudioDB.com website have now been deleted or removed ? This guy being one example: http://theaudiodb.com/artist/125123 I have had to restore several artists.

No idea sorry, we don't delete any artists usually.

Your user log will tell you the history and what a mod has done. It only shows the last 20 actions but I could probably look back in the db for you.

This works

http://search.musicbrainz.org/ws/2/artist/?fmt=xml&query=artist:%22All-4-One%22&limit=100

But you're log indicates its adding a forward slash like this and it finds a different artist as a result.

http://search.musicbrainz.org/ws/2/artist/?fmt=xml&query=artist:%22All-4/-One%22&limit=100

So its the forward slash that is causing the problems. Why the scraper is adding that I'm not sure?

I had a problem with a forward slash in the the track name. For example in the album of Joan Baez Sings Bob Dylan track nr 1. "Love Minus Zero/No Limit". In my XBMC library is the trackname "Love Minus Zero" an the Artistname is "No Limit" in stead op Joan Baez. Has someone a solution for this problem?


RE: [Release] Universal Scraper for Music Artists - zag - 2014-02-10

Hey Olympia,

As discussed on IRC I have now implemented some fields on TADB

Get Artist Genre from = strGenre
Get Artist Styles from = strSubGenre
Get Artist Moods from = strMoods

This should make it totally compatible with Allmusic now Wink

I'll get adding the data on TADB but it would be useful for others to help also.

This also means we wont have large scrolling text like the Allmusic styles. Hurray!


RE: [Release] Universal Scraper for Music Artists - fiveisalive - 2014-02-15

(2012-07-31, 18:18)Kinneas Wrote: Thanks for this great addon!

I have a question. Is it currently possible to scrape "translated" artists names?

As an example, the Japanese band "Spitz".

http://musicbrainz.org/artist/0550993e-ddec-468e-b05f-da81bf6f7694
http://www.last.fm/music/%E3%82%B9%E3%83%94%E3%83%83%E3%83%84

lastfm and Musicbrainz both it under its Japanese name but both seem to have some way to determine that the English translation/alias is "Spitz". However I can only scrape it properly if I tag my files with the Japanese name.

Is it at all possible to somehow scrape the correct Japanese entry but retain the English translated name in my library? Or is this a limitation of the last.fm API?

Did you you ever solve this problem? I just rescanned my library using Gotham using the "override with online information option" because I wanted to use MusicBrainz superior data and disambiguation/sorting. Unfortunately this means that it uses the primary MusicBrainz name for foreign artists such as Pyotr Ilyich Tchaikovsky which now appears as "Пётр Ильич Чайковский " as per the MusicBrainz entry:

http://musicbrainz.org/artist/9ddd7abc-9e1b-471d-8031-583bc6bc8be9

However MusicBrainz *does* have information on the English alias here:

http://musicbrainz.org/artist/9ddd7abc-9e1b-471d-8031-583bc6bc8be9/aliases

so presumably a setting could be added to the scraper that, if enabled, would revert back to using the primary alias for the current language of XBMC. This is what Picard allows (the application I originally used to populate the MBID tags), and it uses the correct MBID but writes the English names into the tags, so presumably the scraper could do something similar with the library.


RE: [Release] Universal Scraper for Music Artists - slinden - 2014-02-22

In Headphones, all my artists have info, including thumbs.
There's not a single artist that doesn't have info.
In xmbc, using Universal Artist Scraper, maybe 10% of the artists have any info.
When manually getting the information, I can find my artists, it just doesn't seem to do much with it :S


RE: [Release] Universal Scraper for Music Artists - zag - 2014-02-22

Post an example of something that is missed then


RE: [Release] Universal Scraper for Music Artists - fiveisalive - 2014-02-22

To follow-up on my reply/post above about using translated names. It looks like this support will need to be added in the Music library proper, not in the scraper per se, so I filed two related Feature Requests.

The first is to use MusicBrainz's "alias" feature to extract the locale-specific (e.g. "en" for me) translated name rather than the default:

http://forum.xbmc.org/showthread.php?tid=186972

The second is to also use the "sort name" also from MusicBrainz for sorting artists / album names in lists:

http://forum.xbmc.org/showthread.php?tid=186973

Please follow-up on those threads if you're interested in those features. There may or may not be additional changes / features made to the scraper, although I'm less clear on that, because, as I understand it, the scraper uses the artist / album MBID directly to pull artist / album metadata, rather than the translated name, which is only really used for UI display.


RE: [Release] Universal Scraper for Music Artists - fiveisalive - 2014-02-25

(2014-02-22, 23:28)fiveisalive Wrote: To follow-up on my reply/post above about using translated names. It looks like this support will need to be added in the Music library proper, not in the scraper per se, so I filed two related Feature Requests.

The first is to use MusicBrainz's "alias" feature to extract the locale-specific (e.g. "en" for me) translated name rather than the default:

http://forum.xbmc.org/showthread.php?tid=186972

The second is to also use the "sort name" also from MusicBrainz for sorting artists / album names in lists:

http://forum.xbmc.org/showthread.php?tid=186973

Please follow-up on those threads if you're interested in those features. There may or may not be additional changes / features made to the scraper, although I'm less clear on that, because, as I understand it, the scraper uses the artist / album MBID directly to pull artist / album metadata, rather than the translated name, which is only really used for UI display.

Actually it seems that this feature can be implemented completely in the scraper, because overriding the artist name from MusicBrainz is done at scrape-time. I forked the upstream repository on sourceforge and I made a start on doing this, you can checkout / download / view the tree here:

https://sourceforge.net/u/alexl/xbmc-scrapers/ci/frodo/tree/metadata.artists.universal/

This is my first attempt at writing/modifying a scraper, but hopefully it will be a start. The basic idea is that if enabled it will return the <name> tag from a localized alias in the XML before the "standardized" name.


RE: [Release] Universal Scraper for Music Artists - zag - 2014-02-25

If you use github then maybe you could create a PR and get it in the official scraper.


RE: [Release] Universal Scraper for Music Artists - fiveisalive - 2014-02-25

(2014-02-25, 11:02)zag Wrote: If you use github then maybe you could create a PR and get it in the official scraper.

Thanks for the suggestion. In fact, I thought about doing exactly that, but it seems that the source in the github tree (I'm assuming this the code you're referring to):

https://github.com/xbmc/xbmc/tree/master/addons/metadata.artists.universal

is behind (at version 3.3.0) the sourceforge repo (which is it 3.4.0). Hence why I forked the sourceforge repo. It seems that the github repo gets synced with the sourceforge repo periodically? or does it happen the other way around? I'm a bit confused. I'm happy to create a PR, but wouldn't it make sense for it to be against the latest code?