• 1
  • 34
  • 35
  • 36(current)
  • 37
  • 38
  • 42
Release Universal Scraper for Music Artists
Added ability to define MB mirror in scraper settings. Useful if you know a well performing mirror or you run your own...
Reply
2 good musicbrainz mirrors if needed

http://musicbrainz.fin-alice.de:5000/
http://musicbrainz-mirror.eu:5000/
Reply
Is it possible to include the Encyclopaedia Metallum in Universal Scraper?
I have a huge music library with about 75% being Metal, and scraping that stuff is an ordeal.

I did over 1500 edits over on AudioDB, but compared to other sites, they barely have any entries.
Reply
Universal Scraper starts at Musicbrainz and link all other sources via mbid. I don't believe Encyclopaedia Metallum can be linked via mbid? Let me know if it can, then I will look at it.

By the way, is the direct Encyclopaedia Metallum scraper broken?
Reply
I cannot answer the first question, but i tried the EM scraper yesterday, it didn't work.
KODI Player: Nvidia Shield TV Pro [2019] w/ Wolf Launcher + Synology DS418 | Receiver: Marantz SR6013 | TV: LG 55SJ800V | Toaster: Severin AT 2515

How to:
Create custom video nodes like Documentaries, Concerts, Kids etc
Reply
...so I should mark it as broken Tongue

edit: just tried. It worked for me, however we only have EM scraper for artists, not for albums.
Reply
I have followed zag's advice and I started to add spanish biographies in theaudiodb.com. I was becoming insane since I couldn't scrape any data with this scraper but I noticed it was due to the musicbrainz mirror, I tried one of the above and it worked... now I have another issue: I have some artists that don't have any information in Spanish, then I'd rather have their bios in english than empty, but when I go to the config of this scraper I go to General and set Get Artist Biography from to TheAudioDb.com and set the language to es; then I go to Fallbacks and select Fallback to Artist Biography from to TheAudioDb.com but I set Preferred Language to en. I hoped that worked but it didn't, since you can only have one preferred language, whenever you change it in one section, the other one gets changed too... would it be possible to modify that?

Thanks in advance!
If I have helped you or increased your knowledge, please click the 'thumbs up' button to give thanks :)
Reply
The scraper should return English by default if info on preferred language is not existing. You don't even need to set fallback for that.
So not so sure what is happening. A log surely would help.
Reply
(2016-05-26, 17:45)olympia Wrote: The scraper should return English by default if info on preferred language is not existing. You don't even need to set fallback for that.
So not so sure what is happening. A log surely would help.

Ok, it seems that is working well now. Another question: let's imagine that I scrapped some artists that didn't have bio in spanish and then I got them in english, after that I add some bios in theaudiodb.com in spanish and I want those artists updated with the spanish bio. Is there any way to get them all at once? If I hit update library nothing happens, only way is selecting manually each artist and hitting refresh...

Thanks
If I have helped you or increased your knowledge, please click the 'thumbs up' button to give thanks :)
Reply
There's some new behaviour to the addon i haven't seen before:
Yesterday i chose "Query infos for all artists" ("Prefer online information" is checked in music settings).

So far, i've seen 2 artists names changed:
The B-52's are now The B-Boys.
Accuser (real name: Accu§er) is now The Accuser.
Hitting refresh on Artist information just returns you to the Artist info screen.
No dialogue window to chose a band name.
So... i cannot correct these names anymore.

The only thing i could do at this point is remove files from the artists i know have been changed, clean up library, uncheck "prefer online information", re-add files, re-scan.
Reply
(2016-05-27, 00:42)manfeed Wrote:
(2016-05-26, 17:45)olympia Wrote: The scraper should return English by default if info on preferred language is not existing. You don't even need to set fallback for that.
So not so sure what is happening. A log surely would help.

Ok, it seems that is working well now. Another question: let's imagine that I scrapped some artists that didn't have bio in spanish and then I got them in english, after that I add some bios in theaudiodb.com in spanish and I want those artists updated with the spanish bio. Is there any way to get them all at once? If I hit update library nothing happens, only way is selecting manually each artist and hitting refresh...

Thanks

I think a manual refresh is the only way to go really.

Best option is to add all the spanish translations as soon as possible hehe Wink
Reply
Seeking guidance
for a week or so the scrapper is not finding any artwork. mediaelch which I was using cannot connect to musicbrainz which I believe uses this scrapper. If I read the posts here correctly. The scrapper uses the musicbrainz ID to find artwork. Has something changed or could I have a setting off. I tried a couple of mirrors but same result. Any Ideas?
Reply
I'm unable to get the bio for some artists that are in themusicdb.com and I don't know why?

Some of them are:

Ash Koley
Bo Bruce
Candy Hearts

I can't find any reasonable common pattern to this issue...

Thanks
If I have helped you or increased your knowledge, please click the 'thumbs up' button to give thanks :)
Reply
I'm also having trouble getting the scraper to return results. I'm coming back to Kodi after a long break so still getting myself up to speed but I did spot the following in the log and it appears that the MBID is being duplicated in the URLs. Everything looks ok until the "chain function" commands at 22:08:43 3734.888916 T:1553986544 where the MBID is duplicated:

Code:
22:08:40 3731.706055 T:1956717488   DEBUG: UpdateDatabaseArtistInfo downloading info for: Hellfish
22:08:40 3731.771973 T:1956717488   DEBUG: scraper: ResolveIDToUrl returned <url>http://musicbrainz.org/ws/2/artist/ab8857ca-4f6f-49e6-8f13-4145bcab8693?inc=url-rels</url>
22:08:42 3733.772705 T:1956717488   DEBUG: -- nfo-scraper: Universal Artist Scraper
22:08:42 3733.772949 T:1956717488   DEBUG: -- nfo url: http://musicbrainz.org/ws/2/artist/ab8857ca-4f6f-49e6-8f13-4145bcab8693?inc=url-rels
22:08:42 3733.774414 T:1553986544   DEBUG: Thread MusicInfoScraper start, auto delete: false
22:08:42 3733.774902 T:1553986544   DEBUG: GetArtistDetails: Reading 'http://musicbrainz.org/ws/2/artist/ab8857ca-4f6f-49e6-8f13-4145bcab8693?inc=url-rels' ('Hellfish') using Universal Artist Scraper scraper (file: '/home/osmc/.kodi/addons/metadata.artists.universal', content: 'artists', version: '3.6.2')
22:08:42 3733.775391 T:1553986544   DEBUG: CurlFile::Open(0x4f3da00) http://musicbrainz.org/ws/2/artist/ab8857ca-4f6f-49e6-8f13-4145bcab8693?inc=url-rels
22:08:42 3733.776367 T:1553986544    INFO: easy_aquire - Created session to http://musicbrainz.org
22:08:43 3734.879395 T:1553986544   DEBUG: Get: Using "UTF-8" charset for XML "http://musicbrainz.org/ws/2/artist/ab8857ca-4f6f-49e6-8f13-4145bcab8693?inc=url-rels"
22:08:43 3734.888916 T:1553986544   DEBUG: scraper: GetArtistDetails returned <details><musicBrainzArtistID>ab8857ca-4f6f-49e6-8f13-4145bcab8693</musicBrainzArtistID><name>Hellfish</name><chain function="GetFanartTvArtistThumbsByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetTADBArtistThumbsByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetHTBThumbsByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetFanartTvArtistFanartsByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetTADBArtistFanartsByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetHTBFanartByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="AMGFallback"></chain><chain function="GetMBDiscographyByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetTADBBiographyByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetTADBArtistGenresByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetTADBArtistStylesByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetTADBArtistMoodsByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetTADBLifeSpanByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain></details>[/color]
22:08:43 3734.890869 T:1553986544   DEBUG: scraper: GetFanartTvArtistThumbsByMBID returned <details><url function="ParseFanartTvArtistThumbs" cache="fanarttv-artistimages-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693.json">http://webservice.fanart.tv/v3/music/ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693?api_key=ed4b784f97227358b31ca4dd966a04f1</url></details>
22:08:43 3734.892090 T:1553986544   DEBUG: CurlFile::Open(0x4f3da00) http://webservice.fanart.tv/v3/music/ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693?api_key=ed4b784f97227358b31ca4dd966a04f1
22:08:43 3735.204346 T:1553986544   ERROR: CCurlFile::Open failed with code 404 for http://webservice.fanart.tv/v3/music/ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693?api_key=ed4b784f97227358b31ca4dd966a04f1
22:08:43 3735.204834 T:1553986544   ERROR: Run: Unable to parse web site
22:08:43 3735.206299 T:1553986544   DEBUG: scraper: GetTADBArtistThumbsByMBID returned <details><url function="ParseTADBArtistThumbs" cache="tadb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-artist.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</url></details>
22:08:43 3735.208008 T:1553986544   DEBUG: CurlFile::Open(0x4f3da00) http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693
22:08:44 3735.497070 T:1553986544   DEBUG: Get: Using content of "http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693" as binary or text with "UTF-8" charset
22:08:44 3735.500244 T:1553986544   DEBUG: scraper: ParseTADBArtistThumbs returned <details></details>
22:08:44 3735.501709 T:1553986544   DEBUG: scraper: GetHTBThumbsByMBID returned <details><url function="ParseHTBThumbs" post="yes" cache="htb-images-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693.xml">http://htbackdrops.org/api/7681a907c805e0670330c694e788e8e8/searchXML?mbid=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693&aid=1,5</url></details>
22:08:44 3735.503418 T:1553986544   DEBUG: CurlFile::Open(0x4f3da00) http://htbackdrops.org/api/7681a907c805e0670330c694e788e8e8/searchXML
22:08:44 3735.853271 T:1553986544   DEBUG: Get: Using "UTF-8" charset for XML "http://htbackdrops.org/api/7681a907c805e0670330c694e788e8e8/searchXML?mbid=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693&aid=1,5"
22:08:44 3735.856689 T:1553986544   DEBUG: scraper: ParseHTBThumbs returned <details></details>
22:08:44 3735.857910 T:1553986544   DEBUG: scraper: GetFanartTvArtistFanartsByMBID returned <details><url function="ParseFanartTvArtistFanarts" cache="fanarttv-artistimages-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693.json">http://webservice.fanart.tv/v3/music/ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693?api_key=ed4b784f97227358b31ca4dd966a04f1</url></details>
22:08:44 3735.859619 T:1553986544   DEBUG: CurlFile::Open(0x4f3da00) http://webservice.fanart.tv/v3/music/ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693?api_key=ed4b784f97227358b31ca4dd966a04f1
22:08:44 3735.960693 T:1553986544   ERROR: CCurlFile::Open failed with code 404 for http://webservice.fanart.tv/v3/music/ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693?api_key=ed4b784f97227358b31ca4dd966a04f1
22:08:44 3735.961426 T:1553986544   ERROR: Run: Unable to parse web site
22:08:44 3735.962891 T:1553986544   DEBUG: scraper: GetTADBArtistFanartsByMBID returned <details><url function="ParseTADBArtistFanarts" cache="tadb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-artist.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</url></details>
22:08:44 3735.967529 T:1553986544   DEBUG: scraper: ParseTADBArtistFanarts returned <details><fanart></fanart></details>
22:08:44 3735.968750 T:1553986544   DEBUG: scraper: GetHTBFanartByMBID returned <details><url function="ParseHTBFanart" post="yes" cache="htb-images-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693.xml">http://htbackdrops.org/api/7681a907c805e0670330c694e788e8e8/searchXML?mbid=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693&aid=1,5</url></details>
22:08:44 3735.973633 T:1553986544   DEBUG: scraper: ParseHTBFanart returned <details><fanart></fanart></details>
22:08:44 3735.976562 T:1553986544   DEBUG: scraper: AMGFallback returned <details></details>
22:08:44 3735.977783 T:1553986544   DEBUG: scraper: GetMBDiscographyByMBID returned <details><url function="ParseMBDiscography" cache="mb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-discog.xml">http://musicbrainz.org/ws/2/release-group?artist=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693&amp;limit=100&amp;type=album</url></details>
22:08:44 3735.979736 T:1553986544   DEBUG: CurlFile::Open(0x4f3da00) http://musicbrainz.org/ws/2/release-group?artist=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693&limit=100&type=album
22:08:44 3736.171387 T:1553986544   ERROR: CCurlFile::FillBuffer - Failed: HTTP returned error 503
22:08:44 3736.171875 T:1553986544   ERROR: CCurlFile::Open failed with code 503 for http://musicbrainz.org/ws/2/release-group?artist=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693&limit=100&type=album
22:08:44 3736.172119 T:1553986544   ERROR: Run: Unable to parse web site
22:08:44 3736.173584 T:1553986544   DEBUG: scraper: GetTADBBiographyByMBID returned <details><url function="ParseTADBBiography" cache="tadb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-artist.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</url></details>
22:08:44 3736.179688 T:1553986544   DEBUG: scraper: ParseTADBBiography returned <details></details>
22:08:44 3736.181152 T:1553986544   DEBUG: scraper: GetTADBArtistGenresByMBID returned <details><url function="ParseTADBArtistGenres" cache="tadb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-artist.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</url></details>
22:08:44 3736.186523 T:1553986544   DEBUG: scraper: ParseTADBArtistGenres returned <details></details>
22:08:44 3736.187744 T:1553986544   DEBUG: scraper: GetTADBArtistStylesByMBID returned <details><url function="ParseTADBArtistStyles" cache="tadb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-artist.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</url></details>
22:08:44 3736.193359 T:1553986544   DEBUG: scraper: ParseTADBArtistStyles returned <details></details>
22:08:44 3736.194580 T:1553986544   DEBUG: scraper: GetTADBArtistMoodsByMBID returned <details><url function="ParseTADBArtistMoods" cache="tadb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-artist.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</url></details>
22:08:44 3736.200195 T:1553986544   DEBUG: scraper: ParseTADBArtistMoods returned <details></details>
22:08:44 3736.201660 T:1553986544   DEBUG: scraper: GetTADBLifeSpanByMBID returned <details><url function="ParseTADBLifeSpan" cache="tadb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-artist.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</url></details>
22:08:44 3736.208984 T:1553986544   DEBUG: scraper: ParseTADBLifeSpan returned <details></details>
22:08:44 3736.213135 T:1553986544   DEBUG: Thread MusicInfoScraper 1553986544 terminating
22:08:45 3736.423096 T:1731195888   DEBUG: Thread JobWorker 1731195888 terminating (autodelete)
Reply
post deleted

scott s.
.
maintainer of skin  Aeon MQ5 mods for post-Gotham Kodi releases:
Matrix see: Aeon MQ5 Mod Matrix release thread
Nexus see: Aeon MQ5 Mod Nexus release thread
Aeon MQ 5 skin and addon repo 11.1.0
Reply
  • 1
  • 34
  • 35
  • 36(current)
  • 37
  • 38
  • 42

Logout Mark Read Team Forum Stats Members Help
Universal Scraper for Music Artists9