• 1
  • 37
  • 38
  • 39(current)
  • 40
  • 41
  • 42
Release Universal Scraper for Music Artists
Thanks for your work on this olympia. I will install 3.7.2 tonight and do some more testing.

For information the MusicBrainz mirror I am running was built from scratch so does have the latest schema.
Reply
I'm now running 3.7.2 and have successfully refreshed the artist information on half a dozen artists and got a successful refresh with full information first time every time so it's looking good Smile

Good work olympia and thanks again for your efforts Smile

I'll keep an eye out for anything unusual but looks like you've cracked it!
Reply
When I add an album and do a music library update I can see the scan status and the artist being scraped. But after scraping a few artists, its as though the scanner abruptly gives up. So now I have 10% of the artists in the artists view complete with bio, artist fanart etc but the rest are blank and the scanner has stopped. Even a reboot does not re initiate the scan (update library on restart is enabled in settings) If I manually click on an artist and select "query all artists", then the scanner starts again. Anything I can do to correct this erratic behavior?
Reply
Unfortunately the Musicbrainz server is overloaded and times out lots. I am not sure if using a mirror can improve your chances of gettimng a response or not, I think there are still schema issues - can someone clarify that situation?

For now repeated attempts is the only way to get the extra artist data scraped. Scraping is only initiated on startup if both update library on start-up and fetch online information settings are enabled. But better to use manual scraping than keep re-starting.

However there is a bug in v16 (and below) that means that "Query info for all..." only does something the first time it is clicked after power up or since the last time update library was run (even if there are no changes). This means to repeat scraping attempts you need to also repeat the update library check too.
Reply
In kodi 17 , the scraper will looks for artists in music library > artists . But it will not look into music library > music videos > artists .
Is the scraper not update yet to kodi 17?
Reply
Should work fine on Krypton v17, I rescanned my entire library using the scraper and the musicbrainz mirror http://www.musicbrainz-mirror.eu:5000
Reply
(2016-07-05, 18:06)DaveBlake Wrote: Unfortunately the Musicbrainz server is overloaded and times out lots. I am not sure if using a mirror can improve your chances of gettimng a response or not, I think there are still schema issues - can someone clarify that situation?

Just to clarify on the schema thingy...

The schema issue doesn't impact scraping at all. The new schema not being reflected in the virtual images "only" means that mirrors running the virtual images cannot replicate/ update from http://musicbrainz.org/ and they stuck at data available on 22 May. This is what you see on http://www.musicbrainz-mirror.eu:5000/ for example: "Last replication packet received at 2016-05-22 18:51 UTC".

I.e. This "only" mean that changes made on http://musicbrainz.org/ after 22 May are not pushed further to the mirrors, but other than that, those mirrors are fully functional and can be used from scraping (unless we want some artist or album added after 22 May).

Mirrors what have been built manually (i.e. not using the virtual image) are working flawless and updating regularly. Unfortunately I am not aware of any public mirror like that (I am running my private one).

Hope this clarifies a bit.
Reply
(2016-07-06, 10:19)zag Wrote: Should work fine on Krypton v17, I rescanned my entire library using the scraper and the musicbrainz mirror http://www.musicbrainz-mirror.eu:5000

Zag do you know who is running http://www.musicbrainz-mirror.eu:5000? I presume whoever it is, probably would not appreciate if we were changing our default MB mirror to this one, right? I think it would be dying out in minutes...
Reply
Yeh I had thought about this but you are right, we are simply too big a project to just switch to anyone Wink

I think running our own server is the future. There seems to be a docker image coming up so when thats out properly I'll take another look.
Reply
(2016-07-07, 09:56)zag Wrote: Yeh I had thought about this but you are right, we are simply too big a project to just switch to anyone Wink

I think running our own server is the future. There seems to be a docker image coming up so when thats out properly I'll take another look.

Cannot you run it from unRAID? It has a working docker image for MB.
Reply
(2016-07-05, 19:35)samehvirus Wrote: In kodi 17 , the scraper will looks for artists in music library > artists . But it will not look into music library > music videos > artists .
Is the scraper not update yet to kodi 17?

any one read what i wrote Wink , the scraper work but will not scrape artists located in music > music video > artists .

the scraper work only for artists located in music > artists . so is this related to bug on kodi 17 , or related to the scraper it self ?
Reply
(2016-07-09, 23:09)samehvirus Wrote:
(2016-07-05, 19:35)samehvirus Wrote: In kodi 17 , the scraper will looks for artists in music library > artists . But it will not look into music library > music videos > artists .
Is the scraper not update yet to kodi 17?

any one read what i wrote Wink , the scraper work but will not scrape artists located in music > music video > artists .

the scraper work only for artists located in music > artists . so is this related to bug on kodi 17 , or related to the scraper it self ?

Neither. The scraper doesn't "look" anywhere. The scraper is "called" by the music scanning process. So, it only is called when the music scanner finds new artists in a music source that is being scanned.

There is a separate process that does video scanning. In this case when the video source is set to content type of "musicvideos" by default Kodi only uses local .nfo files found during the scanning of new musicvideo media files.

The only way around this is to use mp4 as the container for music video files, and add .mp4 as a music file extension in your advancedsettings.xml file. Then add all the required metadata tags to the musicvideo mp4 files, same as you would for example m4a files. Then add the folder tree containing music video files as a music source and scan. However, please note that while this pretty much will work, treating music video files as a music source is completely unsupported so you will have to live with whatever quirks you find.

scott s.
.
Reply
so we need to let musicvideo scanning call the artists scraper ..
i think musicvideo in kodi still wip .
Reply
Samehvirus, install this scraper http://forum.kodi.tv/showthread.php?tid=...pid2253950 and use it for your music videos.
Reply
The Almighty
http://www.theaudiodb.com/artist/125179
https://musicbrainz.org/artist/e4e9af85-...bd321c0a3d
Universal Artist Scraper: Download artist information failed.

Tried scraping a few days apart.
Scraper is set to default settings.
Added http://musicbrainz-mirror.eu:5000/ to scraper config - does not work.
Only gets a result back at all when http://musicbrainz.fin-alice.de:5000/ is added in config.

-----------
The 2 Alice Coopers
Image
The only artist where this duplication occurs.
I ripped all CDs the same, tags are fine.
I cannot explain this.

But it might be because of this:
Image
Reply
  • 1
  • 37
  • 38
  • 39(current)
  • 40
  • 41
  • 42

Logout Mark Read Team Forum Stats Members Help
Universal Scraper for Music Artists9