2016-05-20, 16:50
Added ability to define MB mirror in scraper settings. Useful if you know a well performing mirror or you run your own...
(2016-05-26, 17:45)olympia Wrote: The scraper should return English by default if info on preferred language is not existing. You don't even need to set fallback for that.
So not so sure what is happening. A log surely would help.
(2016-05-27, 00:42)manfeed Wrote:(2016-05-26, 17:45)olympia Wrote: The scraper should return English by default if info on preferred language is not existing. You don't even need to set fallback for that.
So not so sure what is happening. A log surely would help.
Ok, it seems that is working well now. Another question: let's imagine that I scrapped some artists that didn't have bio in spanish and then I got them in english, after that I add some bios in theaudiodb.com in spanish and I want those artists updated with the spanish bio. Is there any way to get them all at once? If I hit update library nothing happens, only way is selecting manually each artist and hitting refresh...
Thanks
22:08:40 3731.706055 T:1956717488 DEBUG: UpdateDatabaseArtistInfo downloading info for: Hellfish
22:08:40 3731.771973 T:1956717488 DEBUG: scraper: ResolveIDToUrl returned <url>http://musicbrainz.org/ws/2/artist/ab8857ca-4f6f-49e6-8f13-4145bcab8693?inc=url-rels</url>
22:08:42 3733.772705 T:1956717488 DEBUG: -- nfo-scraper: Universal Artist Scraper
22:08:42 3733.772949 T:1956717488 DEBUG: -- nfo url: http://musicbrainz.org/ws/2/artist/ab8857ca-4f6f-49e6-8f13-4145bcab8693?inc=url-rels
22:08:42 3733.774414 T:1553986544 DEBUG: Thread MusicInfoScraper start, auto delete: false
22:08:42 3733.774902 T:1553986544 DEBUG: GetArtistDetails: Reading 'http://musicbrainz.org/ws/2/artist/ab8857ca-4f6f-49e6-8f13-4145bcab8693?inc=url-rels' ('Hellfish') using Universal Artist Scraper scraper (file: '/home/osmc/.kodi/addons/metadata.artists.universal', content: 'artists', version: '3.6.2')
22:08:42 3733.775391 T:1553986544 DEBUG: CurlFile::Open(0x4f3da00) http://musicbrainz.org/ws/2/artist/ab8857ca-4f6f-49e6-8f13-4145bcab8693?inc=url-rels
22:08:42 3733.776367 T:1553986544 INFO: easy_aquire - Created session to http://musicbrainz.org
22:08:43 3734.879395 T:1553986544 DEBUG: Get: Using "UTF-8" charset for XML "http://musicbrainz.org/ws/2/artist/ab8857ca-4f6f-49e6-8f13-4145bcab8693?inc=url-rels"
22:08:43 3734.888916 T:1553986544 DEBUG: scraper: GetArtistDetails returned <details><musicBrainzArtistID>ab8857ca-4f6f-49e6-8f13-4145bcab8693</musicBrainzArtistID><name>Hellfish</name><chain function="GetFanartTvArtistThumbsByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetTADBArtistThumbsByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetHTBThumbsByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetFanartTvArtistFanartsByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetTADBArtistFanartsByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetHTBFanartByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="AMGFallback"></chain><chain function="GetMBDiscographyByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetTADBBiographyByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetTADBArtistGenresByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetTADBArtistStylesByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetTADBArtistMoodsByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain><chain function="GetTADBLifeSpanByMBID">ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</chain></details>[/color]
22:08:43 3734.890869 T:1553986544 DEBUG: scraper: GetFanartTvArtistThumbsByMBID returned <details><url function="ParseFanartTvArtistThumbs" cache="fanarttv-artistimages-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693.json">http://webservice.fanart.tv/v3/music/ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693?api_key=ed4b784f97227358b31ca4dd966a04f1</url></details>
22:08:43 3734.892090 T:1553986544 DEBUG: CurlFile::Open(0x4f3da00) http://webservice.fanart.tv/v3/music/ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693?api_key=ed4b784f97227358b31ca4dd966a04f1
22:08:43 3735.204346 T:1553986544 ERROR: CCurlFile::Open failed with code 404 for http://webservice.fanart.tv/v3/music/ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693?api_key=ed4b784f97227358b31ca4dd966a04f1
22:08:43 3735.204834 T:1553986544 ERROR: Run: Unable to parse web site
22:08:43 3735.206299 T:1553986544 DEBUG: scraper: GetTADBArtistThumbsByMBID returned <details><url function="ParseTADBArtistThumbs" cache="tadb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-artist.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</url></details>
22:08:43 3735.208008 T:1553986544 DEBUG: CurlFile::Open(0x4f3da00) http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693
22:08:44 3735.497070 T:1553986544 DEBUG: Get: Using content of "http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693" as binary or text with "UTF-8" charset
22:08:44 3735.500244 T:1553986544 DEBUG: scraper: ParseTADBArtistThumbs returned <details></details>
22:08:44 3735.501709 T:1553986544 DEBUG: scraper: GetHTBThumbsByMBID returned <details><url function="ParseHTBThumbs" post="yes" cache="htb-images-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693.xml">http://htbackdrops.org/api/7681a907c805e0670330c694e788e8e8/searchXML?mbid=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693&aid=1,5</url></details>
22:08:44 3735.503418 T:1553986544 DEBUG: CurlFile::Open(0x4f3da00) http://htbackdrops.org/api/7681a907c805e0670330c694e788e8e8/searchXML
22:08:44 3735.853271 T:1553986544 DEBUG: Get: Using "UTF-8" charset for XML "http://htbackdrops.org/api/7681a907c805e0670330c694e788e8e8/searchXML?mbid=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693&aid=1,5"
22:08:44 3735.856689 T:1553986544 DEBUG: scraper: ParseHTBThumbs returned <details></details>
22:08:44 3735.857910 T:1553986544 DEBUG: scraper: GetFanartTvArtistFanartsByMBID returned <details><url function="ParseFanartTvArtistFanarts" cache="fanarttv-artistimages-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693.json">http://webservice.fanart.tv/v3/music/ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693?api_key=ed4b784f97227358b31ca4dd966a04f1</url></details>
22:08:44 3735.859619 T:1553986544 DEBUG: CurlFile::Open(0x4f3da00) http://webservice.fanart.tv/v3/music/ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693?api_key=ed4b784f97227358b31ca4dd966a04f1
22:08:44 3735.960693 T:1553986544 ERROR: CCurlFile::Open failed with code 404 for http://webservice.fanart.tv/v3/music/ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693?api_key=ed4b784f97227358b31ca4dd966a04f1
22:08:44 3735.961426 T:1553986544 ERROR: Run: Unable to parse web site
22:08:44 3735.962891 T:1553986544 DEBUG: scraper: GetTADBArtistFanartsByMBID returned <details><url function="ParseTADBArtistFanarts" cache="tadb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-artist.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</url></details>
22:08:44 3735.967529 T:1553986544 DEBUG: scraper: ParseTADBArtistFanarts returned <details><fanart></fanart></details>
22:08:44 3735.968750 T:1553986544 DEBUG: scraper: GetHTBFanartByMBID returned <details><url function="ParseHTBFanart" post="yes" cache="htb-images-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693.xml">http://htbackdrops.org/api/7681a907c805e0670330c694e788e8e8/searchXML?mbid=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693&aid=1,5</url></details>
22:08:44 3735.973633 T:1553986544 DEBUG: scraper: ParseHTBFanart returned <details><fanart></fanart></details>
22:08:44 3735.976562 T:1553986544 DEBUG: scraper: AMGFallback returned <details></details>
22:08:44 3735.977783 T:1553986544 DEBUG: scraper: GetMBDiscographyByMBID returned <details><url function="ParseMBDiscography" cache="mb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-discog.xml">http://musicbrainz.org/ws/2/release-group?artist=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693&limit=100&type=album</url></details>
22:08:44 3735.979736 T:1553986544 DEBUG: CurlFile::Open(0x4f3da00) http://musicbrainz.org/ws/2/release-group?artist=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693&limit=100&type=album
22:08:44 3736.171387 T:1553986544 ERROR: CCurlFile::FillBuffer - Failed: HTTP returned error 503
22:08:44 3736.171875 T:1553986544 ERROR: CCurlFile::Open failed with code 503 for http://musicbrainz.org/ws/2/release-group?artist=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693&limit=100&type=album
22:08:44 3736.172119 T:1553986544 ERROR: Run: Unable to parse web site
22:08:44 3736.173584 T:1553986544 DEBUG: scraper: GetTADBBiographyByMBID returned <details><url function="ParseTADBBiography" cache="tadb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-artist.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</url></details>
22:08:44 3736.179688 T:1553986544 DEBUG: scraper: ParseTADBBiography returned <details></details>
22:08:44 3736.181152 T:1553986544 DEBUG: scraper: GetTADBArtistGenresByMBID returned <details><url function="ParseTADBArtistGenres" cache="tadb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-artist.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</url></details>
22:08:44 3736.186523 T:1553986544 DEBUG: scraper: ParseTADBArtistGenres returned <details></details>
22:08:44 3736.187744 T:1553986544 DEBUG: scraper: GetTADBArtistStylesByMBID returned <details><url function="ParseTADBArtistStyles" cache="tadb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-artist.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</url></details>
22:08:44 3736.193359 T:1553986544 DEBUG: scraper: ParseTADBArtistStyles returned <details></details>
22:08:44 3736.194580 T:1553986544 DEBUG: scraper: GetTADBArtistMoodsByMBID returned <details><url function="ParseTADBArtistMoods" cache="tadb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-artist.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</url></details>
22:08:44 3736.200195 T:1553986544 DEBUG: scraper: ParseTADBArtistMoods returned <details></details>
22:08:44 3736.201660 T:1553986544 DEBUG: scraper: GetTADBLifeSpanByMBID returned <details><url function="ParseTADBLifeSpan" cache="tadb-ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693-artist.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/artist-mb.php?i=ab8857ca-4f6f-49e6-8f13-4145bcab8693ab8857ca-4f6f-49e6-8f13-4145bcab8693</url></details>
22:08:44 3736.208984 T:1553986544 DEBUG: scraper: ParseTADBLifeSpan returned <details></details>
22:08:44 3736.213135 T:1553986544 DEBUG: Thread MusicInfoScraper 1553986544 terminating
22:08:45 3736.423096 T:1731195888 DEBUG: Thread JobWorker 1731195888 terminating (autodelete)