Kodi Community Forum
Release Universal Scraper for Music Artists - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Music Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=303)
+----- Thread: Release Universal Scraper for Music Artists (/showthread.php?tid=132623)

Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42


RE: [Release] Universal Scraper for Music Artists - deh2k7 - 2013-01-23

(2013-01-23, 22:56)olympia Wrote:
(1970-01-01, 02:02)curtis-rI8972586' Wrote: @olympia,

Thanks for the clear explanation of the issue. Is there any plan to try to get the last.fm xbmc account reactivated? Is there an end-user solution whereby using an individual's account?

http://www.last.fm/group/Last.fm+Web+Services/forum/21604/_/2199932

last.fm give seems to give a shit on this or they don't even read their API forums. No other way to get in contact with them.
Some push from your side guys might help, but honestly I don't think so.

It's time to start filling up theaudiodb.com... Adding an artist to this site is very easy and quick. You just need to enter the musicbrainz ID and the site will automatically import a lot of info, then only the gaps need to be filled in.


Hi Olympia - this link might help, it's a way to send a support request for account issues via the website, if you haven't seen it:
http://www.last.fm/help/support

I also found a way to request additional API accounts/keys, perhaps a new key request? I don't know if you own the account or have access to do this one.
http://www.last.fm/api/accounts

Thanks again for all of your hard work - your scrapers rock!



RE: [Release] Universal Scraper for Music Artists - un1versal - 2013-01-24

I get tripped and quadrupled and quintupled artist photos, its ridiculous for some artists there's like 15 pictures. Some its just one.

uNi


RE: [Release] Universal Scraper for Music Artists - n1md4 - 2013-01-24

(2013-01-23, 13:11)olympia Wrote: Hello n1md4,

Thank you for the nicely raised issue and the willingness for giving back to the community.

It's a work in progress, and every new community project has its learning curve Wink

(2013-01-23, 13:11)olympia Wrote: Looking at specifically 'Bobbie Gentry':

- In general, the scraper always does the initial search on musicbrainz, then jumping onto the other sites either using the musicbrainz id or the link provided by musicbrainz

Okay, that's good to know.

(2013-01-23, 13:11)olympia Wrote: - I do think it is clear, that scraping artist bio is currently only possible from theaudiodb.com

I had read that somewhere, something to do with other sites suppressing bio scraping.

(2013-01-23, 13:11)olympia Wrote: - The artist doesn't exist on theaudiodb.com, so scraping from there is not possible

I have created an account on theaudiodb.com and have submitted my first page Smile

(2013-01-23, 13:11)olympia Wrote: - You will also not be able to get images from fanart.tv as the artist doesn't exist there either

I have created an account here too, the picture approval process takes a little longer though; as I'm sure you're aware.

(2013-01-23, 13:11)olympia Wrote: - So the only source for some info can be musicbrainz and allmusic (but no bio from allmusic)

Okay, I'll keep that in mind. With theaudiodb.com updated, this shouldn't be a problem now, besides adding artists/bands to theaudiodb.com is a very quick and simple process.

(2013-01-23, 13:11)olympia Wrote: - Information from musicbrainz is limited, but you can scrape discogs and lifespan info just right now

I don't know how I might use alternative scrapers, as you're suggesting, but I'm not sure it'll be necessary.

(2013-01-23, 13:11)olympia Wrote: - In case you want additional info from allmusic (except bio) you need to add the allmusic link on musicbrainz

I don't know how to add links, but to be fair, I've not much played with musicbrainz much; save grabbing MBIDs. Would you be able to point to an example, or the relevant documentation?

(2013-01-23, 13:11)olympia Wrote: - In case you want the best scraping experience and to serve the community the best as well, then you should add the artist to theaudiodb and fanart.tv as these two sites provide the best seach hits, quality of information and reliability.

This is my preference, as I like things done accurately and efficiently.


I have one last question. Now I've submitted a bio for Bobbie Gentry on theaudiodb.com I assume those changes are immediately available. I've run Update Library, but the new data doesn't upload. Do you have any idea why this does not work and suggestions on how to fix it?


RE: [Release] Universal Scraper for Music Artists - olympia - 2013-01-24

(2013-01-23, 23:16)deh2k7 Wrote: Hi Olympia - this link might help, it's a way to send a support request for account issues via the website, if you haven't seen it:
http://www.last.fm/help/support
I saw this, but this is not primarily about API account issues, but now I gave it a try. Let's see.

(2013-01-23, 23:16)deh2k7 Wrote: I also found a way to request additional API accounts/keys, perhaps a new key request? I don't know if you own the account or have access to do this one.
http://www.last.fm/api/accounts
I am not gonna request a new one until we can't clarify with them what was the reason behind the suspension.


RE: [Release] Universal Scraper for Music Artists - olympia - 2013-01-24

(2013-01-24, 01:42)n1md4 Wrote: I don't know how I might use alternative scrapers, as you're suggesting, but I'm not sure it'll be necessary.
I didn't mean alternate scrapers Smile
I meant scraping discography and lifespan data (born/death) was/is scraping fine for Bobbie Gentry from musicbrainz...

(2013-01-24, 01:42)n1md4 Wrote: I don't know how to add links, but to be fair, I've not much played with musicbrainz much; save grabbing MBIDs. Would you be able to point to an example, or the relevant documentation?
See this artis as an example: http://musicbrainz.org/artist/79239441-bfd5-4981-a70c-55c3f15c1287
External Link on the righ-bottom corner. You can add external link with an account using the 'Relate to URL' button.

(2013-01-24, 01:42)n1md4 Wrote: I have one last question. Now I've submitted a bio for Bobbie Gentry on theaudiodb.com I assume those changes are immediately available. I've run Update Library, but the new data doesn't upload. Do you have any idea why this does not work and suggestions on how to fix it?

You need to go into artist details and refresh the artist. Update Library will not update already scraped artists. That would take forever for every library update...

...and thanks again for your efforts making the above mentioned databases better.


RE: [Release] Universal Scraper for Music Artists - un1versal - 2013-01-24

(2013-01-24, 00:41)uNiversal Wrote: I get tripped and quadrupled and quintupled artist photos, its ridiculous for some artists there's like 15 pictures. Some its just one.

uNi

@ Olympia did you read that?

It happens in current RC3 builds idk if this is regular behaviour.

uNi


RE: [Release] Universal Scraper for Music Artists - olympia - 2013-01-24

(2013-01-24, 12:57)uNiversal Wrote:
(2013-01-24, 00:41)uNiversal Wrote: I get tripped and quadrupled and quintupled artist photos, its ridiculous for some artists there's like 15 pictures. Some its just one.

uNi

@ Olympia did you read that?

It happens in current RC3 builds idk if this is regular behaviour.

uNi

I don't even understand what you are trying to say here.
...and I am definitely not listening to reports on such tones


RE: [Release] Universal Scraper for Music Artists - un1versal - 2013-01-24

Im saying that my music library the artists genre it displays duplicate and more pictures of same artist but not all artists are duplicated entries or even up-to 10x entries for some artists..

idk if that is normal behaviour or its duplicating artists because of some issue. But if your not interested in such reports then ignore it.

uNi


RE: [Release] Universal Scraper for Music Artists - olympia - 2013-01-24

Dear uNiversal,

I am interested in well articulated bug reports which are understandable. Yours was not.
...and it is still not very. Why are you saying the artist photos are duplicated or triplicated or whaterever you wish, if actually the artists are duplicated. This by the way immediatelly comes to the conclusion that it's not a scraper issue. The scraper is not creating artists. XBMC does. I see a potential tagging issue here, but if you feel your tags are perfect, then raise a proper (with a debug log) bug report in the General Support Forum.

I am also interested and more importantly more motivated to look into reports when I don't see words like "ridiculous".


RE: [Release] Universal Scraper for Music Artists - un1versal - 2013-01-24

Dearest Olympia

Im not English native speaker, ok? So forgive me if I use words like ridiculous (to describe ridiculous things) or cant describe things perfectly the first time as I dont undertsand if its the pictures or if its the arists or what is getting duplicated, or if its xbmc or scraper or even tagging, so excuse me, for disturbing.

I will have a look at tagging as suggested, and if it isnt related to tagging I will do as suggested and submit a proper report.

thank you.

uNi


RE: [Release] Universal Scraper for Music Artists - olympia - 2013-01-24

I am far from being native English speaker as well. I still feel the weight of words, especially those words which can hurt and offense others, in this case those who are working hard in their freetime for you to get a better media center experience.


RE: [Release] Universal Scraper for Music Artists - un1versal - 2013-01-24

If I used words that offended you please let me know, as It definitely was not the intent.

Anyway I looked at tagging and it was indeed tagging causing this, so thank you for suggesting possible tagging issues.

Thank you for your time especially for your contributions to XBMC, it did and does help have a better media experience.

Like you, though in different filed also spend a great deal of time here and wiki also for same reasons to help others get a better media center experience.

Thank you again and apologies for whatever words may have been heavy.

uNi


RE: [Release] Universal Scraper for Music Artists - Brtrnd - 2013-01-24

The api terms of service have a mail adress that you can mail to. Try that one?
http://www.last.fm/api/tos


RE: [Release] Universal Scraper for Music Artists - zag - 2013-01-24

(2013-01-24, 15:38)Brtrnd Wrote: The api terms of service have a mail adress that you can mail to. Try that one?
http://www.last.fm/api/tos

Nice find, I've emailed them for an explanation.


Re: [Release] Universal Scraper for Music Artists - n1md4 - 2013-01-24

Personally, I can't be bothered with Last.fm for scraping, as they yield too much power that they can give and take away as they please; with little or no reason.

There are many community driven audio metadata projects, jump on that wagon, and start sharing and submitting, and then we have the power to ensure data remains open and free.