[xbozzo]

Thank you Karellen, I followed your words and could import the CVS and saved the database.

Now, I have trouble with step 5 on my Mac with python --version Python 2.7.10
(I'm using Kodi 18.3 on libreelec. python --version Python 2.7.15 throws the same error.)

python:
python last_fm_import.py

Traceback (most recent call last):

  File "last_fm_import.py", line 118, in <module>

    main()

  File "last_fm_import.py", line 94, in main

    cur.execute("SELECT DISTINCT Artist, Title FROM plays")

sqlite3.OperationalError: no such table: plays

My Kodi database is named MyMusic72.db.

2 zero byte files are created as well.


This is what I have done:



Step 2 tells something about Artist,Album,Title,DatePlayed

Should I change it to Artist,Album,Title,plays and create the database again?

EDIT: no, that did not work either.

[DaveBlake]

Should I change it to Artist,Album,Title,plays and create the database again?

EDIT: no, that did not work either.

The name of the field "DatePlayed" is not the problem. The clue is in the error message:
"sqlite3.OperationalError: no such table: plays"
 
The script is complaining that there is no table called "plays".

Sorry I have not read pack the rest of this thread to understand more details, and I just don't have the spare time.

[xbozzo]

The script is complaining that there is no table called "plays".

I was under the impression, that a table "plays" was created, as shown in the above screenshot:


Maybe the script complains about a missing table plays in the kodi database MyMusic72.db ?

Anyone?

[black_eagle]

Just a thought, but I know from some of my clients how easy it can be at times to overlook something.  @xbozzo , you have clicked "Write changes" to actually write the new db back to disk ?

[xbozzo]

Just a thought, but I know from some of my clients how easy it can be at times to overlook something.  @xbozzo , you have clicked "Write changes" to actually write the new db back to disk ?

Valid point :-) but the screenshot is made from the re-opened database lastfm.db on my harddrive.

(in addition, DB Browser asks for saving, when you try to close an edited/unsaved database. Also, the keyboard-shortcut CMD+S for save is working too) ;-)

When I browse the db, there is a table called plays

[xbozzo]

Ok, analyzing the script, I found the culprit:

python:
    # create a database connection

    database = "databases\lastfm.db"

    conn = create_connection(database)



    # create a database2 connection

    database2 = "databases\MyMusic72.db"

    conn2 = create_connection(database2)

The script tries to open/write (or whatever) the databases from a subdirectory databases\ which is non-existant.

Moreover, the \ backslash is not working as a folder separator here on Mac, (nor on LibreElec/OpenElec/*nix). Its just part of the filename, as you can see in the above screenshot.


I had posted the screenshot before, but did not realize it could be a problem, because on Mac a filename can look this way w/o causing a problem:


So, I changed the script slightly (just removed the databases\ part)

python:
   # create a database connection

    database = "lastfm.db"

    conn = create_connection(database)



    # create a database2 connection

    database2 = "MyMusic72.db"

    conn2 = create_connection(database2)

...and voilá,  it worked :-)

Thank you all for helping me nailing it down to a point, where I can fix it :-))

[docwra]

Awesome, great to hear it worked. Thanks all for the help...

Hopefully one day someone more skilled in python will write a Kodi Add-on which does all this automatically  The last.fm API works pretty good so it should be easy to bypass the export to csv bit.

I still use this script all the time with my Kodi installs and it makes Music come alive when you have the plays for the last 10 years backed up online and distributed around my Kodi clients.

[xbozzo]

The last.fm API works pretty good

No, it does not ;-)

I tried those Browsers: Internet Explorer (Win), Google Chrome (Mac/Win), Safari (Mac), Waterfox (Win/Mac) and Vivaldi (Win) and none of them could load the whole 222,002 Scrobbles of my last.fm user.

The progress always stopped at 420/1111, so I guess, there is a strange character or some limitation, or just too less RAM involved.

I checked all the exported/saved data and they all had slighlty different content (mostly some doublettes were not exported/skipped sometimes and sometimes not).

I tried an alternate api key and request delays from 0 to 500ms,
but hey, at least the great Webservice at https://benjaminbenben.com/lastfm-to-csv/ allows to save partial states of the exported data, so I now have about 80.400 scrobbles imported in Kodi. ;-]

This is not a problem we need to discuss here, but its a pitty that things always have to be that complicated ;-/

[dubwat]

@docwra Thanks so much for this   Took me 4 or 5 attempts but finally imported ~38k playcounts into kodi!

FYI: it got stuck on a Tori Amos song called Dātura from an album called To Venus and Back.  I don't think the script liked the ā - think it said it was not a UTF-8 character or something.

[docwra]

Cool glad it helped

Obviously this could be made into an Add-on by someone with better knowledge than me, but for a one off it works great in importing Last.Fm history!

[johnnybsquash]

Thank you Karellen, I followed your words and could import the CVS and saved the database.

Now, I have trouble with step 5 on my Mac with python --version Python 2.7.10
(I'm using Kodi 18.3 on libreelec. python --version Python 2.7.15 throws the same error.)

python:
python last_fm_import.py

Traceback (most recent call last):

  File "last_fm_import.py", line 118, in <module>

    main()

  File "last_fm_import.py", line 94, in main

    cur.execute("SELECT DISTINCT Artist, Title FROM plays")

sqlite3.OperationalError: no such table: plays

My Kodi database is named MyMusic72.db.

2 zero byte files are created as well.


This is what I have done:
Step 2 tells something about Artist,Album,Title,DatePlayed

Should I change it to Artist,Album,Title,plays and create the database again?

EDIT: no, that did not work either.

Hi
A newby here. I get exactly the same message and followed the same steps and removed the reference to '\databases' moved the script into the 'databases folder and have been trying to run the script from there but get exactly the same error as before. Desperate to get this to work.
Any ideas, please?
Johnny

[dubwat]

I think the table name has to be 'lastfm'

I was a complete novice when I tried this & it took me a few attempts to get it right.  I think the database is called lastfm and the table inside the database is also called lastfm, not plays.  I could be completely wrong though!

[black_eagle]

I think the table name has to be 'lastfm'

I was a complete novice when I tried this & it took me a few attempts to get it right.  I think the database is called lastfm and the table inside the database is also called lastfm, not plays.  I could be completely wrong though!

Pretty sure from looking at the code and this quote

Basically the table needed to be called "plays"

that the table needs to be called plays

@docwra is that last.fm api returning json ? I have a whole python class for returning and updating music info through Kodi's json api. I don't have a user account on last.fm but if you can post a few examples of what their api returns I can feed that into my local_library_utils class and hopefully update the play count that way. If it works OK, should be quite easy to roll an addon that does it all for you. No promises mind, time is always limited, but I have already written half of the stuff to do this anyway. I do need to know what their api returns though as I imagine you have access to different data if you have an account on there.

I have an api key that I use to grab the data that BBC Radio 2 scrobble so my radio helper can get art etc when I'm listening to that but that's public info.

[meowmoo]

I think the table name has to be 'lastfm'

I was a complete novice when I tried this & it took me a few attempts to get it right.  I think the database is called lastfm and the table inside the database is also called lastfm, not plays.  I could be completely wrong though!

Pretty sure from looking at the code and this quote

Basically the table needed to be called "plays"

that the table needs to be called plays

@docwra is that last.fm api returning json ? I have a whole python class for returning and updating music info through Kodi's json api. I don't have a user account on last.fm but if you can post a few examples of what their api returns I can feed that into my local_library_utils class and hopefully update the play count that way. If it works OK, should be quite easy to roll an addon that does it all for you. No promises mind, time is always limited, but I have already written half of the stuff to do this anyway. I do need to know what their api returns though as I imagine you have access to different data if you have an account on there.

I have an api key that I use to grab the data that BBC Radio 2 scrobble so my radio helper can get art etc when I'm listening to that but that's public info.

This sound great, would really appreciate a addon like this.
I have no idea about the api stuff and no clou where to look for the info you ne but
I can share my account if you wannt, so you can take a look at what ever you need, just drop me a pm.

[dm21912]

Ok, analyzing the script, I found the culprit:

python:
    # create a database connection

    database = "databases\lastfm.db"

    conn = create_connection(database)



    # create a database2 connection

    database2 = "databases\MyMusic72.db"

    conn2 = create_connection(database2)

The script tries to open/write (or whatever) the databases from a subdirectory databases\ which is non-existant.

Moreover, the \ backslash is not working as a folder separator here on Mac, (nor on LibreElec/OpenElec/*nix). Its just part of the filename, as you can see in the above screenshot.


I had posted the screenshot before, but did not realize it could be a problem, because on Mac a filename can look this way w/o causing a problem:


So, I changed the script slightly (just removed the databases\ part)

python:
   # create a database connection

    database = "lastfm.db"

    conn = create_connection(database)



    # create a database2 connection

    database2 = "MyMusic72.db"

    conn2 = create_connection(database2)

...and voilá,  it worked :-)

Thank you all for helping me nailing it down to a point, where I can fix it :-))

Was having the same issue in Linux but this seems to have been sorted it.

Put both database in the same folder as the script. 
Edited the lines as you did
It ran through and completed fine..


But, on checking the data (was doing this on a test db from an old backup), somethings amiss... two of the top 6 tracks are totally wrong and #7 is missing..



And the real #1 track has 0 plays associated with it

edit: Solved the random two tracks with hundreds to many players, but not solved why its not important all tracks. Quite a lot of tracks its not importing the data for.