Posts: 26,215
Joined: Oct 2003
Reputation:
187
Are you sure it's _exactly_ 250? If so, that's an extremely interesting datapoint, but to be honest makes no sense whatsoever.
Are you certain it's not something silly like the NAS failing to send more than 250 items over? (Last time you scanned, it wasn't on the NAS, right?)
Posts: 357
Joined: Nov 2004
Reputation:
0
2009-02-17, 15:04
(This post was last modified: 2009-02-17, 16:00 by kzr1y2.)
Appreciate the quick response.
When the audio library exceeded the HDD capacity (currently at ~79K files), I moved to using the NAS exclusively - around post-11xxx builds.
At first I thought it might be a PMIII skin cosmetic issue, but switching to a different skin or restarting the XBOX yielding the same results - performed library clean and/or DB deletion with restarts in-between.
As each <artist> folder has a varying amount of <album> sub-folders and audio files, you are correct that it could be concidental that it seems to run into to issues at 250+ <artist> folders. I had a look at the last <album> sub-folder in the last <artist> that was added to the library and the <album> was incomplete. Selecting 'Scan To Library' on the <artist> folder adds the missing tracks and in some cases, the missing <album>s.
Here's a file/folder count the breakdown for \\DNS-323\Music\A\:
Total Folders = 903
<artist> Folders = 255
TBN = 648
JPG = 1,148
MP3 = 3,2
It seemed to have stopped adding the files (MP3, TBN, etc.) to the library once it exceeded 4,000 ... not sure the exact number.
Posts: 26,215
Joined: Oct 2003
Reputation:
187
Excellent, so we now have 2 data points for the same bug. The key now will be getting it reproducible or at least tracking it down a bit further.
I'll try and do up a test exe, and will post it in the trac ticket when I have it ready. Obviously you'll need the rest of a build installed - I suggest grabbing one of Jester's builds as a base.
Filenames and/or folders shouldn't matter: It's not a problem with anything failing to scan, as they all scan in with an update library (or multiple update libraries). The problem appears that during a large scan, something goes wrong which stops things being added to the library. Tracking this down is the tricky bit.
Cheers,
Jonathan
Posts: 357
Joined: Nov 2004
Reputation:
0
Hi Jonathan,
I'll need some help tracking down the latest build from Jester ... not sure where to look.
I'll pull the EXE from the Trac once I see your post in this thread.
Cheers,
Posts: 357
Joined: Nov 2004
Reputation:
0
2009-02-18, 20:47
(This post was last modified: 2009-02-18, 20:50 by kzr1y2.)
Much appreciated 'stoli' ... jonathan, will download and install 'MCSetup-Rev17788-jester.exe'.
Cheers,
Posts: 357
Joined: Nov 2004
Reputation:
0
Good News !!!
I can reproduce the problem with Jester's Win32 Build 17788 ... and issuing 'Update Library' does add the missing content from 'Scan To Library'.
Cheers,
KZ
Posts: 357
Joined: Nov 2004
Reputation:
0
@jmarshall:
Installed Jester's SVN 18004 (Feb 23, 2009) build, deleted the Music database and Thumbnails from the userdata folder. Issued 'Clean Library' from Music Settings.
- Issued a 'Scan To Library': not all files added to library
- Issued a 'Update Library': remaining (missing) files added to library
Let me know if you would still like me to run a 'full logging' enabled EXE.
Cheers,
KZ
Posts: 26
Joined: Sep 2004
Reputation:
0
2009-02-24, 20:59
(This post was last modified: 2009-02-24, 21:19 by TheNME123.)
Hiho,
i played a bit around with the XBMC sources and compiled a version with some SQLite output.
I submitted the logfile and the db to the trac ticket.
It seems that sqlite is executing each query and outputting result is fine. But in fact it isn't! At some point each subsequent db query isn't just executed/stored to the db file?!
The log entry of the last song being inserted is on line 2239. Because my C++ skills are very limited i can't investigate why SQLite shows this behaviour when the audio files are organized in subdirectories instead of being all in one directory.
I hope this information helps
Greetings
TheNME123
P.S.: I deleted some albums that were scanned and inserted correctly before. Afterwards i scanned the directory again and now some of the files that were not inserted before got inserted. In the songs table there are always exactly 502 entries. It stops exactly after this amount of songs (although the album is not completly inserted to the db).
Posts: 26,215
Joined: Oct 2003
Reputation:
187
kzr1y2: What I really need is some idea of why this is occuring, as until I can reproduce it, it's going to be very difficult to fix it.
So useful information would be:
1. Is it the number of directories involved? To test, combine a bunch of your folders and see if it gets to a different folder.
2. Is it the number of files involved? Remove some files early on in the scanning, and see if it gets further.
I'll see if I can do up a test build in a little bit with some more logging that may help us track it down further.
Cheers,
Jonathan