[jbinkley60]

Yes, it is a forced date. You can't add the first episode without it.

Perfect.  Then that will work.  I'll have an update out tomorrow with this setting option and folks can test it.

I appreciate the help,

Jeff

[jbinkley60]

When I take a  look at it, the paths are different and the years or am I misinterpreting the results? Anyway, whichever, I am able to make out the dupes just by looking at the report. Great job!

Per the discussion here I have uploaded a new test version 1.0.6d to GitHub.  Please try running it as-is and you should get the same results as before with Goosebumps and similar..  Then try enabling the setting "Enhanced Duplicate Episode Analysis" under the Video DB tab and let me know if the Goosebumps and similar no longer report as duplicates.  You should also notice that the aired time value is now showing for all episodes, including those with duplicate file name matches.


Thanks,

Jeff

[ManilaByNight]

When I take a  look at it, the paths are different and the years or am I misinterpreting the results? Anyway, whichever, I am able to make out the dupes just by looking at the report. Great job!

Per the discussion here I have uploaded a new test version 1.0.6d to GitHub.  Please try running it as-is and you should get the same results as before with Goosebumps and similar..  Then try enabling the setting "Enhanced Duplicate Episode Analysis" under the Video DB tab and let me know if the Goosebumps and similar no longer report as duplicates.  You should also notice that the aired time value is now showing for all episodes, including those with duplicate file name matches.


Thanks,

Jeff

I tried it and yes it appeared the Goosebumps and other dupes disappeared.

However, there were these new ones that appeared which look like they are files of combined TV series.

[jbinkley60]

I tried it and yes it appeared the Goosebumps and other dupes disappeared.

However, there were these new ones that appeared which look like they are files of combined TV series.

They should have been there previously.  To confirm disable the enhanced dupe detection and try again.  Look further down in the list.  They should be there.

It took me a bit of staring at the screen to see the issue.  It's that basically you have one episode in Kodi twice pointing to two different files.  There may be no logic that I can add which won't break something else.   Maybe @Karellen, the scraper expert, will have some ideas.   This is the challenge with many folks doing things differently.  I certainly could add an option to turn off this check altogether but that could cause missing other real duplicates.


Thanks,

Jeff

[Karellen]

Sorry, I can't think of anything to workaround that issue.

[ManilaByNight]

I tried it and yes it appeared the Goosebumps and other dupes disappeared.

However, there were these new ones that appeared which look like they are files of combined TV series.

They should have been there previously.  To confirm disable the enhanced dupe detection and try again.  Look further down in the list.  They should be there.

It took me a bit of staring at the screen to see the issue.  It's that basically you have one episode in Kodi twice pointing to two different files.  There may be no logic that I can add which won't break something else.   Maybe @Karellen, the scraper expert, will have some ideas.   This is the challenge with many folks doing things differently.  I certainly could add an option to turn off this check altogether but that could cause missing other real duplicates.


Thanks,

Jeff

It's not a big issue for me since I can scroll down the list and make comparisons based on the path and filename. It's just that some of these episode files came this way when I downloaded them. I read documentation here in Kodi before explaining these types of tv episode files and it said that these are files having multiple episodes in them. I even have one (or two) file(s) that read S01E01E02E0304 telling me that it contains the first 4 episodes of Season 1 of a particular TV series.

Anyway, the good side is that there is now a utility/tool like this to be able to scan the entire database for possible dupes to generate a singular report makes life easier than having to manually go and search every individual season folder searching for duplicate episode files in them is a big help and makes life so much easier.

Kudos to you! Great job!

[Karellen]

@jbinkley60

Can your addon be submitted to the Kodi repo or are you manipulating the database directly?

[jbinkley60]

@jbinkley60

Can your addon be submitted to the Kodi repo or are you manipulating the database directly?

It's almost all done through direct database access.  There is no way around doing what I do in the KSCleaner addon with RPC calls.  The same is true for the Mezzmo Kodi addon.


Thanks,

Jeff

[jbinkley60]

It's not a big issue for me since I can scroll down the list and make comparisons based on the path and filename. It's just that some of these episode files came this way when I downloaded them. I read documentation here in Kodi before explaining these types of tv episode files and it said that these are files having multiple episodes in them. I even have one (or two) file(s) that read S01E01E02E0304 telling me that it contains the first 4 episodes of Season 1 of a particular TV series.

Anyway, the good side is that there is now a utility/tool like this to be able to scan the entire database for possible dupes to generate a singular report makes life easier than having to manually go and search every individual season folder searching for duplicate episode files in them is a big help and makes life so much easier.

Kudos to you! Great job!

Good to hear and I am glad it is adding value.  Thanks for the feature suggestion.

Jeff

[jbinkley60]

I have uploaded a new test version 1.0.6e to GitHub.  This version has the following enhancements:
 

• Fixes 2 bugs which broke the Clean All function during the development of the dupe detection feature
  
• Adds a new Analyze All feature which  will analyze all tables in your video database and output either the GUI, a text file or both, depending upon the addon setting.  The default setting is GUI.
  

I appreciate anyone who is willing to test this new feature and provide feedback.


Thanks,

Jeff

[kittmaster]

I have uploaded a new test version 1.0.6e to GitHub.  This version has the following enhancements:
 

• Fixes 2 bugs which broke the Clean All function during the development of the dupe detection feature
  
• Adds a new Analyze All feature which  will analyze all tables in your video database and output either the GUI, a text file or both, depending upon the addon setting.  The default setting is GUI.
  

I appreciate anyone who is willing to test this new feature and provide feedback.


Thanks,

Jeff

I'll give it a whirl later tonight, thanks for all your efforts.

[jbinkley60]

I'll give it a whirl later tonight, thanks for all your efforts.

Thanks.  Just note that right now each full analysis will be written to a new file, not overwriting the same file.  The files tend to be small sub 100k in size.  If this becomes a problem I can add an option to save or overwrite.


Jeff

[kittmaster]

I'll give it a whirl later tonight, thanks for all your efforts.

Thanks.  Just note that right now each full analysis will be written to a new file, not overwriting the same file.  The files tend to be small sub 100k in size.  If this becomes a problem I can add an option to save or overwrite.


Jeff

Looking forward, being on a fire tv device, flash space is premium, I think the overwrite would be a needed feature where a single 100K file is more than reasonable, stacking 100K's over time on that kind of device could be problematic without a cache clear... just thinking ahead.

[jbinkley60]

Looking forward, being on a fire tv device, flash space is premium, I think the overwrite would be a needed feature where a single 100K file is more than reasonable, stacking 100K's over time on that kind of device could be problematic without a cache clear... just thinking ahead.

OK.  I think in the next test release I'll add an option called 'Retain Analysis Files" which when enabled will operate as it does today, keeping all old date stamped files.  When disabled, it will delete any old .txt or .csv files associated with prior analysis runs or CSV exports when the addon is launched.  That way you can run the addon, do all of the various exports and analysis and copy them off.  They'll stay until the addon is started again.  This seems like a good balance.  How does that sound ?  You would have the option of starting the addon and then just shutting it down to delete any analysis files.

Also if you set the output to GUI nothing will be written to the Fire TV flash.


Thanks,

Jeff

[jbinkley60]

Looking forward, being on a fire tv device, flash space is premium, I think the overwrite would be a needed feature where a single 100K file is more than reasonable, stacking 100K's over time on that kind of device could be problematic without a cache clear... just thinking ahead.

I was able to add the functionality described above and have posted version1.0.6f on GitHub.  The option Retain Analysis Files needs to be disabled to delete the old files upon startup.  You'll see a message in the addon log viewer showing the number of files deleted and kept.  Nothing should be kept unless another addon writes to the output folder.  Otherwise it will be 0.


Thanks,

Jeff