Kodi Community Forum
Duplicate entries for lowercase and uppercase percent encoded paths - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: General Support (https://forum.kodi.tv/forumdisplay.php?fid=111)
+---- Forum: OS independent / Other (https://forum.kodi.tv/forumdisplay.php?fid=228)
+---- Thread: Duplicate entries for lowercase and uppercase percent encoded paths (/showthread.php?tid=349520)



Duplicate entries for lowercase and uppercase percent encoded paths - appelgran - 2019-11-24

I've had an issue with duplicates for a while. I tracked down the cause to percent encoding in paths having changed to uppercase at some point.

These are the <filenameandpath> tags for two different entries from a exported xml library file. You can see the difference right at the start after smb (%3a vs. %3A).

<filenameandpath>rar://smb%3a%2f%2fBOX%2f_film%2fIsle.of.Dogs.2018.720p%2fisle.of.dogs.2018.720p.rar/Isle.of.Dogs.2018.720p.mkv</filenameandpath>
<filenameandpath>rar://smb%3A%2F%2FBOX%2F_film%2FIsle.of.Dogs.2018.720p%2Fisle.of.dogs.2018.720p.rar/Isle.of.Dogs.2018.720p.mkv</filenameandpath>

Urldecoded these are identifical:

xml:
<filenameandpath>rar://smb%3a%2f%2fBOX%2f_film%2fIsle.of.Dogs.2018.720p%2fisle.of.dogs.2018.720p.rar/Isle.of.Dogs.2018.720p.mkv</filenameandpath>
<filenameandpath>rar://smb%3A%2F%2FBOX%2F_film%2FIsle.of.Dogs.2018.720p%2Fisle.of.dogs.2018.720p.rar/Isle.of.Dogs.2018.720p.mkv</filenameandpath>

1. How can I fix this in my library? I tried export, change all to uppercase, import. But then I got even more duplicates. I don't want to lose playstate.

2. If one assume the problem should be solved with URL normalization (see wikipedia on that term). What part has that responsibility? Core, scraper or VFS-addon? I want to submit a bug report.


RE: Duplicate entries for lowercase and uppercase percent encoded paths - appelgran - 2019-12-06

I can answer my first question myself now as I didn't want to wait any longer. To repair my library and get rid of the false duplicates I did the following:

1. Exported video library
2. Changed all my video sources to have no content (instead of Movies/TV Shows etc)
3. Double checked that all movies/tv shows were gone from library
4. Transferred exported xml document to my pc (from Kodi running on LibreElec)
5. Searched and replaced all "%3a" and "%2f" with "%3A" and "%2F"
6. Transferred the xml document back to my device
7. Created a advancedsettings.xml file according to (https://kodi.wiki/view/Import-export_library/Video#Watched.2C_PlayCount.2C_ResumePoints)
8. Changed importwatchedstate and importresumepoint both to true
9. Transferred advancedsettings.xml to the right location on my device (see https://kodi.wiki/view/Advancedsettings.xml and https://kodi.wiki/view/Userdata)
10. Run Import video library
11. Changed my video sources back to each content type

Done. Those changes made all my false duplicates disappear.

I'm still interested in an answer tp my second question. Please share if you have any idea.