[RELEASE] Texture Cache Maintenance utility - Printable Version +- Kodi Community Forum (https://forum.kodi.tv) +-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33) +--- Forum: Supplementary Tools for Kodi (https://forum.kodi.tv/forumdisplay.php?fid=116) +--- Thread: [RELEASE] Texture Cache Maintenance utility (/showthread.php?tid=158373) Pages:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
|
RE: [RELEASE] Texture Cache Maintenance utility - raspberry_pd - 2015-08-17 (2015-08-17, 03:50)Milhouse Wrote:(2015-08-17, 03:29)raspberry_pd Wrote: Some pages in your GitHub repo? Maybe?!! Fair enough. Hope my response didn't come across as implying documentation for this utility is insufficient. I'm sure it could be expanded upon but I think it's pretty good at the moment. RE: [RELEASE] Texture Cache Maintenance utility - lollo78 - 2015-08-20 Hi Milhouse, I need your help My system configuration: Raspberry Pi2 with Openelec and Aeon Nox theme; all media file stored into a Synology Nas (MySQL database created with MariaDB and phpMyAdmin). From when I transfered all into the NAS, Kodi is became slow to load images. I discovered your script: I installed it, I activated the webserver on port 8080 (instead of the default 80), reboot kodi and gave it a try. With jd option I seen that all the images are downloaded every time from Internet: I used your avatar example, but the situation is the same for all my media files (audio and movies). Code: OpenELEC:~ # ./texturecache.py jd movies avatar Into my media NAS folder there aren't the .nfo and .jpg files. Maybe for this reason it grab all from the Web. So I tryed Code: OpenELEC:~ # ./texturecache.py nc but nothing changed (Kodi is still slow and no info and image are saved into nas directory): Code: | banner | fanart | poster | thumb | thumbnail | TOTAL I used also the "prune" command (it delete a lot of things, but nothing). I don't know what to do now. Thx for any help :* RE: [RELEASE] Texture Cache Maintenance utility - redglory - 2015-08-20 jd doesn't cache your images. You need to use C option. RE: [RELEASE] Texture Cache Maintenance utility - Milhouse - 2015-08-20 (2015-08-20, 01:05)redglory Wrote: jd doesn't cache your images. You need to use C option. No no, the "C" option will force everything item to be re-cached! (2015-08-20, 00:56)lollo78 Wrote: Hi Milhouse, I need your help Try "./texturecache.py c" - this will cache only the remaining 1216 artwork items that are not yet in your cache. If the RPi is still slow once the texture cache is full populated then your problem is due to something else, maybe a very slow SD card? (2015-08-20, 00:56)lollo78 Wrote: Into my media NAS folder there aren't the .nfo and .jpg files. Yes, that would be the reason for Kodi using remote artwork urls. (2015-08-20, 00:56)lollo78 Wrote: but nothing changed (Kodi is still slow and no info and image are saved into nas directory): I'm not sure if you're expecting texturecache.py to create NFO and image files in your NAS directory - it won't do that. If you want to convert your remote artwork into local artwork, then use mklocal.py in conjunction with texturecache.py (see earlier posts for details on mklocal.py). RE: [RELEASE] Texture Cache Maintenance utility - lollo78 - 2015-08-20 Hi guys, with Code: ./texturecache.py c now I have this: Code: | banner | fanart | poster | thumb | thumbnail | TOTAL with Code: ./texturecache.py p Code: ./texturecache.py nc Code: | banner | fanart | poster | thumb | thumbnail | TOTAL How to manage Ignored, Not in cache Skipped and Undefined? This voice means that is not all cached, right? now if I run Code: ./texturecache.py jd movies avatar Code: [ so, mklocal.py, seems to be exactly wath I need. I just installed it and I searched in all the thread to understand how to use it, but I'm a little confused. I have to simply run Code: ./mklocal.py --readonly and after Code: /mklocal.py --nokeep RE: [RELEASE] Texture Cache Maintenance utility - Milhouse - 2015-08-20 "Error" corresponds to those items that were unable to be downloaded (you should have seen those listed). Not much you can do about those as they're probably no longer available remotely, so you need to use alternative artwork - your best bet would be to download alternative artwork localy and then replace the missing artwork in your library via the GUI (as we're only talking about 5 items, until you're up to speed with mklocal.py which would do this for you automatically). "Ignored" items are those artwork types that were not in your @cache.artwork list. If you add @logfile=tc.log" it will log detailed information during the run which will include details of the ignored artwork (search for "Ignored") - not sure why it should ignore thumbnails though, upload your log somewhere if you need further help. Edit: Oh yes, there's a second reason to ignore items - if the artwork matches an entry in "cache.ignore.types" (this defaults to "^video, ^music") the item will be ignored. The default settings avoid trying to cache embedded video or music artwork, as these can't be cached - thumbnail extraction is a GUI process and not supported by the web server which is being used here to cache artwork. Again, this is logged (search for "Ignored"). For mklocal.py, maybe start with this post - some of the arguments might have changed, but hopefully you should get the gist of it. Be aware that it will download new artwork unless you add the --readonly argument. Nothing will be changed in your media library unless you process the output from mklocal.py through "texturecache.py set". RE: [RELEASE] Texture Cache Maintenance utility - lollo78 - 2015-08-20 (2015-08-20, 22:00)Milhouse Wrote: If you add @logfile=tc.log" it will log detailed information during the run which will include details of the ignored artwork (search for "Ignored") - not sure why it should ignore thumbnails though, upload your log somewhere if you need further help. After Code: ./texturecache.py c @logfile=tc.log errors are still there, so don't consider my previous post edit. Code: | banner | fanart | poster | thumb | thumbnail | TOTAL Please, could you download my tc.log from https://www.dropbox.com/s/ndu22pyml90xzy7/tc.zip?dl=0? Thx Quote:For mklocal.py, maybe start with this postThx a lot, I read it and I do some test. RE: [RELEASE] Texture Cache Maintenance utility - Milhouse - 2015-08-20 (2015-08-20, 22:29)lollo78 Wrote: Please, could you download my tc.log from See edit to my previous post - it's due to embedded music artwork, eg: Code: 2015-08-20 22:20:01.148861:MainThread: Ignored [thumbnail ] image due to [^music] rule: music@nfs://192.168.1.68/volume1/music/MP3/Robben Ford/2014 - A Day In Nashville/01 Green Grass Rainwater.mp3 This type of artwork can only be extracted (and eventually cached) by a GUI process, ie. navigate using the GUI to the item in your library and display it - the artwork should be extracted/cached. RE: [RELEASE] Texture Cache Maintenance utility - lollo78 - 2015-08-20 OK, I'll try to solve this issue via GUI. Thx a lot. And what is Skipped and Undefined? It's an issue? For mklocal this is right? For example, if I want to save all movie artworks directly inside my Synology NAS film directory (with all the MKV files inside the FILM directory): Code: ./texturecache.py jd movies | mklocal.py --local /volume1/FILM/ --prefix nfs://192.168.1.68/volume1/FILM/ --artwork fanart poster clearlogo clearart --output fixup.dat and after Code: cat fixup.dat | ./texturecache.py set For tv show (stored in SERIE TV folder like Series_name with Seasons_subfolder)?!? Code: ./texturecache.py jd tvshow | mklocal.py -s --local /volume1/SERIE\040TV/ --prefix nfs://192.168.1.68/volume1/SERIE\040TV/ --season --artwork fanart poster clearlogo clearart --output fixup.dat If I undestood well, mklocal works only for movies and tv show and not for music, right? RE: [RELEASE] Texture Cache Maintenance utility - Milhouse - 2015-08-20 (2015-08-20, 23:27)lollo78 Wrote: For mklocal, I'm unable to find the local mounting point (Openelec). For local mounting point, this needs to be a path to your media files that the OS can access. If you're using OpenELEC, you'll need to add an NFS mount point and use that to access your media files over NFS. Or, as I'm assuming you're not posting this from OpenELEC, you can use your current PC to run mklocal.py assuming that has access to your media files (if it's a Windows PC, your --local path would be something like "E:\FILM", assuming "E:\" is mapped to "\\192.168.1.68\volume1"). (2015-08-20, 23:27)lollo78 Wrote: mklocal works only for movies and tv show, right? Not for music? Frown Movies, TVShows and Movie Sets only. Music (albums, artists, songs) is not currently supported, maybe one day. RE: [RELEASE] Texture Cache Maintenance utility - redglory - 2015-08-21 (2015-08-20, 01:39)Milhouse Wrote:Sorry i misread his post. I thought he was trying to re cache!(2015-08-20, 01:05)redglory Wrote: jd doesn't cache your images. You need to use C option. RE: [RELEASE] Texture Cache Maintenance utility - lollo78 - 2015-08-21 I found the NAS mounting point: Code: /volume1/xxx/ Actually my Code: /userdata/Thumbnails I gave a look inside this folder. It's full of actor images, shitty addon images (damned videodevil ), music artists, movies posters (I don't see fanart)... but if I use texturecache on a movie, ad example: Code: OpenELEC:~ # ./texturecache.py jd movies "come cani e gatti" I don't know why it search the poster from the web, when the same image is inside my Thumbnail folder. This happens with all movies. In the past I tested other media scraper, maybe this compromised the right system working. Maybe I have to delete all the Thumbnails folder and recreate it in the right way? But how? Thanks a lot for all the help :* EDIT: I looked also into my /userdata/Database folder. There are something missing? I have this: CDDB (folder) Addons16.db Addons19.db Addons19.db-journal Epg8.db Texture13.db TV26.db ViewModes.db RE: [RELEASE] Texture Cache Maintenance utility - Milhouse - 2015-08-22 (2015-08-21, 20:00)lollo78 Wrote: but, as you know, I'm searching to get a full speed GUI (no lag when browsing media libray), so if I use mklocal to save all the artwork on the NAS, what I expect about performance? Once artwork is cached, whether it's local or remote artwork, the performance of the client will be the same. The time taken to cache (or scrape, when re-scraping your library) will be quicker with local artwork. Local artwork also makes more sense when you have multiple clients as it avoids repeated downloads, consistent artwork on all clients (a client could display different artwork if between library scrapes some posters or fanart became more or less popular on the remote artwork website, returning different results to those shown by your other clients), and eliminates the risk of the remote artwork disappearing entirely (in a MySQL environment potentially leaving the client unable to display the specified artwork). (2015-08-21, 20:00)lollo78 Wrote: I think that local storage (microSD) is better (mine is a Samsung Evo 32GB class 10) and if all the thumbnail remains around 3 GB, I can archive it on the microSD. Not really sure what you mean by "archive it on the microSD". Having the Thumbnails folder on local storage is definitely best for performance. Your original artwork should ideally be stored locally on your NAS and will only be accessed once from the NAS when it is first cached, after which point the artwork will always be displayed using the cached version. (2015-08-21, 20:00)lollo78 Wrote: Actually my Yep, that's your cached artwork - your fanart will be in there. Unsure what you mean by "I doubt that is used well for the cache". The artwork in the cache will be using an alternative filename - use "texturecache.py s <yourfanartname>.jpg" to view the row in the Textures13.db, which will reveal the filename (cachedurl) as it exists in the Thumbnails cache folder. You can use "texturecache.py P" to prune the texture cache of unused artwork items and keep the size of the texture cache in check. (2015-08-21, 20:00)lollo78 Wrote: but if I use texturecache on a movie, ad example: That's how it works - your media library references the remote (or, ideally, local) artwork, and when you display this artwork for the first time (or scrape it) on the client the artwork is downloaded, reformatted, resized, optimised etc., and then stored in the texture cache (a row is added to Textures13.db, an image written into the Thumbnails folder). Next time you display the artwork it will be retrieved directly from the cache, and not the remote web site or locally from your NAS. (2015-08-21, 20:00)lollo78 Wrote: Maybe I have to delete all the Thumbnails folder and recreate it in the right way? But how? No, your Thumbnails folder is fine, you just need to understand the caching process better. (2015-08-21, 20:00)lollo78 Wrote: EDIT: I looked also into my /userdata/Database folder. There are something missing? Can't see a problem - what do you think is missing? You don't have MyVideosXX.db or MyMusicXX.db which is normal when using MySQL/MariaDB. RE: [RELEASE] Texture Cache Maintenance utility - Ed76 - 2015-08-22 hi, i am not sure if this is the right thread for my question... the problem is, after a clean kodi installation the folder .../roaming/kodi (windows) is growing very fast up to 1.5 gb in 5 month. there are a lot of thumbnails. is there a tool available to delete all that unneeded files without to delete the needed thumbnails and data for viedo database (fanart, cover....). something like the "ccleaner" for windows? is this possible with "texture cache maintenance utility"? Re: RE: [RELEASE] Texture Cache Maintenance utility - Milhouse - 2015-08-22 (2015-08-22, 11:59)Ed76 Wrote: is this possible with "texture cache maintenance utility"? Yep - the "prune" option: Code: texturecache.py P |