• 1
  • 62
  • 63
  • 64(current)
  • 65
  • 66
  • 197
[RELEASE] Texture Cache Maintenance utility
Even -L isn't working properly on OpenELEC so maybe the redirection support in curl 7.36.0 is a bit "broken". At least the direct url works.
Texture Cache Maintenance Utility: Preload your texture cache for optimal UI performance. Remotely manage media libraries. Purge unused artwork to free up space. Find missing media. Configurable QA check to highlight metadata issues. Aid in diagnosis of library and cache related problems.
Reply
yes for sure it works with the direct link. you just only forget at the first page the "e" in texturecache.py

hope you know what i mean
Reply
Yeah, formatting my card solved the problem. But it wasn't just the format... I had been formatting before but I remembered that I had raspberrypi problems before on a gaming distro which was really finicky if you didn't format the card with "all zeros" option. Did that and this solved the problem as well. Random!
Reply
(2014-05-19, 23:35)k1lla1nvan1lla Wrote: yes for sure it works with the direct link. you just only forget at the first page the "e" in texturecache.py

Thanks, fixed.

(2014-05-20, 05:20)rbusenet Wrote: Yeah, formatting my card solved the problem. But it wasn't just the format... I had been formatting before but I remembered that I had raspberrypi problems before on a gaming distro which was really finicky if you didn't format the card with "all zeros" option. Did that and this solved the problem as well. Random!

Excellent - let's hope it holds itself together! Smile
Texture Cache Maintenance Utility: Preload your texture cache for optimal UI performance. Remotely manage media libraries. Purge unused artwork to free up space. Find missing media. Configurable QA check to highlight metadata issues. Aid in diagnosis of library and cache related problems.
Reply
texturecache.py (Version 1.6.1)
  • Add support to rbphdmi for vcgencmd display_power which allows HDMI to be disabled and enabled without requiring a restart of xbmc.bin. Requires firmware from 23 May 2014 onwards. If the path to vcgencmd can't be determined automatically then set @bin.vcgencmd with a valid path (defaults to /usr/bin/vcgencmd but uses which to determine a working alternative as long as its on $PATH). Optionally set @bin.ceccontrol to the path of a script that will be called with "on" and "off" arguments after HDMI is enabled or disabled - the default value for this property is not defined.
Texture Cache Maintenance Utility: Preload your texture cache for optimal UI performance. Remotely manage media libraries. Purge unused artwork to free up space. Find missing media. Configurable QA check to highlight metadata issues. Aid in diagnosis of library and cache related problems.
Reply
Fab script thankyou. Cleaned up my messed up cache thanks to some upgrades/downgrades etc.

Here is another feature that would suit your script nicely if you would consider.
I display all movies with view=Media Info, which means show fanart. Some movies don't have any fanart so no picture shows. Yet the movie may well have a thumbnail and poster. Ideally xbmc would coerce one of those to the job, but given it doesn't, perhaps a feature of your script would be to find movies with missing fanart, and copy the listed thumbnail or poster as fanart and mark it so in the db.
I appreciate there may be size rules so some resizing or cropping may be required.

Great work, thanks
Reply
That's probably not something I'm going to add any time soon, as there are addons (eg. Artwork Downloader) that can do a much better job of "filling in" missing artwork.

You can at least run qa to detect which movies have missing artwork, and either manually copy in replacement artwork, or use a media manager (Ember, etc.) to find suitable artwork.

I also think that using posters as fanart would look pretty fuggly...
Texture Cache Maintenance Utility: Preload your texture cache for optimal UI performance. Remotely manage media libraries. Purge unused artwork to free up space. Find missing media. Configurable QA check to highlight metadata issues. Aid in diagnosis of library and cache related problems.
Reply
I can not use this script, it never downloads anything. Am I missing something? It always tells me: error downloading file (404)...

I call it like this:
Code:
./texturecache.py c

Example output in the logfile:
Quote:2014-05-28 01:48:58.455191:Thread-2 : Failed to download image URL [/image/image%3a%2f%2f%252fhome%252fandi%252f.xbmc%252faddons%252fskin.amber%252ficon.png%2f], status [404], attempts remaining [1]
2014-05-28 01:48:58.457593:Thread-1 : preparedl.RECEIVED DATA: {"id":"preparedl","jsonrpc":"2.0","result":{"details":{"path":"image/image%3a%2f%2f%252fhome%252fandi%252f.xbmc%252faddons%252fweather.wunderground%252ficon.png%2f"},"mode":"redirect","protocol":"http"}}
Reply
It's XBMC that is failing to download the files, not the script.

Have a look in your xbmc.log for errors and try to understand why XBMC can't access those files. For instance, do the files that XBMC can't download actually exist and are they accessible?

In your example, do these files actually exist?

Code:
/home/andi/.xbmc/addons/skin.amber/icon.png
/home/andi/.xbmc/addons/weather.wunderground/icon.png

The script only tries to access these files via XBMC, and when XBMC fails to find the files, the script reports an error.
Texture Cache Maintenance Utility: Preload your texture cache for optimal UI performance. Remotely manage media libraries. Purge unused artwork to free up space. Find missing media. Configurable QA check to highlight metadata issues. Aid in diagnosis of library and cache related problems.
Reply
Yes they are accessible. If I delete the Textures13.db and thumbnails folder, all icons are cached again when I browse through XBMC manually.
I'll check the XBMC logs later...
Reply
Running XBMC with debug error logging doesn't seem to reveal anything, I get only those entries:

Quote:22:21:31 T:140127021676288 DEBUG: webserver: request received for /image/image%3a%2f%2f%252fhome%252fandi%252f.xbmc%252faddons%252fskin.amber%252ficon.png%2f
22:21:31 T:140126663472896 DEBUG: webserver: request received for /jsonrpc
22:21:31 T:140126797690624 DEBUG: Previous line repeats 1 times.
22:21:31 T:140126797690624 DEBUG: webserver: request received for /image/image%3a%2f%2f%252fhome%252fandi%252f.xbmc%252faddons%252fscript.globalsearch%252ficon.png%2f

Downloading from within XBMC (manually selecting items) works, but with the script it does not. Do I need to change a config value for the script to make it work?
Reply
Shouldn't have to. Try enabling verbose logging of curl requests in xbmc.
Texture Cache Maintenance Utility: Preload your texture cache for optimal UI performance. Remotely manage media libraries. Purge unused artwork to free up space. Find missing media. Configurable QA check to highlight metadata issues. Aid in diagnosis of library and cache related problems.
Reply
Verbose logging for Curl gives no additional output, I also activates JSON verbose logging, but nothing special here, too:

Quote:22:33:22 T:139708625573632 DEBUG: webserver: request received for /image/image%3a%2f%2f%252fhome%252fandi%252f.xbmc%252faddons%252fmetadata.themoviedb.org%252ficon.png%2f
22:33:22 T:139708298422016 DEBUG: webserver: request received for /jsonrpc
22:33:22 T:139708298422016 DEBUG: JSONRPC: Incoming request: {"method": "Files.PrepareDownload", "params": {"path": "image://%2fusr%2fshare%2fxbmc%2faddons%2fscreensaver.xbmc.builtin.black%2ficon.png/"}, "id": "preparedl", "jsonrpc": "2.0"}

No match when searching for the word "curl" in the log file
Reply
I can't remember the exact wording, which may have changed in Helix (which I'm running), but it's something like "Enable component-specific logging" and then within that option you enable "Verbose logging for CURL library (http, dav)".

It will be very obvious once you have it enabled.

Is it just these two addon icons that aren't caching? I wonder if it's the recently introduced Gotham "security" feature as XBMC now tends to allow access only to files that are "within" a source, although I'm able to cache /usr/share artwork without any problems, and I'd expect .xbmc/addons to be accessible.
Texture Cache Maintenance Utility: Preload your texture cache for optimal UI performance. Remotely manage media libraries. Purge unused artwork to free up space. Find missing media. Configurable QA check to highlight metadata issues. Aid in diagnosis of library and cache related problems.
Reply
Nothing is caching, no movies, artists, albums... yes I found the option but it is not logged.
Is curl used for caching local fanart, too? Because most of my textures are either pulled directly out of mp3 files or from local fanart in the folders.

Ok some movie fanart will be pulled via HTTP, I checked the art table in the database. Now I have some output in the logifle:

Quote:22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_OUT: HEAD /t/p/original/LXNMeisGBRDMERehjNQDnz9qKI.jpg HTTP/1.1
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_OUT: User-Agent: XBMC/13.0 Git:Unknown (Linux; Arch Linux; 3.14.2-1-ARCH x86_64; http://xbmc.org)
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_OUT: Host: image.tmdb.org
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_OUT: Accept: */*
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_OUT: Cookie: __cfduid=dd99dd30e2bdb3f22e647c402519890951397078765305
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_OUT: Accept-Charset: UTF-8,*;q=0.8
22:45:41 T:139708264851200 DEBUG: webserver: request received for /image/image%3a%2f%2fhttp%253a%252f%252fimage.tmdb.org%252ft%252fp%252foriginal%252f7JmFtKtvgVD0zQ2xPQdUKtTXdeA.jpg%2f
22:45:41 T:139708290029312 DEBUG: Previous line repeats 2 times.
22:45:41 T:139708290029312 DEBUG: webserver: request received for /jsonrpc
22:45:41 T:139708290029312 DEBUG: Curl:Big Grinebug - TEXT: Found bundle for host image.tmdb.org: 0x7f1088026f40
22:45:41 T:139708290029312 DEBUG: Curl:Big Grinebug - TEXT: Re-using existing connection! (#7) with host image.tmdb.org
22:45:41 T:139708290029312 DEBUG: Curl:Big Grinebug - TEXT: Connected to image.tmdb.org (198.41.186.159) port 80 (#7)
22:45:41 T:139708290029312 DEBUG: Curl:Big Grinebug - HEADER_OUT: HEAD /t/p/original/hyR7Fs6Tepgu3yCQGtgO4Ilz9tY.jpg HTTP/1.1
22:45:41 T:139708290029312 DEBUG: Curl:Big Grinebug - HEADER_OUT: User-Agent: XBMC/13.0 Git:Unknown (Linux; Arch Linux; 3.14.2-1-ARCH x86_64; http://xbmc.org)
22:45:41 T:139708290029312 DEBUG: Curl:Big Grinebug - HEADER_OUT: Host: image.tmdb.org
22:45:41 T:139708290029312 DEBUG: Curl:Big Grinebug - HEADER_OUT: Accept: */*
22:45:41 T:139708290029312 DEBUG: Curl:Big Grinebug - HEADER_OUT: Cookie: __cfduid=dd99dd30e2bdb3f22e647c402519890951397078765305
22:45:41 T:139708290029312 DEBUG: Curl:Big Grinebug - HEADER_OUT: Accept-Charset: UTF-8,*;q=0.8
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: HTTP/1.1 200 OK
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - TEXT: Server cloudflare-nginx is not blacklisted
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: Server: cloudflare-nginx
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: Date: Wed, 28 May 2014 20:44:51 GMT
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: Content-Type: image/jpeg
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: Content-Length: 1281426
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: Connection: keep-alive
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: Cache-Control: public, max-age=31449600
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: ETag: "13bebd3a6eb12d550cec8e2b4eb62e62"
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: Expires: Wed, 27 May 2015 20:44:51 GMT
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: Last-Modified: Thu, 07 Nov 2013 05:18:47 GMT
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: X-Content-Digest: 926da85ef8aaba3b698e6b21a5a9e4ee1b84e43f
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: X-Rack-Cache: fresh
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: CF-Cache-Status: HIT
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: Accept-Ranges: bytes
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - HEADER_IN: CF-RAY: 131d4ae3b5dd0467-FRA
22:45:41 T:139709170837248 DEBUG: Curl:Big Grinebug - TEXT: Connection #6 to host image.tmdb.org left intact
22:45:41 T:139708264851200 DEBUG: webserver: request received for /image/image%3a%2f%2fhttp%253a%252f%252fimage.tmdb.org%252ft%252fp%252foriginal%252fLXNMeisGBRDMERehjNQDnz9qKI.jpg%2f

Seems to be ok...
Reply
  • 1
  • 62
  • 63
  • 64(current)
  • 65
  • 66
  • 197

Logout Mark Read Team Forum Stats Members Help
[RELEASE] Texture Cache Maintenance utility17