Should "Extract thumbnail and video information" populate the streamdetails table?
#1
I am trying to figure out how to get XBMC to automatically determine the video's duration and populate the streamdetails table accordingly. Currently, whenever I scan in new video, the streamdetails table never gets updated. I've enabled Extract thumbnail and video information in Video Settings, but nada.

The wiki states:

Quote:Extract thumbnail and video information
When enabled, XBMC will extract thumbnails from videos that have no thumb in the library and information such as codecs and aspect ratio to display in Library Mode.

I am assuming "such as" doesn't include video duration and doesn't include updating the streamdetails table. Can anyone confirm or deny?

Currently, the only way I have to update the streamdetails table is to create a playlist which will return all my movies or episodes and then open it, scroll to the bottom and wait hours while XBMC slowly builds the duration total for the playlist. There has to be a better way?!
Reply
#2
Does anyone know how this is suppose to work? I can capture logs and I can capture what is being saved to the db, but what I really need first is how XBMC is designed to function in this case. I don't believe this is a scraping issue. It's a question as to when should XBMC retrieve the video information via ffmpeg to store in the streamdetails table. I can confirm via logs that it does whenever you open a playlist, but does not whenever you scan in new content. Is this by design?
Reply
#3
Yes. It's done while extracting thumbnails. The scan only fetches meta like actors, plot etc.
Always read the online manual (wiki), FAQ (wiki) and search the forum before posting.
Do not PM or e-mail Team-Kodi members directly asking for support. Read/follow the forum rules (wiki).
Please read the pages on troubleshooting (wiki) and bug reporting (wiki) before reporting issues.
Reply
#4
It's not working that way for me. I uninstalled everything and reinstalled a fresh version of Dharma. Made sure the extract thumbnails option was enabled. Then added a video source for my movies and told it to scan. When it was done, I had 99 entries in my movie table and 0 in the streamdetails table.

I found this thread which seems to point to how xbmc works. It will require using a third party tool to create the <movie>.nfo files with the <durationinseconds> in it.

http://forum.xbmc.org/showthread.php?tid...ninseconds

I appreciate the response. It's obvious that XBMC has the capability to do this during the scan if no nfo file is found, but it looks like it simply doesn't. If not, then I will post it to bugtracker as an enhancement request.
Reply
#5
This is what a movie scan looks like for me in my log. I would love to see how the log should look if it is getting the duration info from the file during the scan and updating the streamdetails properly. Just doesn't work for me.

Code:
13:08:19 T:4956 M:1469947904   DEBUG: VideoInfoScanner: Scanning dir 'S:\FreeAgent Drive\Movies [SD] [G]\' as not in the database
13:08:19 T:4956 M:1468514304   DEBUG: VideoInfoScanner: No (new) information was found in dir S:\FreeAgent Drive\Movies [SD] [G]\
13:08:21 T:4956 M:1468952576   DEBUG: CZipManager::GetZipList - Processing zip://S%3a%5cFreeAgent%20Drive%5cMovies%20%5bSD%5d%20%5bG%5d%5c2001%20A%20Space%20Odyssey%20%281968%29%20%5bSD%5d%20%5bG%5d%5c%5b1968%5d%20%202001%2c%20A%20Space%20Odyssey%20%5bSD%5d%20%5bNR%5d%2ezip/
13:08:22 T:4956 M:1469300736   DEBUG: VideoInfoScanner: Scanning dir 'S:\FreeAgent Drive\Movies [SD] [G]\2001 A Space Odyssey (1968) [SD] [G]\' as not in the database
13:08:22 T:4956 M:1470074880   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'S:\FreeAgent Drive\Movies [SD] [G]\2001 A Space Odyssey (1968) [SD] [G]\2001 A Space Odyssey (1968) [SD] [G].avi'
13:08:22 T:4956 M:1470074880   DEBUG: Win32DllLoader::Load(special://xbmcbin/system/libcurl.dll)
13:08:22 T:4956 M:1468067840   DEBUG: Win32DllLoader::Load(special://xbmcbin/system/libidn-11.dll)
13:08:22 T:4956 M:1468067840   DEBUG: Win32DllLoader::Load(special://xbmcbin/system/libeay32.dll)
13:08:22 T:4956 M:1468067840   DEBUG: Win32DllLoader::Load(special://xbmcbin/system/libssl32.dll)
13:08:22 T:4956 M:1467641856   DEBUG: Win32DllLoader::Load(ADVAPI32.DLL)
13:08:22 T:4956 M:1467641856   DEBUG: Win32DllLoader::Load(KERNEL32.DLL)
13:08:22 T:4956 M:1467641856   DEBUG: Win32DllLoader::Load(NETAPI32.DLL)
13:08:22 T:4956 M:1467555840   DEBUG: FreeLibrary(NETAPI32.DLL) -> 06B64B78
13:08:22 T:4956 M:1467555840   DEBUG: Win32DllLoader::Unload NETAPI32.DLL
13:08:22 T:4956 M:1467604992   DEBUG: FreeLibrary(ADVAPI32.DLL) -> 06B57EC8
13:08:22 T:4956 M:1467604992   DEBUG: Win32DllLoader::Unload ADVAPI32.DLL
13:08:22 T:4956 M:1467576320   DEBUG: Win32DllLoader::Load(USER32.DLL)
13:08:22 T:4956 M:1467576320   DEBUG: FreeLibrary(USER32.DLL) -> 06B57EC8
13:08:22 T:4956 M:1467576320   DEBUG: Win32DllLoader::Unload USER32.DLL
13:08:23 T:4956 M:1467621376   DEBUG: FreeLibrary(KERNEL32.DLL) -> 06B62328
13:08:23 T:4956 M:1467604992   DEBUG: Win32DllLoader::Unload KERNEL32.DLL
13:08:26 T:4956 M:1468723200   DEBUG: Win32DllLoader::Load(secur32.dll)
13:08:26 T:4956 M:1467285504   DEBUG: CIMDB::InternalFindMovie: Searching for '2001 a space odyssey' using The MovieDB scraper (path: 'C:\Users\Administrator\AppData\Roaming\XBMC\addons\metadata.themoviedb.org', content: 'movies', version: '1.2.4')
13:08:26 T:4956 M:1467277312   DEBUG: scraper: CreateSearchUrl returned <url>http://api.themoviedb.org/2.1/Movie.search/en/xml/57983e31fb435df4df77afb854740ea9/2001%20a%20space%20odyssey</url>
13:08:26 T:4956 M:1467211776   DEBUG: FileCurl::Open(0605EE00) http://api.themoviedb.org/2.1/Movie.search/en/xml/57983e31fb435df4df77afb854740ea9/2001%20a%20space%20odyssey
13:08:26 T:4956 M:1467154432    INFO: XCURL::DllLibCurlGlobal::easy_aquire - Created session to http://api.themoviedb.org
13:08:26 T:4956 M:1467641856   DEBUG: FileCurl::Close(0605EE00) http://api.themoviedb.org/2.1/Movie.search/en/xml/57983e31fb435df4df77afb854740ea9/2001%20a%20space%20odyssey
13:08:26 T:4956 M:1467510784   DEBUG: scraper: GetSearchResults returned <results><entity><title>2001 A Space Odyssey</title><id>62</id><year>1968</year><url cache="tmdb-en-62.xml">http://api.themoviedb.org/2.1/Movie.getInfo/en/xml/57983e31fb435df4df77afb854740ea9/62</url></entity><entity><title>2001 A Space Odyssey</title><id>62</id><year>1968</year><url cache="tmdb-en-62.xml">http://api.themoviedb.org/2.1/Movie.getInfo/en/xml/57983e31fb435df4df77afb854740ea9/62</url></entity><entity><title>How the Solar System Was Won</title><id>62</id><year>1968</year><url cache="tmdb-en-62.xml">http://api.themoviedb.org/2.1/Movie.getInfo/en/xml/57983e31fb435df4df77afb854740ea9/62</url></entity></results>
13:08:26 T:4956 M:1466580992   DEBUG: FileCurl::Open(0605EDFC) http://api.themoviedb.org/2.1/Movie.getInfo/en/xml/57983e31fb435df4df77afb854740ea9/62
13:08:26 T:4956 M:1464422400   DEBUG: FileCurl::Close(0605EDFC) http://api.themoviedb.org/2.1/Movie.getInfo/en/xml/57983e31fb435df4df77afb854740ea9/62
13:08:26 T:4956 M:1464266752   DEBUG: scraper: GetDetails returned <details><id>tt0062622</id><title>2001 A Space Odyssey</title><originaltitle>2001 A Space Odyssey</originaltitle><year>1968</year><runtime>141</runtime><rating>8.6</rating><votes>43</votes><tagline>The Ultimate Trip.</tagline><mpaa>Rated G</mpaa><genre>Adventure</genre><genre>Drama</genre><genre>Mystery</genre><genre>Science Fiction</genre><genre>Thriller</genre><studio>Metro-Goldwyn-Mayer</studio><studio>Stanley Kubrick Productions</studio><country>United Kingdom</country><country>United States of America</country><plot>The highly respected and often cited milestone in Science Fiction cinema. Director Stanley Kubrick takes us into the future, into outer space and aboard a spacecraft that’s controlled by a seemingly trustworthy computer named HAL.</plot><overview>The highly respected and often cited milestone in Science Fiction cinema. Director Stanley Kubrick takes us into the future, into outer space and aboard a spacecraft that’s controlled by a seemingly trustworthy computer named HAL.</overview><director>Stanley Kubrick</director><credits>Stanley Kubrick</credits><credits>Arthur C. Clarke</credits><actor><name>Keir Dullea</name><role>Dr. Dave Bowman</role></actor><actor><name>Douglas Rain</name><role>HAL 9000 (voice)</role></actor><actor><name>Gary Lockwood</name><role>Dr. Frank Poole</role></actor><actor><name>William Sylvester</name><role>Dr. Heywood R. Floyd</role></actor><actor><name>Daniel Richter</name><role>Moon-Watcher</role></actor><actor><name>Leonard Rossiter</name><role>Dr. Andrei Smyslov</role></actor><actor><name>Margaret Tyzack</name><role>Elena</role></actor><actor><name>Robert Beatty</name><role>Dr. Ralph Halvorsen</role></actor><actor><name>Sean Sullivan</name><role>Dr. Bill Michaels</role></actor><chain function="GetTMDBThumbsByIdChain">62</chain><chain function="GetTMDBFanartByIdChain">62</chain><chain function="GetHDTrailersnet480p">2001 A Space Odyssey</chain></details>
13:08:26 T:4956 M:1464262656   DEBUG: scraper: GetTMDBThumbsByIdChain returned <details><url function="ParseTMDBThumbs" cache="tmdb-images-62.xml">http://api.themoviedb.org/2.1/Movie.getImages/en/xml/57983e31fb435df4df77afb854740ea9/62</url></details>
13:08:26 T:4956 M:1464262656   DEBUG: FileCurl::Open(0605EDFC) http://api.themoviedb.org/2.1/Movie.getImages/en/xml/57983e31fb435df4df77afb854740ea9/62
13:08:26 T:4956 M:1463361536   DEBUG: FileCurl::Close(0605EDFC) http://api.themoviedb.org/2.1/Movie.getImages/en/xml/57983e31fb435df4df77afb854740ea9/62
Reply
#6
Here is the rest of the log entry

Code:
13:08:26 T:4956 M:1465233408   DEBUG: scraper: ParseTMDBThumbs returned <details><thumb preview="http://cf1.themoviedb.org/posters/4e8/4bc90203017a3c57fe0004e8/2001-a-space-odyssey-mid.jpg">http://cf1.themoviedb.org/posters/4e8/4bc90203017a3c57fe0004e8/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/posters/4ed/4bc90203017a3c57fe0004ed/2001-a-space-odyssey-mid.jpg">http://cf1.themoviedb.org/posters/4ed/4bc90203017a3c57fe0004ed/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/posters/4f7/4bc90204017a3c57fe0004f7/2001-a-space-odyssey-mid.jpg">http://cf1.themoviedb.org/posters/4f7/4bc90204017a3c57fe0004f7/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/posters/307/4bf70a17017a3c7732000307/2001-a-space-odyssey-mid.jpg">http://cf1.themoviedb.org/posters/307/4bf70a17017a3c7732000307/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/posters/334/4bed293c017a3c37ac000334/2001-a-space-odyssey-mid.jpg">http://cf1.themoviedb.org/posters/334/4bed293c017a3c37ac000334/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/posters/289/4d237f1c5e73d66b30004289/2001-a-space-odyssey-mid.jpg">http://cf1.themoviedb.org/posters/289/4d237f1c5e73d66b30004289/2001-a-space-odyssey-original.jpg</thumb></details>
13:08:26 T:4956 M:1466019840   DEBUG: scraper: GetTMDBFanartByIdChain returned <details><url function="ParseTMDBFanart" cache="tmdb-images-62.xml">http://api.themoviedb.org/2.1/Movie.getImages/en/xml/57983e31fb435df4df77afb854740ea9/62</url></details>
13:08:26 T:4956 M:1464184832   DEBUG: scraper: ParseTMDBFanart returned <details><fanart><thumb preview="http://cf1.themoviedb.org/backdrops/4c4/4bc901fd017a3c57fe0004c4/2001-a-space-odyssey-poster.jpg">http://cf1.themoviedb.org/backdrops/4c4/4bc901fd017a3c57fe0004c4/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/4bc/4bc901fc017a3c57fe0004bc/2001-a-space-odyssey-poster.jpg">http://cf1.themoviedb.org/backdrops/4bc/4bc901fc017a3c57fe0004bc/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/4cc/4bc901fd017a3c57fe0004cc/2001-a-space-odyssey-poster.jpg">http://cf1.themoviedb.org/backdrops/4cc/4bc901fd017a3c57fe0004cc/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/194/4c3065687b9aa1665e000194/2001-a-space-odyssey-poster.jpg">http://cf1.themoviedb.org/backdrops/194/4c3065687b9aa1665e000194/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/4e0/4bc90202017a3c57fe0004e0/2001-a-space-odyssey-poster.jpg">http://cf1.themoviedb.org/backdrops/4e0/4bc90202017a3c57fe0004e0/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/4d0/4bc901fe017a3c57fe0004d0/2001-a-space-odyssey-poster.jpg">http://cf1.themoviedb.org/backdrops/4d0/4bc901fe017a3c57fe0004d0/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/d9a/4be7fbc9017a3c35b7000d9a/2001-a-space-odyssey-poster.jpg">http://cf1.themoviedb.org/backdrops/d9a/4be7fbc9017a3c35b7000d9a/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/4e4/4bc90202017a3c57fe0004e4/2001-a-space-odyssey-poster.jpg">http://cf1.themoviedb.org/backdrops/4e4/4bc90202017a3c57fe0004e4/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/4c0/4bc901fc017a3c57fe0004c0/2001-a-space-odyssey-poster.jpg">http://cf1.themoviedb.org/backdrops/4c0/4bc901fc017a3c57fe0004c0/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/83d/4c5c9e047b9aa151f700083d/2001-a-space-odyssey-poster.jpg">http://cf1.themoviedb.org/backdrops/83d/4c5c9e047b9aa151f700083d/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/4c8/4bc901fd017a3c57fe0004c8/2001-a-space-odyssey-poster.jpg">http://cf1.themoviedb.org/backdrops/4c8/4bc901fd017a3c57fe0004c8/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/4d4/4bc901fe017a3c57fe0004d4/2001-a-space-odyssey-poster.jpg">http://cf1.themoviedb.org/backdrops/4d4/4bc901fe017a3c57fe0004d4/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/4dc/4bc90201017a3c57fe0004dc/2001-a-space-odyssey-poster.jpg">http://cf1.themoviedb.org/backdrops/4dc/4bc90201017a3c57fe0004dc/2001-a-space-odyssey-original.jpg</thumb><thumb preview="http://cf1.themoviedb.org/backdrops/4d8/4bc90201017a3c57fe0004d8/2001-a-space-odyssey-poster.jpg">http://cf1.themoviedb.org/backdrops/4d8/4bc90201017a3c57fe0004d8/2001-a-space-odyssey-original.jpg</thumb></fanart></details>
13:08:26 T:4956 M:1464180736   DEBUG: scraper: GetHDTrailersnet480p returned <details><url function="Parse480pTrailer" cache="hd-trailers-2001-A-Space-Odyssey-.xml">http://xbmc.hd-trailers.net/movie/2001-A-Space-Odyssey-</url></details>
13:08:26 T:4956 M:1464180736   DEBUG: FileCurl::Open(0605EDFC) http://xbmc.hd-trailers.net/movie/2001-A-Space-Odyssey-
13:08:27 T:4956 M:1464369152 WARNING: XFILE::CFileCurl::CReadState::FillBuffer: curl failed with code 22
13:08:27 T:4956 M:1464352768   ERROR: CFileCurl::CReadState::Open, didn't get any data from stream.
13:08:27 T:4956 M:1464315904   DEBUG: FileCurl::Close(0605EDFC) http://xbmc.hd-trailers.net/movie/2001-A-Space-Odyssey-
13:08:27 T:4956 M:1464303616   ERROR: ADDON::CScraper::Run: Unable to parse web site
13:08:27 T:4956 M:1465212928   DEBUG: VideoInfoScanner: Adding new item to movies:S:\FreeAgent Drive\Movies [SD] [G]\2001 A Space Odyssey (1968) [SD] [G]\2001 A Space Odyssey (1968) [SD] [G].avi
13:08:27 T:4956 M:1471352832    INFO: Caching image from: S:\FreeAgent Drive\Movies [SD] [G]\2001 A Space Odyssey (1968) [SD] [G]\2001 A Space Odyssey (1968) [SD] [G]-fanart.jpg to special://masterprofile/Thumbnails/Video/Fanart/fa3eeeec.tbn
13:08:28 T:4956 M:1466585088    INFO: Caching image from: S:\FreeAgent Drive\Movies [SD] [G]\2001 A Space Odyssey (1968) [SD] [G]\2001 A Space Odyssey (1968) [SD] [G].tbn to special://masterprofile/Thumbnails/Video/f/fa3eeeec.tbn with width 512 and height 512
13:08:28 T:4956 M:1466580992   DEBUG: Win32DllLoader::Load(special://xbmcbin/system/ImageLib.dll)
13:08:35 T:4956 M:1474080768   DEBUG: VideoInfoScanner: Finished adding information from dir S:\FreeAgent Drive\Movies [SD] [G]\2001 A Space Odyssey (1968) [SD] [G]\
Reply
#7
hey jtucker1972,

I had problems with my runtimes as well and what i ended up doing was telling Ember NOT to scrape runtimes or meta data.

Then after adding the movies to the database, just go to the root and you should notice that the total duration will start to climb as xbmc gets the information from the files. Do the same with your tvshows by choosing the all seasons.

If there is a runtime in the nfo file xbmc won't try to get the duration and will not properly populate the database.

Or at least that was my findings as I haven't dug into the database yet, but it help with my problem with the pseudotv script not adding anything to my channels because it didn't have the proper information in the database.
Image
Image
Reply
#8
rtwight, I didn't have any nfo files in my directories for the scan. I completely removed third-party nfo's from the equation. The issue is that we should not have to use a playlist or go to the root to trigger XBMC to pull the duration from the video file header data. This should be done during the scan if no nfo is found or if <durationinseconds> is not found. Some say XBMC does pull it during scan but I have not scene a log file which shows me where it is calling CDVDDemuxFFmpeg during the scanning process.
Reply
#9
It's not done during scan. Nowhere does it say that it's done during a scan.

It's done (in the background) as and when required - eg while browsing a list or when playing a video.

Note that DVD images are only done on playback (as you must play the image in order to get accurate information).

Cheers,
Jonathan
Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.


Image
Reply
#10
Thanks Jonathan. Good to hear from a developer. There has been so much speculation as to how this feature is suppose to work that I am glad I got it from a developer how it is "designed" to work.
Reply
#11
Thanks for ignoring me.
Always read the online manual (wiki), FAQ (wiki) and search the forum before posting.
Do not PM or e-mail Team-Kodi members directly asking for support. Read/follow the forum rules (wiki).
Please read the pages on troubleshooting (wiki) and bug reporting (wiki) before reporting issues.
Reply

Logout Mark Read Team Forum Stats Members Help
Should "Extract thumbnail and video information" populate the streamdetails table?0