[PeaceMkr]

Hello Guys, im using different Version of Millhouses Helix-RPI-Releases and in the latest Versions a see that the TV-Scraper ist not working as expected.
The Moviescraper is working fine but when i scrape the TV-Show-Harddisc it only finds one Show and the other 23 dont get found.
It doesnt matter if i use the local files or the Onlinedatabase.
Does anybody have this problem too?
Ive seen that the Scraper on my Linux-Server with latest Helix-Nightly is not working and the OSX-Version is not working too.

[Milhouse]

Understanding your file structure is usually the first step.

Easy way to do this on one of my builds:

Code:

texturecache.py rdirectory nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon\ Valley

Then paste the results.

This is what I get for the above show:

Code:

DIR : nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E01-thumb.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E01.mp4
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E01.nfo
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E02-thumb.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E02.mp4
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E02.nfo
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E03-thumb.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E03.mp4
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E03.nfo
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E04-thumb.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E04.mp4
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E04.nfo
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E05-thumb.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E05.mp4
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E05.nfo
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E06-thumb.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E06.mp4
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E06.nfo
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E07-thumb.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E07.mp4
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E07.nfo
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E08-thumb.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E08.mp4
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/Season 1/Silicon Valley S01E08.nfo
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/banner.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/fanart.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/landscape.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/logo.png
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/poster.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/season-all-poster.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/season-specials-poster.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/season01-poster.jpg
FILE: nfs://192.168.0.3/mnt/share/media/Video-Private/TVShows/Silicon Valley/tvshow.nfo

Obviously, substitute your path for the troublesome TV show in place of the path I'm using.

I just scanned Silicon Valley as a new tvshow, without any problems. Mind you, I do have a tvshow.nfo and each episode has an nfo.

Knowing your sources might also be helpful:

Code:

texturecache.py sources

A debug log (wiki) can also be useful, capture the debug log while scanning the troublesome tv show.

[PeaceMkr]

i have all TVShows on one Harddrive. It worked before my holidays without Problems with older versions.

sources:
OpenELEC:/ # texturecache.py sources
video: Komödien: smb://HOMESERVER/Media/Filme_Sortiert/Komödien
video: Serien: smb://HOMESERVER/Media/Serien/Serien

when i start texturecache.py rdirectory its showing me all the stuff of that harddrive.

Ive added the metadata with tinymediamanager and all was fine the past years.
The Movies that are at the same share also work fine. only TV-Shows arnt working. I will try to get a log-file when scanning the directory when im at home.

[Milhouse]

Ah, when you said "when i scrape the TV-Show-Harddisc", I thought you were talking about a show called "Harddisc" - sorry for my lack of comprehension. You could still run the rdirectory command for your tv source directory, piping the output through pastebinit (texturecach.py rdirectory smb://HOMESERVER/Media/Serien/Serien | pastebinit) then paste the link, or describe your file structure/naming convention.

[PeaceMkr]

I have seen that on all system (osx, rpi and ubuntu) with kodi nightlys the system behaves the same.. I only get the first Show scanned..
xbmc.log shows me the below informations.

..
09:49:48 T:140668416546560 NOTICE: UDP: Listening on port 9777
09:49:48 T:140668424939264 NOTICE: Thread JobWorker start, auto delete: true
09:49:52 T:140668382975744 NOTICE: Previous line repeats 2 times.
09:49:52 T:140668382975744 NOTICE: Thread BackgroundLoader start, auto delete: false
09:50:04 T:140668382975744 NOTICE: Thread VideoInfoScanner start, auto delete: false
09:50:04 T:140668382975744 NOTICE: VideoInfoScanner: Starting scan ..
09:50:04 T:140668382975744 ERROR: VideoInfoScanner: Exception while scanning.
09:50:04 T:140668382975744 NOTICE: Thread BackgroundLoader start, auto delete: false
...

My Filestructure is here -> http://sprunge.us/CKdf

But it worked without problems before with the same structure without any problems and moviescraper is working too.

[popcornmix]

I have seen that on all system (osx, rpi and ubuntu) with kodi nightlys the system behaves the same.. I only get the first Show scanned..
xbmc.log shows me the below informations.
09:50:04 T:140668382975744 ERROR: VideoInfoScanner: Exception while scanning.

Probably best to post this in the general forum if it's not Pi specific as more devs are likely to be reading there.
The "Exception while scanning" sounds like a bug that needs fixing.

[Martijn]

moved to general

[Milhouse]

@PeaceMkr - can you scan again with debug enabled, then upload the full log? Maybe it would reveal more information about the exception.

[Kib]

Yeah please upload a debug log (wiki)

[PeaceMkr]

i have enabled debugging on my Linux-Machine now that had the same problems.

11:02:42 T:139930143540992 DEBUG: GetEpisodeId (smb://HOMESERVER/Media/Serien/Serien/2 Broke Girls/tvp-2brokegirls-s01e02-720p.mkv), query = select idEpisode from episode where idFile=406
11:02:42 T:139930143540992 DEBUG: Previous line repeats 1 times.
11:02:42 T:139930143540992 DEBUG: CSMBFile::Open - opened Media/Serien/Serien/2 Broke Girls/tvp-2brokegirls-s01e02-720p.nfo, fd=10002
11:02:42 T:139930143540992 DEBUG: CSMBFile::Close closing fd 10002
11:02:42 T:139930143540992 ERROR: VideoInfoScanner: Exception while scanning.
11:02:42 T:139930143540992 DEBUG: CAnnouncementManager - Announcement: OnScanFinished from xbmc
11:02:42 T:139930143540992 DEBUG: GOT ANNOUNCEMENT, type: 16, from xbmc, message OnScanFinished

Ive deleted the nfo-file, scanned again and got 5 more Shows into the DB and then it stopped again.
Same error, other nfo-file

11:10:06 T:139931142833920 DEBUG: GetEpisodeId (smb://HOMESERVER/Media/Serien/Serien/Ray Donovan/euhd-donovan-s01e10-720p.mkv), query = select idEpisode from episode where idFile=691
11:10:06 T:139931142833920 DEBUG: Previous line repeats 1 times.
11:10:06 T:139931142833920 DEBUG: CSMBFile::Open - opened Media/Serien/Serien/Ray Donovan/euhd-donovan-s01e10-720p.nfo, fd=10000
11:10:06 T:139931142833920 DEBUG: CSMBFile::Close closing fd 10000
11:10:06 T:139931142833920 ERROR: VideoInfoScanner: Exception while scanning.

then deleted again and got some more and stopped again with that exception.

the nfo where it stops is readable and seems valid -> http://pastebin.com/ipAQKhBr

[Milhouse]

MySQL or SQLite?

Which TV scanner? TVDB, Local information only or something else?

Can you upload all of the metadata files (nfo, thumb, jpg files) for the tv shows "The Millers" and "Ray Donovan" as a single zip archive, and I may try and debug this (assuming I can reproduce).

Can you confirm you see this exception with build #0821 of my R-Pi Helix builds?

[PeaceMkr]

i use mysql and the local information. but tvdb didnt work too.

Ive uploaded the file and send you a private message right now with the link.

[Milhouse]

OK the good news I've been able to reproduce the exception (hopefully it's the same exception!)

[Milhouse]

The problem is your file naming.

This file:

Code:

smb://HOMESERVER/Media/Serien/Serien/The Millers/Season 1/tvp-themillers-s01e11-720p.nfo

is a single episode NFO (Series 1, Episode 11).

However the resolution, "-720p", causes it to be interpreted as a multi-episode NFO (ie. S01E11-S01E720):

Code:

DEBUG: VideoInfoScanner: Found episode match nfs://192.168.0.3/mnt/share/media/Video-Test/TVShows/The Millers/Season 1/The Millers.S01E05.Hexe und Papagei GERMAN DUBBED DL 720p WebHD x264-TVP.mkv (s1e5) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
DEBUG: VideoInfoScanner: Found episode match nfs://192.168.0.3/mnt/share/media/Video-Test/TVShows/The Millers/Season 1/The Millers.S01E06.Stuff GERMAN DUBBED DL 720p WebHD x264-TVP.mkv (s1e6) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
DEBUG: VideoInfoScanner: Found episode match nfs://192.168.0.3/mnt/share/media/Video-Test/TVShows/The Millers/Season 1/The Millers.S01E07.The Talk GERMAN DUBBED DL 720p WebHD x264-TVP.mkv (s1e7) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
DEBUG: VideoInfoScanner: Found episode match nfs://192.168.0.3/mnt/share/media/Video-Test/TVShows/The Millers/Season 1/The Millers.S01E08.Internet.Dating.GERMAN.DUBBED.D L.720p.WebHD.x264-TVP.mkv (s1e8) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
DEBUG: VideoInfoScanner: Found episode match nfs://192.168.0.3/mnt/share/media/Video-Test/TVShows/The Millers/Season 1/The Millers.S01E09.Youre In Trouble GERMAN DUBBED DL 720p WebHD x264-TVP.mkv (s1e9) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
DEBUG: VideoInfoScanner: Found episode match nfs://192.168.0.3/mnt/share/media/Video-Test/TVShows/The Millers/Season 1/The Millers.S01E10.Das Fest der Luege GERMAN DUBBED DL 720p WebHD x264-TVP.mkv (s1e10) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
DEBUG: VideoInfoScanner: Found episode match nfs://192.168.0.3/mnt/share/media/Video-Test/TVShows/The Millers/Season 1/tvp-themillers-s01e11-720p.mkv (s1e11) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
DEBUG: VideoInfoScanner: Adding multipart episode 720 [^[-_ex]+([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)]
DEBUG: VideoInfoScanner: Found episode match nfs://192.168.0.3/mnt/share/media/Video-Test/TVShows/The Millers/Season 1/tvp-themillers-s01e12-720p.mkv (s1e12) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
DEBUG: VideoInfoScanner: Adding multipart episode 720 [^[-_ex]+([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)]
DEBUG: VideoInfoScanner: Found episode match nfs://192.168.0.3/mnt/share/media/Video-Test/TVShows/The Millers/Season 1/tvp-themillers-s01e13-720p.mkv (s1e13) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
DEBUG: VideoInfoScanner: Adding multipart episode 720 [^[-_ex]+([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)]
DEBUG: VideoInfoScanner: Found episode match nfs://192.168.0.3/mnt/share/media/Video-Test/TVShows/The Millers/Season 1/tvp-themillers-s01e14-720p.mkv (s1e14) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
DEBUG: VideoInfoScanner: Adding multipart episode 720 [^[-_ex]+([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)]
DEBUG: VideoInfoScanner: Found episode match nfs://192.168.0.3/mnt/share/media/Video-Test/TVShows/The Millers/Season 1/tvp-themillers-s01e15-720p.mkv (s1e15) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
DEBUG: VideoInfoScanner: Adding multipart episode 720 [^[-_ex]+([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)]
DEBUG: VideoInfoScanner: Found episode match nfs://192.168.0.3/mnt/share/media/Video-Test/TVShows/The Millers/Season 1/tvp-themillers-s01e17-720p.mkv (s1e17) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
DEBUG: VideoInfoScanner: Adding multipart episode 720 [^[-_ex]+([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)]

Note how all the videos with the -720p resolution are being considered as multipart episodes. When the s01e11-720p NFO is processed, episode 11 will be created. Then, because the NFO has been identified as multipart, an attempt is made to find episode 720 within the same NFO, which ultimately fails - as it's not a multi-episode NFO - which then leads to NfoFile::GetDetails() being called while m_headPos == -1. Boom. Exception.

It's a bug, as the loop is not working the way it should, but PR5270 should fix that. If you're not scraping on the Pi, the immediate fix is to just remove the resolutions (-720p etc.) from your filenames.

[PeaceMkr]

Thanks Milhouse.
I was wondering why that was working before.. These episodes are not new. "2 Broke Girls" for example is years old and worked before. After my holidays till last week, ive update to the latest kodi-release and couldnt get some new seasons to my db.
Do i understand that right, that with next nightly of xbmc on all plattforms, the bud will disappear?

Big thanks for your help!!!