Scrapers (or something?)
stop2k
Junior Member
Posts: 12
#1
2010-09-02, 16:36
Currently, I'm using 9.11, but am playing with the Dharma beta release. When scanning/updating, the scraper seems to be choking. Here's my folder structure:

//nas/media/tv/24/season 1/24_101__12.AM.to.1.AM--.avi

Now... I didn't choose the file names, but the scraper worked fine in 9.11 and earlier versions. In Dharma, it's putting up duplicates for the first 12 episodes... 2 or 3 of them, making XBMC think there's 36 or 48 episodes in each season. Is the scraper crapping out on the underscores? Is there a way to fix this without going through and renaming 168 files?

Personal rant: I don't understand why everyone has to use their own goofy-ass scheme or naming files... In the case of the above episode of 24, what's so hard about something like "24 S01E01 - 12AM to 1AM" The use of underscores, hypens, periods, and the non-intuitive season/episode number is really annoying. I can't imagine what the developers have to go through to write scrapers able to decipher all that crap.

Thanks,
Find
Reply
jmarshall
Team-XBMC Developer
Posts: 26,215
#2
2010-09-03, 00:34
Do a debug log and it'll show you exactly what is happening.
Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.

Image
Find
Reply
Doemer
Junior Member
Posts: 26
#3
2010-09-03, 17:50
i am having exactly the same problem. it only gets the episode informations for one season. worked perfect with the old build. here is a part of my debug log.

Code:
17:43:48 T:3079161728 M:1329680384   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'smb://xxxx:xxxx@mediaserver/serien/Californication/'
17:43:48 T:1846487920 M:1329680384   DEBUG: thread start, auto delete: 0
$7:43:48 T:1846487920 M:1329680384   DEBUG: scraper: GetDetails returned <?xml version="1.0" encoding="utf-8" standalone="yes"?><details><plot>Hank Moodys beste Zeiten als Autor sind vorbei. Seine Freundin K$
17:43:48 T:1846487920 M:1329680384   DEBUG: Thread 1846487920 terminating
17:43:48 T:3079161728 M:1329680384   DEBUG: VideoInfoScanner: Adding new item to tvshows:smb://xxxx:xxxx@mediaserver/serien/Californication/
17:43:49 T:3079161728 M:1329680384    INFO: Caching image from: http://thetvdb.com/banners/fanart/original/80349-30.jpg to special://masterprofile/Thumbnails/Video/Fanart/612458aa.tbn
17:43:49 T:3079161728 M:1329680384   DEBUG: FileCurl::Open(0xaf04ad08) http://thetvdb.com/banners/fanart/original/80349-30.jpg
17:43:49 T:3079161728 M:1329680384    INFO: easy_aquire - Created session to http://thetvdb.com
17:43:56 T:3079161728 M:1330229248   DEBUG: FileCurl::Close(0xaf04ad08) http://thetvdb.com/banners/fanart/original/80349-30.jpg
17:43:56 T:3079161728 M:1330229248    INFO: Caching image from: http://thetvdb.com/banners/posters/80349-8.jpg to special://masterprofile/Thumbnails/Video/6/612458aa.tbn with width 512 and height 512
m$:43:56 T:3079161728 M:1330229248   DEBUG: FileCurl::Open(0xbff4bd4c) http://thetvdb.com/banners/posters/80349-8.jpg
17:44:00 T:3079161728 M:1330237440   DEBUG: FileCurl::Close(0xbff4bd4c) http://thetvdb.com/banners/posters/80349-8.jpg
17:44:00 T:3079161728 M:1329836032   DEBUG: OpenDir - Using authentication url smb://xxxx:xxxx@mediaserver/serien/Californication
$7:44:00 T:3079161728 M:1329836032   DEBUG: OpenDir - Using authentication url smb://xxxx:xxxx@mediaserver/serien/Californication/Season%202
17:44:00 T:3079161728 M:1329836032   DEBUG: OpenDir - Using authentication url smb://xxxx:xxxx@mediaserver/serien/Californication/Season%201
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 1/s01e01.mkv (s1e1) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 1/s01e02.mkv (s1e2) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 1/s01e03.mkv (s1e3) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 1/s01e04.mkv (s1e4) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 1/s01e05.mkv (s1e5) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 1/s01e06.mkv (s1e6) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 1/s01e07.mkv (s1e7) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 1/s01e08.mkv (s1e8) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 1/s01e09.mkv (s1e9) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 1/s01e10.mkv (s1e10) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 1/s01e11.mkv (s1e11) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
$7:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 1/s01e12.mkv (s1e12) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 2/s02e01.mkv (s2e1) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 2/s02e02.mkv (s2e2) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 2/s02e03.mkv (s2e3) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 2/s02e04.mkv (s2e4) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 2/s02e05.mkv (s2e5) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
ra$44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 2/s02e06.mkv (s2e6) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 2/s02e07.mkv (s2e7) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 2/s02e08.mkv (s2e8) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 2/s02e09.mkv (s2e9) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 2/s02e10.mkv (s2e10) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 2/s02e11.mkv (s2e11) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:00 T:3079161728 M:1329836032   DEBUG: VideoInfoScanner: Found episode match smb://xxxx:xxxx@mediaserver/serien/californication/season 2/s02e12.mkv (s2e12) [[Ss]([0-9]+)[][._-]*[Ee]([0-9]+)([^\\/]*)$]
17:44:01 T:3079161728 M:1329819648   ERROR: PCRE: Match limit reached
17:44:01 T:3079161728 M:1329819648   DEBUG: scraper: GetEpisodeList returned <episodeguide><episode><id>2334731</id><title>Heart, Balls &amp; Swagger</title><aired></aired><epnum></epnum><season>1</season><u$
17:44:01 T:3079161728 M:1329819648   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'smb://xxxx:xxxx@mediaserver/serien/Californication/Season 1/S01E01.mkv'
17:44:01 T:1846487920 M:1329819648   DEBUG: thread start, auto delete: 0
17:44:01 T:1846487920 M:1329819648   DEBUG: scraper: GetEpisodeDetails returned <?xml version="1.0" encoding="utf-8" standalone="yes"?><details><plot>Autor Hank Moody, ein - trotz seines ausschweifenden Lebe$
17:44:01 T:1846487920 M:1329819648   DEBUG: Thread 1846487920 terminating
Find
Reply
stop2k
Junior Member
Posts: 12
#4
2010-09-03, 19:32
Looking through the debug log, here's what I found that stood out. On other TV shows, it does not do this, and after renaming all the files in a single season of 24, that season got added to the library as expected.

Is there something else I need to check for?

Code:
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_201__8.am.to.9.am--.avi (s2e1) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 8
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_202__9.am.to.10.am--.avi (s2e2) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 9
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_203__10.am.to.11.am--.avi (s2e3) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 10
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_204__11.am.to.12.pm--.avi (s2e4) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 11
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_205__12.pm.to.1.pm--.avi (s2e5) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 12
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_206__1.pm.to.2.pm--.avi (s2e6) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 1
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_207__2.pm.to.3.pm--.avi (s2e7) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 2
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_208__3.pm.to.4.pm--.avi (s2e8) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 3
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_209__4.pm.to.5.pm--.avi (s2e9) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 4
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_210__5.pm.to.6.pm--.avi (s2e10) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 5
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_211__6.pm.to.7.pm--.avi (s2e11) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 6
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_212__7.pm.to.8.pm--.avi (s2e12) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 7
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_213__8.pm.to.9.pm--.avi (s2e13) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 8
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_214__9.pm.to.10.pm--.avi (s2e14) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 9
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_215__10.pm.to.11.pm--.avi (s2e15) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 10
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_216__11.pm.to.12.am--.avi (s2e16) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 11
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_217__12.am.to.1.am--.avi (s2e17) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 12
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_218__1.am.to.2.am--.avi (s2e18) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 1
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_219__2.am.to.3.am--.avi (s2e19) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 2
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_220__3.am.to.4.am--.avi (s2e20) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 3
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_221__4.am.to.5.am--.avi (s2e21) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 4
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_222__5.am.to.6.am--.avi (s2e22) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 5
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_223__6.am.to.7.am--.avi (s2e23) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]
VideoInfoScanner: Adding multipart episode 6
VideoInfoScanner: Found episode match smb://freenas/media 1/tv/24/season 2/24_224__7.am.to.8.am--.avi (s2e24) [[\\/\._ -]([0-9]+)([0-9][0-9])([\._ -][^\\/]*)$]

Yeah, I know I can go through and rename all these files, but again, previous versions of XBMC didn't have a problem, this is something new/changed in Dharma.

Thanks!
Find
Reply
Doemer
Junior Member
Posts: 26
#5
2010-09-04, 04:34
sorry... ignore this post lol
Find
Reply
Doemer
Junior Member
Posts: 26
#6
2010-09-05, 18:44
hmmm after all my renaming actions it turned out that I had the scraper options set to absolute and that was the reason why it didn't show the other season. works fine now.
Find
Reply

Home
Search
Help
Logout Mark Read Team Forum Stats Members Help
Scrapers (or something?)0