XBMC and thetvdb.com scraping question
#1
Hi,

I have a question about xbmc's build in scraper.
i recently added a new tv show called leverage.
Season 1 scrapes perfectly (after renaming it with TV renamer)
Season 2 however misses episode thumbs from episode 6,7,8 and 9.
Image

But when I check thetvdb.com, the thumbnails are available?
Image

This also happens with the latest episodes of supernatural.

so I was wondering what could cause this problem?
Reply
#2
Post a debug log and we can probably tell you what is causing it. It is likely something on thetvdb.com end of things.
Reply
#3
ok, and my last action should be refreshing the the episode information I guesS?
would that generate enough information?

edit: ok so I started xbmc refreshed the episode and copied the log
Code:
19:03:22 T:1760 M:1378947072  NOTICE: load default skin:[PM3.HD]
19:03:22 T:1760 M:1373052928  NOTICE: initialize done
19:03:22 T:1760 M:1373040640  NOTICE: Running the application...
19:03:22 T:1760 M:1372581888  NOTICE: Webserver: Starting...
19:03:22 T:2764 M:1372397568  NOTICE: Webserver: Started
19:03:22 T:1760 M:1372381184  NOTICE: ES: Starting event server
19:03:22 T:3608 M:1372327936  NOTICE: ES: Starting UDP Event server on 0.0.0.0:9777
19:03:22 T:3608 M:1372307456  NOTICE: UDP: Listening on port 9777
19:03:28 T:1760 M:1368801280 WARNING: DIRECTORY::CVideoDatabaseDirectory::GetLabel - Unknown nodetype requested 11
19:03:29 T:1760 M:1369006080 WARNING: DIRECTORY::CVideoDatabaseDirectory::GetLabel - Unknown nodetype requested 12
19:03:31 T:1760 M:1364918272   ERROR: DIRECTORY::CDirectory::GetDirectory - Error getting 7/
19:03:32 T:1760 M:1364832256   ERROR: CFileCurl::CReadState::Open, didn't get any data from stream.
19:03:34 T:1760 M:1364893696   ERROR: XFILE::CFile::Delete - Error deleting file C:\Documents and Settings\mavgink\Application Data\XBMC\userdata\Thumbnails\Video\f\ffffffff.tbn
19:03:34 T:1760 M:1364893696   ERROR: XFILE::CFile::Delete - Error deleting file special://masterprofile/Thumbnails/Video/f/ffffffff.tbn
19:03:36 T:1760 M:1364975616   ERROR: CFileCurl::CReadState::Open, didn't get any data from stream.
19:03:36 T:1760 M:1365008384   ERROR: CFileCurl::CReadState::Open, didn't get any data from stream.
19:03:36 T:1760 M:1365008384   ERROR: PICTURE::DoCreateThumbnail: Unable to create thumbfile special://masterprofile/Thumbnails/Video/3/30220c15.tbn from image http://images.thetvdb.com/banners/episodes/82339/900211.jpg
19:03:36 T:1760 M:1365241856   ERROR: DIRECTORY::CDirectory::GetDirectory - Error getting 7/
19:03:37 T:1760 M:1364652032   ERROR: CFileCurl::CReadState::Open, didn't get any data from stream.
19:03:38 T:1760 M:1364389888 WARNING: DIRECTORY::CVideoDatabaseDirectory::GetLabel - Unknown nodetype requested 12
19:03:39 T:1760 M:1349447680  NOTICE: Storing total System Uptime
19:03:39 T:1760 M:1349447680  NOTICE: Saving settings
19:03:39 T:1760 M:1355747328  NOTICE: stop all
19:03:39 T:1760 M:1355747328  NOTICE: Webserver: Stopping...
19:03:39 T:1760 M:1355771904  NOTICE: Webserver: Stopped...
19:03:39 T:1760 M:1355771904  NOTICE: ES: Stopping event server
19:03:40 T:3608 M:1355776000  NOTICE: ES: UDP Event server stopped
19:03:40 T:1760 M:1355784192  NOTICE: stop sap announcement listener
19:03:40 T:1760 M:1355784192  NOTICE: clean cached files!
19:03:40 T:1760 M:1355776000  NOTICE: unload skin
19:03:40 T:1760 M:1365311488  NOTICE: stop python
19:03:40 T:1760 M:1365311488  NOTICE: stopped
19:03:40 T:1760 M:1365311488  NOTICE: destroy
19:03:40 T:1760 M:1365327872  NOTICE: unload sections

i'm a noob here.. but is this it?
PICTURE:Big GrinoCreateThumbnail: Unable to create thumbfile special://masterprofile/Thumbnails/Video/3/30220c15.tbn from image http://images.thetvdb.com/banners/episod...900211.jpg
Reply
#4
Yeah that is it. It looks like there is nothing at that address which is a problem with thetvdb.com.

I know that a bandaid fix for the problem is to manually edit thetvdb.com scraper .xml file and delete all "images." instances. It is under system/scrapers/video in your XBMC install dir. Make sure to backup the file before doing anything to it if you go this route.
Reply
#5
thanx alot.. gonna try it tonight
Reply
#6
Did this work for you mavgink? I don't really understand the bandaid solution.

I think I'm having a related problem. New episodes of TV shows from 2009 that are airing weekly are being scanned in with episode information, but the episode's are missing thumbnails. The cover for the new seasons are also missing thumbnails.

I thought maybe that all TV shows I'm scanning in would not pull in thumbnails now. But I scanned in seasons 1-2 of an older TV show (The Wire), and all the thumbnails and covers for the seasons worked fine.

I've checked thetvdb.com and thumbnails exist for shows that I'm trying to scan (True Blood, Big Bang Theory, etc). I can't seem to get the content on XBMC to pick up the existing thumbnails from thetvdb.com. Even for thumbnails that are set, and hitting Get Thumb, the remote thumb box is empty. I've checked my debug log and it looks like all the thumbs give me a 404, since it's look for the wrong xxxxxxxxxxxxx.jpg value.

Code:
11:57:44 M: 42164224   DEBUG: CApplication::OnKey: 195 pressed, action is 11
11:57:44 M: 42164224   DEBUG: CVideoDatabase::GetEpisodeId (smb://SHAREDMEDIA/Volume_1/TV/The Big Bang Theory/Season 3/The.Big.Bang.Theory.S03E05.HDTV.XviD-LOL.avi), query = select idEpisode from episode where idFile=1387
11:57:45 M: 42151936   DEBUG: CVideoDatabase::GetTvShowsByWhere query: select * from tvshowview where c00='The Big Bang Theory'
11:57:45 M: 42151936   DEBUG: Time for actual SQL query = 545
11:57:45 M: 42151936   DEBUG: Time to retrieve movies from dataset = 46
11:57:45 M: 42164224    INFO: Loading skin file: DialogVideoInfo.xml
11:57:46 M: 42164224   DEBUG: Load DialogVideoInfo.xml: 132.98ms
11:57:46 M: 42139648   DEBUG: Alloc resources: 146.14ms (133.46 ms skin load, 0.57 ms preload)
11:57:46 M: 42139648   DEBUG: XFILE::CFileSMB::Exists(smb://SHAREDMEDIA/Volume_1/TV/The%20Big%20Bang%20Theory/Season%203/The.Big.Bang.Theory.S03E05.HDTV.XviD-LOL.tbn)
11:57:46 M: 42139648    INFO: Get URL: [url]http://images.thetvdb.com/banners/episodes/80379/1175941.jpg[/url]
11:57:47 M: 42102784   ERROR: Server returned: 404 Not Found
11:57:47 M: 42131456    INFO: Loading skin file: DialogBusy.xml
11:57:47 M: 42131456   DEBUG: Load DialogBusy.xml: 96.31ms
11:57:47 M: 42131456   DEBUG: Alloc resources: 96.99ms (96.98 ms skin load, 0.00 ms preload)
11:57:47 M: 41455616   DEBUG: CApplication::OnKey: 195 pressed, action is 11
11:57:49 M: 41455616   DEBUG: CApplication::OnKey: 166 pressed, action is 3
11:57:51 M: 41455616   DEBUG: CApplication::OnKey: 11 pressed, action is 7
11:57:51 M: 41443328   DEBUG: XFILE::CFileSMB::Exists(smb://SHAREDMEDIA/Volume_1/TV/The%20Big%20Bang%20Theory/Season%203/The.Big.Bang.Theory.S03E05.HDTV.XviD-LOL.tbn)
11:57:51 M: 41443328    INFO: Loading skin file: FileBrowser.xml
11:57:51 M: 41443328   DEBUG: Load FileBrowser.xml: 32.67ms
11:57:51 M: 40910848    INFO: Get URL: [url]http://images.thetvdb.com/banners/episodes/80379/1175941.jpg[/url]
11:57:51 M: 40902656   DEBUG: Alloc resources: 13.16ms (0.00 ms skin load, 0.41 ms preload)
11:57:52 M: 40808448   ERROR: Server returned: 404 Not Found
11:57:54 M: 41369600   DEBUG: CApplication::OnKey: 169 pressed, action is 1
11:57:54 M: 41361408   DEBUG: CApplication::OnKey: 167 pressed, action is 4
11:57:55 M: 41361408   DEBUG: CApplication::OnKey: 11 pressed, action is 7
11:57:58 M: 41455616   DEBUG: CApplication::OnKey: 216 pressed, action is 51
Reply
#7
it looks like it isnt found, youll get a 404 there... i tried the url in the browser and it shows the 404 also, changed the url to the following, and it is show. i guess they reverted the changes they made. check out the scraper xml maybe youll find youre answer there ...

http://thetvdb.com/banners/episodes/80379/1175941.jpg

update: looks like this is something they fixed allready in the svn, therefor its allways more helpful to post a full debug log, since it includes all the infos necessary, i sugess to update to the latest svn!
Reply
#8
Ah thank you Mason! Now I understand that bandaid fix of removing "images.".

I'll play with my scrapers file and post my result here in case others need the fix as well. I think this will work.

EDIT: This fix works!

It looks like the thumbnails for older shows are available at the images subdomain (images.thetvdb.com/...) and at (thetvdb.com/...), while newer shows are only available at thetvdb.com/... . To fix this, I changed all instances of "http://images.thetvdb.com" to "http://thetvdb.com" in the xml file as mitul103 suggested above.
Reply
#9
You can just upgrade to a newer version as well now as mason mentioned since the scraper has been fixed in SVN for some time now.
Reply
#10
Thanks, sorry for wasting your time on a bug that's already been fixed.

I'm running XBMC on my XBOX and don't want to risk the upgrade. "If it ain't broke..."
Reply

Logout Mark Read Team Forum Stats Members Help
XBMC and thetvdb.com scraping question0