Failure to scrape movie using IMDB scraper
#1
Hi there,

I've got a movie, 'Wilby Wonderful', that flat-out refuses to scrape no matter what I do. All my other movies are scraped perfectly, including ones that I have tried more recently than this.

The log output suggests that it is finding the correct movie on IMDB, but then for some reason the scraper returns a URL that doesn't include the 'tt' movie ID -- despite it having worked this bit out correctly earlier.

Code:
15:53:16 T:5064 M:608665600   DEBUG: VideoInfoScanner: Scanning dir 'R:\Movies\Wilby Wonderful (2004)\' as not in the database
15:53:16 T:5064 M:608661504   DEBUG: CVideoDatabase::GetMovieId (R:\Movies\Wilby Wonderful (2004)\Wilby Wonderful.avi), query = select idMovie from movie where idFile=5708
15:53:16 T:5064 M:608690176   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'R:\Movies\Wilby Wonderful (2004)\Wilby Wonderful.avi'
15:53:16 T:5064 M:608690176   DEBUG: Win32DllLoader::Load(special://xbmcbin/system/libcurl.dll)
15:53:16 T:5064 M:608460800   DEBUG: Win32DllLoader::Load(special://xbmcbin/system/libidn-11.dll)
15:53:16 T:5064 M:608460800   DEBUG: Win32DllLoader::Load(special://xbmcbin/system/libeay32.dll)
15:53:16 T:5064 M:608460800   DEBUG: Win32DllLoader::Load(special://xbmcbin/system/libssl32.dll)
15:53:16 T:5064 M:608083968   DEBUG: Win32DllLoader::Load(ADVAPI32.DLL)
15:53:16 T:5064 M:608083968   DEBUG: Win32DllLoader::Load(KERNEL32.DLL)
15:53:16 T:5064 M:608034816   DEBUG: Win32DllLoader::Load(NETAPI32.DLL)
15:53:16 T:5064 M:607952896   DEBUG: FreeLibrary(NETAPI32.DLL) -> 0875EF28
15:53:16 T:5064 M:607952896   DEBUG: Win32DllLoader::Unload NETAPI32.DLL
15:53:16 T:5064 M:608165888   DEBUG: FreeLibrary(ADVAPI32.DLL) -> 087699C8
15:53:16 T:5064 M:608165888   DEBUG: Win32DllLoader::Unload ADVAPI32.DLL
15:53:16 T:5064 M:607997952   DEBUG: Win32DllLoader::Load(USER32.DLL)
15:53:16 T:5064 M:607997952   DEBUG: FreeLibrary(USER32.DLL) -> 087699C8
15:53:16 T:5064 M:607997952   DEBUG: Win32DllLoader::Unload USER32.DLL
15:53:17 T:5064 M:606965760   DEBUG: FreeLibrary(KERNEL32.DLL) -> 0875DA88
15:53:17 T:5064 M:606978048   DEBUG: Win32DllLoader::Unload KERNEL32.DLL
15:53:19 T:5064 M:607358976   DEBUG: Win32DllLoader::Load(secur32.dll)
15:53:19 T:5064 M:607285248   DEBUG: CIMDB::InternalFindMovie: Searching for 'wilby wonderful' using IMDb scraper (path: 'C:\Users\xxxxxxxx\AppData\Roaming\XBMC\addons\metadata.imdb.com', content: 'movies', version: '2.1.7')
15:53:19 T:5064 M:607285248   DEBUG: scraper: CreateSearchUrl returned <url>http://akas.imdb.com/find?s=tt;q=wilby%20wonderful%20(2004)</url>
15:53:19 T:5064 M:607285248   DEBUG: FileCurl::Open(0495EE00) http://akas.imdb.com/find?s=tt;q=wilby%20wonderful%20(2004)
15:53:19 T:5064 M:607260672    INFO: XCURL::DllLibCurlGlobal::easy_aquire - Created session to http://akas.imdb.com
15:53:21 T:5064 M:607444992   DEBUG: FileCurl::Close(0495EE00) http://akas.imdb.com/title/tt0383717/?fr=c2M9MXxsbT01MDB8ZmI9dXx0dD0xfG14PTIwfGh0bWw9MXxjaD0wfGNvPTB8cG49MHxmdD0wfGt3PTB8cXM9d2lsYnkgd29uZGVyZnVsICgyMDA0KXxzaXRlPWFrYXxxPXdpbGJ5IHdvbmRlcmZ1bHxubT0w;fc=1;ft=20
15:53:21 T:5064 M:607444992   DEBUG: scraper: GetSearchResults returned <?xml version="1.0" encoding="iso-8859-1" standalone="yes"?><results><entity><title>Wilby Wonderful</title><year>2004</year><url cache="-main.html">http://akas.imdb.com/title//</url><id></id></entity></results>
15:53:21 T:5064 M:607395840   DEBUG: FileCurl::Open(0495EDFC) http://akas.imdb.com/title//
15:53:21 T:5064 M:607379456 WARNING: XFILE::CFileCurl::CReadState::FillBuffer: curl failed with code 22
15:53:21 T:5064 M:607379456   ERROR: CFileCurl::CReadState::Open, didn't get any data from stream.
15:53:21 T:5064 M:607379456   DEBUG: FileCurl::Close(0495EDFC) http://akas.imdb.com/title//
15:53:21 T:5064 M:607379456   ERROR: ADDON::CScraper::Run: Unable to parse web site
15:53:21 T:5064 M:607379456   DEBUG: VideoInfoScanner: Adding new item to movies:R:\Movies\Wilby Wonderful (2004)\Wilby Wonderful.avi
15:53:21 T:5064 M:607375360   DEBUG: CVideoDatabase::GetMovieId (R:\Movies\Wilby Wonderful (2004)\Wilby Wonderful.avi), query = select idMovie from movie where idFile=5708
15:53:21 T:5064 M:607469568   DEBUG: Previous line repeats 1 times.
15:53:21 T:5064 M:607469568   DEBUG: VideoInfoScanner: Finished adding information from dir R:\Movies\Wilby Wonderful (2004)\

I have tried this multiple times, and scanned this movie at the same time as another movie, to ensure that it wasn't a problem at the IMDB end.

Does anyone have any ideas?
Reply
#2
Hey snoopstah, go see the bug you filled, I posted I reply, that may be a workaround until the problem is solved.

http://trac.xbmc.org/ticket/11318

Thanks,

Jean-Philippe
Reply

Logout Mark Read Team Forum Stats Members Help
Failure to scrape movie using IMDB scraper0