TMDB scrapers don;t seem to be working..
#1
Hey All,


I have a number of new movies in my DB and KODI is seeing them and trying to get the info from TMDB.

The request seems to work (200 OK - in cUrl debugging and additional debugging) but then the loggin says.. found <results></results> in the response.. so nothing:

DEBUG: scraper: CreateSearchUrl returned <url>http://api.tmdb.org/3/search/movie?api_key=57983e31fb435df4df77afb854740ea9&amp;query=Survivor&amp;year=2015&amp;language=en</url>
DEBUG: CurlFile::Open(0x10571a0b0) http://api.tmdb.org/3/search/movie?api_k...anguage=en
DEBUG: Curl:Big Grinebug - TEXT: Re-using existing connection! (#0) with host api.tmdb.org
DEBUG: Curl:Big Grinebug - TEXT: Connected to api.tmdb.org (198.41.188.159) port 80 (#0)
DEBUG: Curl:Big Grinebug - HEADER_OUT: GET /3/search/movie?api_key=57983e31fb435df4df77afb854740ea9&query=Survivor&year=2015&language=en HTTP/1.1
DEBUG: Curl:Big Grinebug - HEADER_OUT: Range: bytes=0-
DEBUG: Curl:Big Grinebug - HEADER_OUT: User-Agent: Kodi/14.2 (Macintosh; Intel Mac OS X 10_10_3) App_Bitness/64 Version/14.2-Git:2015-03-26-7cc53a9-dirty
DEBUG: Curl:Big Grinebug - HEADER_OUT: Host: api.tmdb.org
DEBUG: Curl:Big Grinebug - HEADER_OUT: Accept: */*
DEBUG: Curl:Big Grinebug - HEADER_OUT: Cookie: __cfduid=d9a36e3202f97accf4bcb0613c19f02221422758030
DEBUG: Curl:Big Grinebug - HEADER_OUT: Accept-Charset: UTF-8,*;q=0.8
DEBUG: Curl:Big Grinebug - HEADER_IN: HTTP/1.1 200 OK
DEBUG: Curl:Big Grinebug - HEADER_IN: Date: Sat, 30 May 2015 03:58:11 GMT
DEBUG: Curl:Big Grinebug - HEADER_IN: Content-Type: application/json;charset=utf-8
DEBUG: Curl:Big Grinebug - HEADER_IN: Transfer-Encoding: chunked
DEBUG: Curl:Big Grinebug - HEADER_IN: Connection: keep-alive
DEBUG: Curl:Big Grinebug - HEADER_IN: Access-Control-Allow-Origin: *
DEBUG: Curl:Big Grinebug - HEADER_IN: Cache-Control: public, max-age=28800
DEBUG: Curl:Big Grinebug - HEADER_IN: ETag: W/"0176e8ba94264176de04e54ec7a34087"
DEBUG: Curl:Big Grinebug - HEADER_IN: Status: 200 OK
DEBUG: Curl:Big Grinebug - HEADER_IN: Vary: Accept-Encoding
DEBUG: Curl:Big Grinebug - HEADER_IN: X-Memc: HIT
DEBUG: Curl:Big Grinebug - HEADER_IN: X-Memc-Age: 3979
DEBUG: Curl:Big Grinebug - HEADER_IN: X-Memc-Expires: 6821
DEBUG: Curl:Big Grinebug - HEADER_IN: X-Memc-Key: 01456e58a93f7500433dd53b9c3766ba
DEBUG: Curl:Big Grinebug - HEADER_IN: X-RateLimit-Limit: 40
DEBUG: Curl:Big Grinebug - HEADER_IN: X-RateLimit-Remaining: 39
DEBUG: Curl:Big Grinebug - HEADER_IN: X-RateLimit-Reset: 1432937888
DEBUG: Curl:Big Grinebug - HEADER_IN: CF-Cache-Status: HIT
DEBUG: Curl:Big Grinebug - HEADER_IN: Expires: Sat, 30 May 2015 11:58:11 GMT
DEBUG: Curl:Big Grinebug - HEADER_IN: Server: cloudflare-nginx
DEBUG: Curl:Big Grinebug - HEADER_IN: CF-RAY: 1ee784e849ad1d9e-MEL
DEBUG: Curl:Big Grinebug - TEXT: Connection #0 to host api.tmdb.org left intact
DEBUG: Get: Using "UTF-8" charset for "http://api.tmdb.org/3/search/movie?api_key=57983e31fb435df4df77afb854740ea9&query=Survivor&year=2015&language=en"
DEBUG: scraper: GetSearchResults returned <results></results>

If I try the request from the command line it returns data about the movie, but it is in JSON, not XML (Is the scraper expecting an XML response?)

I get this on both OSX and RaspBMC (KODI 14.2, and TMDB plugin versions 3.7.13 & 3.8)

Anyone else?

Thx

G./
Reply
#2
Seems to work now.

G./
Reply
#3
For me still not working, I get only the posters
Reply
#4
(2015-06-13, 18:24)Danny3 Wrote: For me still not working, I get only the posters

and that helps us how?
Read/follow the forum rules.
For troubleshooting and bug reporting, read this first
Interested in seeing some YouTube videos about Kodi? Go here and subscribe
Reply
#5
(2015-06-13, 18:26)Martijn Wrote: and that helps us how?

Ok, I assume you tested and you can't replicate and you want a debug log

I would've added it the first time if I knew how

So I read this:
http://kodi.wiki/view/Log_file/Easy

and here it is scraping movies:
http://xbmclogs.com/peif8hdj6

and here scraping a tv show:
http://xbmclogs.com/px6e7qiul

From component speciffic logging I avtivated logging for curl library since the user above hinted the problem might be there


In Kodi movie titles, plots and episodes names are only empty strings
Only the posters are correct

If the logs are not good, please tell me what I should do
Reply
#6
Ok that clears it up a lot more.
You've hit a build that had a problem.
Remove myvideos93.db and install last available nightly and try again
Read/follow the forum rules.
For troubleshooting and bug reporting, read this first
Interested in seeing some YouTube videos about Kodi? Go here and subscribe
Reply
#7
Yes, that solved the problem, thank you very much for the quick reply
Reply

Logout Mark Read Team Forum Stats Members Help
TMDB scrapers don;t seem to be working..1