[mathius]

Example of thetvdb scraper failure:

06:34:16 T:888 M:1369571328 DEBUG: FileCurl::Open(07C32F40) http://www.thetvdb.com/api/GetSeries.php...anguage=en
06:34:25 T:888 M:1363423232 DEBUG: XFILE::CFileCurl::CReadState::FillBuffer: curl failed with code 28
06:34:25 T:888 M:1363423232 DEBUG: XFILE::CFileCurl::CReadState::FillBuffer: Reconnect, (re)try 1
06:34:28 T:888 M:1363451904 DEBUG: FileCurl::Close(07C32F40) http://www.thetvdb.com/api/GetSeries.php...anguage=en
06:34:28 T:888 M:1363451904 DEBUG: scraper: GetSearchResults returned <?xml version="1.0" encoding="utf-8" standalone="yes"?><results><entity><title>Black Books</title><language>en</language><url cache="76924.xml">http://www.thetvdb.com/api/1D62F2F90030C444/series/76924/all/en.zip</url><id>76924</id></entity></results>
06:34:28 T:888 M:1363427328 DEBUG: FileCurl::Open(07C32F40) http://www.thetvdb.com/api/1D62F2F90030C...all/en.zip
06:34:32 T:888 M:1363603456 DEBUG: XFILE::CFileCurl::CReadState::FillBuffer: curl failed with code 22
06:34:32 T:888 M:1363599360 ERROR: CFileCurl::CReadState::Open, didn't get any data from stream.
06:34:32 T:888 M:1363599360 DEBUG: FileCurl::Close(07C32F40) http://www.thetvdb.com/api/1D62F2F90030C...all/en.zip
06:34:32 T:888 M:1363599360 DEBUG: CVideoDatabase::GetSeasonsNav query: select episode.c12,path.strPath,tvshow.c00,count(1),count(files.playCount) from episode join tvshow on tvshow.idshow=tvshowlinkepisode.idshow join tvshowlinkepisode on tvshowlinkepisode.idEpisode = episode.idEpisode join files on files.idFile=episode.idFile join tvshowlinkpath on tvshowlinkpath.idShow = tvshow.idShow join path on path.idPath = tvshowlinkpath.idPath where tvshow.idShow = 4294967295 group by episode.c12
06:34:32 T:888 M:1363599360 DEBUG: VIDEO::CVideoInfoScanner:oScan - Finished dir: E:\Video\TV\Black Books\
06:34:32 T:888 M:1363595264 DEBUG: VIDEO::CVideoInfoScanner:rocess - Finished scan
___________________________________________________________________________________________

So..
Within the http://www.thetvdb.com/api/1D62F2F90030C444/series/ directory, there is no 7692 subdirectory. Seems thetvdb is either still recovering data or is reorganising their structure.

[infernalshade]

I'm a Web-Developer and i think i know the Problem they have

Their new provider does not have cURL activated in their Apache Webserver!

Short description of cURL:

curl is a command line tool for transferring files with URL syntax, supporting FTP, FTPS, HTTP, HTTPS, SCP, SFTP, TFTP, TELNET, DICT, LDAP, LDAPS and FILE. curl supports SSL certificates, HTTP POST, HTTP PUT, FTP uploading, HTTP form based upload, proxies, cookies, user+password authentication (Basic, Digest, NTLM, Negotiate, kerberos...), file transfer resume, proxy tunneling and a busload of other useful tricks.

cURL isn't needed for a "normal" Website, but some Scripts use it, like the Scrapers, or some Online-Shops!

So they have to contact their Hosters to activate cURL, then it should work again

EDIT: Also, the Scrapers return cURL Error Codes 28 and 22 ... as you can see here: http://curl.haxx.se/libcurl/c/libcurl-errors.html

CURLE_HTTP_RETURNED_ERROR (22)
This is returned if CURLOPT_FAILONERROR is set TRUE and the HTTP server returns an error code that is >= 400. (This error code was formerly known as CURLE_HTTP_NOT_FOUND.)

CURLE_OPERATION_TIMEDOUT (28)
Operation timeout. The specified time-out period was reached according to the conditions.

This is the typical behavior if cURL isnt activated!

[tslayer]

infernalshade,

Umm.. No. You couldn't be more wrong. Sorry

[XBL.]

To me it appears that thetvdb.com is still down? I guess that's still the root of the problem, having thetvdb going down (and up, and down).

Tested from three different networks (two dutch, one US):

US (Spry):

Code:

jochem@usa:~$ ping thetvdb.com
PING thetvdb.com (67.152.32.114) 56(84) bytes of data.

--- thetvdb.com ping statistics ---
6 packets transmitted, 0 received, 100% packet loss, time 5007ms

NL (Reasonnet):

Code:

jochem@production:~$ ping thetvdb.com
PING thetvdb.com (67.152.32.114) 56(84) bytes of data.

--- thetvdb.com ping statistics ---
15 packets transmitted, 0 received, 100% packet loss, time 14010ms

NL (Ziggo):

Code:

mb-jochem:~ jochem$ ping thetvdb.com
PING thetvdb.com (67.152.32.114): 56 data bytes
Request timeout for icmp_seq 0
Request timeout for icmp_seq 1
Request timeout for icmp_seq 2
Request timeout for icmp_seq 3
Request timeout for icmp_seq 4
^C
--- thetvdb.com ping statistics ---
6 packets transmitted, 0 packets received, 100.0% packet loss

Just checked their forums (which apparently runs on a different box ) and got this from this topic:

Just to clarify. We were getting free hosting from a friend. Unfortunatly they had a customer turn on 12 blades on Friday. This cause an overdraw on circuits, so a bunch of stuff had to be turned off till more power could be installed. Free is a pretty good price for a site that drives 15-30Mbit/sec.

And according to this topic their busy doing some maintenance.

I guess we just have to wait and see what will happen and when it will be back .

[infernalshade]

infernalshade,

Umm.. No. You couldn't be more wrong. Sorry

Then please explain why this is wrong?

A week ago i run into the same problem of an onlineshop from a customer... the hoster activated cURL in the Apache Webserver and everything was working fine again! cURL is needed to transfer the data when the scraper is requesting it through the links...

They installed a backup-file, because of this i don't think that the links have changed!

If you call the scraper-generated links manually in the Browser you'll get a 404 Error and i think THIS i caused by cURL, isn't it?! If not i'm sorry but i thought this is possible..

[Constructacon]

And according to this topic their busy doing some maintenance.

I guess we just have to wait and see what will happen and when it will be back .

Yeah. They're rebuilding the db at the moment. Their reports page shows the status of the rebuild. When the series waiting for update reaches 0 the rebuild is complete. It's dropped from 17000 to 12300 in the past couple of hours. I guess it's going to take another day (give or take) for it to be up and running again.

I'm wondering if we need to wait for completion for it to work or if scapers will work with increasing results as the rebuild continues.

[tenoce]

Yeah. They're rebuilding the db at the moment. Their reports page shows the status of the rebuild. When the series waiting for update reaches 0 the rebuild is complete. It's dropped from 17000 to 12300 in the past couple of hours. I guess it's going to take another day (give or take) for it to be up and running again.

I'm wondering if we need to wait for completion for it to work or if scapers will work with increasing results as the rebuild continues.

I've tried with Desperate Housewives s06e06 and it already worked. No need to wait, if your lucky your series might have been already processed.

[Hitomics]

Seems to me they have changed some of the subdomains and that's giving XBMC some problems.

For example it's trying to get all the images from images.thetvdb.com/banners when they're all on http://thetvdb.com/banners/ now

[tslayer]

infernalshade,

Sorry, but you are wrong. We use curl just to make http/ftp/etc requests. The webserver does not need to know about this. The only time a webserver may need it is if it acts as a client to some other webserver.

But all libcurl will do in XBMC is act as a browser and make requests and get responses.

Nothing has to be done on the webserver itself.

[Jaerin]

Seems to me they have changed some of the subdomains and that's giving XBMC some problems.

For example it's trying to get all the images from images.thetvdb.com/banners when they're all on http://thetvdb.com/banners/ now

This is a known issue with older builds. The Devs at TVDB did change the location of the images from images.thetvdb.com to just thetvdb.com.

If you still have this issue go into your tvdb.xml and do a gobal replace of images.thetvdb.com to just thetvdb.com.

This was separate than the outage they are currently having.

[Hitomics]

This is a known issue with older builds. The Devs at TVDB did change the location of the images from images.thetvdb.com to just thetvdb.com.

If you still have this issue go into your tvdb.xml and do a gobal replace of images.thetvdb.com to just thetvdb.com.

This was separate than the outage they are currently having.

Yeah I was fixing that at the time of that post and got it to work.

But I wasn't using an old build... oO

[outleradam]

If it has anything to do with python, it may explain the problem. Python is broke in the recent releases.

[infernalshade]

infernalshade,

Sorry, but you are wrong. We use curl just to make http/ftp/etc requests. The webserver does not need to know about this. The only time a webserver may need it is if it acts as a client to some other webserver.

But all libcurl will do in XBMC is act as a browser and make requests and get responses.

Nothing has to be done on the webserver itself.

Ah ok, thx! I thought XBMC is connecting to the API directly to the Server

Well..if XBMC is acting like a web browser to get data, then i couldn't be deactivated cURL, you're right!

But this means the Problem isn't xbmc or the Scraper, it's thetvdb itself...hmhm...then we have to wait till thetvdb.com solves the problem..

[nemrod95]

tvdb is ok now Yes !

[tenoce]

Scrapers are OK, but it does not download any fanart from thetvdb.com
Is anyone else experiencing the same issue?