[RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies

  Thread Rating:
  • 8 Vote(s) - 4.5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
fireba11 Offline
Junior Member
Posts: 19
Joined: May 2013
Reputation: 0
Post: #766
can confirm information loading currently has some issues ...

hopefull the anidb api will be up again soon :-)

from log:
17:18:27 T:7020 ERROR: CCurlFile::FillBuffer - Failed: Timeout was reached(28)
17:18:27 T:7020 ERROR: CCurlFile::Open failed with code 0 for http://api.anidb.net:9001/httpapi?reques...=1&aid=xxx
17:18:27 T:7020 ERROR: ADDON::CScraper::Run: Unable to parse web site
find quote
Satori Ankh Offline
Junior Member
Posts: 1
Joined: Jul 2016
Reputation: 0
Post: #767
Excuse me, since that problem (now solved, reading on twitter) I can't add new anime. It says I'm banned and I have to wait to be unbanned. I even followed the guide and I set the delay to 100+ but it doesn't work. Some advice/help? I don't understand why I got banned Undecided I'm sorry for my bad englishs.
find quote
Floppik Offline
Junior Member
Posts: 1
Joined: Jul 2016
Reputation: 0
Post: #768
Hi!, I still can't add new title to the database.
Code:
20:22:10  99.820427 T:1607463920   ERROR: CCurlFile::Stat - Failed: Timeout was reached(28) for https://github.com/ScudLee/scudlee-xbmc-addons/raw/master/repo/metadata.tvshows.anidb.net.mod/icon.png
20:22:16 106.078041 T:1956422576   ERROR: ExecuteAsync - Not executing non-existing script script.favourites
20:22:32 122.187241 T:1510994928  NOTICE: VideoInfoScanner: Starting scan ..
20:22:42 132.357056 T:1510994928   ERROR: CCurlFile::FillBuffer - Failed: Timeout was reached(28)
20:22:42 132.357391 T:1510994928   ERROR: CCurlFile::Open failed with code 0 for https://raw.github.com/ScudLee/anime-lists/master/animetitles.xml
20:22:42 132.357727 T:1510994928   ERROR: Run: Unable to parse web site
20:22:44 134.702423 T:1510994928  NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:12
[/b]

Anyone can help with this?
(This post was last modified: 2016-07-11 19:30 by Floppik.)
find quote
Reiginsei Offline
Junior Member
Posts: 2
Joined: Jul 2016
Reputation: 0
Post: #769
I'm in the same boat, ever since they fixed their crash at anidb, I cannot update anything using the scraper. Any help would be appreciated.
find quote
gates Offline
Senior Member
Posts: 159
Joined: Jun 2010
Reputation: 2
Location: France
Post: #770
It works fine for me ...

Floppik,
in your log, the problem seems to be with https://raw.github.com/ScudLee/anime-lis...titles.xml
and not with anidb.net
find quote
BAXON Offline
Junior Member
Posts: 2
Joined: Mar 2013
Reputation: 0
Post: #771
Is it possible in the following version skrapper add a function to have a choice where to get the description of the anime. With anidb.net or thetvdb.com. Because there are descriptions thetvdb.som serials in other languages.
find quote
CanisCanis Offline
Junior Member
Posts: 2
Joined: Aug 2016
Reputation: 0
Post: #772
Hi,

first off, thanks for the great add-on!

Only just recently got into Kodi and using your scraper has been a godsend for Anime.

I have run into a small problem last night while adding some Anime movies.

Using the Anidb Movie scraper everything was working fine but I am only receiving Fanart / posters from AniDB...which with all 5 tested movies only brings up 1 image.

Checking the change logs here it stated that with version 1.1.0 themoviedb would also be included to scrape fanart but I still was not getting anything.

Scanning with themoviedb is a success and all fanart posters ect show up but for the future I would rather be using the anidb mod.

Just went through the log and I think I can see what the problem is, seems to be the API key has been banned or is invalid.


Code:
16:39:13 T:6584   DEBUG: scraper: ParseWriters returned <details><credits>Takahashi Chizuru</credits></details>
16:39:13 T:6584   DEBUG: scraper: GetDirectorsByIDChain returned <details><url function="ParseDirectors" gzip="yes" cache="8141.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=8141</url></details>
16:39:13 T:6584   DEBUG: scraper: ParseDirectors returned <details><director>Miyazaki Gorou</director></details>
16:39:13 T:6584   DEBUG: scraper: GetStudiosByIDChain returned <details><url function="ParseStudios" gzip="yes" cache="8141.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=8141</url></details>
16:39:13 T:6584   DEBUG: scraper: ParseStudios returned <details><studio>Studio Ghibli</studio></details>
16:39:13 T:6584   DEBUG: scraper: GetArtworkByIDChain returned <details><url function="ParseAniDBArtwork" gzip="yes" cache="8141.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=8141</url><url function="ParseTMDBBaseImageURL" cache="tmdb-config.json">http://api.tmdb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9</url><url function="ParseTMDBArtwork" cache="tmdb-images-8141-tt1798188.json">http://api.tmdb.org/3/movie/tt1798188/images?api_key=57983e31fb435df4df77afb854740ea9</url><chain function="ReturnFanart">&</url></details>
16:39:13 T:6584   DEBUG: scraper: ParseAniDBArtwork returned <details><thumb aspect="poster">http://img7.anidb.net/pics/anime/60829.jpg</thumb></details>
16:39:13 T:6584   DEBUG: CurlFile::Open(12BB4170) http://api.tmdb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9
16:39:13 T:6584    INFO: XCURL::DllLibCurlGlobal::easy_aquire - Created session to http://api.tmdb.org
16:39:13 T:6584   ERROR: CCurlFile::FillBuffer - Failed: HTTP returned error 401
16:39:13 T:6584   ERROR: CCurlFile::Open failed with code 401 for http://api.tmdb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9
16:39:13 T:6584   ERROR: ADDON::CScraper::Run: Unable to parse web site
16:39:13 T:6584   DEBUG: CurlFile::Open(12BB4170) http://api.tmdb.org/3/movie/tt1798188/images?api_key=57983e31fb435df4df77afb854740ea9
16:39:13 T:6584   ERROR: CCurlFile::FillBuffer - Failed: HTTP returned error 401
16:39:13 T:6584   ERROR: CCurlFile::Open failed with code 401 for http://api.tmdb.org/3/movie/tt1798188/images?api_key=57983e31fb435df4df77afb854740ea9
16:39:13 T:6584   ERROR: ADDON::CScraper::Run: Unable to parse web site
16:39:13 T:6584   DEBUG: scraper: ReturnFanart returned <details><fanart><fanart></details>
16:39:13 T:6584   DEBUG: scraper: GetMovieData returned <details><chain function="GetTMDBCertificationsByIdChain">tt1798188</chain><chain function="GetTMDBTrailerByIdChain">tt1798188</chain></details>
16:39:13 T:6584   DEBUG: scraper: GetTMDBCertificationsByIdChain returned <details><url function="ParseTMDBCertifications" cache="tmdb-cert-tt1798188.json">http://api.tmdb.org/3/movie/tt1798188/releases?api_key=f7f51775877e0bb6703520952b3c7840&amp;language=gb</url></details>
16:39:13 T:6584   DEBUG: scraper: ParseTMDBCertifications returned <details><mpaa>Rated U</mpaa></details>
16:39:13 T:6584   DEBUG: scraper: GetTMDBTrailerByIdChain returned <details><url function="ParseTMDBTrailer" cache="tmdb-trailer--tt1798188.json">http://api.tmdb.org/3/movie/tt1798188/trailers?api_key=f7f51775877e0bb6703520952b3c7840&amp;language=</url></details>
16:39:13 T:6584   DEBUG: scraper: ParseTMDBTrailer returned <details><trailer>plugin://plugin.video.youtube/?action=play_video&amp;videoid=k-vfzhfq5JA</trailer></details>
16:39:13 T:6584   DEBUG: scraper: StartDelayLoop returned <details><chain function="DelayLoop">&</chain></details>
16:39:13 T:6584   DEBUG: scraper: DelayLoop returned <details><chain function="DelayLoop">&</chain></details>
16:39:13 T:6584   DEBUG: Previous line repeats 248 times.
16:39:13 T:6584   DEBUG: scraper: DelayLoop returned <details></details>


Opening the link the page states:

{"status_code":10,"status_message":"Suspended API key: Access to your account has been suspended, contact TMDb."}


Not sure if this is an issue on my end or on the mod side. Scraping myself using themoviedb works fine.

Many thanks!
find quote
CanisCanis Offline
Junior Member
Posts: 2
Joined: Aug 2016
Reputation: 0
Post: #773
Maybe I am mistaken with the above,

looking at the anime-list.xml - tmdb isn't listed there for the movies in question. Only the imdb.

Maybe I'm just being stupid here,

The Anime Movies in question here are mainly Studio Ghibly, like My Neighbor Totoro, Howl's Moving Castle, Princess Mononoke, Ponyo ect.

For all these, the only artwork I am getting is 1 poster image which is from the anidb site. Nothing else. All information is there, so it is scraping properly, I am just not getting any alternative artwork and the 1 I get with anidb is quite low quality.

Apart from downloading artwork myself, is there something I am doing wrong?

Many thanks
find quote
Reiginsei Offline
Junior Member
Posts: 2
Joined: Jul 2016
Reputation: 0
Post: #774
So I finally fixed my scraping problem, but another has reared its head. Now any titles with a number in their title will not scrape at all. 91 Days - 02.mkv, Shokugeki no Soma S2 - 01.mkv and so on. If I were to remove the 91 or the S2, it will scrape just fine and it doesn't care about [720p] tags or checksums thanks to the anime entries in the advancedsettings.xml, but this number-in-a-title issue has never been a problem before that I can recall. Any ideas what could now be causing this or something I can to the advancedsettings.xml to fix it?
find quote
gates Offline
Senior Member
Posts: 159
Joined: Jun 2010
Reputation: 2
Location: France
Post: #775
number-in-a-title issue has always been a problem for me Smile

you can try to fix it with complexe advancedsettings.xml

but i suggest to simply rename it
with no space between "91" and "Days" for example
91Days - 02.mkv, Shokugeki no Soma S2 - 01.mkv
find quote
Shogunreaper Offline
Senior Member
Posts: 119
Joined: Jan 2015
Reputation: 1
Post: #776
is tagging broken?

No matter what settings i change in the anidb2 tab the number of tags doesn't change.

i was trying to scrape a bunch of hentais and notice that it's missing a bunch of tags

for example with Futabu! 2 tags i noticed it didn't get were small breasts/futanari

in fact those tags (along with a bunch of others i assume) were completely missing from any series that i know has them on anidb

it was able to grab the "mammary intercourse" tag which only had 2 gold stars by the name, but not female student or futanari which had 3.
(This post was last modified: 2016-08-23 20:19 by Shogunreaper.)
find quote
Post Reply