[RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies

  Thread Rating:
  • 8 Vote(s) - 4.5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
fireba11 Offline
Junior Member
Posts: 19
Joined: May 2013
Reputation: 0
Post: #766
can confirm information loading currently has some issues ...

hopefull the anidb api will be up again soon :-)

from log:
17:18:27 T:7020 ERROR: CCurlFile::FillBuffer - Failed: Timeout was reached(28)
17:18:27 T:7020 ERROR: CCurlFile::Open failed with code 0 for http://api.anidb.net:9001/httpapi?reques...=1&aid=xxx
17:18:27 T:7020 ERROR: ADDON::CScraper::Run: Unable to parse web site
find quote
Satori Ankh Offline
Junior Member
Posts: 1
Joined: Jul 2016
Reputation: 0
Post: #767
Excuse me, since that problem (now solved, reading on twitter) I can't add new anime. It says I'm banned and I have to wait to be unbanned. I even followed the guide and I set the delay to 100+ but it doesn't work. Some advice/help? I don't understand why I got banned Undecided I'm sorry for my bad englishs.
find quote
Floppik Offline
Junior Member
Posts: 1
Joined: Jul 2016
Reputation: 0
Post: #768
Hi!, I still can't add new title to the database.
Code:
20:22:10  99.820427 T:1607463920   ERROR: CCurlFile::Stat - Failed: Timeout was reached(28) for https://github.com/ScudLee/scudlee-xbmc-addons/raw/master/repo/metadata.tvshows.anidb.net.mod/icon.png
20:22:16 106.078041 T:1956422576   ERROR: ExecuteAsync - Not executing non-existing script script.favourites
20:22:32 122.187241 T:1510994928  NOTICE: VideoInfoScanner: Starting scan ..
20:22:42 132.357056 T:1510994928   ERROR: CCurlFile::FillBuffer - Failed: Timeout was reached(28)
20:22:42 132.357391 T:1510994928   ERROR: CCurlFile::Open failed with code 0 for https://raw.github.com/ScudLee/anime-lists/master/animetitles.xml
20:22:42 132.357727 T:1510994928   ERROR: Run: Unable to parse web site
20:22:44 134.702423 T:1510994928  NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:12
[/b]

Anyone can help with this?
(This post was last modified: 2016-07-11 19:30 by Floppik.)
find quote
Reiginsei Offline
Junior Member
Posts: 2
Joined: Jul 2016
Reputation: 0
Post: #769
I'm in the same boat, ever since they fixed their crash at anidb, I cannot update anything using the scraper. Any help would be appreciated.
find quote
gates Offline
Senior Member
Posts: 164
Joined: Jun 2010
Reputation: 3
Location: France
Post: #770
It works fine for me ...

Floppik,
in your log, the problem seems to be with https://raw.github.com/ScudLee/anime-lis...titles.xml
and not with anidb.net
find quote
BAXON Offline
Junior Member
Posts: 2
Joined: Mar 2013
Reputation: 0
Post: #771
Is it possible in the following version skrapper add a function to have a choice where to get the description of the anime. With anidb.net or thetvdb.com. Because there are descriptions thetvdb.som serials in other languages.
find quote
CanisCanis Offline
Junior Member
Posts: 2
Joined: Aug 2016
Reputation: 0
Post: #772
Hi,

first off, thanks for the great add-on!

Only just recently got into Kodi and using your scraper has been a godsend for Anime.

I have run into a small problem last night while adding some Anime movies.

Using the Anidb Movie scraper everything was working fine but I am only receiving Fanart / posters from AniDB...which with all 5 tested movies only brings up 1 image.

Checking the change logs here it stated that with version 1.1.0 themoviedb would also be included to scrape fanart but I still was not getting anything.

Scanning with themoviedb is a success and all fanart posters ect show up but for the future I would rather be using the anidb mod.

Just went through the log and I think I can see what the problem is, seems to be the API key has been banned or is invalid.


Code:
16:39:13 T:6584   DEBUG: scraper: ParseWriters returned <details><credits>Takahashi Chizuru</credits></details>
16:39:13 T:6584   DEBUG: scraper: GetDirectorsByIDChain returned <details><url function="ParseDirectors" gzip="yes" cache="8141.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=8141</url></details>
16:39:13 T:6584   DEBUG: scraper: ParseDirectors returned <details><director>Miyazaki Gorou</director></details>
16:39:13 T:6584   DEBUG: scraper: GetStudiosByIDChain returned <details><url function="ParseStudios" gzip="yes" cache="8141.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=8141</url></details>
16:39:13 T:6584   DEBUG: scraper: ParseStudios returned <details><studio>Studio Ghibli</studio></details>
16:39:13 T:6584   DEBUG: scraper: GetArtworkByIDChain returned <details><url function="ParseAniDBArtwork" gzip="yes" cache="8141.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=8141</url><url function="ParseTMDBBaseImageURL" cache="tmdb-config.json">http://api.tmdb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9</url><url function="ParseTMDBArtwork" cache="tmdb-images-8141-tt1798188.json">http://api.tmdb.org/3/movie/tt1798188/images?api_key=57983e31fb435df4df77afb854740ea9</url><chain function="ReturnFanart">&</url></details>
16:39:13 T:6584   DEBUG: scraper: ParseAniDBArtwork returned <details><thumb aspect="poster">http://img7.anidb.net/pics/anime/60829.jpg</thumb></details>
16:39:13 T:6584   DEBUG: CurlFile::Open(12BB4170) http://api.tmdb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9
16:39:13 T:6584    INFO: XCURL::DllLibCurlGlobal::easy_aquire - Created session to http://api.tmdb.org
16:39:13 T:6584   ERROR: CCurlFile::FillBuffer - Failed: HTTP returned error 401
16:39:13 T:6584   ERROR: CCurlFile::Open failed with code 401 for http://api.tmdb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9
16:39:13 T:6584   ERROR: ADDON::CScraper::Run: Unable to parse web site
16:39:13 T:6584   DEBUG: CurlFile::Open(12BB4170) http://api.tmdb.org/3/movie/tt1798188/images?api_key=57983e31fb435df4df77afb854740ea9
16:39:13 T:6584   ERROR: CCurlFile::FillBuffer - Failed: HTTP returned error 401
16:39:13 T:6584   ERROR: CCurlFile::Open failed with code 401 for http://api.tmdb.org/3/movie/tt1798188/images?api_key=57983e31fb435df4df77afb854740ea9
16:39:13 T:6584   ERROR: ADDON::CScraper::Run: Unable to parse web site
16:39:13 T:6584   DEBUG: scraper: ReturnFanart returned <details><fanart><fanart></details>
16:39:13 T:6584   DEBUG: scraper: GetMovieData returned <details><chain function="GetTMDBCertificationsByIdChain">tt1798188</chain><chain function="GetTMDBTrailerByIdChain">tt1798188</chain></details>
16:39:13 T:6584   DEBUG: scraper: GetTMDBCertificationsByIdChain returned <details><url function="ParseTMDBCertifications" cache="tmdb-cert-tt1798188.json">http://api.tmdb.org/3/movie/tt1798188/releases?api_key=f7f51775877e0bb6703520952b3c7840&amp;language=gb</url></details>
16:39:13 T:6584   DEBUG: scraper: ParseTMDBCertifications returned <details><mpaa>Rated U</mpaa></details>
16:39:13 T:6584   DEBUG: scraper: GetTMDBTrailerByIdChain returned <details><url function="ParseTMDBTrailer" cache="tmdb-trailer--tt1798188.json">http://api.tmdb.org/3/movie/tt1798188/trailers?api_key=f7f51775877e0bb6703520952b3c7840&amp;language=</url></details>
16:39:13 T:6584   DEBUG: scraper: ParseTMDBTrailer returned <details><trailer>plugin://plugin.video.youtube/?action=play_video&amp;videoid=k-vfzhfq5JA</trailer></details>
16:39:13 T:6584   DEBUG: scraper: StartDelayLoop returned <details><chain function="DelayLoop">&</chain></details>
16:39:13 T:6584   DEBUG: scraper: DelayLoop returned <details><chain function="DelayLoop">&</chain></details>
16:39:13 T:6584   DEBUG: Previous line repeats 248 times.
16:39:13 T:6584   DEBUG: scraper: DelayLoop returned <details></details>


Opening the link the page states:

{"status_code":10,"status_message":"Suspended API key: Access to your account has been suspended, contact TMDb."}


Not sure if this is an issue on my end or on the mod side. Scraping myself using themoviedb works fine.

Many thanks!
find quote
CanisCanis Offline
Junior Member
Posts: 2
Joined: Aug 2016
Reputation: 0
Post: #773
Maybe I am mistaken with the above,

looking at the anime-list.xml - tmdb isn't listed there for the movies in question. Only the imdb.

Maybe I'm just being stupid here,

The Anime Movies in question here are mainly Studio Ghibly, like My Neighbor Totoro, Howl's Moving Castle, Princess Mononoke, Ponyo ect.

For all these, the only artwork I am getting is 1 poster image which is from the anidb site. Nothing else. All information is there, so it is scraping properly, I am just not getting any alternative artwork and the 1 I get with anidb is quite low quality.

Apart from downloading artwork myself, is there something I am doing wrong?

Many thanks
find quote
Reiginsei Offline
Junior Member
Posts: 2
Joined: Jul 2016
Reputation: 0
Post: #774
So I finally fixed my scraping problem, but another has reared its head. Now any titles with a number in their title will not scrape at all. 91 Days - 02.mkv, Shokugeki no Soma S2 - 01.mkv and so on. If I were to remove the 91 or the S2, it will scrape just fine and it doesn't care about [720p] tags or checksums thanks to the anime entries in the advancedsettings.xml, but this number-in-a-title issue has never been a problem before that I can recall. Any ideas what could now be causing this or something I can to the advancedsettings.xml to fix it?
find quote
gates Offline
Senior Member
Posts: 164
Joined: Jun 2010
Reputation: 3
Location: France
Post: #775
number-in-a-title issue has always been a problem for me Smile

you can try to fix it with complexe advancedsettings.xml

but i suggest to simply rename it
with no space between "91" and "Days" for example
91Days - 02.mkv, Shokugeki no Soma S2 - 01.mkv
find quote
Shogunreaper Offline
Senior Member
Posts: 151
Joined: Jan 2015
Reputation: 2
Post: #776
nvm
(This post was last modified: 2016-09-14 18:53 by Shogunreaper.)
find quote
fireaza Offline
Member
Posts: 55
Joined: May 2015
Reputation: 0
Post: #777
I just discovered this plugin, it's been a big help with my Kodi woes! I've still got a few issues though:
1) Is it possible to separate specials from the main episodes? Right now, they're mixed in, I'd rather they were in a separate folder or put after the main episodes.
2) Is there some issue with the way this plugin scrapes that makes it incompatible with extra fanart downloader? I'm trying to get Kodi to display banners for my anime movies, and even though there's banners on fanart.tv, Kodi doesn't load them.
3) Is it possible to group related series together in a folder? For example, if I have "Clannad" and "Clannad: After Story" instead of having them appear one after the other, could I just have a main "Clannad" folder which I can open to then see "Clannad" and "Clannad: After Story"?
find quote
gates Offline
Senior Member
Posts: 164
Joined: Jun 2010
Reputation: 3
Location: France
Post: #778
hi fireaza

1) You can map special episode at the end of episode list => go in anidb-mod option "anidb 1

2) You can have fanart and cie.
in anidb-mod main option, select "thetvdb.com" to store ID
Since kodi 16 (or 15 maybe) that can be tricky, because tv-show aren't no more sort by title but by ID.
You just have to change ID from anidb for anime sequel/prequel wich are "season" in thetvdb and select artwork manually (ie Clannad)

3) one day maybe, i hope Smile
http://forum.kodi.tv/showthread.php?tid=68476
http://forum.kodi.tv/showthread.php?tid=195174
(This post was last modified: 2016-08-31 07:54 by gates.)
find quote
firewater Offline
Junior Member
Posts: 14
Joined: Mar 2016
Reputation: 0
Post: #779
For folders I use what AniDB calls the "Official Title", that is to say, I name my folder "シリアルエクスペリメンツレイン" instead of "Serial Experiments Lain". If I use said title, not a single series gets picked up unless I add a "tvshow.nfo" file to the folder, containing the URL to the series on AniDB. Since "Official Title" is an actual parameter recognized by AniDB, is there any way I can skip the part were I gotta make the .nfo file?
(This post was last modified: 2016-09-01 11:33 by firewater.)
find quote
Squid Girl Offline
Junior Member
Posts: 1
Joined: Sep 2016
Reputation: 0
Post: #780
So I have a few hentai videos that I want the information for on kodi, but the aniDB scraper never wants to get it for me. I see the scraper finds the information then it just doesn't update my library. I'll give you an example, I have a video called "Classes In Seduction", and that's the name for the source file on my computer. When I use the scraper I see the little loading bar at the top and it shows the video should actually be called, "Professor Shino's Classes in Seduction". I go and check to see if its been updated but nothing, this also happens for the other two videos. I'm just a little confused as to why this is happening and seeing if anyone could help me. Thx
(This post was last modified: 2016-09-06 06:21 by Squid Girl.)
find quote
Post Reply