• 1
  • 45
  • 46
  • 47(current)
  • 48
  • 49
  • 71
Release [MOD] AniDB.net scrapers for TV shows and Movies
I had my anime scraped on my old computer using Kodi, but it died. I've since tried to set it up again and it won't scrape a single Anime episode. Played around with the settings in the scraper, tried messing with the advancedsettings.xml per the main post, but didn't make any difference. Using the latest 2.3.0

My format is (Example): Cowboy Bebop (1998)\Cowboy Bebop - EP01 - Asteroid Blues, which was working before.No idea what to do. Any ideas?
Reply
why do i get ban from anidb?
Reply
@scudlee Thanks for the heads up. Some of the genres were redundant anyway, "Seinen", "Ecchi", and "Mecha" made more sense than "General Lack of Common Sense" or "Transfer Student" If you run Genesis, all of those would show up as a channel. Take your time, I don't see others complaining about it and thanks for everything, anime on XBMC/KODI wouldn't be the same without it.

@caffeinepills I find that naming the show as S01E01, 1x1, 101, or 1x01 usually work, also, OVAs work best when labeled as S00E01, etc. Review Thetvdb for proper naming. Many second seasons have different titles, ex: Code Geass season 1 is titled Code Geass Lelouch of the Rebellion and season 2 is titled Code Geass Lelouch of the Rebellion R2. It is important to place those second seasons in a separate folder with the proper name and title them S01E01, 2, 3 etc. as well. You can name second seasons, S02E01, 2, 3 etc but you will have to scrape it using TheTVDb scraper, otherwise you will have doubles of season 1 using the AniDB.net scraper.

@rickyman I've found that if you scrape a large number of shows consecutively, AniDB.net will ban you for a limited time, this is to prevent exceeding bandwidth. Just wait 30 min to an hour and you should be good. This makes scraping take longer if shows are not named properly. I've also found that if you disable the "Use Google Search", it will let you scrape consecutively, no problem, although you may have trouble finding every show.

(I may be wrong on some of this but it does works for me, I'm using KODI Helix 14.2)
Reply
does OVA equal TV shows or movies?
Reply
With Jarvis coming up, I decided to just uninstall Isengard and start over with a totally new install of the latest Jarvis nightly. Everything was working great until I went to add my anime. Ran into 2 different problems. Not sure if the two are related or not. Now, all of this is involving a fully functioning and scraped collection from Helix and Isengard. Most of the shows have an info files as I did an Export Library a while back after most where in the library.

The first problem is only a small percentage of shows are recognized by the initial scan. Most of of the shows are passed over and still have the folder icon in the Files list view instead of the number of shows. If I then click on one, and choose "TV show information" (may not be exact wording), it reads the info files fine and correctly loads the show into the database. The show is then in the library.

BUT, if there are no info files and it tries to scrape it as a new show, it crashes every time.

I had first set my delay to 1000 to be extra safe with the banning. I saw "DelayLoop" a couple of times right before crash and then tried 500 and 25. Same result.

Here is the log file from the first apparent mention of anidb on a scan of a new show.

Code:
02:12:09 T:3828   DEBUG: ------ Window Deinit (DialogSelect.xml) ------
02:12:09 T:3828   DEBUG: CVideoLibraryRefreshingJob: user selected item 'Anidb Search : A7001 ~ Usaru-san' with URL 'http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001'
02:12:09 T:3828   DEBUG: DialogProgress::Open called
02:12:09 T:3828   DEBUG: ------ Window Init (DialogProgress.xml) ------
02:12:10 T:3828   DEBUG: CAnnouncementManager - Announcement: OnRemove from xbmc
02:12:10 T:3828   DEBUG: GOT ANNOUNCEMENT, type: 16, from xbmc, message OnRemove
02:12:10 T:3828   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'I:\_MAIN\Usaru-san\'
02:12:10 T:4184   DEBUG: Thread VideoInfoDownloader start, auto delete: false
02:12:10 T:4184   DEBUG: ADDON::CScraper::GetVideoDetails: Reading movie 'http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001' using AniDB.net [MOD] scraper (file: 'C:\Users\Joel\AppData\Roaming\Kodi\addons\metadata.tvshows.anidb.net.mod', content: 'tvshows', version: '2.3.0')
02:12:10 T:4184   DEBUG: scraper: GetDetails returned <details><url function="LoadAnimeMapping" cache="anime-list.xml">https://raw.github.com/ScudLee/anime-lists/master/anime-list.xml</url><chain function="GetIDByIDChain">7001</chain><chain function="GetTitleByIDChain">7001</chain><chain function="GetOriginalTitleByIDChain">7001</chain><chain function="GetStartDateByIDChain">7001</chain><chain function="GetRatingByIDChain">7001</chain><chain function="GetGenresByIDChain">7001</chain><chain function="GetPlotByIDChain">7001</chain><chain function="GetCastByIDChain">7001</chain><chain function="GetWritersByIDChain">7001</chain><chain function="GetDirectorsByIDChain">7001</chain><chain function="GetStudiosByIDChain">7001</chain><chain function="GetArtworkByIDChain">7001</chain><chain function="GetTVArtworkByIDChain">7001</chain><episodeguide><url gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></episodeguide></details>
02:12:10 T:4184   DEBUG: scraper: LoadAnimeMapping returned <details><url function="PrepareTVDBSearch" cache="7001.xml">&</url></details>
02:12:10 T:4184   DEBUG: scraper: PrepareTVDBSearch returned <details><url function="CheckTVDBResults" cache="tvdb-s7001-Usaru-san.xml">http://www.thetvdb.com/api/GetSeries.php?seriesname=Usaru-san</url></details>
02:12:10 T:4184   DEBUG: scraper: CheckTVDBResults returned <details><chain function="TVDBSearchLoop">&</chain></details>
02:12:10 T:4184   DEBUG: scraper: TVDBSearchLoop returned <details></details>
02:12:10 T:4184   DEBUG: scraper: GetIDByIDChain returned <details><id>7001</id></details>
02:12:10 T:4184   DEBUG: scraper: GetTitleByIDChain returned <details><url function="ParseTitle" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseTitle returned <details><title>Usaru-san</title></details>
02:12:10 T:4184   DEBUG: scraper: GetOriginalTitleByIDChain returned <details><url function="ParseOriginalTitle" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseOriginalTitle returned <details></details>
02:12:10 T:4184   DEBUG: scraper: GetStartDateByIDChain returned <details><url function="ParseStartDate" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseStartDate returned <details><year>2009</year><premiered>2009-10-03</premiered></details>
02:12:10 T:4184   DEBUG: scraper: GetRatingByIDChain returned <details><url function="ParseRating" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseRating returned <details><votes>90</votes><rating>5.49</rating></details>
02:12:10 T:4184   DEBUG: scraper: GetGenresByIDChain returned <details><url function="ParseGenres" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseGenres returned <details></details>
02:12:10 T:4184   DEBUG: scraper: GetPlotByIDChain returned <details><url function="ParsePlot" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParsePlot returned <details><plot>The Media Factory mascot character franchise revolves around a male rabbit that transforms into Usaru-san by wearing a monkey costume and eating bananas. The title "Usaru-san" is a portmanteau of "usagi" (rabbit) and "saru" (monkey).</plot></details>
02:12:10 T:4184   DEBUG: scraper: GetCastByIDChain returned <details><url function="ParseCast" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseCast returned <details></details>
02:12:10 T:4184   DEBUG: scraper: GetWritersByIDChain returned <details><url function="ParseWriters" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseWriters returned <details><credits>Baba Toshiko</credits></details>
02:12:10 T:4184   DEBUG: scraper: GetDirectorsByIDChain returned <details><url function="ParseDirectors" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseDirectors returned <details><director>Toyama Sou</director></details>
02:12:10 T:4184   DEBUG: scraper: GetStudiosByIDChain returned <details><url function="ParseStudios" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseStudios returned <details><studio>OLM</studio></details>
02:12:10 T:4184   DEBUG: scraper: GetArtworkByIDChain returned <details><url function="ParseAniDBArtwork" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url><chain function="ReturnFanart">&</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseAniDBArtwork returned <details><thumb aspect="poster">http://img7.anidb.net/pics/anime/34812.jpg</thumb></details>
02:12:10 T:4184   DEBUG: scraper: ReturnFanart returned <details><fanart><fanart></details>
02:12:10 T:4184   DEBUG: scraper: GetTVArtworkByIDChain returned <details></details>
02:12:10 T:4184   DEBUG: Thread VideoInfoDownloader 4184 terminating
02:12:10 T:3828   DEBUG: VideoInfoScanner: Adding new item to tvshows:I:\_MAIN\Usaru-san\
02:12:10 T:7196    INFO: XCURL::DllLibCurlGlobal::easy_aquire - Created session to http://img7.anidb.net
02:12:10 T:3828   DEBUG: CAnnouncementManager - Announcement: OnUpdate from xbmc
02:12:10 T:3828   DEBUG: GOT ANNOUNCEMENT, type: 16, from xbmc, message OnUpdate
02:12:10 T:3828   DEBUG: VideoInfoScanner: Scanning dir 'I:\_MAIN\Usaru-san\' as not in the database
02:12:10 T:3828   DEBUG: VideoInfoScanner: Found episode match I:\_MAIN\Usaru-san\[Diffusion] Usaru-san - s01e01 [00A75094].mkv (s1e1) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
02:12:10 T:3828   DEBUG: VideoInfoScanner: Found episode match I:\_MAIN\Usaru-san\[Diffusion] Usaru-san - s01e02 [4751DEE5].mkv (s1e2) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
02:12:10 T:3828   DEBUG: VideoInfoScanner: Found episode match I:\_MAIN\Usaru-san\[Diffusion] Usaru-san - s01e03 [23E911DB].mkv (s1e3) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
02:12:10 T:3828   DEBUG: VideoInfoScanner: Found episode match I:\_MAIN\Usaru-san\[Diffusion] Usaru-san - s01e04 [452D2338].mkv (s1e4) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
02:12:10 T:3828   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'I:\_MAIN\Usaru-san\[Diffusion] Usaru-san - s01e01 [00A75094].mkv'
02:12:10 T:3828   DEBUG: ADDON::CScraper::GetEpisodeList: Searching 'http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001' using AniDB.net [MOD] scraper (file: 'C:\Users\Joel\AppData\Roaming\Kodi\addons\metadata.tvshows.anidb.net.mod', content: 'tvshows', version: '2.3.0')
02:12:10 T:3828   DEBUG: scraper: GetEpisodeList returned <episodeguide><episode><title>Episode 2</title><url cache="7001.xml">109293</url><epnum>2</epnum><season>1</season><id>109293</id><aired>2009-10-03</aired></episode><episode><title>Episode 1</title><url cache="7001.xml">109294</url><epnum>1</epnum><season>1</season><id>109294</id><aired>2009-10-03</aired></episode><episode><title>Episode 4</title><url cache="7001.xml">110704</url><epnum>4</epnum><season>1</season><id>110704</id><aired>2009-10-10</aired></episode><episode><title>Episode 3</title><url cache="7001.xml">110705</url><epnum>3</epnum><season>1</season><id>110705</id><aired>2009-10-10</aired></episode><chain function="StartDelayLoop">&</chain></episodeguide>
02:12:10 T:3828   DEBUG: scraper: StartDelayLoop returned <details><chain function="DelayLoop">&</chain></details>
02:12:10 T:3828   DEBUG: scraper: DelayLoop returned <details><chain function="DelayLoop">&</chain></details>
02:12:19 T:3828   DEBUG: Previous line repeats 1749 times.
02:12:19 T:3828   ERROR: Unhandled exception in CApplication::FrameMove() : Win32 exception (code:0xc00000fd) at 0x01d023ab
Reply
I just went back to Helix and my small test directory scraped perfectly with 2.3.0. It picked up every show and even scrapped the 3 new shows in the directory that were crashing it in Jarvis.

Hopefully I can get everything added in Helix and then just upgrade to Jarvis with the database intact.
Reply
@ rickyman OVAs are special episodes, usually around 5 minutes long, more or less it is fan service, but not all of them. OVAs are smaller episodes released direct to video, Original Video Animation (OVA) and are not released on television or film. It depends on if the episode is given proper attention per naming on TheTVDb, OVAs are notoriously difficult to scrape and if it's not properly entered into TheTVDb it will not scrape regardless. Some OVAs show up as movies too. However, some OVAs are given an entire page within TheTVDb & AniDB.net and can be named S01e01, 1x1, or 1x01, ect. instead of S00. It takes a combination of both TheTVDb and AniDB.net and trial and error. If you see OVAs (specials) for shows that have 12 or 24 (or more) episodes, the episodes would be named S01 or 1x, the OVAs (specials) would be named S00. If you find that an OVA has it's own page, it may be possible to name them S01, 1x1 ect. This trick (S00) also works with live action shows so keep that in mind if you have specials of live action TV shows. Usually special episodes are named S00 throughout the entire run of the show, regardless of which season it appeared. Hopefully that helps.
Reply
Just noticed when adding Mirai Nikki Redial: Data Ikou http://anidb.net/perl-bin/animedb.pl?sho...e&aid=9585 that it doesn't seem to be linked with anything on thetvdb so here is what it should go to, the future diary S00 E02 http://thetvdb.com/?tab=episode&seriesid...7484&lid=7
Reply
Anyone else having trouble scraping anime starting today? I just downloaded a couple of new episodes of shows already in my library, but the new episodes just won't scrape.
The debug logs shows that the scraper correctly identifies the new files as episodes, but can't find any information for them, so they're not added to the library. The show itself seems to be identified when I refresh information, but it's the episodes that are problematic.
Reply
Please,

Someone check if i'm doing something wrong.

I'm running kodi 15.2 (Compiled: Nov 1 2015) at OpenELEC (official) Version: 6.0.0 (Raspberry Pi 2)

I put the TagSystem Rules (as in the first post) in AniDB Client, and after that my episodes are like:

Air (this is a folder)
Air - 01 - Breeze [OMDA][DTV][640x360][XviD][EFE4F092].avi
Air - 02 - Town [OMDA][DTV][704x396][XviD][B7E47F4C].avi
Air - 03 - Whisper [OMDA][DTV][704x396][XviD][DDCB61A6].avi
(...)
Another (another folder)
Another - 01 - Rough Sketch [L-A][DVD][0x0][unknown][70B5C66A].mvv
Another - 02 - Blueprint [L-A][DVD][0x0][unknown][8D4016F4].mkv
Another - 03 - Bone Work [L-A][DVD][0x0][unknown][240C256D].mkv
Another - 04 - Put Flesh [L-A][DVD][0x0][unknown][B762535E].mkv
(...)
(... and a lot of other anime folders)

My advancedsettings.xml is located in /storage/.kodi/userdata:

Code:
OpenELEC:~/.kodi/userdata # pwd
/storage/.kodi/userdata
OpenELEC:~/.kodi/userdata # ls -l
total 75
drwxr-xr-x    3 root     root          1024 Nov 23 00:03 Database
-rw-r--r--    1 root     root           609 Dec 31  1969 RssFeeds.xml
drwxr-xr-x   19 root     root          1024 Dec 31  1969 Thumbnails
drwxr-xr-x    7 root     root          1024 Mar 23  2015 addon_data
-rw-r--r--    1 root     root           240 Nov 22 16:50 advancedsettings.xml
-rw-r--r--    1 root     root         62292 Dec 31  1969 guisettings.xml
drwxr-xr-x    2 root     root          1024 Dec 31  1969 keymaps
drwxr-xr-x    2 root     root          1024 Dec 31  1969 library
drwxr-xr-x    2 root     root          1024 Dec 31  1969 peripheral_data
drwxr-xr-x    5 root     root          1024 Dec 31  1969 playlists
drwxr-xr-x    3 root     root          1024 Nov 22 16:06 profiles
-rw-r--r--    1 root     root          1705 Nov 23 16:54 profiles.xml
-rw-r--r--    1 root     root          1618 Nov 22 16:04 sources.xml

And its content is (as in the first post):

Code:
<advancedsettings>
  <tvshowmatching action="prepend">
    <regexp> - ()(\d+)((?:-\d+)*)(?:v\d+)? - [^\\/]*$</regexp>
    <regexp defaultseason="0"> - ()s(\d+)((?:-\d+)*)(?:v\d+)? - [^\\/]*$</regexp>
  </tvshowmatching>
</advancedsettings>

The movies are find ok by scrapper.

But the TV Series, the scrapper only find the series name. No episodes are found =(

Can anybody help me?

Ps. I'm not in the main user profile at kodi, I make an Animes profile just to animes. I already tried to make an advancedsettings.xml in the folder /storage/.kodi/userdata/profiles/Animes but with no success.

Thanks
Reply
The scraper seems to be unable to download the information for Shomin Sample. It correctly recognizes the files and even displays the correct Id for the anime. But then fails to download any information at all. It also doesnt get added to the TV Series list.
Reply
There seems to be an issue with Dragon Ball Super due to tvdb separating the arcs as different seasons, unlike the anidb entry. I've been having problems scraping recent episodes, I has to be because of this. I also checked both anime-list.xml and don't see any mention of tvdb's season 2.
Reply
(2015-11-27, 15:43)ACB666 Wrote: The scraper seems to be unable to download the information for Shomin Sample. It correctly recognizes the files and even displays the correct Id for the anime. But then fails to download any information at all. It also doesnt get added to the TV Series list.

I have the same problem too.
Reply
(2015-12-21, 10:07)Zandar Wrote:
(2015-11-27, 15:43)ACB666 Wrote: The scraper seems to be unable to download the information for Shomin Sample. It correctly recognizes the files and even displays the correct Id for the anime. But then fails to download any information at all. It also doesnt get added to the TV Series list.

I have the same problem too.

Same here. Any workaround?
Reply
The Shomin Sample issue is due to Kodi ignoring files and folders that contain the word "sample".
http://kodi.wiki/view/Advancedsettings.x...wsfromscan

Workarounds are either to remove the "sample" regexp from excludetvshowsfromscan via your advancedsettings.xml, or to simply remove/break up the word Sample from the folder and file names.

To achieve the former, just use:
PHP Code:
<advancedsettings>
  <
video>
    <
excludetvshowsfromscan/>
  </
video>
</
advancedsettings
In your advancedsettings.xml. (If you already have a <video> node, just add the <excludetvshowsfromscan/> inside it.)
However, this may cause conflicts if you have actual sample files that need ignoring.


Personally, I went the second route, and added:
Code:
ShowTitle:=$repl(%ShowTitle%, 'Sample', 'S_ample')
To my anidb client rules (after line 6). Slightly ugly, but it gets the job done, since the AniDb scraper search is smart enough to match "S_ample" to "Sample" (note thetvdb scraper search may not be as smart).
Reply
  • 1
  • 45
  • 46
  • 47(current)
  • 48
  • 49
  • 71

Logout Mark Read Team Forum Stats Members Help
[MOD] AniDB.net scrapers for TV shows and Movies8