Release [MOD] AniDB.net scrapers for TV shows and Movies
With Jarvis coming up, I decided to just uninstall Isengard and start over with a totally new install of the latest Jarvis nightly. Everything was working great until I went to add my anime. Ran into 2 different problems. Not sure if the two are related or not. Now, all of this is involving a fully functioning and scraped collection from Helix and Isengard. Most of the shows have an info files as I did an Export Library a while back after most where in the library.

The first problem is only a small percentage of shows are recognized by the initial scan. Most of of the shows are passed over and still have the folder icon in the Files list view instead of the number of shows. If I then click on one, and choose "TV show information" (may not be exact wording), it reads the info files fine and correctly loads the show into the database. The show is then in the library.

BUT, if there are no info files and it tries to scrape it as a new show, it crashes every time.

I had first set my delay to 1000 to be extra safe with the banning. I saw "DelayLoop" a couple of times right before crash and then tried 500 and 25. Same result.

Here is the log file from the first apparent mention of anidb on a scan of a new show.

Code:
02:12:09 T:3828   DEBUG: ------ Window Deinit (DialogSelect.xml) ------
02:12:09 T:3828   DEBUG: CVideoLibraryRefreshingJob: user selected item 'Anidb Search : A7001 ~ Usaru-san' with URL 'http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001'
02:12:09 T:3828   DEBUG: DialogProgress::Open called
02:12:09 T:3828   DEBUG: ------ Window Init (DialogProgress.xml) ------
02:12:10 T:3828   DEBUG: CAnnouncementManager - Announcement: OnRemove from xbmc
02:12:10 T:3828   DEBUG: GOT ANNOUNCEMENT, type: 16, from xbmc, message OnRemove
02:12:10 T:3828   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'I:\_MAIN\Usaru-san\'
02:12:10 T:4184   DEBUG: Thread VideoInfoDownloader start, auto delete: false
02:12:10 T:4184   DEBUG: ADDON::CScraper::GetVideoDetails: Reading movie 'http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001' using AniDB.net [MOD] scraper (file: 'C:\Users\Joel\AppData\Roaming\Kodi\addons\metadata.tvshows.anidb.net.mod', content: 'tvshows', version: '2.3.0')
02:12:10 T:4184   DEBUG: scraper: GetDetails returned <details><url function="LoadAnimeMapping" cache="anime-list.xml">https://raw.github.com/ScudLee/anime-lists/master/anime-list.xml</url><chain function="GetIDByIDChain">7001</chain><chain function="GetTitleByIDChain">7001</chain><chain function="GetOriginalTitleByIDChain">7001</chain><chain function="GetStartDateByIDChain">7001</chain><chain function="GetRatingByIDChain">7001</chain><chain function="GetGenresByIDChain">7001</chain><chain function="GetPlotByIDChain">7001</chain><chain function="GetCastByIDChain">7001</chain><chain function="GetWritersByIDChain">7001</chain><chain function="GetDirectorsByIDChain">7001</chain><chain function="GetStudiosByIDChain">7001</chain><chain function="GetArtworkByIDChain">7001</chain><chain function="GetTVArtworkByIDChain">7001</chain><episodeguide><url gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></episodeguide></details>
02:12:10 T:4184   DEBUG: scraper: LoadAnimeMapping returned <details><url function="PrepareTVDBSearch" cache="7001.xml">&</url></details>
02:12:10 T:4184   DEBUG: scraper: PrepareTVDBSearch returned <details><url function="CheckTVDBResults" cache="tvdb-s7001-Usaru-san.xml">http://www.thetvdb.com/api/GetSeries.php?seriesname=Usaru-san</url></details>
02:12:10 T:4184   DEBUG: scraper: CheckTVDBResults returned <details><chain function="TVDBSearchLoop">&</chain></details>
02:12:10 T:4184   DEBUG: scraper: TVDBSearchLoop returned <details></details>
02:12:10 T:4184   DEBUG: scraper: GetIDByIDChain returned <details><id>7001</id></details>
02:12:10 T:4184   DEBUG: scraper: GetTitleByIDChain returned <details><url function="ParseTitle" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseTitle returned <details><title>Usaru-san</title></details>
02:12:10 T:4184   DEBUG: scraper: GetOriginalTitleByIDChain returned <details><url function="ParseOriginalTitle" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseOriginalTitle returned <details></details>
02:12:10 T:4184   DEBUG: scraper: GetStartDateByIDChain returned <details><url function="ParseStartDate" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseStartDate returned <details><year>2009</year><premiered>2009-10-03</premiered></details>
02:12:10 T:4184   DEBUG: scraper: GetRatingByIDChain returned <details><url function="ParseRating" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseRating returned <details><votes>90</votes><rating>5.49</rating></details>
02:12:10 T:4184   DEBUG: scraper: GetGenresByIDChain returned <details><url function="ParseGenres" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseGenres returned <details></details>
02:12:10 T:4184   DEBUG: scraper: GetPlotByIDChain returned <details><url function="ParsePlot" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParsePlot returned <details><plot>The Media Factory mascot character franchise revolves around a male rabbit that transforms into Usaru-san by wearing a monkey costume and eating bananas. The title "Usaru-san" is a portmanteau of "usagi" (rabbit) and "saru" (monkey).</plot></details>
02:12:10 T:4184   DEBUG: scraper: GetCastByIDChain returned <details><url function="ParseCast" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseCast returned <details></details>
02:12:10 T:4184   DEBUG: scraper: GetWritersByIDChain returned <details><url function="ParseWriters" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseWriters returned <details><credits>Baba Toshiko</credits></details>
02:12:10 T:4184   DEBUG: scraper: GetDirectorsByIDChain returned <details><url function="ParseDirectors" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseDirectors returned <details><director>Toyama Sou</director></details>
02:12:10 T:4184   DEBUG: scraper: GetStudiosByIDChain returned <details><url function="ParseStudios" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseStudios returned <details><studio>OLM</studio></details>
02:12:10 T:4184   DEBUG: scraper: GetArtworkByIDChain returned <details><url function="ParseAniDBArtwork" gzip="yes" cache="7001.xml">http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001</url><chain function="ReturnFanart">&</url></details>
02:12:10 T:4184   DEBUG: scraper: ParseAniDBArtwork returned <details><thumb aspect="poster">http://img7.anidb.net/pics/anime/34812.jpg</thumb></details>
02:12:10 T:4184   DEBUG: scraper: ReturnFanart returned <details><fanart><fanart></details>
02:12:10 T:4184   DEBUG: scraper: GetTVArtworkByIDChain returned <details></details>
02:12:10 T:4184   DEBUG: Thread VideoInfoDownloader 4184 terminating
02:12:10 T:3828   DEBUG: VideoInfoScanner: Adding new item to tvshows:I:\_MAIN\Usaru-san\
02:12:10 T:7196    INFO: XCURL::DllLibCurlGlobal::easy_aquire - Created session to http://img7.anidb.net
02:12:10 T:3828   DEBUG: CAnnouncementManager - Announcement: OnUpdate from xbmc
02:12:10 T:3828   DEBUG: GOT ANNOUNCEMENT, type: 16, from xbmc, message OnUpdate
02:12:10 T:3828   DEBUG: VideoInfoScanner: Scanning dir 'I:\_MAIN\Usaru-san\' as not in the database
02:12:10 T:3828   DEBUG: VideoInfoScanner: Found episode match I:\_MAIN\Usaru-san\[Diffusion] Usaru-san - s01e01 [00A75094].mkv (s1e1) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
02:12:10 T:3828   DEBUG: VideoInfoScanner: Found episode match I:\_MAIN\Usaru-san\[Diffusion] Usaru-san - s01e02 [4751DEE5].mkv (s1e2) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
02:12:10 T:3828   DEBUG: VideoInfoScanner: Found episode match I:\_MAIN\Usaru-san\[Diffusion] Usaru-san - s01e03 [23E911DB].mkv (s1e3) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
02:12:10 T:3828   DEBUG: VideoInfoScanner: Found episode match I:\_MAIN\Usaru-san\[Diffusion] Usaru-san - s01e04 [452D2338].mkv (s1e4) [s([0-9]+)[ ._-]*e([0-9]+(?:(?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
02:12:10 T:3828   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'I:\_MAIN\Usaru-san\[Diffusion] Usaru-san - s01e01 [00A75094].mkv'
02:12:10 T:3828   DEBUG: ADDON::CScraper::GetEpisodeList: Searching 'http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=7001' using AniDB.net [MOD] scraper (file: 'C:\Users\Joel\AppData\Roaming\Kodi\addons\metadata.tvshows.anidb.net.mod', content: 'tvshows', version: '2.3.0')
02:12:10 T:3828   DEBUG: scraper: GetEpisodeList returned <episodeguide><episode><title>Episode 2</title><url cache="7001.xml">109293</url><epnum>2</epnum><season>1</season><id>109293</id><aired>2009-10-03</aired></episode><episode><title>Episode 1</title><url cache="7001.xml">109294</url><epnum>1</epnum><season>1</season><id>109294</id><aired>2009-10-03</aired></episode><episode><title>Episode 4</title><url cache="7001.xml">110704</url><epnum>4</epnum><season>1</season><id>110704</id><aired>2009-10-10</aired></episode><episode><title>Episode 3</title><url cache="7001.xml">110705</url><epnum>3</epnum><season>1</season><id>110705</id><aired>2009-10-10</aired></episode><chain function="StartDelayLoop">&</chain></episodeguide>
02:12:10 T:3828   DEBUG: scraper: StartDelayLoop returned <details><chain function="DelayLoop">&</chain></details>
02:12:10 T:3828   DEBUG: scraper: DelayLoop returned <details><chain function="DelayLoop">&</chain></details>
02:12:19 T:3828   DEBUG: Previous line repeats 1749 times.
02:12:19 T:3828   ERROR: Unhandled exception in CApplication::FrameMove() : Win32 exception (code:0xc00000fd) at 0x01d023ab
Reply


Messages In This Thread
RE: - by scudlee - 2013-10-12, 17:42
RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - by Thales - 2015-11-08, 11:38
Logout Mark Read Team Forum Stats Members Help
[MOD] AniDB.net scrapers for TV shows and Movies8