+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: [WIP] AniDB.net Anime Video Scraper (/showthread.php?tid=64587)
- Xeijin - 2010-08-27
spiff Wrote:you're not attempting to scan the problematic show in that log.
Well I'm now planning to rename my entire library with the AniDB.net to solve that problem, however here is a full scan of my Anime anyway:
xbmc.log
It picks up the names of shows but there's nothing in my library (i.e. the shows themselves, even without episodes do not appear).
- spiff - 2010-08-27
lines 736-737 indicates a scraper bug.
- Xeijin - 2010-08-27
spiff Wrote:lines 736-737 indicates a scraper bug.
Ah I see, upon clicking the URL in line 736
(http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=)
You get:
Code:
<error>Banned</error>- spiff - 2010-08-27
problem is we have no id. it's probably just the url without an id that yields that. either that or it's checking the user agent.
- Xeijin - 2010-08-27
spiff Wrote:problem is we have no id. it's probably just the url without an id that yields that. either that or it's checking the user agent.
Well thanks for all your help spiff. Going to try the ANN scraper and see if I have any luck with that.
- Kirov - 2010-08-27
Xeijin Wrote:Ah I see, upon clicking the URL in line 736
(http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=)
You get:
Does this mean XBMC has been banned? Or is it just a result of me clicking the link?Code:<error>Banned</error>
I've run into this issue. Most likely the scraper still doesn't play by AniDB's HTTP API Flooding Rules (their scraping/api policy is strict to say the least) in all use cases. I don't know if a ban is permanent or time based but it is IP based.
- spiff - 2010-08-27
might be related to the fact that the cache was ineffective for quite some time. vdrfan fixed it yesterday
- Xeijin - 2010-08-28
Yes it seems this way as the ANN scraper has worked fine for me, whereas the <results></results> for AniDB always seems to be empty
problem is some ANN info is not accurate (episode titles).Also, a bit off topic, and I don't think it's a problem anymore but they seem to have their own facility for title searching now (as opposed to using google?) http://anisearch.outrance.pl/ (Documentation - http://anisearch.outrance.pl/doc.html)
- salival - 2010-08-28
Xeijin Wrote:Also, a bit off topic, and I don't think it's a problem anymore but they seem to have their own facility for title searching now (as opposed to using google?) http://anisearch.outrance.pl/ (Documentation - http://anisearch.outrance.pl/doc.html)I believe that's a third party service that searches the same animetitles.xml that this scraper does.
- jfgi - 2010-08-30
Would it be possible to use the english title in the library instead? So Xam'd: Lost Memories instead of Bounen no Xamdou.
- CourierSS - 2010-08-31
jfgi Wrote:Would it be possible to use the english title in the library instead? So Xam'd: Lost Memories instead of Bounen no Xamdou.
I'm not sure if there's a way to retrieve titles by language, but you can rename the entry in library mode by right clicking on the title and clicking "Edit title."
- jfgi - 2010-08-31
It is getting them. I can see it in the cache.
Code:
<titles>
<title xml:lang="x-jat" type="main">Bounen no Xamdou</title>
<title xml:lang="ru" type="synonym">Ксам`д: Потерянные Воспоминания</title>
<title xml:lang="ar" type="synonym">ذكريات زامد الضائعة</title>
<title xml:lang="tr" type="synonym">Xam`d: Kayıp Hatıralar</title>
<title xml:lang="zh-Hans" type="synonym">亡念的扎穆德</title>
<title xml:lang="x-unk" type="short">xamd</title>
<title xml:lang="x-jat" type="short">BnX</title>
<title xml:lang="ja" type="official">亡念のザムド</title>
<title xml:lang="en" type="official">Xam`d: Lost Memories</title>
</titles>I know i can edit them manually for each one, but with the size of my library i'd prefer not to.
- Xeijin - 2010-08-31
It still doesn't even scan for me
is it worth going on the AniDB forums and posting to ask if I've been banned? I can't think of any other reason it wouldn't work.
- jfgi - 2010-09-01
Xeijin Wrote:It still doesn't even scan for me
http://forum.xbmc.org/showpost.php?p=584697&postcount=93 Try that advancedsettings.xml.
- snyft - 2010-09-08
CourierSS Wrote:I'm not sure if there's a way to retrieve titles by language, but you can rename the entry in library mode by right clicking on the title and clicking "Edit title."
This is the only thing the scraper need and then its complete imo.
Awesome work anyway!