Kodi Community Forum
Release [MOD] AniDB.net scrapers for TV shows and Movies - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: Release [MOD] AniDB.net scrapers for TV shows and Movies (/showthread.php?tid=142835)



RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - gr3y - 2013-04-05

Hi, I'm having some issues setting up the scraper; my files should be organized in the right way but they just don't get added to the show list.
Here's my log file http://xbmclogs.com/show.php?id=9798 any help would be really appreciated. Thanks.


RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - scudlee - 2013-04-05

From the logs it looks like you're not able to connect to the anidb api:
Code:
DEBUG: CurlFile::Open(034425C0) http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=247
WARNING: XFILE::CCurlFile::CReadState::FillBuffer: curl failed with code 28
ERROR: CCurlFile::CReadState::Open, didn't get any data from stream.
ERROR: ADDON::CScraper::Run: Unable to parse web site

Try opening the link http://api.anidb.net:9001/httpapi?request=anime&client=xbmcscrap&clientver=1&protover=1&aid=247 in your browser, see what happens.


RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - gr3y - 2013-04-05

The network I was connected to didn't let me reach the API, now I'm using another connection and it's working! Thank you very much for the help, this addon is great!


RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - DeadSix27 - 2013-04-07

So what about Season2's with bad namings? "Ore no imouto" Season 2 just started, and its season2 name is just having a "." (dot) at end, which isnt possible in windows as foldername, and as filename it wouldnt work as well i guess? (name..S02E01) (xbmc prob would ignore it or so) however AniDB does not have a second name for ore no imouto. (no S2 or Season2 or 2 as search addition)
What should i do now?

I just added "Ore no Imouto ga Konna ni Kawaii Wake ga Nai 2" on AniDB, lets hope they keep that name.

Could you add that title as well to your anime-list on: https://raw.github.com/ScudLee/anime-lists/master/animetitles.xml
as I do not like using english translated titles for animes and currently your list doesnt contain it:
Code:
<anime aid="9134">
        <title type="official" xml:lang="ko">내 여동생이 이렇게 귀여울 리가 없어.</title>
        <title type="syn" xml:lang="en">My Little Sister Can`t Be This Cute 2</title>
        <title type="short" xml:lang="x-jat">oreimo2</title>
        <title type="main" xml:lang="x-jat">Ore no Imouto ga Konna ni Kawaii Wake ga Nai.</title>
        <title type="official" xml:lang="ja">俺の妹がこんなに可愛いわけがない.</title>
</anime>

Otherwise, if i wanted to use my own xml file on my server, how do i make the scraper reload the xml?
PS: I noticed theres a personal mapping thing, so i could add a xml with only containing a couple animes in that and it would prefer those if existing in official list over them? And if so, how do i make that xml update in XBMC? (theres no button like "Reload")

And yet it doesn't scan it.


RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - scudlee - 2013-04-07

The personal mapping list is only really for the mappings between AniDB and TVDB (the "anime-list.xml"), you can't use it to add titles to the animetitles.xml. Your only choice in that regard is to take the full animetitles.xml and host it yourself, replacing the "Anime List URL".

A couple of things to consider if you're having difficulty with that:
1. Make sure you change the URL at the source folder, not just the Addon settings. (Highlight the source folder, bring up the context menu, "Change content", then Settings).
2. Everything is cached for 48 hours. Delete the %APPDATA%\xbmc\cache\scrapers\metadata.tvshows.anidb.net.mod folder to force an immediate refresh.


I'm loathe to edit the animetitles.xml on the basis that I sync it directly from AniDB, and I would have to manually maintain any additions after each update. It's likely I couldn't even use git to merge/rebase my changes as they seem to randomly change the order of the titles for each series every time I download a new copy.


The easiest option to solve your problem is to just make a tvshow.nfo file containing "aid=9134" (just that) and stick it in the show's folder. Then you can name the folder whatever you like.

If it's any consolation, I had a quick look through the anime list, and Ore no Imouto ga Konna ni Kawaii Wake ga Nai. looks like it's the only title affected by being a duplicate title with a period on the end (I think, I wasn't overly thorough). It can join Shinryaku!? Ika Musume in the "Titles Too Messed Up To Work" category.

If your alternate title goes through on AniDB, ping me and I'll update the animetitles.xml straight away (just mind the 48 hour caching).

Edit: Done. Ore no Imouto ga Konna ni Kawaii Wake ga Nai 2 should work now. You'll still need to clear your cache first.


RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - DeadSix27 - 2013-04-08

(2013-04-07, 10:32)scudlee Wrote: The personal mapping list is only really for the mappings between AniDB and TVDB (the "anime-list.xml"), you can't use it to add titles to the animetitles.xml. Your only choice in that regard is to take the full animetitles.xml and host it yourself, replacing the "Anime List URL".

A couple of things to consider if you're having difficulty with that:
1. Make sure you change the URL at the source folder, not just the Addon settings. (Highlight the source folder, bring up the context menu, "Change content", then Settings).
2. Everything is cached for 48 hours. Delete the %APPDATA%\xbmc\cache\scrapers\metadata.tvshows.anidb.net.mod folder to force an immediate refresh.


I'm loathe to edit the animetitles.xml on the basis that I sync it directly from AniDB, and I would have to manually maintain any additions after each update. It's likely I couldn't even use git to merge/rebase my changes as they seem to randomly change the order of the titles for each series every time I download a new copy.


The easiest option to solve your problem is to just make a tvshow.nfo file containing "aid=9134" (just that) and stick it in the show's folder. Then you can name the folder whatever you like.

If it's any consolation, I had a quick look through the anime list, and Ore no Imouto ga Konna ni Kawaii Wake ga Nai. looks like it's the only title affected by being a duplicate title with a period on the end (I think, I wasn't overly thorough). It can join Shinryaku!? Ika Musume in the "Titles Too Messed Up To Work" category.

If your alternate title goes through on AniDB, ping me and I'll update the animetitles.xml straight away (just mind the 48 hour caching).

Edit: Done. Ore no Imouto ga Konna ni Kawaii Wake ga Nai 2 should work now. You'll still need to clear your cache first.
Thanks for doing that, and thanks for telling me theres a NFO option for your scraper, and yes my title is still on AniDB.

Yet i have still problems, either the nfo does get ignored (which is in this format) (I wasnt sure if meant to make xml valid, or really just put "aid=.." (because what should i do with the xml below it (if needed)"
Solved it,I just forgot that it has to be S01 even though its S02..
But in future cases, would this XML format be correct:
Code:
<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<tvshow>
    <aid>9134</aid>
</tvshow>

PS: A while ago i added PV1 to: http://anidb.net/perl-bin/animedb.pl?show=anime&aid=9341
I put the file into the shows folder and named it: Hentai_Ouji_to_Warawanai_Neko.S00E201.mp4, but it does not get scanned, whats the right format for PV(Trailer) with your sraper?

its in my cache thoguh and shows as:

Code:
.....
<episode id="147973" update="2013-03-07">
<epno type="4">T1</epno>
<length>1</length>
<title xml:lang="en">PV1</title>
</episode>
.....
I also have problems with "Dog Days 2" i named the folder like that and the episodes: Dog Days 2.S01E02.mkv ...etc
they're not beeing scraped. (Same to "Medaka Box")


RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - scudlee - 2013-04-09

For the nfo file, it should literally just contain "aid=9134", no more, no less. No need for any xml.

Well, technically it should be the full URL, http://anidb.net/perl-bin/animedb.pl?show=anime&aid=9134 but the scraper only checks for the "aid=9134" part anyway, so that's all you need.


For the PV, your file name looks correct, and a little testing on my end got it to show correctly. If it's recently added, could you be falling victim to the 48 hour cache?


RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - DeadSix27 - 2013-04-09

I cleared your whole folders in cache, i mean.. movie and tvshow anidbmod folders, and restarted xbmc
But it works now, for idk what reason.. but check my edit on bottom.

I tested "aid=8882" nfo for dog days and that made it work, but why doesnt it work the normal way?


RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - scudlee - 2013-04-09

Well, Dog Days 2 is a valid synonym, but unlike the Oreimo 2 synonym, it's xml:lang attribute in the animetitles.xml is "ja" (Japanese) whereas the Oreimo 2 synonym is "x-jat" (which I guess is used for Romaji).

...And the scraper only checks the "x-jat" synonyms. Not sure why (this is inherited code). I might loosen that, unless I find some unintended consequences (i.e. title mismatches).

The title Dog Days' (with apostrophe) works.


RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - DeadSix27 - 2013-04-09

(2013-04-09, 00:49)scudlee Wrote: Well, Dog Days 2 is a valid synonym, but unlike the Oreimo 2 synonym, it's xml:lang attribute in the animetitles.xml is "ja" (Japanese) whereas the Oreimo 2 synonym is "x-jat" (which I guess is used for Romaji).

...And the scraper only checks the "x-jat" synonyms. Not sure why (this is inherited code). I might loosen that, unless I find some unintended consequences (i.e. title mismatches).

The title Dog Days' (with apostrophe) works.

Well it didn't scan that right for me for some reason, idk.. manual nfo way worked.
Fixing alot of other ones now.. for example "Sora no Otoshimono Forte" doesnt work either.
That uses X-jat though: <title type="main" xml:lang="x-jat">Sora no Otoshimono Forte</title>


RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - scudlee - 2013-04-09

Sora no Otoshimono Forte works fine here. Not sure why it didn't for you, there might be something else at play.


Titles that gets checked:

type="main" (xml:lang ignored)
type="official" xml:lang="[Official language]" (as determined by scraper settings)
type="official" xml:lang="en"
type="syn" xml:lang="x-jat"


RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - DeadSix27 - 2013-04-09

(2013-04-09, 01:18)scudlee Wrote: Sora no Otoshimono Forte works fine here. Not sure why it didn't for you, there might be something else at play.


Titles that gets checked:

type="main" (xml:lang ignored)
type="official" xml:lang="[Official language]" (as determined by scraper settings)
type="official" xml:lang="en"
type="syn" xml:lang="x-jat"

Well I used manual NFO way now, i also had a couple copies, e.g same show in 2 different paths, which ruined the scraping, i moved 1 of them now.. but is there a way to have it multiple times?


RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - otakujhp - 2013-04-09

This works pretty well for the most part. You've really gone above and beyond, scudlee. Thanks!

So far, I've only tripped up when adding Arata-naru Sekai: World`s/Start/Load/End.

I ran it through the anidb client with the tagging rules and it renamed the folder and file just fine (stripped the : and /). When I added it to XBMC using the mod, the lookup completed successfully and it now shows up under TV shows with artwork and the whole bit, but the episode file is oddly missing. The filename on disk is Arata-naru Sekai World's Start Load End [Commie][Blu-ray][1280x720][h264](3392911e).mkv which appears to be all legal and everything.

Any ideas? I'm probably just making a dumb mistake somewhere.

EDIT: Hmm... False alarm. I added it as a movie and it appears to have added without incident.


RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - DeadSix27 - 2013-04-09

Recently released Anime(s) missing in your list:
Photokano: http://anidb.net/perl-bin/animedb.pl?show=anime&aid=9520 (Added it manually with aid in nfo)

Looks like it's added, it didnt scan it right though (maybe cache?)


RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies - scudlee - 2013-04-09

Looks like AniDB changed the main title to Photokano (one word) from Photo Kano (two words). The scraper isn't smart enough to split one word into two (but would match two-into-one).

I just went to update the animetitles.xml (which should have fixed it), but the change must be too recent, as it still has Photo Kano listed as main.

Photokano was there as a synonym, but like Dog Days 2 it wasn't listed as xml:lang="x-jat", so the scraper ignored it (in this case it was "x-unk").


@otakuhjp: If you do want movies/one-shot OVAs to appear as TV shows rather than movies, they need to include the "episode" number. To get that with the tagging rules, either empty the MovieTypes variable (i.e. MovieTypes:="") - that will force everything to be a TV show, or just add %EpNoFull% into the MovieFileName variable.