[RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies

  Thread Rating:
  • 7 Vote(s) - 4.43 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
LoveJoy Offline
Junior Member
Posts: 23
Joined: Sep 2013
Reputation: 0
Post: #646
Will try and tell how it works here at my place. I have almost none of the problems I see other people mention here. So maybe my way can help some of you.

I still run XBMC 13.1 (if it aint broke don't fix it) and i have the Anidb java client to handle renaming and moving my new anime files. You need a login on anidb.net I belive.
This should take you there. http://anidb.net/perl-bin/animedb.pl?show=applet

How to make the client rename and move files depends on your settings and network. Seach this tread for more about the anidb client.

I make the client move my files, and in doing so it will also name the directories for me. I use original names in romanji for that.

It ends up like this

anime
-----movies
-------2015
---------Aki no Kanade
-------2014
-------2013
-------etc
-----tvshows
-------2015
---------Absolute Duo
---------Aldnoah.Zero (2015)
---------Anime de Wakaru Shinryounaika
---------Ansatsu Kyoushitsu (2015)
---------etc
-------2014
-------2013
-------etc

you get the picture.
All the files are renamed with the info in filename I want AND it puts ep infront of each episode number. ep01, ep02 - ep306, ep307

I have made no changes to advancesettings.xml regarding file naming. But in each anime folder I place a tvshow.nfo file containing the url of the show on anidb.

My anime folder is split up in 3 sources.
one for anime/movies
one for anime/tvshows/2015 and 2014
one for anime/tvshows/ all the rest
i change the last two each newyear.
settings for anidbMod are no google seach and store tvdb id.

I have my anime the "native" way, like 3 folders of bakuman and so on. Fanart and artworkdownloader works. and as long as i remember to place that tvshow.nfo file in a new folder in my sources, it will scrape it just fine.
Only exception to this day is Dog Days''. It keps showing up as season one x2.

This took some work to set up, but now it is almost just drag and drop to anidb client and it's all ready.
What anidb client could not help with i use a macro keyboard to record one file renaming, and then just repeat.
find quote
SHJordan Offline
Junior Member
Posts: 6
Joined: Apr 2015
Reputation: 0
Post: #647
I would try the java app from anidb but i keep getting this message:
[Image: 4VKao7F.png]
find quote
LoveJoy Offline
Junior Member
Posts: 23
Joined: Sep 2013
Reputation: 0
Tongue  RE: [RELEASE] [MOD] AniDB.net scrapers for TV shows and Movies
Post: #648
I can not read that. Danish, english, bodylanguage and a little japanese i can handle, but not that. . Smile

But maybe this is what it is about.
http://anidb.net/perl-bin/animedb.pl?sho...87#c347384
find quote
SHJordan Offline
Junior Member
Posts: 6
Joined: Apr 2015
Reputation: 0
Post: #649
(2015-05-04 20:17)LoveJoy Wrote:  I can not read that. Danish, english, bodylanguage and a little japanese i can handle, but not that. . Smile

But maybe this is what it is about.
http://anidb.net/perl-bin/animedb.pl?sho...87#c347384

I was able to use applet after using those instructions, thx. but i still have the problem of ovas not being handled. They're not being categorized neither as movies nor tv shows.

EDIT:

Sinbad no Bouken is being fetched as Shadow Skill (1996) WTF?
This is my folder structure for it:

Anime
---Magi Sinbad no Bouken
------Magi Sinbad no Bouken - 1 - Volume 1 [Aenianos][1280x720][h264][24305C1E]
------Magi Sinbad no Bouken - 2 - Volume 2 [Aenianos][848x480][h264][99AD3E91]

I have used the unformated rules on the OP. why would this be happening?
find quote
LoveJoy Offline
Junior Member
Posts: 23
Joined: Sep 2013
Reputation: 0
Post: #650
TVSHOW.NFO

Do you have a tvshow.nfo in your `Magi Sinbad no Bouken folder?
My way of doing it, only works if you have the tvshow.nfo file with the right anidb url in it. This one http://anidb.net/perl-bin/animedb.pl?sho...&aid=10392
And ep before episode number. not 1 but ep1

And the anidb client needs to be configured individualy.

This is my tagging options.

Code:
BaseTVShowPath:="\\10.0.1.99\mcstore\Anime\tvshows\"
BaseMoviePath:="\\10.0.1.99\mcstore\Anime\movies\"

ShowTitle:=[%ATr%, %ATe%, %ATk%]
EpisodeTitle:=[%ETe%, %ETr%, %ETk%]

ShowTitle:=$repl(%ShowTitle%, "\?|\s*\.+$", "_")

ShowTitle:=$repl(%ShowTitle%, '[\\":/*|<>?]', " ")
EpisodeTitle:=$repl(%EpisodeTitle%, '[\\":/*|<>?]', " ")
ShowTitle:=$repl(%ShowTitle%, "\s+", " ")
EpisodeTitle:=$repl(%EpisodeTitle%, "\s+", " ")
ShowTitle:=$repl(%ShowTitle%, "^\s|\s$", "")
EpisodeTitle:=$repl(%EpisodeTitle%, "^\s|\s$", "")

ShowTitle:=$repl(%ShowTitle%, "`", "'")
EpisodeTitle:=$repl(%EpisodeTitle%, "`", "'")

Trunc(str, len):=$repl(%str%, ".{" $len($repl(%str%, "(.?){" %len% "}$", "")) "}$", "")
TruncEllipse(str, len):={$len(%str%) = $len($Trunc(%str%, %len%)) ? %str% : $Trunc(%str%, %len%) "…" }

EpisodeTitle:=$TruncEllipse(%EpisodeTitle%, "64")

Separator:=" - "
Regular:="ep"
Special:="S00E"
SpecialEp:=$repl(%EpNo%, "[1234567890]", "")
EpNo:=$repl(%EpNo%, "[SCTPO]", "")
Ver:={%Ver% = "1" ? "" : "v" %Ver% }
Pad:={%SpecialEp% ? "2" : $max($len(%EpHiNo%), $len(%EpCount%)) }
Pad:={$match(%EpCount%, "0") ? $max("2", %Pad%) : %Pad% }
EpNoPad:=$pad(%EpNo%, %Pad%, "0")

EpNoPad:={%SpecialEp%       ? %EpNoPad%  :  %Regular%   %EpNoPad% }
EpNoPad:={%SpecialEp% = "S" ? %Special%     %EpNoPad% : %EpNoPad% }
EpNoPad:={%SpecialEp% = "C" ? %Special% "1" %EpNoPad% : %EpNoPad% }
EpNoPad:={%SpecialEp% = "T" ? %Special% "2" %EpNoPad% : %EpNoPad% }
EpNoPad:={%SpecialEp% = "P" ? %Special% "3" %EpNoPad% : %EpNoPad% }
EpNoPad:={%SpecialEp% = "O" ? %Special% "4" %EpNoPad% : %EpNoPad% }

EpNoFull:=%Separator% %EpNoPad% %Ver% %Separator%

GT:="[" [%GTs%, %GTl%] "]"
Src:="[" $repl(%Source%, "Blu-ray", "BluRay") "]"
Cen:={%Cen% ? "[Cen]" : "" }
Res:="[" %FVideoRes% "]"
VCodec:="[" $repl(%FVCodec%,"H264/AVC","h264") "]"
ACodec:="[" %FACodec% "]"
CRC:="[" $uc(%FCrc%) "]"

FileInfo:=" " %GT% %Src% %Cen% %Res% %VCodec% %CRC%

MovieTypes:="Movie|OVA"
IsMovie:={$match(%Type%, %MovieTypes%) ? {%EpCount% = "1" ? {%SpecialEp% ? "" : "1" } : "" } : "" }

MovieFileName:=%ShowTitle% %FileInfo%
TVShowFileName:=%ShowTitle% %EpNoFull% %EpisodeTitle% %FileInfo%

BasePath:={%IsMovie% ? %BaseMoviePath% : %BaseTVShowPath% }

FileName:={%IsMovie% ? %MovieFileName% : %TVShowFileName% }
PathName:=%BasePath% %AYearBegin% "\" %ShowTitle%
(This post was last modified: 2015-05-05 19:40 by LoveJoy.)
find quote
bambi73 Offline
Senior Member
Posts: 238
Joined: Jan 2010
Reputation: 0
Location: Czech Republic
Post: #651
@SHJordan: debug log

Simply start Kodi, scrape one show which cause you problems, stop Kodi, post debug log. Maybe you will find problem in debug log by yourself, scrappers logs quite a lot of useful info.
find quote
Joontje Offline
Junior Member
Posts: 31
Joined: Mar 2014
Reputation: 0
Post: #652
I cant get the scraper to recognise 'Hibike! Euphonium' (http://anidb.net/perl-bin/animedb.pl?sho...&aid=10889)
The directory contains all my other Anime which is detected with no problem
/Anime/Hibike! Euphonium/Hibike! Euphonium - 01 - Episode 1.mkv is the path

Regex looks like this:
Code:
<tvshowmatching action="prepend">
                <regexp> - ()(\d+)((?:-\d+)*)(?:v\d+)? - [^\\/]*$</regexp>
                <regexp defaultseason="0"> - ()s(\d+)((?:-\d+)*)(?:v\d+)? - [^\\/]*$</regexp>
        </tvshowmatching>

Anyone else have this issue? or have an idea what i can do about it ?

edit: removing the exclamationmark and adding a tvshow.nfo doesnt work either.. can anyone confirm ? (using linux btw)
(This post was last modified: 2015-05-10 22:05 by Joontje.)
find quote
bambi73 Offline
Senior Member
Posts: 238
Joined: Jan 2010
Reputation: 0
Location: Czech Republic
Post: #653
Post debug log. See my post above.
find quote
blaize9 Offline
Junior Member
Posts: 1
Joined: May 2015
Reputation: 0
Post: #654
I had an issue with the scraper not matching anime titles with (*, /, ?, :, ", <, >, |) (Example: Seikai no Danshou: Tanjou)

It takes the invalid names (stuff with *, /, ?, :, ", <, >, |) and strips out the invalid characters and places it above the invalid line.
The file gets updated automatically once per hour. To use it just change the "Anime list URL" to

http://bakabt.info/anidb/animetitles.xml

Example:
Code:
<anime aid="6">
        <title type="main" xml:lang="x-jat">Seikai no Danshou Tanjou</title>
        <title type="main" xml:lang="x-jat">Seikai no Danshou: Tanjou</title>
        <title type="official" xml:lang="en">Crest of the Stars Birth</title>
        <title type="official" xml:lang="en">Crest of the Stars: Birth</title>
        <title type="official" xml:lang="ja">星界の断章 誕生</title>
        <title type="short" xml:lang="x-jat">SnD</title>
        <title type="syn" xml:lang="en">Crest of the Stars Fragment Birth of Stars</title>
        <title type="syn" xml:lang="en">Crest of the Stars: Fragment Birth of Stars</title>
        <title type="syn" xml:lang="en">Lost Chapter of the Stars</title>
        <title type="syn" xml:lang="x-jat">Seikai no Monshou Birth</title>
        <title type="syn" xml:lang="zh-Hans">星界的断章</title>
</anime>
(This post was last modified: 2015-06-03 14:45 by blaize9.)
find quote
Joontje Offline
Junior Member
Posts: 31
Joined: Mar 2014
Reputation: 0
Post: #655
(2015-05-11 01:27)bambi73 Wrote:  Post debug log. See my post above.

Here you go Bambi,

I cant get it to recognise 4 new episodes now, they are all named correctly and were previously recognised without any issues.

http://xbmclogs.com/pfqffdq9s

Starts at line 620
find quote
rukasu01 Offline
Junior Member
Posts: 1
Joined: Jul 2015
Reputation: 0
Post: #656
HI! First post on an excellent piece of code!

I am having some issues with certain shows.

~Folder~ (Filename)

~Baccano~ (baccano_s01eXX.mkv)
Only shows 13 episodes. Should be 16

~Cross Ange Tenshi to Ryuu no Rondo~ (Cross Ange Tenshi to Ryuu no Rondo_s01eXX.mkv)
Does not work at all. It is in the database at a10766

~Fate Zero~ (Fate Zero_s01eXX.mkv)
Only shows 13 episodes. Should be 25.

~Ore no Imouto ga Konna ni Kawaii Wake ga Nai~ (Ore no Imouto ga Konna ni Kawaii Wake ga Nai_s01e15)
Only shows 13 episodes. Should be 25.

~Sky Girls (2007)~ (sky girls_s01eXX.mkv)
Works, but only shows the OVA. Needs to show a5269, but only shows a4383. I also tried without the (2007), no joy.

~Strike Witches~ (Strike Witches_s01eXX.mkv)
Same problem as Sky Girls

I probably have more problems in my database, but these are the ones that are driving me nuts. Any help would be very appreciated!
find quote
scudlee Offline
Team-Kodi Member
Posts: 844
Joined: Jul 2011
Reputation: 52
Post: #657
(2015-07-11 08:38)rukasu01 Wrote:  ~Baccano~ (baccano_s01eXX.mkv)
Only shows 13 episodes. Should be 16
AniDb treats 14-16 as specials. Rename them to S00E01-S00E03, they'll show up in the correct positions.

(2015-07-11 08:38)rukasu01 Wrote:  ~Cross Ange Tenshi to Ryuu no Rondo~ (Cross Ange Tenshi to Ryuu no Rondo_s01eXX.mkv)
Does not work at all. It is in the database at a10766
Not sure, that's exactly what my folder is called and it works. Double-check that the folder name matches what you've posted, and try manually refreshing.

Would need to see a debug log (wiki) for more help.

(2015-07-11 08:38)rukasu01 Wrote:  ~Fate Zero~ (Fate Zero_s01eXX.mkv)
Only shows 13 episodes. Should be 25.

~Ore no Imouto ga Konna ni Kawaii Wake ga Nai~ (Ore no Imouto ga Konna ni Kawaii Wake ga Nai_s01e15)
Only shows 13 episodes. Should be 25.

"Fate/Zero" has only has 13 episodes...
"Fate/Zero (2012)" has the other 12.

Two separate series, two separate folders, each starting from S01E01.

Similarly with "Ore no Imouto ga Konna ni Kawaii Wake ga Nai" and "Ore no Imouto ga Konna ni Kawaii Wake ga Nai.".
(Tricky ones to separate there I imagine, since Windows strips periods from the end of folder names. Probably better off using a tvshow.nfo with the ids in, or naming the second season "Oreimo 2".)

(2015-07-11 08:38)rukasu01 Wrote:  ~Sky Girls (2007)~ (sky girls_s01eXX.mkv)
Works, but only shows the OVA. Needs to show a5269, but only shows a4383. I also tried without the (2007), no joy.

~Strike Witches~ (Strike Witches_s01eXX.mkv)
Same problem as Sky Girls

"Sky Girls (2007)" and "Strike Witches (2008)" should pick up the TV series over the OVAs. Again, without a debug log showing you refreshing those folders I can't help more than that.
find quote
Post Reply