• 1
  • 44
  • 45
  • 46(current)
  • 47
  • 48
  • 71
Release [MOD] AniDB.net scrapers for TV shows and Movies
Tested the fixes, and everything seems alright except for Infinite Stratos, which is still not linked to Special 1 on TheTVDB (http://thetvdb.com/index.php?tab=episode...id=4111725).

Thanks for the rest of the fixes though, especially Ore Monogatari. Looking forward to the future Fate fix.
Reply
(2015-10-15, 02:46)TheFireKahuna Wrote: Tested the fixes, and everything seems alright except for Infinite Stratos, which is still not linked to Special 1 on TheTVDB (http://thetvdb.com/index.php?tab=episode...id=4111725).

The TVDB special you link to corresponds to IS: Infinite Stratos Encore - Koi ni Kogareru Rokujuusou, which is it's own entry in anidb (and is correctly linked in the anime-list.xml).

The only special for the the first season of Infinite Stratos is "One-off Festival", which is live-action footage of an Infinite Stratos special event held at Yokohama Blitz. That does not correspond to any of the specials on TVDB.
Reply
Hello...

have question about advancedsettings.xml and file renaming..
now I have this in as.xml to fetch anime files with Name - xx.mkv

Code:
<tvshowmatching action="prepend">
    <regexp> - ()(\d+)((?:-\d+)*)(?:v\d+)? - [^\\/]*$</regexp>
    <regexp defaultseason="0"> - ()s(\d+)((?:-\d+)*)(?:v\d+)? - [^\\/]*$</regexp>
    <regexp> - ()(\d+)((?:-\d+)*)(?:v\d+)?\.[^.\\/]*$</regexp>
    <regexp defaultseason="0"> - ()s(\d+)((?:-\d+)*)(?:v\d+)?\.[^.\\/]*$</regexp>
  </tvshowmatching>

can you please help me with regexp for animes without renaming.. example [HorribleSubs] Young Black Jack - 03 [1080p].mkv
Im not good with coding or regexp, so please help me Smile

Thanks
Reply
@Sp4rh4wk: http://forum.kodi.tv/showthread.php?tid=...pid1531110

deja vu?
Reply
(2015-10-17, 10:37)scudlee Wrote: @Sp4rh4wk: http://forum.kodi.tv/showthread.php?tid=...pid1531110

deja vu?


well this time its different.. Im using

Code:
<tvshowmatching action="prepend">
  <regexp>(?i)().*(?:\D|^)(\d+)(?=(\[[^\]]+]|\([^)]+\)|\{[^}]+\}|[^\]\[(){}]+)*$)</regexp>
</tvshowmatching>

it works great for almost all formats.. but then tv series (not anime) scraper is fucked up..
I tried this one for tv series http://pastebin.com/UPPrk7VU but I wasnt able to implement anime one to it..
Is there a way to lock that regexp thing only for anime scraper?

for example...

if I dont have advancedsettings.xml at all, tv series are recognized fine..
but if I create advancedsettings.xml and add that regexp there, tv series arent recognized right Sad
I think thats cause that regexp is used by all scrapers and not only animdb one Sad
any way to fix this? thanks
Reply
Thanks for the Girls und Panzer fix!
Reply
(2015-10-15, 06:46)scudlee Wrote:
(2015-10-15, 02:46)TheFireKahuna Wrote: Tested the fixes, and everything seems alright except for Infinite Stratos, which is still not linked to Special 1 on TheTVDB (http://thetvdb.com/index.php?tab=episode...id=4111725).

The TVDB special you link to corresponds to IS: Infinite Stratos Encore - Koi ni Kogareru Rokujuusou, which is it's own entry in anidb (and is correctly linked in the anime-list.xml).

The only special for the the first season of Infinite Stratos is "One-off Festival", which is live-action footage of an Infinite Stratos special event held at Yokohama Blitz. That does not correspond to any of the specials on TVDB.

Your right, sorry about that.

I found another bug. http://anidb.net/perl-bin/animedb.pl?sho...&aid=10648 This Chaika OVA is currently linking to Fate/stay night 2014 TVDB data. The bad news is that TVDB split the OVA into two episodes, when they are linked on AniDB and MyAnimeList (http://thetvdb.com/?tab=season&seriesid=...5625&lid=7).
Reply
(2015-10-19, 00:05)TheFireKahuna Wrote: I found another bug. http://anidb.net/perl-bin/animedb.pl?sho...&aid=10648 This Chaika OVA is currently linking to Fate/stay night 2014 TVDB data. The bad news is that TVDB split the OVA into two episodes, when they are linked on AniDB and MyAnimeList (http://thetvdb.com/?tab=season&seriesid=...5625&lid=7).

Should be fixed. The scraper can actually handle one anidb episode being split into two tvdb episodes. Of course, there's currently no plots for either part on tvdb... So you'll just have to take my word on that.
Reply
(2015-10-17, 23:20)Sp4rh4wk Wrote: it works great for almost all formats.. but then tv series (not anime) scraper is fucked up..
I tried this one for tv series http://pastebin.com/UPPrk7VU but I wasnt able to implement anime one to it..
Is there a way to lock that regexp thing only for anime scraper?

if I dont have advancedsettings.xml at all, tv series are recognized fine..
but if I create advancedsettings.xml and add that regexp there, tv series arent recognized right Sad
I think thats cause that regexp is used by all scrapers and not only animdb one Sad
any way to fix this? thanks

Had a similar issue some time ago when I first started using this scraper so I figured I should just post what I did to fix it since it might help you:

Kodi has a built-in set of RegEx. You can also specify a different set of RegEx for <tvshowmatching> in your advancedsettings.xml file, and whether those are to be run before (if you add action="prepend") or after (if you add action="append") Kodi's built-in RegEx. From what I can tell, Kodi will run file names through every RegEx it has available until it finds a match. This happens with every scraper. The problem is, the RegEx you're using to handle anime episode file names is also being used when searching for TV Shows, and it's fetching information incorrectly from your TV Shows file names. This happens because you specified action="prepend" in your advancedsettings.xml file, and the TV Shows scraper finds an (incorrect) match by using your custom RegEx.
There is no way to tell Kodi or a specific scraper not to use your custom <tvshowmatching> RegEx, at least from a user perspective. However, since there's an order that Kodi obeys to when running RegEx, you can add whichever RegEx you need from the built-in RegEx set to your advancedsettings.xml file so that those are used before your custom RegEx. This obviously depends on the naming scheme you're using for your files.

For example: I don't like renaming files. I like the fact that I can simply have an organized folder structure and throw whatever files I download into their corresponding folder without having to bother with renaming. AniDB's renaming client doesn't really work as is on Chrome anymore (Google discontinued NPAPI support last month), and I like re-downloading shows if there's a better release around, so having everything with its original file name is useful in many ways. This also applies to TV Shows.
Considering this, to scrape anime, I'm using a personal version of scudlee's RegEx:

Code:
<regexp defaultseason="0">(?:[\.\] _-])()s(\d+)((?:-\d+)*)(?:v\d+)?(?:[\.\[\( _-])[^\\/]*$</regexp>
<regexp>(?:[\.\] _-])(()\d+)((?:-\d+)*)(?:v\d+)?(?:[\.\[\( _-])[^\\/]*$</regexp>

This works for pretty much every file name on my anime library, barring some specials that do not contain Sn on their file name. I deal with that by simply prepending Special S1 (for example) to their file name.
This is great and all but it obviously messes with my TV Shows scraper. The reason scudlee's original RegEx doesn't mess with TV Shows is because it searches for a specific match, which is ensured to exist if you rename your files using AniDB's client.
So to solve this, I looked at my TV Shows file names and added the following built-in RegEx, before the two RegEx I use for anime:

Code:
<regexp>[Ss]([0-9]+)[][ ._-]*[Ee]([0-9]+)([^\\/]*)$</regexp>

This works because most TV Shows files contain SnEn (for example S01E04) in their name, and the RegEx above matches that before the scraper attempts to use the two RegEx I use for anime file names. So the whole <tvshowmatching> section on my advancedsettings.xml file looks like this:

Code:
<tvshowmatching action="prepend">
  <regexp>[Ss]([0-9]+)[][ ._-]*[Ee]([0-9]+)([^\\/]*)$</regexp>
  <regexp defaultseason="0">(?:[\.\] _-])()s(\d+)((?:-\d+)*)(?:v\d+)?(?:[\.\[\( _-])[^\\/]*$</regexp>
  <regexp>(?:[\.\] _-])(()\d+)((?:-\d+)*)(?:v\d+)?(?:[\.\[\( _-])[^\\/]*$</regexp>
</tvshowmatching>

Hope this helps.
Reply
Found a new issue: http://anidb.net/perl-bin/animedb.pl?sho...e&aid=7991 isn't linking to http://thetvdb.com/?tab=season&seriesid=...1214&lid=7 properly

Update: Also found another one with Blue Exorcist, special 1 of http://anidb.net/perl-bin/animedb.pl?sho...e&aid=8148 doesn't match up with http://thetvdb.com/?tab=episode&seriesid...9529&lid=7 , currently links with TVDB S00E01.
Reply
I have noticed that the genres or tags for anime shows are not appearing in the TV show information. There is no label containing the word 'Genre' anymore. Whereas previously there were up to six different genres labeled. I am currently migrating everything over to Kodi from Gotham (XBMC) due to video codecs. I have Gotham still operating and found that this issue has popped up on that as well. If I rescrape an anime TV show that previously had genres labeled there are now no genres present, again, the Genre: line within the info is no longer present within both Gotham (previous) and Kodi Helix (present). I have tried Isengard 15.1 but it seems glitchy compared to Kodi Helix 14.2. TheTVDB scraper does have genres after scraping but the AniDB.net genres were more diverse in the labeling of the shows. It's a minor inconvenience but to have something that previously work no longer work is a little frustrating. Having two separate installs should have no effect on this due to XBMC (Gotham) and Kodi (Helix) being in separate directories. I had both Gotham and Kodi installed for about 6 months and added dozens of shows to Gotham with the genres showing up. The last time it worked properly was prior to August. I have checked the "Use Tags" function within the scraper and marked all of them and all of them separately with no change in the results. This could be an issue with AniDB.net metadata not transferring. I added the Information libraries addon AniDB.net MOD common scraper functions and it didn't work either. The main need for this to work is to populate PseudoTV Live and allow for genre separation for channels, again, a minor inconvenience which wasn't one previously.
Reply
Can anyone tell me why i can't scrape http://anidb.net/perl-bin/animedb.pl?sho...&aid=10847 properly?

i mean it finds the series fine and says loading episode details, but then nothing is loaded.
Reply
Found another specials issue, http://anidb.net/perl-bin/animedb.pl?sho...e&aid=9206 doesn't link to http://thetvdb.com/?tab=episode&seriesid...4348&lid=7 , it currently incorrectly links to S00E01 of TheTVDB

I think that's the last of them (including my post 3 up) from my collection, any last ones were due to my own mistakes.

Thankyou for the work you've invested in this list Smile
Reply
New features in 2.3.0

This update adds the ability for the scraper to read new offset attributes in the anime-list.xml, which should simplify a lot of the mappings in the list (specifically those for split-cour anime).

This release will only work on 13.0 (Gotham) or later. It will install on earlier versions but the episode mapping won't work at all. No tvdb plot/thumbnail will be retrieved for any episode.
Since the current stable version is 15.2 (Isengard), hopefully this won't actually affect anyone.


@TheFireKahuna: With this update, I've also pushed all the split-cour anime fixes (so Fate/Stay Night, etc. should all be fixed). I've also pushed fixes for the other issues, but double-check that last one, as the OVA was already mapping correctly - my guess is you have it named as S00E01 rather than S01E01 (or whatever your preferred naming scheme is). The OVA is the regular episode, the special episode is another live event thing with no corresponding match on tvdb. Without any mapping that special would have mapped to the first tvdb special, while the regular episode (with a mapping) would go to the second tvdb special episode... I hope that makes sense Huh

@PryMatrix: Thank you for making me aware of this issue. I've started working on a fix, but it's going to take a while to get it working properly. The problem is that the anidb category system (which was being used by the scraper as "genres") has been merged into the anidb tagging system (which was used to get "tags" (obviously)). With only one system in place, it's a lot harder to disentangle in a meaningful way.
The results will likely not be exactly the same as before.
Reply
Thanks for the fixes, especially the split-cour fix. I did have the OVA as S00 instead of S01. Such an easy mistake to make when your splitting off a special to a separate OVA folder.

I found a few more issues (this actually might finally be the last ones for a while, considering that at 174 anime, I have a decent amount to watch before I add anything new):

- http://anidb.net/perl-bin/animedb.pl?sho...e&aid=9088 doesn't have any metadata.
- http://anidb.net/perl-bin/animedb.pl?sho...&aid=10012 doesn't link to http://thetvdb.com/?tab=episode&seriesid...4556&lid=7 , it incorrectly links to the other movie TVDB entry.
- http://anidb.net/perl-bin/animedb.pl?show=anime&aid=570 doesn't have any metadata (or at least, the Complete Movie entry doesn't).
- http://anidb.net/perl-bin/animedb.pl?sho...e&aid=8857 doesn't have any metadata

That should be it. Thankyou again for maintaining this.
Reply
  • 1
  • 44
  • 45
  • 46(current)
  • 47
  • 48
  • 71

Logout Mark Read Team Forum Stats Members Help
[MOD] AniDB.net scrapers for TV shows and Movies8