• 1
  • 18
  • 19
  • 20(current)
  • 21
  • 22
  • 71
Release [MOD] AniDB.net scrapers for TV shows and Movies
Are you changing the delay parameter at the source, or just in the Addon settings?
Reply
(2013-07-12, 20:59)scudlee Wrote: Are you changing the delay parameter at the source, or just in the Addon settings?

Haven't messed with the source, just the addon settings which default at 1.
Reply
Sorry, possible bad choice of words on my part, so let me just be a bit more explicit:

When changing the delay parameter (or any setting), you need to select your anime source folder in XBMC (the one you set the content on originally), bring up the context menu, select "Change content" and then click the Settings button and change the setting there. Make sure to press "OK" both times to save your changes.

If you're going via System/Settings->Add-ons->Enabled Add-ons->etc., that's the wrong place and won't change existing sources (just the default for future sources).


You should also clear your cache, as you're likely just seeing cached ban messages. (On Windows it's at %APPDATA%\XBMC\cache\scrapers\metadata.tvshows.anidb.net.mod, other OSes will vary).

In fact, the simplest option would be to just clear your cache, and then manually refresh each of the trouble-causing shows, without bothering to change the delay parameter. I guess that depends a lot on the numbers involved, though.
Reply
Well there's about 100 of them, so I'd rather get it working properly. What's weird is that it DID work for all the OVA's with the original AniDb scraper. Then one morning I found that all my anime was missing, and I couldn't rescrape it. Tried this scraper with same results. I've deleted the XBMC profile folder in APPDATA several times, and did a couple full reisntalls. I've tried adjusting the delay setting both under System > Addons and from the change content dialogue.

I'll just try finessing it some more and see if I can't convince it to function.
Reply
This would be my advice to help figure this out:

1. Delete the cache.
2. Turn on debug logging (crucial!)
3. Change the content on the source folder to "None" and remove everything from library when prompted.
4. Change the content back to TV shows and select the AniDB mod scraper. In the settings screen, press the defaults button.
5. Initiate a scan when prompted.
6. ...Get banned?
7. Quit XBMC and upload the log to http://xbmclogs.com (or pastebin).
8. Post a link to it here.

Actually, before you do all that, start at step 0:
0. Click this link: http://api.anidb.net:9001/httpapi?reques...er=1&aid=1 and make sure you're not already banned.

If you are currently banned, wait a few hours until you aren't before doing the rest of the steps, otherwise the log won't show anything helpful.
Reply
What I've done to what around it is add batches of 10-12 OVA's to the library at a time, and was able to load them all without issue. Thanks for you help.
Reply
As promised, new features as they get written...

New features in 2.1.0

Original Work and Location tagging
You can now add tags based on sub-categories of the "Original Work" and "Setting/Place" categories. (If there's any desire for "Setting/Time", let me know Wink )

These will look like: "Original Work: Manga" and "Location: Akihabara" by default, although you can also change the prefixes in the settings (or remove them entirely).


Absolute order mappings
(TV shows only.)
It's now possible for episodes to map between anidb and theTVDB using theTVDB.com absolute order, if the show is marked as such in the mapping list.

What this means is that for many long series that are spread over multiple seasons, the mapping list no longer has to contain mappings for each individual episode in order for it to work.

For example,
Before:
Code:
<anime anidbid="69" tvdbid="81797" defaulttvdbseason="1">
  <name>One Piece</name>
  <mapping-list>
    <mapping anidbseason="0" tvdbseason="0">;1-3;2-9;3-10;4-14;5-0;6-99;7-99;8-99;9-99;10-99;11-99;12-99;13-99;14-99;15-99;16-23;17-24;</mapping>
    <mapping anidbseason="1" tvdbseason="1">;1-1;2-2;3-3;4-4;5-5;6-6;7-7;8-8;</mapping>
    <mapping anidbseason="1" tvdbseason="2">;9-1;10-2;11-3;12-4;13-5;14-6;15-7;16-8;17-9;18-10;19-11;20-12;21-13;22-14;23-15;24-16;25-17;26-18;27-19;28-20;29-21;30-22;</mapping>
    <mapping anidbseason="1" tvdbseason="3">;31-1;32-2;33-3;34-4;35-5;36-6;37-7;38-8;39-9;10-40;41-11;42-12;43-13;44-14;45-15;46-16;47-17;</mapping>
    <mapping anidbseason="1" tvdbseason="4">;48-1;49-2;50-3;51-4;52-5;53-6;54-7;55-8;56-9;57-10;58-11;59-12;60-13;</mapping>
    <mapping anidbseason="1" tvdbseason="5">;61-1;62-2;63-3;64-4;65-5;66-6;67-7;68-8;69-9;</mapping>
    <mapping anidbseason="1" tvdbseason="6">;70-1;71-2;72-3;73-4;74-5;75-6;76-7;77-8;78-9;79-10;80-11;81-12;82-13;83-14;84-15;85-16;86-17;87-18;88-19;89-20;90-21;91-22;</mapping>
    <mapping anidbseason="1" tvdbseason="7">;92-1;93-2;94-3;95-4;96-5;97-6;98-7;99-8;100-9;101-10;102-11;103-12;104-13;105-14;106-15;107-16;108-17;109-18;110-19;111-20;112-21;113-22;114-23;115-24;116-25;117-26;118-27;119-28;120-29;121-30;122-31;123-32;124-33;125-34;126-35;127-36;128-37;129-38;130-39;</mapping>
    <mapping anidbseason="1" tvdbseason="8">;131-1;132-2;133-3;134-4;135-5;136-6;137-7;138-8;139-9;140-10;141-11;142-12;143-13;</mapping>
    <mapping anidbseason="1" tvdbseason="9">;144-1;145-2;146-3;147-4;148-5;149-6;150-7;151-8;152-9;153-10;154-11;155-12;156-13;157-14;158-15;159-16;160-17;161-18;162-19;163-20;164-21;165-22;166-23;167-24;168-25;169-26;170-27;171-28;172-29;173-30;174-31;175-32;176-33;177-34;178-35;179-36;180-37;181-38;182-39;183-40;184-41;185-42;186-43;187-44;188-45;189-46;190-47;191-48;192-49;193-50;194-51;195-52;</mapping>
    <mapping anidbseason="1" tvdbseason="10">;196-1;197-2;198-3;199-4;200-5;201-6;202-7;203-8;204-9;205-10;206-11;207-12;208-13;209-14;210-15;211-16;212-17;213-18;214-19;215-20;216-21;217-22;218-23;219-24;220-25;221-26;222-27;223-28;224-29;225-30;226-31;</mapping>
    <mapping anidbseason="1" tvdbseason="11">;227-1;228-2;229-3;230-4;231-5;232-6;233-7;234-8;235-9;236-10;237-11;238-12;239-13;240-14;241-15;242-16;243-17;244-18;245-19;246-20;247-21;248-22;249-23;250-24;251-25;252-26;253-27;254-28;255-29;256-30;257-31;258-32;259-33;260-34;261-35;262-36;263-37;264-38;265-39;266-40;267-41;268-42;269-43;270-44;271-45;272-46;273-47;274-48;275-49;276-50;277-51;278-52;279-53;280-54;281-55;282-56;283-57;284-58;285-59;286-60;287-61;288-62;289-63;290-64;291-65;292-66;293-67;294-68;295-69;296-70;297-71;298-72;299-73;300-74;301-75;302-76;303-77;304-78;305-79;306-80;307-81;308-82;309-83;310-84;311-85;312-86;313-87;314-88;315-89;316-90;317-91;318-92;319-93;320-94;321-95;322-96;323-97;324-98;325-99;</mapping>
    <mapping anidbseason="1" tvdbseason="12">;326-1;327-2;328-3;329-4;330-5;331-6;332-7;333-8;334-9;335-10;336-11;337-12;338-13;339-14;340-15;341-16;342-17;343-18;344-19;345-20;346-21;347-22;348-23;349-24;350-25;351-26;352-27;353-28;354-29;355-30;356-31;357-32;358-33;359-34;360-35;361-36;362-37;363-38;364-39;365-40;366-41;367-42;368-43;369-44;370-45;371-46;372-47;373-48;374-49;375-50;376-51;377-52;378-53;379-54;380-55;381-56;</mapping>
    <mapping anidbseason="1" tvdbseason="13">;382-1;383-2;384-3;385-4;386-5;387-6;388-7;389-8;390-9;391-10;392-11;393-12;394-13;395-14;396-15;397-16;398-17;399-18;400-19;401-20;402-21;403-22;404-23;405-24;406-25;407-26;408-27;409-28;410-29;411-30;412-31;413-32;414-33;415-34;416-35;417-36;418-37;419-38;420-39;421-40;422-41;423-42;424-43;425-44;426-45;427-46;428-47;429-48;430-49;431-50;432-51;433-52;434-53;435-54;436-55;437-56;438-57;439-58;440-59;441-60;442-61;443-62;444-63;445-64;446-65;447-66;448-67;449-68;450-69;451-70;452-71;453-72;454-73;455-74;456-75;457-76;458-77;459-78;460-79;461-80;462-81;463-82;464-83;465-84;466-85;467-86;468-87;469-88;470-89;471-90;472-91;473-92;474-93;475-94;476-95;477-96;478-97;479-98;480-99;481-100;</mapping>
    <mapping anidbseason="1" tvdbseason="14">;482-1;483-2;484-3;485-4;486-5;487-6;488-7;489-8;490-9;491-10;492-11;493-12;494-13;495-14;496-15;497-16;498-17;499-18;500-19;501-20;502-21;503-22;504-23;505-24;506-25;507-26;508-27;509-28;510-29;511-30;512-31;513-32;514-33;515-34;516-35;</mapping>
    <mapping anidbseason="1" tvdbseason="15">;517-1;518-2;519-3;520-4;521-5;522-6;523-7;524-8;525-9;526-10;527-11;528-12;529-13;530-14;531-15;532-16;533-17;534-18;535-19;536-20;537-21;538-22;539-23;540-24;541-25;542-26;543-27;544-28;545-29;546-30;547-31;548-32;549-33;550-34;551-35;552-36;553-37;554-38;555-39;556-40;557-41;558-42;559-43;560-44;561-45;562-46;563-47;564-48;565-49;566-50;567-51;568-52;569-53;570-54;571-55;572-56;573-57;574-58;575-59;576-60;577-61;578-62;</mapping>
    <mapping anidbseason="1" tvdbseason="16">;579-1;580-2;581-3;582-4;583-5;584-6;585-7;586-8;587-9;588-10;589-11;590-12;591-13;592-14;593-15;594-16;595-17;596-18;597-19;598-20;599-21;600-22;601-23;602-24;603-25;604-26;605-27;606-28;607-29;608-30;609-31;</mapping>
  </mapping-list>
</anime>
After:
Code:
<anime anidbid="69" tvdbid="81797" defaulttvdbseason="a">
  <name>One Piece</name>
  <mapping-list>
    <mapping anidbseason="0" tvdbseason="0">;1-3;2-9;3-10;4-14;5-0;6-99;7-99;8-99;9-99;10-99;11-99;12-99;13-99;14-99;15-99;16-23;17-24;</mapping>
  </mapping-list>
</anime>
The "a" marks the show as using absolute ordering, but it's still possible to map individual episodes (such as specials) if corrections are needed. Special episodes will still also map correctly inside the series.

The benefit to this (aside from shrinking the mapping list somewhat) is that ongoing series no longer have to be maintained. In the old system, every single episode has to be mapped for it to work, and if the series hasn't finished, new episodes continually need to be added. You can see in the One Piece code, I would "project ahead" a little, but I do fall behind often. Now, I don't have to bother.

Another small unintended feature of this is that the banner artwork for these shows will default to the series banner rather than the season 1 banner (if you look back to the 1.1.0 feature post, you can see the order the banners are taken). This made sense to me, so I didn't try to "fix" it.


Edit: Just to note, since this feature is contingent on recent changes to the anime-list.xml, you may not see the benefits until your cache has cleared (i.e. wait 48hrs or manually delete).
Reply
I've installed the scrapers, but I don't know how they work as I installed the original ones previously before installing these ones.
Reply
It sounds like you want to change the content on your anime source folder.

Select the source folder in File view and bring up the context menu ('c' or right-mouse click), select "Change content" and switch to the Mod scraper. You can also change the scraper settings there.

Ideally though, you should first change the content to "None" and remove everything from the library, and then (re-)set the content using the Mod scraper. That way your entire source folder will get rescanned using the Mod.
Reply
Hey, I've started using this mod just before I was about to give up on xbmc for my anime collection, but it worked with everything and I was so overjoyed until recently, I decided to add my hentai collection and for some reason some series don't get identified...

Before I start I'd like to thank the creator of the mod for it. I never asked for help or uploaded a log, so here goes nothing.

Edit: Nevermind, noob mistake, found out what I was doing wrong.
Reply
Looks like you just need to fix your folder names:

Ali Maniax -> Ail Maniax
Milk Junkies -> Milk Junkie
Night Shift Nurses Karte -> Night Shift Nurses
Sexy Magical Girl Ai -> Sexy Magical Girl
Stepmothers Sin -> Stepmother's Sin
Reply
hey scudlee

I think we talked about this before. Would it be possible to make all the Titles and Synonym's on AniDB available, or if not, maybe editing the Anime List like:

Code:
<anime anidbid="584" tvdbid="81618" defaulttvdbseason="1">
    <name>Ginga Eiyuu Densetsu</name>
    <synonym>Legend of the Galactic Heroes</synonym>

    <en>Legend of the Galactic Heroes</en>
    <ger>Heldensagen vom Kosmosinsel</ger>
    etc.

So let's say i change my folder from: "Ginga Eiyuu Densetsu" to "Legend of the Galactic Heroes", the scraper can pick it up and will name it in XBMC "Legend of the Galactic Heroes". Or maybe it could even work with the option "official name instead of main name", and it picks up the <en></en> title.

I know ofc it work's with NFO's, but that would be quite nice Smile
Reply
I did have a vague notion of a "Use the best match to my folder/file name" setting, which would certainly (I think) be doable. It's just a matter of carrying forward the folder name from GetSearchResults and then matching it up in the same way in GetDetails... The issue there is if you use a URL nfo file, GetSearchResults is bypassed and the scraper never even sees the folder name, so no comparison can be made. Although I don't think that's a "real" issue, it's just something people would need to be aware of - a URL nfo file means the folder name is irrelevant (and the main or official title will be used based on your other settings).

The lack of synonyms in the search (apart from the "x-jat" ones) was something I meant to address in 2.0.0 but didn't get around to. There's a slight technical niggle in the possibility of a synonym title getting higher priority over a main or official title if it has fewer digits in its id number (with everything else being identical). Because the scraper returns e.g. "Anidb Search : A1234 ~ Foo Bar" in the search results, that is what gets compared to your folder name to sort the results, so even though the synonym titles would get checked last, if your folder was "Foo Bar" and that happened to also be a synonym for a show with id 567, then the "Anidb Search : A567 ~ Foo Bar" would be seen as a better match than the "Anidb Search : A1234 ~ Foo Bar" (since it has fewer mismatching characters).

Of course it may be the case that that never occurs, but there's currently 42,488 titles in animetitles.xml, of which 13,029 are synonyms... So I feel it warrants figuring out a way to check.

There would be several ways to deal with it if it is an issue (none pretty).
Reply
(2013-07-25, 06:46)irxson Wrote: Hey, I've started using this mod just before I was about to give up on xbmc for my anime collection, but it worked with everything and I was so overjoyed until recently, I decided to add my hentai collection and for some reason some series don't get identified...

Before I start I'd like to thank the creator of the mod for it. I never asked for help or uploaded a log, so here goes nothing.

Edit: Nevermind, noob mistake, found out what I was doing wrong.

Out of curiosity as a collector of hentai as well as non-hentai OAV's, how did you set it up to scan those particular types of anime using the Mod if I may ask?

This other question is for Scudlee: When a particular anime gets scanned, does it add ALL the information from a entry on the AniDB website or just certain information?
Reply
(2013-07-26, 16:05)borgmanjayce Wrote: This other question is for Scudlee: When a particular anime gets scanned, does it add ALL the information from a entry on the AniDB website or just certain information?
That's a tricky question, certainly all the information that XBMC can handle is squeezed out of the AniDB API by the scraper, but not ALL of the information available is usable (such as the recommendations - there's no real place for them). Also, for example, the scraper converts the categories into genres, but not all categories can be considered to be genres and sometimes there's overlap or redundancy between categories, so some heavy filtering takes place there.

Then there's the fact that the API is not the website, and some stuff that's on the website is just not available, such as OP/ED titles - if you look on the site you'll see the name of the song, but in the API you'll just get e.g. "Opening 1". You also only get the "Main staff" in the API (just what's in the box near the top of a show's page) not the full staff that may also be available further down the page. That can lead to, say, the Studio being listed on the site but not in the API, and therefore not in XBMC. In those cases it's possible for the anime-list.xml to fill in the blanks via it's "supplemental-info" tag (and you can let me know if anything is missing and I'll add it).

And then some information doesn't come from AniDB at all: All artwork apart from the main poster comes from thetvdb.com and/or themoviedb.org; episode plots come thetvdb.com; movie certifications, trailers, and (optionally) movie sets come from themoviedb.org; movie sets by default come from the anime-movieset-list.xml.


...I hope that answers your question.
Reply
  • 1
  • 18
  • 19
  • 20(current)
  • 21
  • 22
  • 71

Logout Mark Read Team Forum Stats Members Help
[MOD] AniDB.net scrapers for TV shows and Movies8