• 1
  • 41
  • 42
  • 43(current)
  • 44
  • 45
  • 66
mythicalLibrarian - a tool to build Movie and TV Show library from MythTV recordings
ubuntite, see post 620, also somewhere around SVN REV770ish I added some extra debug lines for you to run. I may have forgot to ask you to run them. I need to see a debug log from a newer revision. It will show me where the holdup is.
Use mythicalLibrarian to make a library out of your MythTV files. Leave the recording to MythTV and use XBMC as your library.
Installation and Instructions:http://wiki.xbmc.org/index.php?title=MythicalLibrarian
Technical Support:http://forum.xbmc.org/showthread.php?tid=65644
[url=http://forum.xda-developers.com/showthread.php?tid=1081892][/url]
Reply
Ubuntitie: Assuming you had to set a level on which shows would be removed from the MythTV database and which ones would go into the doover que....


Code:
Title match scheme:
+1 = Match on Zap2itID
0 = Generic Programming with no data
-1 = Match on exact Title
-2 = Match on Fuzzy logic Title
-3 = There should have been a match, but it was not possible at the time
Code:
Subtitle Match Scheme:
+1 = Match on Airdate
0 = Generic Programming with no data
-1 = Match on exact Subtitle
-2 = Match on fuzzy logic Subtitle
-3 = There should have been a match, but it was not possible at the time
Basically, I've come up with a rating system, but I need to know how to best utilize it for your situation. You can specify individual values, or you can specify a combined rating.
Use mythicalLibrarian to make a library out of your MythTV files. Leave the recording to MythTV and use XBMC as your library.
Installation and Instructions:http://wiki.xbmc.org/index.php?title=MythicalLibrarian
Technical Support:http://forum.xbmc.org/showthread.php?tid=65644
[url=http://forum.xda-developers.com/showthread.php?tid=1081892][/url]
Reply
SVN is up and working properly. I will be making slight revisions over this weekend as it has no doover logging capabilities currently. The overall structure is in tact and working to rename episodes. It is also providing feedback.

Code:
Revision 804 Fri Nov 19 23:06:40 CST 2010
Attemting to pull database information on /home/mythtv/Videos/1956_20101119230000.mpg
RECSTART:2010-11-19 23:00:00 DATE: 2001-12-05
PROGRAMID:EP002298270084 ShowCategory:Sitcom
PLOT: Cartman has a personal stake in stem cell research.
PERFORMING MAINTENANCE ROUTINE...
REMOVING ORPHAN FOLDER:/home/mythtv/.mythicalLibrarian/mythicalSetup/Episodes/Mister Rogers Neighborhood/Season 7
REMOVING ORPHAN FOLDER:/home/mythtv/.mythicalLibrarian/mythicalSetup/Episodes/Mister Rogers Neighborhood
SEARCHING: www.TheTvDb.com SHOW NAME: South Park EPISODE: Kenny Dies
TESTING FOR ZAP2ITID MATCH:SH229827 South Park
MATCH FOUND BASED ON Zap2itID:
FOUND:South Park ID#:75897 WITH CONFIDENCE:1 $
DATABASE IS MAINTAINED. TIME IS:1290230651 NEXT UPDATE IS:1290294954
AIRDATE/SANDARD LOGIC FAILED. FUZZY LOGIC ABSOLUTE: 118
TOTAL MATCHES:2076 TOTAL VERIFIED FUZZY ERRORS:459
EPISODE:Kenny Dies EPISODE NUMBER:118 S05E13 WITH CONFIDENCE: 1
JOB: mythicalLibrarian '/home/mythtv/Videos/1956_20101119230000.mpg' 'South Park' 'Kenny Dies'
CONFIDENCE:4 LOGIC PATH:  Attempted Match On Zap2itID: Sucessful; Attemped match on OriginalAirDate: Sucessful;  Verified with Standard logic. Verified with Fuzzy logic.
TARGET SET:/home/mythtv/Videos/Episodes/South Park/Season 5/South Park S05E13 (Kenny Dies).mpg
CREATING SYMLINK IN MOVE MODE
MOVED: /home/mythtv/Videos/1956_20101119230000.mpg
TO: /home/mythtv/Videos/Episodes/South Park/Season 5/South Park S05E13 (Kenny Dies).mpg
SENDING REQUESTED COMMANDS TO:192.168.1.110:8080
RSS ENTRY SUCCESSFULLY CREATED: /var/www/mythical-rss/rss.xml
SUCCESSFUL COMPLETEION TYPE: MoveModeSuccessful
You may notice that the Episode Confidence and Series confidence are a total of 2, but the overall confidence is 4. This is because fuzzy logic verification of a match on airdate will boost confidence levels if it all comes out the same.

Higher levels of confidence means more confirmation. Lower levels of confidence means there was less confirmations. mythicalLibrarian can only work with what's there.

You can improve your confidence levels by adding your favorite program's Zap2itIDs to TheTvDb.com. You can also use a showTranslations for faulty guide data. On top of that, you can get even higher levels of confirmation by adding Airdate and correcting TvDb Title information.

Still left: doovers, revising epishow handling, and determining a level of confidence which would
Use mythicalLibrarian to make a library out of your MythTV files. Leave the recording to MythTV and use XBMC as your library.
Installation and Instructions:http://wiki.xbmc.org/index.php?title=MythicalLibrarian
Technical Support:http://forum.xbmc.org/showthread.php?tid=65644
[url=http://forum.xda-developers.com/showthread.php?tid=1081892][/url]
Reply
The SVN is decently stable now. I've pretty much performed an overhaul of the episode matching, movie handling and showing handling capabilites. The SVN is now using a confidence based matching system which can reference up to 6 points of data per Episode and verify that data for perfect match. The SVN is also *much* quicker at matching each episode due to the overhaul.

There are 168 "if then" statement and 201 "test" statements in mythicalLibrarian. I don't use all of them in my setup (the defaults). Any help in finding glitches or what you consider a glitch is helpful. I will spend tomorrow working quarks out of the SVN for a new stable release tomorrow night.

I would like to get some input.
Use mythicalLibrarian to make a library out of your MythTV files. Leave the recording to MythTV and use XBMC as your library.
Installation and Instructions:http://wiki.xbmc.org/index.php?title=MythicalLibrarian
Technical Support:http://forum.xbmc.org/showthread.php?tid=65644
[url=http://forum.xda-developers.com/showthread.php?tid=1081892][/url]
Reply
I would like to announce that not only does mythicalLibrarian have the most advanced matching routine available, it also resolves conflicts.

mythicalLibrarian Wrote:CONFIDENCE:4 LOGIC PATH: Attempted Match On Zap2itID: Sucessful; Attemped match on OriginalAirDate: Conflict; Multiple Airdates Detected- Parsed results; Attempted to resolve confilct with Standard Logic: Sucessful; Sucessful; Verified with Standard logic; Verified with Fuzzy logic;

I feel confident that all core features are working as they should. The logic has been thoroughly revised, moved to a confidence based system, and conflict resolution is in effect. This is a very big milestone.

I could use some help with the non-core features. Let me know if there is a problem and I am working on a 0.24 python bindings solution for those who want to delete mythtv data.
Use mythicalLibrarian to make a library out of your MythTV files. Leave the recording to MythTV and use XBMC as your library.
Installation and Instructions:http://wiki.xbmc.org/index.php?title=MythicalLibrarian
Technical Support:http://forum.xbmc.org/showthread.php?tid=65644
[url=http://forum.xda-developers.com/showthread.php?tid=1081892][/url]
Reply
Adam:

Just updated to Stable a few minutes ago, and mythicalSetup exited with no errors, but without going through the expected diagnostics, including testing XBMC communication, Mister Rogers, etc. Here's all the output following the dialog box selections:

Code:
mythicalLibrarian will now conduct mythicalDiagnostics
Press any key to continue to online testing....

Installation and tests completed successfully.
MythTV job not added because mythicalLibrarian already exists in slot 1
permissions were set for user: mythtv.
RSS Feed will be located at http://192.168.1.10/mythical-rss/rss.xml .
mythicalLibrarian is located in /usr/local/bin
mythicalLibrarian's log is located in ~/.mythicalLibrarian/output.log
Renamed video files will be placed in new folders within original.
  ie. /var/lib/mythtv/recordings/Episodes, /Movies and /Showings.
Check the mythicalLibrarian checkbox when setting up recordings.
For more information, type 'mythicalLibrarian --help'
Done.

Is this expected (e.g. did you take out the diagnostics from the latest versions?)

/Greg
Reply
outleradam Wrote:Ubuntite: can you verify that this show made it into your library?
Code:
/media/recordings/Episodes/CTV News/CTV News S2010E1111 ( Recorded  [email protected]).mpg

Yes, it did.

Quote:Towards the end of your log I see
Code:
[LIST=1]
[*]@@@@@@@@@@@@@OPERATION COMPLETE Fri Nov 12 21:03:04 PST 2010 @@@@@@@@@@@@@@@@
[*]@@@@@@@@@@@@@OPERATION COMPLETE Fri Nov 12 21:07:14 PST 2010 @@@@@@@@@@@@@@@@
[/LIST]
I've never seen this in my logs. Did you splice two together? I have seen two New search initiated before, but never two operation complete.

I did not splice two logs together.

Quote:Please update to revision 777 and see if the problem persists.

Just updated to 852. Problem still persists.
Reply
Alright. I think that dual operation complete must be due to running multiple jobs at the same time. One was a larger file then the other and was not completed when the seccond job was called.

Are you running 0.24, or 0.23? The deletion methods have not been implemented in 0.24.

The newest specs are Confidence must be greater then or equal to -4 before a delete will occur in Disabled mode. Is this the case or is it simply not deleting anything?

There are debug lines I placed in mythicalLibrarian to test where the holdup is. Please post a log where a proper match was made so that I can trace the problem.
Use mythicalLibrarian to make a library out of your MythTV files. Leave the recording to MythTV and use XBMC as your library.
Installation and Instructions:http://wiki.xbmc.org/index.php?title=MythicalLibrarian
Technical Support:http://forum.xbmc.org/showthread.php?tid=65644
[url=http://forum.xda-developers.com/showthread.php?tid=1081892][/url]
Reply
GregoryK Wrote:Adam:

Just updated to Stable a few minutes ago, and mythicalSetup exited with no errors, but without going through the expected diagnostics, including testing XBMC communication, Mister Rogers, etc. Here's all the output following the dialog box selections:

Code:
mythicalLibrarian will now conduct mythicalDiagnostics
Press any key to continue to online testing....

Installation and tests completed successfully.
MythTV job not added because mythicalLibrarian already exists in slot 1
permissions were set for user: mythtv.
RSS Feed will be located at http://192.168.1.10/mythical-rss/rss.xml .
mythicalLibrarian is located in /usr/local/bin
mythicalLibrarian's log is located in ~/.mythicalLibrarian/output.log
Renamed video files will be placed in new folders within original.
  ie. /var/lib/mythtv/recordings/Episodes, /Movies and /Showings.
Check the mythicalLibrarian checkbox when setting up recordings.
For more information, type 'mythicalLibrarian --help'
Done.

Is this expected (e.g. did you take out the diagnostics from the latest versions?)

/Greg
Please update to SVN. Stable is outdated by a few months. There was a slight change in the parsing of SVN. It is possible that the change to parsing was not handled well by the old stable version. Were you by chance running SVN, then switched to stable? In that case you were trying to parse the older version with the newer software. It's understandable that this would fail. Please try updating to SVN. SVN is where the development is taking place. Stable is about 3 months old.
Use mythicalLibrarian to make a library out of your MythTV files. Leave the recording to MythTV and use XBMC as your library.
Installation and Instructions:http://wiki.xbmc.org/index.php?title=MythicalLibrarian
Technical Support:http://forum.xbmc.org/showthread.php?tid=65644
[url=http://forum.xda-developers.com/showthread.php?tid=1081892][/url]
Reply
ubuntite, got the issue right here on line 2380 SVN:
Code:
if [ -s "$MoveDir/$ShowFileName.$OriginalExt" ]; then

Should be:
Code:
if [ ! -e "$MoveDir/$ShowFileName.$OriginalExt" ]; then
This is a touchy area of the code, I will make the appropriate changes to the SVN tonight on this.
Use mythicalLibrarian to make a library out of your MythTV files. Leave the recording to MythTV and use XBMC as your library.
Installation and Instructions:http://wiki.xbmc.org/index.php?title=MythicalLibrarian
Technical Support:http://forum.xbmc.org/showthread.php?tid=65644
[url=http://forum.xda-developers.com/showthread.php?tid=1081892][/url]
Reply
outleradam Wrote:Please update to SVN.

Hm, I thought I was running stable, but must have borked something with that last update to stable, because now, if I 'sudo mythicalLibrarian --update' it doesn't run anything.

What's the best way to reinstall?

Thanks,

/gkk
Reply
outleradam Wrote:ubuntite, got the issue right here on line 2380 SVN:
Code:
if [ -s "$MoveDir/$ShowFileName.$OriginalExt" ]; then

Should be:
Code:
if [ ! -e "$MoveDir/$ShowFileName.$OriginalExt" ]; then
This is a touchy area of the code, I will make the appropriate changes to the SVN tonight on this.

Great. By the way, I am running mythicalLibrarian as a user job within mythtv, and I am allowing two simultaneous jobs to run at the same time (I have two tuners, so it works well that way). This does create the situation where mythicalLibrarian could be called a second time before the first run has completed. Could this also be an issue?
Reply
^^Well, if the initial identification of the time and show title are perfomed at the same time then it could cause problems. I have a solution in mind which would separate the working dirs into instance dirs. Then, on a sucessful zap2itid match, it would create a reference list. This reference list would be checked and the working dir could be referenced from this list.

I'm holding off on that until the next stable release. I need to get the current code stablized before I destablize it again.

Upcomming features:

1. multiple instances of mythicalLibrarian at the same time (currently there are some possible mis-matches)
2. When running --doover mode, since the operator is at the console, fuzzy logic will be replaced with a operator selection (currently defaults to fuzzy logic)
3. revision of offline mode for files with existing databases in case TVDB is down or no internet connection. (currently inoperable)

Please report any problems you find in the SVN. I'm going to undo and redo my entire library tonight and review episode-by-episode. It's my goal to move a revision to stable tonight.
Use mythicalLibrarian to make a library out of your MythTV files. Leave the recording to MythTV and use XBMC as your library.
Installation and Instructions:http://wiki.xbmc.org/index.php?title=MythicalLibrarian
Technical Support:http://forum.xbmc.org/showthread.php?tid=65644
[url=http://forum.xda-developers.com/showthread.php?tid=1081892][/url]
Reply
GregoryK Wrote:What's the best way to reinstall?
Code:
cd ~/.mythicalLibrarian/mythicalSetup
./mythicalSetup.sh
Please select SVN. Then do
Code:
mythicalLibrarian --update
and select SVN again.
Let me know if there are any problems.
Use mythicalLibrarian to make a library out of your MythTV files. Leave the recording to MythTV and use XBMC as your library.
Installation and Instructions:http://wiki.xbmc.org/index.php?title=MythicalLibrarian
Technical Support:http://forum.xbmc.org/showthread.php?tid=65644
[url=http://forum.xda-developers.com/showthread.php?tid=1081892][/url]
Reply
Adam: that worked to reinstall, thanks. /Greg
Reply
  • 1
  • 41
  • 42
  • 43(current)
  • 44
  • 45
  • 66

Logout Mark Read Team Forum Stats Members Help
mythicalLibrarian - a tool to build Movie and TV Show library from MythTV recordings3