2010-06-17, 06:08
DVDProfiler maintains on the machine it is running on a data base, I believe using SQL. It also puts out (exports on demand so it is available) an XML file which is what I use and could obviously be querried.
DVDprofiler does allow for plugins which could be written to put out the nfo format desired by the current scrapers.
To aid this community (and obviously myself) I would like to look at the writing of a scraper that deals with the exported DVDprofiler XML data base that has everything in it. If you can aid me in finding out how to write such a scraper (some one said the were just XML files themselves which has me confused, as ther must be some process going on) I would take a look at doing that.
Cover art for all disks in the collection are kept as jpg files in a folder whose location is well known. Each disks cover art file is named with the disks ID number with a suffix of f for front and b for back. Avatar's front cover is named 024543656135f.jpg.
For clarification, the following is what the DVDprofiler has in its XML output file for the movie Avatar (hoping the forum scanner leaves it intact):
<DVD>
<ProfileTimestamp>2010-05-17T12:41:58.000Z</ProfileTimestamp>
<ID>024543656135</ID>
<MediaTypes>
<DVD>true</DVD>
<HDDVD>false</HDDVD>
<BluRay>true</BluRay>
</MediaTypes>
<UPC>024543-656135</UPC>
<CollectionNumber>450</CollectionNumber>
<CollectionType>Owned</CollectionType>
<Title>Avatar</Title>
<DistTrait/>
<OriginalTitle/>
<CountryOfOrigin>United States</CountryOfOrigin>
<ProductionYear>2009</ProductionYear>
<Released>2010-04-22</Released>
<RunningTime>162</RunningTime>
<RatingSystem>Film</RatingSystem>
<Rating>PG-13</Rating>
<RatingAge>13</RatingAge>
<RatingVariant>0</RatingVariant>
<RatingDetails>Intense Epic Battle Sequences and Warfare, Sensuality, Language and Some Smoking</RatingDetails>
<CaseType>HD Slim</CaseType>
<CaseSlipCover>true</CaseSlipCover>
<Genres>
<Genre>Fantasy</Genre>
<Genre>Action</Genre>
<Genre>Adventure</Genre>
</Genres>
<Regions/>
<Format>
<FormatAspectRatio>1.78</FormatAspectRatio>
<FormatVideoStandard>NTSC</FormatVideoStandard>
<FormatLetterBox>true</FormatLetterBox>
<FormatPanAndScan>false</FormatPanAndScan>
<FormatFullFrame>false</FormatFullFrame>
<Format16X9>false</Format16X9>
<FormatDualSided>false</FormatDualSided>
<FormatDualLayered>false</FormatDualLayered>
</Format>
<Features>
<FeatureSceneAccess>true</FeatureSceneAccess>
<FeatureCommentary>false</FeatureCommentary>
<FeatureTrailer>false</FeatureTrailer>
<FeaturePhotoGallery>false</FeaturePhotoGallery>
<FeatureDeletedScenes>false</FeatureDeletedScenes>
<FeatureMakingOf>false</FeatureMakingOf>
<FeatureProductionNotes>false</FeatureProductionNotes>
<FeatureGame>false</FeatureGame>
<FeatureDVDROMContent>false</FeatureDVDROMContent>
<FeatureMultiAngle>false</FeatureMultiAngle>
<FeatureMusicVideos>false</FeatureMusicVideos>
<FeatureInterviews>false</FeatureInterviews>
<FeatureStoryboardComparisons>false</FeatureStoryboardComparisons>
<FeatureOuttakes>false</FeatureOuttakes>
<FeatureClosedCaptioned>false</FeatureClosedCaptioned>
<FeatureTHXCertified>true</FeatureTHXCertified>
<FeaturePIP>false</FeaturePIP>
<FeatureBDLive>false</FeatureBDLive>
<FeatureBonusTrailers>false</FeatureBonusTrailers>
<FeatureDigitalCopy>false</FeatureDigitalCopy>
<OtherFeatures/>
</Features>
<Studios>
<Studio>Twentieth Century Fox</Studio>
<Studio>Dune Entertainment</Studio>
<Studio>Ingenious Film Partners</Studio>
</Studios>
<MediaCompanies>
<MediaCompany>Twentieth Century Fox Home Entertainment</MediaCompany>
</MediaCompanies>
<Audio>
<AudioTrack>
<AudioContent>English</AudioContent>
<AudioFormat>DTS-HD Master Audio</AudioFormat>
<AudioChannels>5.1</AudioChannels>
</AudioTrack>
<AudioTrack>
<AudioContent>English</AudioContent>
<AudioFormat>Dolby Digital</AudioFormat>
<AudioChannels>Dolby Surround</AudioChannels>
</AudioTrack>
<AudioTrack>
<AudioContent>Audio Descriptive</AudioContent>
<AudioFormat>Dolby Digital</AudioFormat>
<AudioChannels>5.1</AudioChannels>
</AudioTrack>
<AudioTrack>
<AudioContent>Spanish</AudioContent>
<AudioFormat>Dolby Digital</AudioFormat>
<AudioChannels>5.1</AudioChannels>
</AudioTrack>
<AudioTrack>
<AudioContent>French</AudioContent>
<AudioFormat>Dolby Digital</AudioFormat>
<AudioChannels>5.1</AudioChannels>
</AudioTrack>
<AudioTrack>
<AudioContent>Portuguese</AudioContent>
<AudioFormat>Dolby Digital</AudioFormat>
<AudioChannels>5.1</AudioChannels>
</AudioTrack>
</Audio>
<Subtitles>
<Subtitle>English</Subtitle>
<Subtitle>Portuguese</Subtitle>
<Subtitle>Spanish</Subtitle>
</Subtitles>
<SRP DenominationType="USD" DenominationDesc="United States (Dollar)" FormattedValue="$39.99">39.99</SRP>
<Actors>
<Actor FirstName="Sam" MiddleName="" LastName="Worthington" BirthYear="0" Role="Jake Sully" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Zoë" MiddleName="" LastName="Saldana" BirthYear="0" Role="Neytiri" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Sigourney" MiddleName="" LastName="Weaver" BirthYear="0" Role="Grace" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Stephen" MiddleName="" LastName="Lang" BirthYear="0" Role="Colonel Miles Quaritch" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Michelle" MiddleName="" LastName="Rodriguez" BirthYear="0" Role="Trudy Chacon" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Giovanni" MiddleName="" LastName="Ribisi" BirthYear="0" Role="Parker Selfridge" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Joel" MiddleName="" LastName="David Moore" BirthYear="0" Role="Norm Spellman" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="CCH" MiddleName="" LastName="Pounder" BirthYear="0" Role="Moat" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Wes" MiddleName="" LastName="Studi" BirthYear="0" Role="Eytukan" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Laz" MiddleName="" LastName="Alonso" BirthYear="0" Role="Tsu'tey" CreditedAs="" Voice="false" Uncredited="false"/>
</Actors>
<Overview>A reluctant hero. An epic journey. A choice between the life he left behind and the incredible new world he's learned to call home. Return to James Cameron's <i>AVATAR</i> — the greatest adventure of all time.</Overview>
<Discs>
<Disc>
<DescriptionSideA>Main Feature</DescriptionSideA>
<DescriptionSideB/>
<DiscIDSideA/>
<DiscIDSideB/>
<LabelSideA/>
<LabelSideB/>
<DualLayeredSideA>false</DualLayeredSideA>
<DualLayeredSideB>false</DualLayeredSideB>
<DualSided>false</DualSided>
<Location>BRC</Location>
<Slot>55</Slot>
</Disc>
</Discs>
<SortTitle>Avatar</SortTitle>
<LastEdited>2010-06-10T15:22:36.000Z</LastEdited>
<WishPriority>0</WishPriority>
<CountAs>1</CountAs>
<PurchaseInfo>
<PurchasePrice DenominationType="USD" DenominationDesc="United States (Dollar)" FormattedValue="$0.00">0</PurchasePrice>
<PurchasePlace/>
<PurchasePlaceType/>
<PurchasePlaceWebsite/>
<PurchaseDate>2010-04-23</PurchaseDate>
</PurchaseInfo>
<Review Film="0" Video="0" Audio="0" Extras="0"/>
<MediaBanners Front="Automatic" Back="Automatic"/>
<Events/>
<BoxSet>
<Parent/>
<Contents/>
</BoxSet>
<LoanInfo>
<Loaned>false</Loaned>
</LoanInfo>
<Tags/>
</DVD>
DVDprofiler does allow for plugins which could be written to put out the nfo format desired by the current scrapers.
To aid this community (and obviously myself) I would like to look at the writing of a scraper that deals with the exported DVDprofiler XML data base that has everything in it. If you can aid me in finding out how to write such a scraper (some one said the were just XML files themselves which has me confused, as ther must be some process going on) I would take a look at doing that.
Cover art for all disks in the collection are kept as jpg files in a folder whose location is well known. Each disks cover art file is named with the disks ID number with a suffix of f for front and b for back. Avatar's front cover is named 024543656135f.jpg.
For clarification, the following is what the DVDprofiler has in its XML output file for the movie Avatar (hoping the forum scanner leaves it intact):
<DVD>
<ProfileTimestamp>2010-05-17T12:41:58.000Z</ProfileTimestamp>
<ID>024543656135</ID>
<MediaTypes>
<DVD>true</DVD>
<HDDVD>false</HDDVD>
<BluRay>true</BluRay>
</MediaTypes>
<UPC>024543-656135</UPC>
<CollectionNumber>450</CollectionNumber>
<CollectionType>Owned</CollectionType>
<Title>Avatar</Title>
<DistTrait/>
<OriginalTitle/>
<CountryOfOrigin>United States</CountryOfOrigin>
<ProductionYear>2009</ProductionYear>
<Released>2010-04-22</Released>
<RunningTime>162</RunningTime>
<RatingSystem>Film</RatingSystem>
<Rating>PG-13</Rating>
<RatingAge>13</RatingAge>
<RatingVariant>0</RatingVariant>
<RatingDetails>Intense Epic Battle Sequences and Warfare, Sensuality, Language and Some Smoking</RatingDetails>
<CaseType>HD Slim</CaseType>
<CaseSlipCover>true</CaseSlipCover>
<Genres>
<Genre>Fantasy</Genre>
<Genre>Action</Genre>
<Genre>Adventure</Genre>
</Genres>
<Regions/>
<Format>
<FormatAspectRatio>1.78</FormatAspectRatio>
<FormatVideoStandard>NTSC</FormatVideoStandard>
<FormatLetterBox>true</FormatLetterBox>
<FormatPanAndScan>false</FormatPanAndScan>
<FormatFullFrame>false</FormatFullFrame>
<Format16X9>false</Format16X9>
<FormatDualSided>false</FormatDualSided>
<FormatDualLayered>false</FormatDualLayered>
</Format>
<Features>
<FeatureSceneAccess>true</FeatureSceneAccess>
<FeatureCommentary>false</FeatureCommentary>
<FeatureTrailer>false</FeatureTrailer>
<FeaturePhotoGallery>false</FeaturePhotoGallery>
<FeatureDeletedScenes>false</FeatureDeletedScenes>
<FeatureMakingOf>false</FeatureMakingOf>
<FeatureProductionNotes>false</FeatureProductionNotes>
<FeatureGame>false</FeatureGame>
<FeatureDVDROMContent>false</FeatureDVDROMContent>
<FeatureMultiAngle>false</FeatureMultiAngle>
<FeatureMusicVideos>false</FeatureMusicVideos>
<FeatureInterviews>false</FeatureInterviews>
<FeatureStoryboardComparisons>false</FeatureStoryboardComparisons>
<FeatureOuttakes>false</FeatureOuttakes>
<FeatureClosedCaptioned>false</FeatureClosedCaptioned>
<FeatureTHXCertified>true</FeatureTHXCertified>
<FeaturePIP>false</FeaturePIP>
<FeatureBDLive>false</FeatureBDLive>
<FeatureBonusTrailers>false</FeatureBonusTrailers>
<FeatureDigitalCopy>false</FeatureDigitalCopy>
<OtherFeatures/>
</Features>
<Studios>
<Studio>Twentieth Century Fox</Studio>
<Studio>Dune Entertainment</Studio>
<Studio>Ingenious Film Partners</Studio>
</Studios>
<MediaCompanies>
<MediaCompany>Twentieth Century Fox Home Entertainment</MediaCompany>
</MediaCompanies>
<Audio>
<AudioTrack>
<AudioContent>English</AudioContent>
<AudioFormat>DTS-HD Master Audio</AudioFormat>
<AudioChannels>5.1</AudioChannels>
</AudioTrack>
<AudioTrack>
<AudioContent>English</AudioContent>
<AudioFormat>Dolby Digital</AudioFormat>
<AudioChannels>Dolby Surround</AudioChannels>
</AudioTrack>
<AudioTrack>
<AudioContent>Audio Descriptive</AudioContent>
<AudioFormat>Dolby Digital</AudioFormat>
<AudioChannels>5.1</AudioChannels>
</AudioTrack>
<AudioTrack>
<AudioContent>Spanish</AudioContent>
<AudioFormat>Dolby Digital</AudioFormat>
<AudioChannels>5.1</AudioChannels>
</AudioTrack>
<AudioTrack>
<AudioContent>French</AudioContent>
<AudioFormat>Dolby Digital</AudioFormat>
<AudioChannels>5.1</AudioChannels>
</AudioTrack>
<AudioTrack>
<AudioContent>Portuguese</AudioContent>
<AudioFormat>Dolby Digital</AudioFormat>
<AudioChannels>5.1</AudioChannels>
</AudioTrack>
</Audio>
<Subtitles>
<Subtitle>English</Subtitle>
<Subtitle>Portuguese</Subtitle>
<Subtitle>Spanish</Subtitle>
</Subtitles>
<SRP DenominationType="USD" DenominationDesc="United States (Dollar)" FormattedValue="$39.99">39.99</SRP>
<Actors>
<Actor FirstName="Sam" MiddleName="" LastName="Worthington" BirthYear="0" Role="Jake Sully" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Zoë" MiddleName="" LastName="Saldana" BirthYear="0" Role="Neytiri" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Sigourney" MiddleName="" LastName="Weaver" BirthYear="0" Role="Grace" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Stephen" MiddleName="" LastName="Lang" BirthYear="0" Role="Colonel Miles Quaritch" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Michelle" MiddleName="" LastName="Rodriguez" BirthYear="0" Role="Trudy Chacon" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Giovanni" MiddleName="" LastName="Ribisi" BirthYear="0" Role="Parker Selfridge" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Joel" MiddleName="" LastName="David Moore" BirthYear="0" Role="Norm Spellman" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="CCH" MiddleName="" LastName="Pounder" BirthYear="0" Role="Moat" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Wes" MiddleName="" LastName="Studi" BirthYear="0" Role="Eytukan" CreditedAs="" Voice="false" Uncredited="false"/>
<Actor FirstName="Laz" MiddleName="" LastName="Alonso" BirthYear="0" Role="Tsu'tey" CreditedAs="" Voice="false" Uncredited="false"/>
</Actors>
<Overview>A reluctant hero. An epic journey. A choice between the life he left behind and the incredible new world he's learned to call home. Return to James Cameron's <i>AVATAR</i> — the greatest adventure of all time.</Overview>
<Discs>
<Disc>
<DescriptionSideA>Main Feature</DescriptionSideA>
<DescriptionSideB/>
<DiscIDSideA/>
<DiscIDSideB/>
<LabelSideA/>
<LabelSideB/>
<DualLayeredSideA>false</DualLayeredSideA>
<DualLayeredSideB>false</DualLayeredSideB>
<DualSided>false</DualSided>
<Location>BRC</Location>
<Slot>55</Slot>
</Disc>
</Discs>
<SortTitle>Avatar</SortTitle>
<LastEdited>2010-06-10T15:22:36.000Z</LastEdited>
<WishPriority>0</WishPriority>
<CountAs>1</CountAs>
<PurchaseInfo>
<PurchasePrice DenominationType="USD" DenominationDesc="United States (Dollar)" FormattedValue="$0.00">0</PurchasePrice>
<PurchasePlace/>
<PurchasePlaceType/>
<PurchasePlaceWebsite/>
<PurchaseDate>2010-04-23</PurchaseDate>
</PurchaseInfo>
<Review Film="0" Video="0" Audio="0" Extras="0"/>
<MediaBanners Front="Automatic" Back="Automatic"/>
<Events/>
<BoxSet>
<Parent/>
<Contents/>
</BoxSet>
<LoanInfo>
<Loaned>false</Loaned>
</LoanInfo>
<Tags/>
</DVD>
