Pictures database and library mode; scan EXIF and IPTC metadata tags into a SQL db

  Thread Rating:
  • 2 Votes - 5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Thread Closed
pedr0 Offline
Junior Member
Posts: 23
Joined: Feb 2011
Reputation: 0
Post: #331
Hi,

I'm having problems getting the scan to work (0 images found). I'm on XBMCbuntu Eden. Please could you tell me how to delete the database so I can start again.

Thanks.
find
Xycl Offline
Fan
Posts: 374
Joined: Feb 2012
Reputation: 7
Location: Germany
Post: #332
(2012-04-15 14:43)pedr0 Wrote:  Hi,

I'm having problems getting the scan to work (0 images found). I'm on XBMCbuntu Eden. Please could you tell me how to delete the database so I can start again.

Thanks.

The Database is in directory $HOME/.xbmc/userdata/Database and has the name MyPictures.db

No log no help.
How to submit a log file: XBMC-Wiki

Main page: https://github.com/Xycl
Repository: Xycl Repository
find
pedr0 Offline
Junior Member
Posts: 23
Joined: Feb 2011
Reputation: 0
Post: #333
(2012-04-15 16:41)Xycl Wrote:  The Database is in directory $HOME/.xbmc/userdata/Database and has the name MyPictures.db

Thanks.

I've been having trouble getting MyPicsDB to recognise my jpg files on an NFS network drive. But I've just re-read the op. Is it still the case that I need to mount network drives to a mount point (i.e. not just use the NFS in the Eden file browser list)?
find
Xycl Offline
Fan
Posts: 374
Joined: Feb 2012
Reputation: 7
Location: Germany
Post: #334
(2012-04-16 00:26)pedr0 Wrote:  I've been having trouble getting MyPicsDB to recognise my jpg files on an NFS network drive. But I've just re-read the op. Is it still the case that I need to mount network drives to a mount point (i.e. not just use the NFS in the Eden file browser list)?

You cannot connect to a network share from python because python uses the normal file functions.
E.g. you cannot
PHP Code:
ls nfs://ip-address/directory 
Therefore you must mount the share

2nd hint:
Don't use multipath sources!

No log no help.
How to submit a log file: XBMC-Wiki

Main page: https://github.com/Xycl
Repository: Xycl Repository
find
mgmartin Offline
Junior Member
Posts: 4
Joined: Mar 2012
Reputation: 0
Post: #335
(2012-04-10 11:34)Xycl Wrote:  [quote='mgmartin' pid='1070337' dateline='1333954155']
Still seems to have issues under Linux.
I have to trap exceptcions in the picentry={...stat...} code to successfully scan the folders.

Which directory permission is missing x or r?
I need it to know in order to test the plugin within a vmware linux.

The directory does not have "x".
find
Xycl Offline
Fan
Posts: 374
Joined: Feb 2012
Reputation: 7
Location: Germany
Exclamation  New repo location!
Post: #336
Repos changed their location!

Link to repository: repository.xycl.abandoned.dharma
Direct link to MyPicsDB: MyPicsDb version 0.6.7

No log no help.
How to submit a log file: XBMC-Wiki

Main page: https://github.com/Xycl
Repository: Xycl Repository
find
Xycl Offline
Fan
Posts: 374
Joined: Feb 2012
Reputation: 7
Location: Germany
Post: #337
Version 0.6.8 released.
Update: Browse by Tags menu. This shows you all stored tags in a submenu like Persons, Keywords etc. From there you can select the desired content of the tags.
Hint: The menu uses 3 new tables which are not filled! In order to rescan your pictures without modifying them you must remove the source directory and readd it.


Edit: Please give feedback about performance and desired but still missing tags. E.g. from XMP only the person tag is imported.

No log no help.
How to submit a log file: XBMC-Wiki

Main page: https://github.com/Xycl
Repository: Xycl Repository
(This post was last modified: 2012-04-25 10:32 by Xycl.)
find
fungify Offline
Senior Member
Posts: 146
Joined: Jul 2010
Reputation: 2
Post: #338
Rescanning all images as I'm writing this, and will report results tomorrow.

FFY
find
fungify Offline
Senior Member
Posts: 146
Joined: Jul 2010
Reputation: 2
Post: #339
Hi

First impression after a rescan is that it works as intended. I see a lot of different fields like GPS coordinates, caption, keywords and more. There seems to be errors with unicode characters in the caption field, but I will check this in more detail in a few hours.

Regarding the scanning of more XMP-fields - I did find this handy chart of the relationship between IPTC and XMP fields - it might prove useful?

[Image: 2cz5wqx.png]

(Found here: http://answers.microsoft.com/en-us/windo...56b83e05cd)

FFY
find
fungify Offline
Senior Member
Posts: 146
Joined: Jul 2010
Reputation: 2
Post: #340
OK - back with some feedback.

I would really like to see all the various keyword fields scanned as previously mentioned. Right now I have to manually copy all information from one field to another to get the keywords added to the addon.

Title / Description seems to not be unicode-converted correctly. Below is an example of one of the images.

This is what the image description looks like in the addon:
[Image: og9us1.png]

And this is the raw XMP-data - as viewed by the exif-viewer at http://regex.info/exif.cgi:
Code:
<?xpacket begin='' id='W5M0MpCehiHzreSzNTczkc9d'?>
<x:xmpmeta xmlns:x="adobe:ns:meta/"><rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
<rdf:Description rdf:about="uuid:faf5bdd5-ba3d-11da-ad31-d33d75182f1b" xmlns:dc="http://purl.org/dc/elements/1.1/">
<dc:subject><rdf:Bag xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"><rdf:li>
Ferie</rdf:li><rdf:li>Distortion Copenhagen 2011</rdf:li><rdf:li>Mærkedag/Bryllupsdag</rdf:li>
<rdf:li>Dyr/And</rdf:li></rdf:Bag>
            </dc:subject></rdf:Description><rdf:Description rdf:about="uuid:faf5bdd5-ba3d-11da-ad31-d33d75182f1b" xmlns:dc="http://purl.org/dc/elements/1.1/">
<dc:title><rdf:Alt xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"><rdf:li xml:lang="x-default">
10 års bryllupsdag i København</rdf:li></rdf:Alt>
            </dc:title><dc:description><rdf:Alt xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
<rdf:li xml:lang="x-default">10 års bryllupsdag i København</rdf:li></rdf:Alt>
            </dc:description></rdf:Description><rdf:Description rdf:about="uuid:faf5bdd5-ba3d-11da-ad31-d33d75182f1b" xmlns:MicrosoftPhoto="http://ns.microsoft.com/photo/1.0/">
<MicrosoftPhoto:LastKeywordXMP><rdf:Bag xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
<rdf:li>Ferie</rdf:li><rdf:li>Distortion Copenhagen 2011</rdf:li><rdf:li>Mærkedag/Bryllupsdag</rdf:li>
<rdf:li>Dyr/And</rdf:li></rdf:Bag>
            </MicrosoftPhoto:LastKeywordXMP><MicrosoftPhoto:LastKeywordIPTC><rdf:Bag xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
<rdf:li>Ferie</rdf:li><rdf:li>Distortion Copenhagen 2011</rdf:li><rdf:li>Mærkedag/Bryllupsdag</rdf:li>
<rdf:li>Dyr/And</rdf:li></rdf:Bag>
            </MicrosoftPhoto:LastKeywordIPTC></rdf:Description><rdf:Description rdf:about="uuid:faf5bdd5-ba3d-11da-ad31-d33d75182f1b" xmlns:MicrosoftPhoto="http://ns.microsoft.com/photo/1.0/"/>
<rdf:Description xmlns:Iptc4xmpExt="http://iptc.org/std/Iptc4xmpExt/2008-02-29/">
<Iptc4xmpExt:LocationCreated><rdf:Bag xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
<rdf:li><rdf:Description xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
<Iptc4xmpExt:CountryName xmlns:Iptc4xmpExt="http://iptc.org/std/Iptc4xmpExt/2008-02-29/">
Denmark</Iptc4xmpExt:CountryName><Iptc4xmpExt:ProvinceState xmlns:Iptc4xmpExt="http://iptc.org/std/Iptc4xmpExt/2008-02-29/">
Copenhagen City</Iptc4xmpExt:ProvinceState><Iptc4xmpExt:City xmlns:Iptc4xmpExt="http://iptc.org/std/Iptc4xmpExt/2008-02-29/">
Copenhagen</Iptc4xmpExt:City></rdf:Description>
                    </rdf:li></rdf:Bag>
            </Iptc4xmpExt:LocationCreated></rdf:Description></rdf:RDF></x:xmpmeta>
<?xpacket end='w'?>

FFY
find
Xycl Offline
Fan
Posts: 374
Joined: Feb 2012
Reputation: 7
Location: Germany
Post: #341
Hi Fungify,

please check your IPTC tags.
From XMP only the person tag is imported and the tag "<MicrosoftPhoto:LastKeywordIPTC>" is an XMP tag which is not used.

Arne

No log no help.
How to submit a log file: XBMC-Wiki

Main page: https://github.com/Xycl
Repository: Xycl Repository
find
fungify Offline
Senior Member
Posts: 146
Joined: Jul 2010
Reputation: 2
Post: #342
(2012-04-30 18:07)Xycl Wrote:  please check your IPTC tags.
From XMP only the person tag is imported and the tag "<MicrosoftPhoto:LastKeywordIPTC>" is an XMP tag which is not used.
I know - it was more a feature request than anything else. I would very much like for all of the keyword / tag fields to be scanned and combined into the database, as it seems that there is no singular standard, so it's pretty much hit or miss whether you favorite program stores the information in IPTC, XMP or maybe in a combination.

Concerning my woes with unicode in description: You are right. When looking at the field in Irfanview the field is displayed exactly as it is in the addon, but when extracting the information with other software, it looks all right. Yet another inconsistency to face I suppose Smile

Once again - thanks for continuing the addon. I do remember you boldly declaring your intentions to only fix the unicode problem and nothing else - yet you're still here and adding features and fixes. Thanks a lot.

FFY
find
Xycl Offline
Fan
Posts: 374
Joined: Feb 2012
Reputation: 7
Location: Germany
Post: #343
Hi Fungify,

two issues.

1)
Code:
<rdf:Description rdf:about="uuid:faf5bdd5-ba3d-11da-ad31-d33d75182f1b" xmlns:MicrosoftPhoto="http://ns.microsoft.com/photo/1.0/">
<MicrosoftPhoto:LastKeywordXMP><rdf:Bag xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
<rdf:li>Ferie</rdf:li><rdf:li>Distortion Copenhagen 2011</rdf:li><rdf:li>Mærkedag/Bryllupsdag</rdf:li>
<rdf:li>Dyr/And</rdf:li></rdf:Bag>
            </MicrosoftPhoto:LastKeywordXMP><MicrosoftPhoto:LastKeywordIPTC><rdf:Bag xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
<rdf:li>Ferie</rdf:li><rdf:li>Distortion Copenhagen 2011</rdf:li><rdf:li>Mærkedag/Bryllupsdag</rdf:li>
<rdf:li>Dyr/And</rdf:li></rdf:Bag>
In your example XMP RDF there two identical keyword lists. MicrosoftPhoto:LastKeywordXMP and MicrosoftPhoto:LastKeywordIPTC. Both lists contain the same keywords.
I dont't think that it makes sense to display a keyword twice for one picture only because it's in two different keyword lists, isn't it?

2) I entered
Code:
10 års bryllupsdag i København
into IrfanView as a keyword. MyPicsDB displayed it correctly. Then I added a second keyword with Microsoft Picture Gallery.
After that IrfanView shows
Code:
10 års bryllupsdag i København
but deleting, readding and rescanning the source in MyPicsDB still shows
Code:
10 års bryllupsdag i København;

That works because I modified the IPTC parser 2 months ago to first try utf-8 encoding. And if doesn't work (because of ascii codes higher than 128) the IPTC parser will use CP1252 (Windows Western Europe) encoding.

I don't know what's wrong with your picture.
My only explanation is that it is neither utf-8 nor cp1252 encoding.

No log no help.
How to submit a log file: XBMC-Wiki

Main page: https://github.com/Xycl
Repository: Xycl Repository
find
Joooonaaaas Offline
Junior Member
Posts: 6
Joined: May 2012
Reputation: 0
Post: #344
Hi,
Just recently installed the my pictures database to get a convenient interface for browsing my photos. Problem is that my xbmc is installed on an apple tv 2 and my pictures are stored on a NAS. First I tried to scan the pictures of the NAS folders through the xbmc addon interface without success, then I found a post in this forum saying that you need to mount network drives to get the addon to index the pictures correctly. I tried moving a few pictures locally and tried again and this time it worked.

Unfortunately I can not move all my photos to the apple tv and I have no idea how to mount the NAS folders on my appleTV installation, if I could be done at all.

I assume the setup with an ATV and a picture library stored in another network location is a pretty common one, so I really hope there is a solution...

Any hints would be highly appreciated.

Many thanks,
Jonas
find
Xycl Offline
Fan
Posts: 374
Joined: Feb 2012
Reputation: 7
Location: Germany
Post: #345
1) XBMC is able to connect to net shares. But, every add-on written in Python must use the normal Python file functions to access remote directories or files because XBMC doesn't make the remote file function calls availble!

That means that Windows is the only OS where Python add-ons can access remote files because of notation \\server\share\file. And even this only works when your local XBMC user has access rights on the NAS because you cannot pass user & password information with this notation.

For every UNIX OS like Linux or MacOS you must mount the net shares in order to access them from Python add-ons.

2) I don't own an ATV but I read that you should use the Zeroconf Browser to mount AFP shares because there is no Samba client for ATV. Of course, this is only possible with a NAS which supports AFP.

No log no help.
How to submit a log file: XBMC-Wiki

Main page: https://github.com/Xycl
Repository: Xycl Repository
find
Thread Closed