(2021-02-21, 15:08)LongMan Wrote: MediaImport is not restricted to servers. Many users import strm files from Kodi Addons. I haven't checked Mezzmo but the other direct to database addons run into problems with such addons. With the plethora of streaming services, no Media server will be able to supply all the content desired by the user. Playing nicely with other addons is going to be important.

And yes the performance of Kodi's content infrastructure needs to be addressed. Right now there are at least seven persons/teams writing code to bypass it. Just wish that effort was used to addressed it. That's a lot of talent working on a problem without trying to solve it.

Cheers,
LongMan

Quote:It would be easy enough for me to modify the addon to create a strm file for the Mezzmo servers it discovers and provide the content URL etc..  for MediaImport.  Currently the addon does not create one.  Does MediaImport need anything specific or I just output a strm file for Kodi ?

(2021-02-27, 22:15)LongMan Wrote: @jbinkley60,
How far have you gotten with adding MediaImport support?

Cheers,
LongMan

(2021-02-28, 00:15)jbinkley60 Wrote: I started looking at it but due to other priorities didn't make much progress.  Aside from the code your provided is there some place where there is more documentation on the integration ?   Maybe because I don't run MediaImport I am missing how integration with the Mezzmo addon would work since it already imports all Mezzmo data into the Kodi database and plays nice with other data so it peacefully coexists with anything else, including any data which MediaImport adds to the database from other sources.  It verifies separation of the data by keying off of the path table entries.  The Mezzmo addon tracks its path table entries and only touches database entries which join to that data. 

(2021-02-28, 00:15)jbinkley60 Wrote: I started picking around looking at the JSON RPC documentation but most of it seems to be for controlling Kodi interface functions and I can't find much on using JSON RPC to add, change delete data in the Kodi database.

(2021-02-28, 00:15)jbinkley60 Wrote: Lastly, I thought MediaImport will find and discovers uPNP servers so I would think it will find a Mezzmo server and use its normal uPNP import methods ?  For the Mezzmo addon there are a few special calls in Mezzmo which allows the addon to leverage a bulk import from Mezzmo vs. walking the database tree but generic uPNP browsing of the Mezzmo data works with any uPNP client.

(2021-03-01, 12:13)Montellese Wrote: Media import would take care of this for you. You wouldn't have to write directly to the Kodi database (which is not well received when it comes to support) and you wouldn't have to take care of separating your media data from the rest of Kodi's database / library. The idea is that the add-on provides a way to connect to the media provider (Mezzmo server) through some custom settings and then the user can specify which media types (movies, tvshows, musicvideos) to import. Then Kodi calls the add-on to provide all media items of a specific media type. The add-on retrieves the items and passes them back to Kodi which takes care of synchronizing them into the database. Obviously there are some advanced concepts like partial synchronization etc. but this should give you a general idea.

Media import has nothing to do with JSON-RPC.

I haven't used the UPnP import for a while but the main problem with non-Kodi UPnP servers is that they often don't implement the Search functionality which is necessary to retrieve all media items of a specific media type. I had to add this functionality to Kodi when I started with media import because it didn't support it either. Furthermore UPnP is limited in the type of metadata it can provide.

(2021-03-01, 23:20)jbinkley60 Wrote: When I say separate in the Kodi database I simply mean I track records belonging to Mezzmo vs. not.  As far as the user goes, if they are displaying data from the native Kodi front end vs. using the Mezzmo addon GUI, they won't be able to tell the difference.  I believe this is similar to how it looks like MediaImport operates.  The Mezzmo addon just simply plays nice with other data and is a good citizen.  The JSON RPC comment was simply looking at moving from the current direct SQL access to JSON RPC to populate / maintain data which is what the Wiki says is preferred.  I've had minimal luck finding any documentation on this and would have concerns about performance.  This was just part of a conversation LongMan and I were having and not really related to MediaImporter other than I originally thought that is how MediaImprotter was updating the database.

(2021-03-01, 23:20)jbinkley60 Wrote: I've done some additional reading on the Wiki page and looking at the other importer addon code.  I have a better understanding of MediaImport in that it is native to the Kodi code and not another addon.  It uses an extension point for media provider addons.  I looked through some of the Emby code and many of the various functions it has Discovery, Import etc..  are already written in the Mezzmo addon but operate a bit differently due to having a GUI, leveraging some Mezzmo specific functions and similar.

(2021-03-01, 23:20)jbinkley60 Wrote: In addition there are a number of features in the Mezmo addon which are unique or operate differently.  Playcounts, bookmarks and such are passed back to the Mezzmo server for all clients to leverage.  Likewise you can mark watched and unwatched via the GUI and it sets it in the Mezzmo database for all clients.

(2021-03-01, 23:20)jbinkley60 Wrote: The GUI has view over rides so the user can remap a view to their preference overriding the default view for the media type.  The bookmarks are user adjustable for 0-30 seconds behind where you stop in case you want to rewatch the last few seconds.

(2021-03-01, 23:20)jbinkley60 Wrote: As mentioned earlier, full synchronization is built-in including detecting Mezzmo database metadata changes, a daily sync process and more.

(2021-03-01, 23:20)jbinkley60 Wrote: Because of all of this and other integrated functionality it would likely be better to write a new addon for MediaImporter and leverage code from the existing addon.  It's going to be a piece of work and I have a number of questions on how MediaImporter works and the interface to an addon.

(2021-03-01, 23:20)jbinkley60 Wrote: I'd also only do a Matrix version and not maintain 2 code versions.

(2021-03-01, 23:20)jbinkley60 Wrote: First, how are you handling uPNP server record deletions ?  I handle it in Mezzmo via a daily sync process which runs between midnight and 6AM.   The sync processes detects when nothing is playing and runs in the background.  The daily sync removes all Mezzmo records from the Kodi database and then does a new bulk import.  This takes care of deleted records.  I also detect duplicate records in the Mezzmo database.  I am unaware of uPNP servers having the ability to let you know of a deleted record so a full sync seemed to be the best option.  It also makes it nice if a client needs to be rebuilt or the Kodi DB goes haywire.  The addon rebuilds it as soon as it starts.  I am curious how you handle this ?

(2021-03-01, 23:20)jbinkley60 Wrote: Second, does MediaImporter take all of the metadata from the addon vs. rescraping the data ?  If so, what format is needed from the addon ?  The Mezzmo addon gets an XML response and parses it prior to adding to the Kodi database.  In looking at the Emby importer code it looks like you might be doing a field mapping but I can't tall what the exact structure is of the uPNP metadata going to MediaImporter.

• Media items can be imported from multiple providers (servers) coexisting. For each provider the user can create imports of specific media types.
  
• Media import uses generic interfaces everywhere: for importers, databases, media type handlers, ...
  
• The following media types can currently be imported:
  • movies and sets / collections
    
  • tvshows, seasons and episodes
    
  • music videos
    
• The following importers are currently supported:
  • UPnP (hardcoded in Kodi core)
    
  • add-ons (new extension point)
    
• A media importer can support the following features
  • automatic provider discovery
    
  • manual provider discovery (with user interaction)
    
  • full (and optionally partial) synchronization
    
  • observing imported providers / imports for changes and synchronizing them with the Kodi library
    
  • passing changes to imported media items from Kodi back to the media provider
    
• Add-on media importers can provide any other additional functionality which is not media import specific
  

(2021-03-02, 08:15)Montellese Wrote:  ?The UPnP media importer does not support partial synchronization. Also doing a full import every day would probably be too slow right now (but I'm currently looking into performance). The media import logic contains a lot of code to compare the already imported media items with the newly provided media items. It detects whether items have changed or have been added and removed and only makes the changes to the database which are necessary. If an item hasn't changed between imports it isn't touched. Right now there is no scheduled synchronization (identical to the "normal" library scan / update) but it would be very easy to add.

(2021-03-01, 23:20)jbinkley60 Wrote: Second, does MediaImporter take all of the metadata from the addon vs. rescraping the data ?  If so, what format is needed from the addon ?  The Mezzmo addon gets an XML response and parses it prior to adding to the Kodi database.  In looking at the Emby importer code it looks like you might be doing a field mapping but I can't tall what the exact structure is of the uPNP metadata going to MediaImporter.

Media importer add-ons must provide their media items as ListItems (see https://codedocs.xyz/AlwinEsch/kodi/group__python__xbmcgui__listitem.html). UPnP isn't involved and the media import logic doesn't care whether the information was originally retrieved as XML or JSON or anything else because it is the add-on's responsibility to transform this into a list of ListItems. In your Mezzmo add-on you currently take the XML and turn it into SQL queries. In a media importer add-on you turn it into ListItems.

As a general roundup I'm just putting out a few buzz words to try to describe the feature set of media importing:

• Media items can be imported from multiple providers (servers) coexisting. For each provider the user can create imports of specific media types.
  
• Media import uses generic interfaces everywhere: for importers, databases, media type handlers, ...
  
• The following media types can currently be imported:
  • movies and sets / collections
    
  • tvshows, seasons and episodes
    
  • music videos
    
• The following importers are currently supported:
  • UPnP (hardcoded in Kodi core)
    
  • add-ons (new extension point)
    
• A media importer can support the following features
  • automatic provider discovery
    
  • manual provider discovery (with user interaction)
    
  • full (and optionally partial) synchronization
    
  • observing imported providers / imports for changes and synchronizing them with the Kodi library
    
  • passing changes to imported media items from Kodi back to the media provider
    
• Add-on media importers can provide any other additional functionality which is not media import specific
  

(2021-03-02, 11:42)jbinkley60 Wrote: Thanks for the response.  I am still not following the how you handle deletions answer.  Are you marking each record in the database with a last seen timestamp or something similar and then via your synchronization process noting that a Kodi entry wasn't seen during the last media provider scan and thus removing it ?   I originally was going to take this approach in the Mezzmo addon but the full sync seemed easier and speed isn't a problem with the SQL interface. 

1. The media importer (add-on) does a full sync. Kodi then retrieves all previously imported media items and compares them with the list of "newly" provided media items. All items which are part of the list of already imported items but not part of the list of "newly" provided media items will then be removed from the database.
   
2. The media importer (add-on) detects that the media item has been removed from the server (Emby and Plex support this) and tells Kodi through the media importer interface that the item has been removed. It is then automatically removed from the database.
   

1. The media importer (add-on) simply provides a list of changed (added or updated) media items and Kodi determines which ones are new and which ones have changed. This approach does not support removing imported media items.
   
2. The media importer (add-on) provides a list of changed (added, updated or removed) media items with an additional flag for each item which specifies the type of change. Kodi then takes care of either adding, updating or removing the media items depending on the specified type of change.