Kodi Community Forum
WIP Media importing and library integration (UPnP, Emby, Plex, ...) - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Development (https://forum.kodi.tv/forumdisplay.php?fid=32)
+--- Forum: Kodi Application (https://forum.kodi.tv/forumdisplay.php?fid=93)
+--- Thread: WIP Media importing and library integration (UPnP, Emby, Plex, ...) (/showthread.php?tid=224794)



RE: Media importing and library integration (UPnP, Emby, Plex, ...) - flubshi - 2021-03-18

(2021-03-18, 10:08)LongMan Wrote: Maybe not a conflict but I think any changes to the build has to be done with a patch. I don't quite understand how yet.

Did you run a clean build? If I remember correctly, I did a clean build or cleaned at least the kodi and skin package. See here: https://libreelec.wiki/development-1/build-basics#cleaning


RE: Media importing and library integration (UPnP, Emby, Plex, ...) - LongMan - 2021-03-18

@flubshi,
I will give that a try when I get home.
On another Note What do you think of adding a mediaimport extension point to one of the following script or addon and in so doing allow any Kodi Video addon to have access to MediaImport.
Library Integration Tool
Add to Lib
Osmosis

Cheers,
LongMan


RE: Media importing and library integration (UPnP, Emby, Plex, ...) - Montellese - 2021-03-19

I've taken a quick look at these add-ons:
  • Library Integration Tool is still Python 2 and not Matrix compatible. There hasn't been any real update since August 2018.
  • Add to Lib is still Python 2 and not Matrix compatible. It also hasn't been updated since December 2016 which is a long time ago.
  • I haven't found a lot of information on Osmosis. It seems to be Matrix compatible but it doesn't even have an official support thread in our official forums.



RE: Media importing and library integration (UPnP, Emby, Plex, ...) - LongMan - 2021-03-19

Yeah. I gave Library Integration Tool a spin on Leia and Osmosis on Matrix, a MedaImport Build actually. I actually was looking more at the  user experience. I am not really fan of the Osmosis approach, one has to enter Osmosis to export an item, you cannot export from each video addon. With Library Integration Tool, the 'Add to Library" menu entry is present in each video addon, so one can export from within each addon and I prefer that.

I am aware of the state of the addons, @kingkiller mentioned looking into updating Library Integration Tool. Hope he gets a chance to do it.


RE: Media importing and library integration (UPnP, Emby, Plex, ...) - jmh2002 - 2021-03-19

Just a note, @kingkiller / luizoti has been doing updates to Library Integration tool. There is quite a lot of discussion in the last few pages of the official thread.

And here is his own GitHub link: https://github.com/luizoti/script.library.integration.tool


RE: Media importing and library integration (UPnP, Emby, Plex, ...) - LongMan - 2021-03-19

Quote:Did you run a clean build? If I remember correctly, I did a clean build or cleaned at least the kodi and skin package. See here: https://libreelec.wiki/development-1/bui...s#cleaning
Thanks. That did the trick.


RE: Media importing and library integration (UPnP, Emby, Plex, ...) - Croneter - 2021-03-19

(2021-03-15, 18:21)webmaher Wrote:
(2021-03-15, 13:54)Montellese Wrote:
(2021-03-10, 22:47)Croneter Wrote: I'd think that PlexKodiConnect is a couple of magnitudes faster than that, though I can't test on a large library. Took months to improve... Have you looked at its code, specifically the MySQL and Plex metadata retrieval part?

@Croneter I took a closer look at what python-plexapi does and it first retrieves a list of 100 items (specified by mediaimporter.plex) and then retrieves the metadata for every item separately. I did some manual testing and couldn't figure out how to retrieve multiple items from a library section with all necessary metadata (cast, media parts, ...). How do you do that as part of PKC?

With PKC tested last time with KOdi Matrix beta and import over 20k movies and 243k episodes in 40 minutes... but at the end no chance to import last maybe 300 movies... 
That was a while ago while Kodi Matrix was still beta  - PlexKodiConnect should now function just fine!


RE: Media importing and library integration (UPnP, Emby, Plex, ...) - Supersilver - 2021-03-19

(2021-03-17, 14:29)Montellese Wrote: I've released new test builds which contain
  • small performance improvements to the Python API which should benefit the performance of retrieving media items from Emby / Plex servers
  • major performance improvements (factor 4) when adding actors to the video database

Downloads: https://github.com/Montellese/xbmc/wiki/Downloads#downloads
Changelog: https://github.com/Montellese/xbmc/wiki/Downloads#kodi-v19-performance-v2
Tried with the updated build, put it on before I went to bed and woke up to an error, here's the log if you can make anything from it

https://paste.kodi.tv/urajemejel


RE: Media importing and library integration (UPnP, Emby, Plex, ...) - Montellese - 2021-03-19

(2021-03-19, 12:39)Supersilver Wrote:
(2021-03-17, 14:29)Montellese Wrote: I've released new test builds which contain
  • small performance improvements to the Python API which should benefit the performance of retrieving media items from Emby / Plex servers
  • major performance improvements (factor 4) when adding actors to the video database

Downloads: https://github.com/Montellese/xbmc/wiki/Downloads#downloads
Changelog: https://github.com/Montellese/xbmc/wiki/Downloads#kodi-v19-performance-v2
Tried with the updated build, put it on before I went to bed and woke up to an error, here's the log if you can make anything from it

https://paste.kodi.tv/urajemejel
Thanks for the feedback. It looks like the following happened:
  • It checked for changes to your movie library and synchronized 6 updated movies.
  • It retrieved all 9062 tvshows from your library in 25 minutes
  • It retrieved all 21377 season from your library in 48 minutes
  • It tried to import all your episodes but after 3h and 33 minutes a connection error occured and the import process was aborted.
This matches your assumption with the mobile broadband connection not being rock solid.

When I get some time I will try to introduce some handling for this by retrying the connection that failed 2 or 3 times. I will also throw in the parallelization I'm working on for mediaimporter.plex which improved the performance of importing 9k movies by a factor 4 and now takes 9 minutes.


RE: Media importing and library integration (UPnP, Emby, Plex, ...) - webmaher - 2021-03-19

i have almost the same problems but my internet connection is 99,99% OK... when you finished new plex importer i try again...


RE: Media importing and library integration (UPnP, Emby, Plex, ...) - Montellese - 2021-03-19

(2021-03-19, 14:49)webmaher Wrote: i have almost the same problems but my internet connection is 99,99% OK... when you finished new plex importer i try again...
Odd. Before I made any of the performance improvements I imported a movie library with 9k movies and a tvshow library with almost 2k tvshows and while it took about 16 hours to import everything it worked without a problem. And it wasn't from a local PMS so connection hickups might occur as well.


RE: Media importing and library integration (UPnP, Emby, Plex, ...) - LongMan - 2021-03-19

@Montellese
Quote:CastagnaIT commented 3 hours ago
i tried use the mentioned installer for w64 but i think is broken all python scripts fails to install/update and if i copy an existing user data from a working copy of kodi, all addons are without logo and strange things happen when i run netflix...



RE: Media importing and library integration (UPnP, Emby, Plex, ...) - LongMan - 2021-03-19

@CastagnaIT,
i just tried Netflix and it installed and played fine. It did give a popup that Addon Signals was not compatible but it played a movie in spite of that.


RE: Media importing and library integration (UPnP, Emby, Plex, ...) - Supersilver - 2021-03-19

(2021-03-19, 14:29)Montellese Wrote:
(2021-03-19, 12:39)Supersilver Wrote:
(2021-03-17, 14:29)Montellese Wrote: I've released new test builds which contain
  • small performance improvements to the Python API which should benefit the performance of retrieving media items from Emby / Plex servers
  • major performance improvements (factor 4) when adding actors to the video database

Downloads: https://github.com/Montellese/xbmc/wiki/Downloads#downloads
Changelog: https://github.com/Montellese/xbmc/wiki/Downloads#kodi-v19-performance-v2
Tried with the updated build, put it on before I went to bed and woke up to an error, here's the log if you can make anything from it

https://paste.kodi.tv/urajemejel
Thanks for the feedback. It looks like the following happened:
  • It checked for changes to your movie library and synchronized 6 updated movies.
  • It retrieved all 9062 tvshows from your library in 25 minutes
  • It retrieved all 21377 season from your library in 48 minutes
  • It tried to import all your episodes but after 3h and 33 minutes a connection error occured and the import process was aborted.
This matches your assumption with the mobile broadband connection not being rock solid.

When I get some time I will try to introduce some handling for this by retrying the connection that failed 2 or 3 times. I will also throw in the parallelization I'm working on for mediaimporter.plex which improved the performance of importing 9k movies by a factor 4 and now takes 9 minutes.
Ah damn thought my broadband would be able to do it that time haha thanks for letting me know what happened, I'll be sure to try on the next update cheers


RE: Media importing and library integration (UPnP, Emby, Plex, ...) - Montellese - 2021-03-19

(2021-03-19, 19:13)LongMan Wrote: @CastagnaIT,
i just tried Netflix and it installed and played fine. It did give a popup that Addon Signals was not compatible but it played a movie in spite of that.
Same for me I tried with Tubed and some other video add-ons and everything plays fine on my Windows 10 machine. Media Import works as well.


This forum uses Lukasz Tkacz MyBB addons.