Kodi Community Forum

Full Version: Light IMDb Ratings Update 5.1.3
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
(2017-09-21, 15:45)dziobak Wrote: [ -> ]
(2017-09-21, 15:00)axlt2002 Wrote: [ -> ]Ok, I understand the point now and static build seems to be the way to go. What is just still confusing me is that changing the version of LibreELEC made such error appears...may be the 8.1.1 is missing some libraries wrt 8.0.2? Anyway...

ldd shows every binary dependecies and lack of libraries

i.e. on my RPi

PHP Code:
LibreELEC (official): 8.1.1 (RPi2.arm)
PiBob:~ # ldd /usr/bin/python
        
linux-vdso.so.1 (0x7eca4000)
        /
usr/lib/libarmmem.so (0x76ebf000)
        
libpython2.7.so.1.0 => /usr/lib/libpython2.7.so.1.0 (0x76d2d000)
        
libc.so.6 => /usr/lib/libc.so.6 (0x76bf6000)
        
libpthread.so.0 => /usr/lib/libpthread.so.0 (0x76bce000)
        
libdl.so.2 => /usr/lib/libdl.so.2 (0x76bbb000)
        
libutil.so.1 => /usr/lib/libutil.so.1 (0x76ba8000)
        
libm.so.6 => /usr/lib/libm.so.6 (0x76b2a000)
        /
lib/ld-linux-armhf.so.3 (0x76ed4000

About libraries in 8.1.1 vs 8.0.2 - missing or changing to other - PHP are full of modules and dependencies on other system components. If something was replaced ...
ldd on php-cgi shows dependencies

OK, more testing done and seems like the problem has been found (altough the solution...?)

Here is the ldd command executed on the php-cgi provided by the addon on libreelec 8.1.2 AKA Krypton 17.4:

# ldd /storage/.kodi/userdata/addon_data/script.light.imdb.ratings.update/php-binary/php-cgi
        linux-vdso.so.1 (0x00007ffec07cd000)
        libcurl.so.4 => /usr/lib/libcurl.so.4 (0x00007f79260f4000)
        libssl.so.39 => not found
        libcrypto.so.38 => not found
        libz.so.1 => /usr/lib/libz.so.1 (0x00007f7926565000)
        libm.so.6 => /usr/lib/libm.so.6 (0x00007f7925df0000)
        libc.so.6 => /usr/lib/libc.so.6 (0x00007f7925a58000)
        libssl.so.1.0.0 => /usr/lib/libssl.so.1.0.0 (0x00007f79264f1000)
        libcrypto.so.1.0.0 => /usr/lib/libcrypto.so.1.0.0 (0x00007f79257e4000)
        librt.so.1 => /usr/lib/librt.so.1 (0x00007f79255dc000)
        libpthread.so.0 => /usr/lib/libpthread.so.0 (0x00007f79253bf000)
        /lib64/ld-linux-x86-64.so.2 (0x00007f792635b000)
        libdl.so.2 => /usr/lib/libdl.so.2 (0x00007f79251bb000)

2 libraries missing

Here is the ldd command executed on the other php-cgi provided by axlt on libreelec 8.1.2 AKA Krypton 17.4:

        linux-vdso.so.1 (0x00007ffeabf6e000)
        libresolv.so.2 => /usr/lib/libresolv.so.2 (0x00007fcb3444a000)
        libreadline.so.7 => not found
        libz.so.1 => /usr/lib/libz.so.1 (0x00007fcb3486d000)
        libpcre.so.1 => not found
        libm.so.6 => /usr/lib/libm.so.6 (0x00007fcb34146000)
        libdl.so.2 => /usr/lib/libdl.so.2 (0x00007fcb33f42000)
        libxml2.so.2 => /usr/lib/libxml2.so.2 (0x00007fcb33c1a000)
        libssl.so.1.1 => not found
        libcrypto.so.1.1 => not found
        libc.so.6 => /usr/lib/libc.so.6 (0x00007fcb33882000)
        /lib64/ld-linux-x86-64.so.2 (0x00007fcb34661000)

4 libraries missing

I think this cgi file is not the correct one anyway.

----

Both php-cgi produce no other results (still speed-scanning through all the collection)
Hi djhifi,

Nice to read from you after the long period in which the forum was down. And it seems that you didn't loose the optimism to find a solution...

Well, this is valid also for me...I'm currently working on an almost completely reviewed version of the add-on...I'm just proceeding at small steps due to a really busy period at work...but, please, stay tuned!  Wink
djhifi,
while waiting for new version of add-on you can try of php-cgi static build, that I found here:
http://blog.arak.ro/statically-compile-php/
xz util for this archive here:
https://tukaani.org/xz/
(2017-10-10, 09:38)axlt2002 Wrote: [ -> ]Hi djhifi,

Nice to read from you after the long period in which the forum was down. And it seems that you didn't loose the optimism to find a solution...

Well, this is valid also for me...I'm currently working on an almost completely reviewed version of the add-on...I'm just proceeding at small steps due to a really busy period at work...but, please, stay tuned!  Wink

I never lose hope and this feature of ratings update IMO should already come on KODI thats why I invest so much time into it. Are you adding the new libraries and PHP on the upcoming version? I will do further testing

(2017-10-10, 10:53)dziobak Wrote: [ -> ]djhifi,
while waiting for new version of add-on you can try of php-cgi static build, that I found here:
http://blog.arak.ro/statically-compile-php/
xz util for this archive here:
https://tukaani.org/xz/

Thanks mate, will test it and report back. I just have 1 question, I extract the .tar file in the libreelec filesystem? inside the /usr/lib? If that's the case I think I will have to mount the folder because I currently cannot access it via SMB on my PC.

and also do I need to chmod +x that static php?
(2017-10-11, 16:00)djhifi Wrote: [ -> ]Thanks mate, will test it and report back. I just have 1 question, I extract the .tar file in the libreelec filesystem? inside the /usr/lib? If that's the case I think I will have to mount the folder because I currently cannot access it via SMB on my PC.

and also do I need to chmod +x that static php?

This is direct link: http://blog.arak.ro/download/php-cgi.xz
xz is not tar, this is different archive type, on LibreELEC use xz -d FILE
inside is one file only (php-cgi), put this in old place and chmod +x

simple steps: shell, go to destination directory, use
wget http://blog.arak.ro/download/php-cgi.xz
then
xz -d php-cgi.xz
and then
chmod +x php-cgi
(2017-10-12, 01:12)dziobak Wrote: [ -> ]
(2017-10-11, 16:00)djhifi Wrote: [ -> ]Thanks mate, will test it and report back. I just have 1 question, I extract the .tar file in the libreelec filesystem? inside the /usr/lib? If that's the case I think I will have to mount the folder because I currently cannot access it via SMB on my PC.

and also do I need to chmod +x that static php?

This is direct link: http://blog.arak.ro/download/php-cgi.xz
xz is not tar, this is different archive type, on LibreELEC use xz -d FILE
inside is one file only (php-cgi), put this in old place and chmod +x

simple steps: shell, go to destination directory, use
wget http://blog.arak.ro/download/php-cgi.xz
then
xz -d php-cgi.xz
and then
chmod +x php-cgi

"xz is not tar, this is different archive type" i thought I needed to download "xz-5.2.3.tar.gz"

So you advise doing everything via SSH and not mounting destination directory but rather "wget" is that it?

And if I want to revert the changes when axlt launches the new version of the addon? They auto-replace once I install the new version?
(2017-10-12, 01:50)djhifi Wrote: [ -> ]"xz is not tar, this is different archive type" i thought I needed to download "xz-5.2.3.tar.gz"

So you advise doing everything via SSH and not mounting destination directory but rather "wget" is that it?

And if I want to revert the changes when axlt launches the new version of the addon? They auto-replace once I install the new version?

xz is in place for LibreELEC, so simple - use it, like wget

I think that new version of add-on will not use php at all.
(2017-10-12, 19:40)dziobak Wrote: [ -> ]I think that new version of add-on will not use php at all.
Angel Wink
I think I will wait until the new version of this addon is out until further testing. If php is going to be removed I probably wont lose more time trying to figure out what is happening?

EDIT:

Anyway, I've done how dziobak suggested and installed the static php linked by him, ldd still reports the same missing libraries:
# ldd php-cgi
linux-vdso.so.1 (0x00007fff059a1000)
libcurl.so.4 => /usr/lib/libcurl.so.4 (0x00007fbf2ff4a000)
libssl.so.39 => not found
libcrypto.so.38 => not found
libz.so.1 => /usr/lib/libz.so.1 (0x00007fbf303bb000)
libm.so.6 => /usr/lib/libm.so.6 (0x00007fbf2fc46000)
libc.so.6 => /usr/lib/libc.so.6 (0x00007fbf2f8ae000)
libssl.so.1.0.0 => /usr/lib/libssl.so.1.0.0 (0x00007fbf30347000)
libcrypto.so.1.0.0 => /usr/lib/libcrypto.so.1.0.0 (0x00007fbf2f63a000)
librt.so.1 => /usr/lib/librt.so.1 (0x00007fbf2f432000)
libpthread.so.0 => /usr/lib/libpthread.so.0 (0x00007fbf2f215000)
/lib64/ld-linux-x86-64.so.2 (0x00007fbf301b1000)
libdl.so.2 => /usr/lib/libdl.so.2 (0x00007fbf2f011000)


Im almost giving up. This is maybe related to libraries uninstalled by libreelec? You really need to move away from php mate Big Grin
Hi guys,

I'm proud to announce the new release of Light IMDb Ratings Upate! And this thime it is lighter than ever!

Hereafter the changelog related to the new version 3.0.0:

  • New IMDb scraper based on python (removed PHP)
  • Added manual update from the Home menu (under Add-on sub-menu)
  • Added update of single Movie/TV Show/Season/Episode through context menu
  • Added TV Shows/Episodes IMDb ID retrieval from TheTVDB.com (need API key)
  • Added check to avoid multiple concurrent updates
  • Fixed IMDb ID check for Episodes
  • Revised all logging messages

I have also edited the first post of this thread to explain the new functionalities I have introduced. So, please take a look to it before starting to "blindly" use the add-on. Hope you will appreciate and enjoy the huge work done to further improve Light IMDb Ratings Update! In case, consider my signature below...  Wink
(2017-10-18, 17:04)axlt2002 Wrote: [ -> ]Hi guys,

I'm proud to announce the new release of Light IMDb Ratings Upate! And this thime it is lighter than ever!

Hereafter the changelog related to the new version 3.0.0:

  • New IMDb scraper based on python (removed PHP)
  • Added manual update from the Home menu (under Add-on sub-menu)
  • Added update of single Movie/TV Show/Season/Episode through context menu
  • Added TV Shows/Episodes IMDb ID retrieval from TheTVDB.com (need API key)
  • Added check to avoid multiple concurrent updates
  • Fixed IMDb ID check for Episodes
  • Revised all logging messages

I have also edited the first post of this thread to explain the new functionalities I have introduced. So, please take a look to it before starting to "blindly" use the add-on. Hope you will appreciate and enjoy the huge work done to further improve Light IMDb Ratings Update! In case, consider my signature below...  Wink

Nod Nod Nod Nod

So far is updating my LARRRRGEEEE collection with success! Still halfway in movies only tough. And no TV Shows yet.

What does the "obtain IMDB ID from themoviedb" does? Is this some form of "manually" identifying the movie/tv show like the other addon by max1m did?

"Added update of single Movie/TV Show/Season/Episode through context menu" -----> THANK YOU!!!

This addon should be in the official kodi repo! and/or come pre-installed with kodi. Now if only skin.helper.script had the ability to include updates from Rotten Tomatoes yet...
(2017-10-18, 18:15)djhifi Wrote: [ -> ]
(2017-10-18, 17:04)axlt2002 Wrote: [ -> ]Hi guys,

I'm proud to announce the new release of Light IMDb Ratings Upate! And this thime it is lighter than ever!

Hereafter the changelog related to the new version 3.0.0:

  • New IMDb scraper based on python (removed PHP)
  • Added manual update from the Home menu (under Add-on sub-menu)
  • Added update of single Movie/TV Show/Season/Episode through context menu
  • Added TV Shows/Episodes IMDb ID retrieval from TheTVDB.com (need API key)
  • Added check to avoid multiple concurrent updates
  • Fixed IMDb ID check for Episodes
  • Revised all logging messages

I have also edited the first post of this thread to explain the new functionalities I have introduced. So, please take a look to it before starting to "blindly" use the add-on. Hope you will appreciate and enjoy the huge work done to further improve Light IMDb Ratings Update! In case, consider my signature below...  Wink

Nod Nod Nod Nod

So far is updating my LARRRRGEEEE collection with success! Still halfway in movies only tough. And no TV Shows yet.

What does the "obtain IMDB ID from themoviedb" does? Is this some form of "manually" identifying the movie/tv show like the other addon by max1m did?

"Added update of single Movie/TV Show/Season/Episode through context menu" -----> THANK YOU!!!

This addon should be in the official kodi repo! and/or come pre-installed with kodi. Now if only skin.helper.script had the ability to include updates from Rotten Tomatoes yet...

Hi djhifi,

I'm happy that you appreciated the new version!  Nod

About "Obtain IMDb ID from TheTVDB.com"...please refer to the text I have highlighted in bold purple in my message above... Wink 

Have a great day!

Alex
Great Alex, good work.

First debug info, about 20% progress in my library then socket timeout and addon stopped (we need exception handling?)

https://pastebin.com/dnpxE3dv
So far is working OK. I would ask if possible to be introduced a "resume" feature? I have a big collection..:p
I've checked other addons for Kodi, two things:
1. socket.setdefaulttimeout(60) - this can help when IMDB is chocked (I think that default is 10 seconds only)
2. API key for TheTVDB - this is key for app, not for user - in other addons (like tv.show.next.aired) key is one and put inside code

------
ad.1
I put this line in imdb_scraper.py, but this not resolving problem with timeout (another test gives timeout on 15% of library parsing)