Kodi Community Forum

@axlt2002, no worries, and enjoy your vacation!  

NumberOfThreads: 8. Today, I only see 1/3 of the errors in the file. Most of the errors today are 403 or 503. I have no problem accessing the IMDB website in the same timeframe. I will continue to run in the next few days to see if the issue is somehow connected to the number of total queries.

(2023-07-06, 05:36)jsmith432 Wrote: [ -> ]@axlt2002, no worries, and enjoy your vacation!  

NumberOfThreads: 8. Today, I only see 1/3 of the errors in the file. Most of the errors today are 403 or 503. I have no problem accessing the IMDB website in the same timeframe. I will continue to run in the next few days to see if the issue is somehow connected to the number of total queries.

Code:


The Game (IMDb ID: tt0119174, TVDB ID: n/a, TMDB ID: 2649)
Method get_page - https://www.imdb.com/title/tt0119174/ -> Error accessing IMDb site (403 Forbidden)

Sing 2 (IMDb ID: tt6467266, TVDB ID: n/a, TMDB ID: 438695)
Method get_page - https://www.imdb.com/title/tt6467266/ -> Error accessing IMDb site (403 Forbidden)

The Girl King (IMDb ID: tt1254322, TVDB ID: n/a, TMDB ID: 329829)
Method get_page - https://www.imdb.com/title/tt1254322/ -> Error accessing IMDb site (503 Service Unavailable)

The Girl in the Spider's Web (IMDb ID: tt5177088, TVDB ID: n/a, TMDB ID: 446807)
Method get_page - https://www.imdb.com/title/tt5177088/ -> Error accessing IMDb site (403 Forbidden)

The Girl Next Door (IMDb ID: tt0265208, TVDB ID: n/a, TMDB ID: 10591)
Method get_page - https://www.imdb.com/title/tt0265208/ -> Error accessing IMDb site (503 Service Unavailable)


Hello!

Have you tried again and checked if the issue persists? Can you also try to run the update with just 4 threads and check if there is any difference? Please, let me know.

Cheers!

@axlt2002, all good now. Thank you!

I had the same thought and tried with four threads yesterday; the log was much smaller (error-wise). Today I had my first clean run—no issues with movies. I will try with TV shows, but for me, this is resolved. 

The number of threads and items remaining for an update might be factors here as the log kept going smaller daily, but it is pure conjecture on my part.

For the last x weeks (I don't know what x is, but more than 4) when my scheduled thing runs on Friday I get a no internet connection error.  There is definitely internet.  If I try to manually update one series (via the context menu), same thing.

(2023-07-08, 01:59)michaeljc70 Wrote: [ -> ]For the last x weeks (I don't know what x is, but more than 4) when my scheduled thing runs on Friday I get a no internet connection error.  There is definitely internet.  If I try to manually update one series (via the context menu), same thing.

Hi @michaeljc70, thanks for your post.

What the add-on just does is to send a request to the address https://www.imdb.com. It looks strange you are the only one reporting bout this issue in 4 weeks...is the problem still persisting? Have you tried to access the site through the browser? Do you have any VPN running?

Let me know.

Alex

(2023-07-10, 09:13)axlt2002 Wrote: [ -> ]

(2023-07-08, 01:59)michaeljc70 Wrote: [ -> ]For the last x weeks (I don't know what x is, but more than 4) when my scheduled thing runs on Friday I get a no internet connection error.  There is definitely internet.  If I try to manually update one series (via the context menu), same thing.

Hi @michaeljc70, thanks for your post.

What the add-on just does is to send a request to the address https://www.imdb.com. It looks strange you are the only one reporting bout this issue in 4 weeks...is the problem still persisting? Have you tried to access the site through the browser? Do you have any VPN running?

Let me know.

Alex

I don't have a VPN running.  I'm still getting the error. I tried reducing the number of threads.  There is nothing in the log after I enabled logging at the time of the error.  Do I need component level logging?

(2023-07-19, 22:31)michaeljc70 Wrote: [ -> ]

(2023-07-10, 09:13)axlt2002 Wrote: [ -> ]

(2023-07-08, 01:59)michaeljc70 Wrote: [ -> ]For the last x weeks (I don't know what x is, but more than 4) when my scheduled thing runs on Friday I get a no internet connection error.  There is definitely internet.  If I try to manually update one series (via the context menu), same thing.

Hi @michaeljc70, thanks for your post.

What the add-on just does is to send a request to the address https://www.imdb.com. It looks strange you are the only one reporting bout this issue in 4 weeks...is the problem still persisting? Have you tried to access the site through the browser? Do you have any VPN running?

Let me know.

Alex

I don't have a VPN running.  I'm still getting the error. I tried reducing the number of threads.  There is nothing in the log after I enabled logging at the time of the error.  Do I need component level logging?

Hello, I'm sorry to read that the issue is still persisting. I have just tried with a ratings update and everything went smoothly. Unfortunately there is nothing you can enable at the component level logging, or at least I don't see anything that can be related to network/Internet stuffs.

One thing we can try is the following: look for the file "httptools.py" in the "support" folder inside the installation folder of the add-on; then edit the function "def internet():" at line 50 to always return True. This will bypass the Internet connection check so we can take a look to what is happening when accessing the imdb site for the ratings update (that part of the code manages the exceptions so that we can understand better what is going on...hopefully!).

Waiting for news! 

(2023-07-20, 13:21)axlt2002 Wrote: [ -> ]

(2023-07-19, 22:31)michaeljc70 Wrote: [ -> ]

(2023-07-10, 09:13)axlt2002 Wrote: [ -> ]Hi @michaeljc70, thanks for your post.

What the add-on just does is to send a request to the address https://www.imdb.com. It looks strange you are the only one reporting bout this issue in 4 weeks...is the problem still persisting? Have you tried to access the site through the browser? Do you have any VPN running?

Let me know.

Alex

I don't have a VPN running.  I'm still getting the error. I tried reducing the number of threads.  There is nothing in the log after I enabled logging at the time of the error.  Do I need component level logging?

Hello, I'm sorry to read that the issue is still persisting. I have just tried with a ratings update and everything went smoothly. Unfortunately there is nothing you can enable at the component level logging, or at least I don't see anything that can be related to network/Internet stuffs.

One thing we can try is the following: look for the file "httptools.py" in the "support" folder inside the installation folder of the add-on; then edit the function "def internet():" at line 50 to always return True. This will bypass the Internet connection check so we can take a look to what is happening when accessing the imdb site for the ratings update (that part of the code manages the exceptions so that we can understand better what is going on...hopefully!).

Waiting for news! 

Thanks for the help.  I am not seeing a support folder.  I see a resources folder, context.py,  main.py and service.py.  I am looking in addons/script.lite.imdb.ratings.update. Am I in the wrong place?

EDIT:  I should have done this in the first place, but I uninstalled the add-on and reinstalled it and it is working fine.  I think I had an older version and erroneously though it would auto update since auto update is on.  Since I installed it from a zip, I don't think it can auto update.

(2023-07-20, 14:16)michaeljc70 Wrote: [ -> ]

(2023-07-20, 13:21)axlt2002 Wrote: [ -> ]

(2023-07-19, 22:31)michaeljc70 Wrote: [ -> ]I don't have a VPN running.  I'm still getting the error. I tried reducing the number of threads.  There is nothing in the log after I enabled logging at the time of the error.  Do I need component level logging?

Hello, I'm sorry to read that the issue is still persisting. I have just tried with a ratings update and everything went smoothly. Unfortunately there is nothing you can enable at the component level logging, or at least I don't see anything that can be related to network/Internet stuffs.

One thing we can try is the following: look for the file "httptools.py" in the "support" folder inside the installation folder of the add-on; then edit the function "def internet():" at line 50 to always return True. This will bypass the Internet connection check so we can take a look to what is happening when accessing the imdb site for the ratings update (that part of the code manages the exceptions so that we can understand better what is going on...hopefully!).

Waiting for news! 

Thanks for the help.  I am not seeing a support folder.  I see a resources folder, context.py,  main.py and service.py.  I am looking in addons/script.lite.imdb.ratings.update. Am I in the wrong place?

EDIT:  I should have done this in the first place, but I uninstalled the add-on and reinstalled it and it is working fine.  I think I had an older version and erroneously though it would auto update since auto update is on.  Since I installed it from a zip, I don't think it can auto update.

Ok, good! Enjoy the ratings updates now! 

Cheers,

Alex

A single rule over at the TMDB is beginning to cause larger, trickle down issues elsewhere and I'm wondering if there's something we can do for this addon to account for it.  They have a HARD rule that everything is entered according to "original release".  If something happens outside of that, 9 out of 10 times, it becomes a "special".  Currently, The Nevers has the entire second half of its first (and only) season listed under "Specials" because it was cancelled and the second half of the season didn't air on HBO¹.  I Am Groot is listed as beginning with season 2 and no season 1 even exists; season 1's episodes are considered movies on TMDB².  IMDB and TVDB have these two examples listed just as anyone with half a brain would want/expect them listed.

This is getting to be a much larger problem as more shows jump networks/services, get cancelled mid-season with unaired episodes, etc.  I've switched these shows from TMDB to TVDB so the scraping will put them in the correct order for watching, but then this addon can't scrape them because it uses TMDB IDs to pull ratings and the numbering doesn't match.  These issues are causing the addon to crash (sometimes Kodi, itself, is crashing on my system).  Since TMDB is ignoring the community's pleas to adjust their rules and accommodate these shows in the most logical fashion, is there something we can do for this addon's ability to handle these ever-growing situations?  Sorry to be asking you to address an issue TMDB's obstinance is causing.

¹ Numerous discussion threads: https://www.themoviedb.org/tv/80828-the-nevers/discuss
² Numerous discussion threads:  https://www.themoviedb.org/tv/232125-i-am-groot/discuss

(2023-08-18, 21:24)Skirge01 Wrote: [ -> ]A single rule over at the TMDB is beginning to cause larger, trickle down issues elsewhere and I'm wondering if there's something we can do for this addon to account for it.  They have a HARD rule that everything is entered according to "original release".  If something happens outside of that, 9 out of 10 times, it becomes a "special".  Currently, The Nevers has the entire second half of its first (and only) season listed under "Specials" because it was cancelled and the second half of the season didn't air on HBO¹.  I Am Groot is listed as beginning with season 2 and no season 1 even exists; season 1's episodes are considered movies on TMDB².  IMDB and TVDB have these two examples listed just as anyone with half a brain would want/expect them listed.

This is getting to be a much larger problem as more shows jump networks/services, get cancelled mid-season with unaired episodes, etc.  I've switched these shows from TMDB to TVDB so the scraping will put them in the correct order for watching, but then this addon can't scrape them because it uses TMDB IDs to pull ratings and the numbering doesn't match.  These issues are causing the addon to crash (sometimes Kodi, itself, is crashing on my system).  Since TMDB is ignoring the community's pleas to adjust their rules and accommodate these shows in the most logical fashion, is there something we can do for this addon's ability to handle these ever-growing situations?  Sorry to be asking you to address an issue TMDB's obstinance is causing.

¹ Numerous discussion threads: https://www.themoviedb.org/tv/80828-the-nevers/discuss
² Numerous discussion threads:  https://www.themoviedb.org/tv/232125-i-am-groot/discuss

Hi @Skirge01, thanks a lot for your post.

To be honest I see really difficult to solve this issue at Light IMDb Ratings Update level at least if I do not change it in a completely new add-on such as TV shows scraper. This was not of course my initial objective and still is not the case.Anyway the only things that this add-on request to properly work ins the IMDb ID for each episode. If you use the "Episode mode" update, everything should work perfectly despite the episodes order. So, my question is: does the TVDB scraper retrieves also the IMDb IDs or not? If yes, but they are missing in the information stored on TVDB, the only thing to do is to contribute towards the community and add them directly on TVDB. Unfortunately I can not introduce back the IMDb IDs retrieval from TVDB in Light IMDb Ratings Update (it is no more free).

These are my thoughts...at least if I have correctly understood your concerns 

Lovely day!

Quote:does the TVDB scraper retrieves also the IMDb IDs or not?

Yes, it does.  However, it doesn't seem to pull TMDB IDs.  I've seen some places where TMDB IDs exist on the TVDB and others where it does not.  I have your addon set to update ratings at the episode level, but if there's no TMDB ID for a show, the update tends to fail, sometimes catastrophically.  That's why I was under the impression that your addon depended on TMDB IDs.  But, perhaps these crashes are not caused by that missing ID and something else is going on.  That just happened to be the pattern I was noticing.

Honestly, even if you were willing, I wouldn't want you to rewrite your entire addon because TMDB is screwing up their own data with utter stupidity.  I'd be quite happy with your addon completely ignoring any episodes which don't have the necessary ID in Kodi and have it simply update the show's rating.

(2023-08-22, 22:47)Skirge01 Wrote: [ -> ]

Quote:does the TVDB scraper retrieves also the IMDb IDs or not?

Yes, it does.  However, it doesn't seem to pull TMDB IDs.  I've seen some places where TMDB IDs exist on the TVDB and others where it does not.  I have your addon set to update ratings at the episode level, but if there's no TMDB ID for a show, the update tends to fail, sometimes catastrophically.  That's why I was under the impression that your addon depended on TMDB IDs.  But, perhaps these crashes are not caused by that missing ID and something else is going on.  That just happened to be the pattern I was noticing.

Honestly, even if you were willing, I wouldn't want you to rewrite your entire addon because TMDB is screwing up their own data with utter stupidity.  I'd be quite happy with your addon completely ignoring any episodes which don't have the necessary ID in Kodi and have it simply update the show's rating.

Hi @Skirge01,

In your post you are mentioning the TMDB ID as the key point but it is not the case; what it is fundamental is the IMDb ID. As far as the TVDB scraper retrieves the IMDb IDs, the episode rating are correctly updated. On the other side, if there is no IMDb ID for a specific episode, the add-on just reports a warning inside its log file and passes to the next episode to be updated.

Having said that, it would be great if you can share both Kodi and add-on logs when a crash you are referring to happens. Let's take this as the first step to understand if there is any issue that depends on the add-on to be solved.

Have a great day!

Alex

Hi @axlt2002,

Recently I've been having so many issues with the addon, it's just driving me crazy. Because of an issue I can't seem to remember, I just know that you told me to use the "season" method instead of the "episode" method of updating the season. Anyway, I have for example the TV series "Heels" that does indeed have IMDB ID's for S02 EP 6 & 7 but when I pull up UPDATE IMDB RATING from the context menu, it does not update the episodes anymore. A few weeks ago it became more and more difficult to updated it, but now it just doesn't, unless I use the metadataeditor addon and manually enter the IMDB episode number then update, then it works. I have attached my log file to see if you can help me with this issue.

Log: https://paste.kodi.tv/udetetayom.kodi

Regards,

Shedrock

(2023-09-11, 22:51)shedrock Wrote: [ -> ]Hi @axlt2002,

Recently I've been having so many issues with the addon, it's just driving me crazy. Because of an issue I can't seem to remember, I just know that you told me to use the "season" method instead of the "episode" method of updating the season. Anyway, I have for example the TV series "Heels" that does indeed have IMDB ID's for S02 EP 6 & 7 but when I pull up UPDATE IMDB RATING from the context menu, it does not update the episodes anymore. A few weeks ago it became more and more difficult to updated it, but now it just doesn't, unless I use the metadataeditor addon and manually enter the IMDB episode number then update, then it works. I have attached my log file to see if you can help me with this issue.

Log: https://paste.kodi.tv/udetetayom.kodi

Regards,

Shedrock

Hello @shedrock,

Can you please also share the update log file? From what you reported it seems there is an issue at the database level...

Let me know!

Alex