[Julipo]

Hi, i see that there are some problems with the scrapper (I have th scrapper in Spanish). I come here for the same.

Since some days (less than a week?) I have problems with Kodi 17.6

I saw that some TV shows stopped updating and I added logs. The last episode available (4x02) it not bing parsed: https://paste.kodi.tv/bedolobaci.kodi
This happens with all new items that I have (not only this).

It ends with :

Code:

14:58:38.533 T:1300230912 DEBUG: scraper: GetSeasonEpisodeList returned <episodeguide></episodeguide>
14:58:38.538 T:1300230912 DEBUG: Previous line repeats 1 times.
14:58:38.538 T:1300230912 WARNING: No information found for item 'special://profile/addon_data/plugin.video.tvshowscrapper/library/SERIES/the good doctor [tt6470478]/', it won't be added to the library.

I saw that in the last days I had some updates from this addon:

Code:

Oct 17 07:00 metadata.common.themoviedb.org-3.2.6.zip
Oct 17 07:00 metadata.themoviedb.org-5.2.2.zip
Oct 17 22:50 metadata.tvshows.themoviedb.org-2.0.10.zip
Oct 21 07:00 metadata.tvshows.themoviedb.org-2.0.11.zip
Nov 15 07:00 metadata.common.themoviedb.org-3.2.10.zip


But I can't say when this stop working. I can say that episode 4x01 well scrapped was aired on November 10 and was scrapped on November 11 (Nov 11 11:18 4x01.strm)

Any help or fix? The API key is working and the scrapped URL (in the logs) is working, I can retreive the JSON with CURL/wget

The problem is there, but I test something: In my computer I installed Kodi 18 and everything is working, so I copied from Kodi 18 to my Kodi 17.6 (OSMC on Raspberry Pi) the folders "metadata.common.themoviedb" and "metadata.tvshows.themoviedb" and now is working again.

I didn't update my OSMC because I read lot of problems with the next updates (2 years ago), and "if it works, don't touch", i kept it. I supose that I will make a clean install with future Kodi 19.

If someone is having the same problem that me: Install Kodi18 addons on your Kodi 17.

[Karellen]

@Julipo

All these changes have not been backported to v17 and earlier and that is why you still are having problems.

Great to know that the v18 changes work in v17.6.

[olympia]

@Hebotsuki

Can you please switch to the new Python scraper and see if that solves your issue... https://kodi.wiki/view/Add-on:TMDb_TV_Shows

@Karellen 

I tried the Python scraper as asked:

• Ao Haru Ride: It works - The guest actors show up in each episode view.
  
• Violet Evergarden: It doesn't work - Same result than with the XML scraper. It only gets the special episode, but without title. Debug log in case it's useful.
  

guest actors issue should be fixed with the XML version v3.5.9.

Please don't discuss Python scraper related issues in this thread. Troubleshoot Python scraper in the Python thread and XML scraper in this thread.

[burekas]

I have a request that I wrote before, tell me if it's possible:

It certainly is possible, whether it will be added is a whole other question. And I highly doubt olympia would be willing to do this.

Both scraper developers have been worked ragged the last few days trying to fix the sudden influx of all these issues, so I can say with confidence that neither are in any frame of mind to now consider feature requests so soon.

I hope so, because I prefer to get my Art in English and the Details in Hebrew.
* By the way, why don'y you update this version also in Krypton branch? It's working there also except the ExtraArt that I mentioned before.
 

The titles of "All Seasons", "Season 1", "Season 2", ... Are they set according to Kodi language or according to the scraper language?

Should be in the language you selected, IF somebody has added those translations at TheMovieDB. Check there first and see what they have.

There is translation in TMDB, but it still shows it in English, this is why I asked if this is because of Kodi Language.
Images:
For example:
The Witcher: (TMDB) https://i.postimg.cc/Gpv0J7Dg/a1.png
The Witcher: (Kodi) https://i.postimg.cc/85G2yRBp/a2.png
Westworld: (Kodi)https://i.postimg.cc/j5hGBDZz/a3.png

[Karellen]

There is translation in TMDB, but it still shows it in English, this is why I asked if this is because of Kodi Language.

It is working for me. I'll need a Debug Log which captures you scraping the show, so delete it from your library first.

[burekas]

There is translation in TMDB, but it still shows it in English, this is why I asked if this is because of Kodi Language.

It is working for me. I'll need a Debug Log which captures you scraping the show, so delete it from your library first.

Weird. Probably another issue with krypton.

[burekas]

It certainly is possible, whether it will be added is a whole other question. And I highly doubt olympia would be willing to do this.

Both scraper developers have been worked ragged the last few days trying to fix the sudden influx of all these issues, so I can say with confidence that neither are in any frame of mind to now consider feature requests so soon.

@Karellen 
@olympia 

So at the end I did it by myself, split the language option into two options of: Details language and Images language.
Made it as version 3.5.9.1 (based on version 3.5.9).
(Changes in: addon, settings, string, tmdb)
zip: https://f2h.io/wnu06x9bp3xq

I add a new option for images languages, and called the "preferred language" -> "preferred details language".
I tested it and it works well.
Please check and test it, and it would be nice to update the official version with this fix.
Or if you want to and it's ok, I can try to checkout & commit a new pr also in git.

[burekas]

@olympia 

By the way, finally I found the source of the Episodes Titles problem.
It wasn't the "he-IL", or refresh the settings.xml.

When the "Get Default Rating from" is set on "IMDB", I'm getting the Episodes titles in english.
When the "Get Default Rating from" is set on "Themoviedb", I'm getting the Episodes titles correctly in the selected language.
It also works when I set it on "IMDB" and enabled the "Also get ratings from themoviedb".
It seems that the problem is when "IMDB" selected to be alone.
Why is that?



The "All Seasons", "Season 1", "Seson 2" etc... are still shown in english, this is another issue, probably because it 17.6 but it's not sure.

[_novalis]

all this scraping issues with tmdb tv show scrapers are so nerve wrecking. Was on the tvdb, had some problems that it wouldn't find a show (Spanish Princess), switched to tmdb, had other issues, switched to tmdb tv shows and still 'no information found' on e. g. Fringe.S03E01-02-03.uhd.iso
the tvdb still works best for me.

[burekas]

I have a new issue with TMDB.
I don't know, maybe they made a change on their API again or something.

1) Some of the TV Show has correct search url query, but 'GetSearchResults' returned empty even there is result when coping the url to browser, maybe something in json has been changed.
Here is example for "The Last Ship (2014)" But it relevant also for these tv shows:
13 Reason Why (2017), Lost (2004), Lost In Space (2018), Money Heist(2017), Stranger Things (2016), Vikings (2013), The 100 (2014), Colony (2016), Terra Nova (2011), Jericho (2006), Last Resort (2012), Chernobyl (2019), Six (2017)

Code:

21:28:27.350 T:9288   DEBUG: ADDON::CScraper::FindMovie: Searching for 'The Last Ship' using The Movie Database scraper (path: 'C:\Users\atzoref\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org', content: 'tvshows', version: '3.5.9')
20:54:17.147 T:17576   DEBUG: scraper: CreateSearchUrl returned <url cache="tmdb-search-The%20Last%20Ship-(2014)-he.json">https://api.tmdb.org/3/search/tv?api_key=6a5be4999abf74eba1f9a8311294c267&amp;query=The%20Last%20Ship&amp;first_air_date_year=2014&amp;language=he&amp;append_to_response=credits,external_ids,images&amp;include_image_language=he,en,null</url>
20:54:17.148 T:17576   DEBUG: CurlFile::Open(24F4A088) https://api.tmdb.org/3/search/tv?api_key...he,en,null
20:54:17.148 T:17576    INFO: XCURL:llLibCurlGlobal::easy_aquire - Created session to https://api.tmdb.org
20:54:17.989 T:17576   DEBUG: CScraperUrl::Get: Using "UTF-8" charset for "https://api.tmdb.org/3/search/tv?api_key=6a5be4999abf74eba1f9a8311294c267&query=The%20Last%20Ship&first_air_date_year=2014&language=he&append_to_response=credits,external_ids,images&include_image_language=he,en,null"
20:54:18.005 T:17576   DEBUG: scraper: GetSearchResults returned <results></results>

2) One of the tv show find other results except the correct one: 
Revolution (2012)

Code:

21:25:57.666 T:21156   DEBUG: ADDON::CScraper::FindMovie: Searching for 'Revolution' using The Movie Database scraper (path: 'C:\Users\atzoref\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org', content: 'tvshows', version: '3.5.9')
21:25:57.667 T:21156   DEBUG: scraper: CreateSearchUrl returned <url cache="tmdb-search-Revolution-(2012)-he.json">https://api.tmdb.org/3/search/tv?api_key=6a5be4999abf74eba1f9a8311294c267&amp;query=Revolution&amp;first_air_date_year=2012&amp;language=he&amp;append_to_response=credits,external_ids,images&amp;include_image_language=he,en,null</url>
21:25:57.672 T:21156   DEBUG: scraper: GetSearchResults returned <results></results>
21:25:57.672 T:21156   DEBUG: ADDON::CScraper::FindMovie: Searching for 'Revolution' using The Movie Database scraper (path: 'C:\Users\atzoref\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org', content: 'tvshows', version: '3.5.9')
21:25:57.672 T:21156   DEBUG: scraper: CreateSearchUrl returned <url cache="tmdb-search-Revolution-he.json">https://api.tmdb.org/3/search/tv?api_key=6a5be4999abf74eba1f9a8311294c267&amp;query=Revolution&amp;language=he&amp;append_to_response=credits,external_ids,images&amp;include_image_language=he,en,null</url>
21:25:57.676 T:21156   DEBUG: scraper: GetSearchResults returned <results><entity><title>La Révolution</title><id>99807</id><year>2020</year><url cache="tmdb-99807-he.json">https://api.tmdb.org/3/tv/99807?api_key=6a5be4999abf74eba1f9a8311294c267&amp;language=he&amp;append_to_response=content_ratings,credits,external_ids,images&amp;include_image_language=he,en,null</url></entity><entity><title>Revolution 618</title><id>31897</id><year>2010</year><url cache="tmdb-31897-he.json">https://api.tmdb.org/3/tv/31897?api_key=6a5be4999abf74eba1f9a8311294c267&amp;language=he&amp;append_to_response=content_ratings,credits,external_ids,images&amp;include_image_language=he,en,null</url></entity><entity><title>TV Revolution</title><id>23760</id><year>2004</year><url cache="tmdb-23760-he.json">https://api.tmdb.org/3/tv/23760?api_key=6a5be4999abf74eba1f9a8311294c267&amp;language=he&amp;append_to_response=content_ratings,credits,external_ids,images&amp;include_image_language=he,en,null</url></entity><entity><title>Sex: The Revolution</title><id>16766</id><year>2008</year><url cache="tmdb-16766-he.json">https://api.tmdb.org/3/tv/16766?api_key=6a5be4999abf74eba1f9a8311294c267&amp;language=he&amp;append_to_response=content_ratings,credits,external_ids,images&amp;include_image_language=he,en,null</url></entity><entity><title>L'été de la Révolution</title><id>94470</id><year>1989</year><url cache="tmdb-94470-he.json">https://api.tmdb.org/3/tv/94470?api_key=6a5be4999abf74eba1f9a8311294c267&amp;language=he&amp;append_to_response=content_ratings,credits,external_ids,images&amp;include_image_language=he,en,null</url></entity><entity><title>Gabriel Iglesias Presents Stand-Up Revolution</title><id>59746</id><year>2011</year><url cache="tmdb-59746-he.json">https://api.tmdb.org/3/tv/59746?api_key=6a5be4999abf74eba1f9a8311294c267&amp;language=he&amp;append_to_response=content_ratings,credits,external_ids,images&amp;include_image_language=he,en,null</url></entity></results>

3) The other tv shows return only result in English, the Hebrew results as it was before doesn't show up:
For example: Game of Thrones (2011)

Code:

21:27:46.859 T:10496   DEBUG: ADDON::CScraper::FindMovie: Searching for 'Game of Thrones' using The Movie Database scraper (path: 'C:\Users\atzoref\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org', content: 'tvshows', version: '3.5.9')
21:27:46.860 T:10496   DEBUG: scraper: CreateSearchUrl returned <url cache="tmdb-search-Game%20of%20Thrones-(2011)-he.json">https://api.tmdb.org/3/search/tv?api_key=6a5be4999abf74eba1f9a8311294c267&amp;query=Game%20of%20Thrones&amp;first_air_date_year=2011&amp;language=he&amp;append_to_response=credits,external_ids,images&amp;include_image_language=he,en,null</url>
21:27:46.863 T:10496   DEBUG: scraper: GetSearchResults returned <results></results>
21:27:46.863 T:10496   DEBUG: ADDON::CScraper::FindMovie: Searching for 'Game of Thrones' using The Movie Database scraper (path: 'C:\Users\atzoref\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org', content: 'tvshows', version: '3.5.9')
21:27:46.863 T:10496   DEBUG: scraper: CreateSearchUrl returned <url cache="tmdb-search-Game%20of%20Thrones-he.json">https://api.tmdb.org/3/search/tv?api_key=6a5be4999abf74eba1f9a8311294c267&amp;query=Game%20of%20Thrones&amp;language=he&amp;append_to_response=credits,external_ids,images&amp;include_image_language=he,en,null</url>
21:27:46.866 T:10496   DEBUG: scraper: GetSearchResults returned <results><entity><title>Game of Thrones</title><id>1399</id><year>2011</year><url cache="tmdb-1399-he.json">https://api.tmdb.org/3/tv/1399?api_key=6a5be4999abf74eba1f9a8311294c267&amp;language=he&amp;append_to_response=content_ratings,credits,external_ids,images&amp;include_image_language=he,en,null</url></entity></results>

4) Only one of me tv shows return correct and has the Hebrew details:
Black Mirror (2011)

Code:

21:25:41.534 T:7164   DEBUG: ADDON::CScraper::FindMovie: Searching for 'Black Mirror' using The Movie Database scraper (path: 'C:\Users\atzoref\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org', content: 'tvshows', version: '3.5.9')
21:25:41.534 T:7164   DEBUG: scraper: CreateSearchUrl returned <url cache="tmdb-search-Black%20Mirror-(2011)-he.json">https://api.tmdb.org/3/search/tv?api_key=6a5be4999abf74eba1f9a8311294c267&amp;query=Black%20Mirror&amp;first_air_date_year=2011&amp;language=he&amp;append_to_response=credits,external_ids,images&amp;include_image_language=he,en,null</url>
21:25:41.537 T:7164   DEBUG: scraper: GetSearchResults returned <results><entity><title>Black Mirror</title><id>42009</id><year>2011</year><url cache="tmdb-42009-he.json">https://api.tmdb.org/3/tv/42009?api_key=6a5be4999abf74eba1f9a8311294c267&amp;language=he&amp;append_to_response=content_ratings,credits,external_ids,images&amp;include_image_language=he,en,null</url></entity><entity><title>מראה שחורה</title><id>42009</id><year>2011</year><url cache="tmdb-42009-he.json">https://api.tmdb.org/3/tv/42009?api_key=6a5be4999abf74eba1f9a8311294c267&amp;language=he&amp;append_to_response=content_ratings,credits,external_ids,images&amp;include_image_language=he,en,null</url></entity></results>


[Karellen]

I have a new issue with TMDB.
I don't know, maybe they made a change on their API again or something.

Olympia is working on a fix... https://forum.kodi.tv/showthread.php?tid...pid2990893

[olympia]

I have a new issue with TMDB.
I don't know, maybe they made a change on their API again or something.

Probably you wouldn't run into similar issues such frequently if you wasn't rescrape your entire library every day

[burekas]

I have a new issue with TMDB.
I don't know, maybe they made a change on their API again or something.

Probably you wouldn't run into similar issues such frequently if you wasn't rescrape your entire library every day

Maybe
The idea was to move from TVDB to TMDB, since then as I have some strange issues.
One of them was the episodes titles which the reason is the rating type (As I mentioned above), so this is not my fault.

But as I see, just since I decided to move to TMDB, the TMDB team decided to make changes in their API or something.
The last issue seems to be something with TMDB since also the movie scraper just got updates.

And basically I backup the database files so everytime I copy them back and sometimes even delete the settings files.
So actually I don't "rescrape every day".

By the way, what do you say about these last posts:
The Episodes Titles bug: https://forum.kodi.tv/showthread.php?tid...pid2990583
The new feature "Images Language" that I made: https://forum.kodi.tv/showthread.php?tid...pid2990558

[olympia]

The Episodes Titles bug: https://forum.kodi.tv/showthread.php?tid...pid2990583
The new feature "Images Language" that I made: https://forum.kodi.tv/showthread.php?tid...pid2990558

For the first I have a fix I not submitted yet.
For the second, I need to think about how would I add this (if at all) - Not a priority at the moment at all with all this turbulence.

[burekas]

For the first I have a fix I not submitted yet.

Thanks, I will check it when it will be available.

For the second, I need to think about how would I add this (if at all) - Not a priority at the moment at all with all this turbulence.

As I said, I have already made a version with this feature based on version 3.5.9, and it worked (Until TMDB starts to make problems again).
It's pretty simple fix:
- Add new strings.
- Add the new option to the settings with the same language options.
- Using the new id to the urls for "include_image_language=" instead the current id
If you want I will make a fork with the changes in the git after you will submit the last changes.