• 1
  • 2(current)
  • 3
  • 4
  • 5
  • 44
Release TMDb TV Show scraper (Python - Default Matrix Scraper)
#16
I notice that the "Original Name" in French does have the accent.
Image

I also notice that there are no alternative names for the show. Not sure which fields the scraper searches, but maybe it needs one?
Image
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
#17
(2020-10-15, 01:09)Karellen Wrote: I notice that the "Original Name" in French does have the accent.


I also notice that there are no alternative names for the show. Not sure which fields the scraper searches, but maybe it needs one?

I've just added the French spelling as an alt title, but that doesn't seem to have worked. The standard scraper does work with the accent in the directory name, fwiw.
Reply
#18
(2020-10-15, 01:16)macomeau Wrote: I've just added the French spelling as an alt title, but that doesn't seem to have worked.
You won't see an immediate change due to the caching TMDB uses. It will take a few hours.

But I also wanted to raise the observation for @pkscout in case there is a workaround.
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
#19
(2020-10-15, 01:19)Karellen Wrote:
(2020-10-15, 01:16)macomeau Wrote: I've just added the French spelling as an alt title, but that doesn't seem to have worked.
You won't see an immediate change due to the caching TMDB uses. It will take a few hours.

But I also wanted to raise the observation for @pkscout in case there is a workaround.
The API doesn't specify which fields it searches when you do a search, you just give it a title and then it returns results.  Based on results I've gotten in the past, it appears to search the title and original title fields. But it won't find something if they are spelled differently (and that accent character makes it a different spelling).  I'd suggest putting the URL for the show in a tvshow.nfo file in the root of the folder name. That will tell the scraper what show to scrape. Alternatively, if you can get to the manual search interface, you could just use the TMDb ID (type tmdb/<id> into the search field.
Reply
#20
(2020-10-14, 23:42)pkscout Wrote: @macomeau I was right, it was an easy fix.  This will by pushed out with the next release, but I don't yet know for sure when that will be.  In the meantime, you can manually install this version for Leia (that's what your log should you were using) that should resolve your issue:

https://github.com/xbmc/metadata.tvshows...e/leia.zip

If anyone is on Matrix and having problems with a show not scraping because they have no network listed, you can download the Matrix version of this patch at:

https://github.com/xbmc/metadata.tvshows...matrix.zip
Hi,

does this matrix version include the fallback to english fix too? I Experience the same Problem with some non English Series
Reply
#21
(2020-10-15, 08:09)pkscout Wrote: The API doesn't specify which fields it searches when you do a search, you just give it a title and then it returns results.  Based on results I've gotten in the past, it appears to search the title and original title fields. But it won't find something if they are spelled differently (and that accent character makes it a different spelling).  I'd suggest putting the URL for the show in a tvshow.nfo file in the root of the folder name. That will tell the scraper what show to scrape. Alternatively, if you can get to the manual search interface, you could just use the TMDb ID (type tmdb/<id> into the search field.

Yeah, the accented version of the title is the "original name" on TMDB. Like I said, the old scraper finds it with the accent. Both the old scraper and the python scraper also find Scene of the Crime in my directory with the original, German title. The German title is also not present as an "alternative name," only as "original name."

TV\Tatort\ gets scraped as Scene of the Crime (1970) by both scrapers. Correct.
TV\Bron-Broen (2011)\ gets scraped as The Bridge (2011) by both scrapers. Also correct. Also the "original name."
TV\Résistance\ throws an error with the python scraper, but gets scraped correctly as Resistance (2014) by the old one.

My concern is more that it is throwing an error, since I can (and have) manually added it to my library.

Specifically, this bit from the log caught my eye:
2020-10-14 18:51:56.093 T:2597318864 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.17)]: using title of Résistance to find show
2020-10-14 18:51:56.116 T:2597318864 ERROR: [metadata.tvshows.themoviedb.org.python (1.1.17)]: *** Unhandled exception detected: <type 'exceptions.UnicodeEncodeError'> 'ascii' codec can't encode character u'\xe9' in position 1: ordinal not in range(128) ***
Reply
#22
(2020-10-15, 08:31)ramis52 Wrote:
(2020-10-14, 23:42)pkscout Wrote: @macomeau I was right, it was an easy fix.  This will by pushed out with the next release, but I don't yet know for sure when that will be.  In the meantime, you can manually install this version for Leia (that's what your log should you were using) that should resolve your issue:

https://github.com/xbmc/metadata.tvshows...e/leia.zip

If anyone is on Matrix and having problems with a show not scraping because they have no network listed, you can download the Matrix version of this patch at:

https://github.com/xbmc/metadata.tvshows...matrix.zip
Hi,

does this matrix version include the fallback to english fix too? I Experience the same Problem with some non English Series
Yes, that zip does include the English fallback logic. I am submitting it for review to the main repo today.  If you can, I would encourage you to wait until the update hits the repo. In Matrix if you install it from zip you won't get anymore updates from the repo until you manually update it once from the repo.
Reply
#23
(2020-10-15, 20:01)macomeau Wrote:
(2020-10-15, 08:09)pkscout Wrote: The API doesn't specify which fields it searches when you do a search, you just give it a title and then it returns results.  Based on results I've gotten in the past, it appears to search the title and original title fields. But it won't find something if they are spelled differently (and that accent character makes it a different spelling).  I'd suggest putting the URL for the show in a tvshow.nfo file in the root of the folder name. That will tell the scraper what show to scrape. Alternatively, if you can get to the manual search interface, you could just use the TMDb ID (type tmdb/<id> into the search field.

Yeah, the accented version of the title is the "original name" on TMDB. Like I said, the old scraper finds it with the accent. Both the old scraper and the python scraper also find Scene of the Crime in my directory with the original, German title. The German title is also not present as an "alternative name," only as "original name."

TV\Tatort\ gets scraped as Scene of the Crime (1970) by both scrapers. Correct.
TV\Bron-Broen (2011)\ gets scraped as The Bridge (2011) by both scrapers. Also correct. Also the "original name."
TV\Résistance\ throws an error with the python scraper, but gets scraped correctly as Resistance (2014) by the old one.

My concern is more that it is throwing an error, since I can (and have) manually added it to my library.

Specifically, this bit from the log caught my eye:
2020-10-14 18:51:56.093 T:2597318864 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.17)]: using title of Résistance to find show
2020-10-14 18:51:56.116 T:2597318864 ERROR: [metadata.tvshows.themoviedb.org.python (1.1.17)]: *** Unhandled exception detected: <type 'exceptions.UnicodeEncodeError'> 'ascii' codec can't encode character u'\xe9' in position 1: ordinal not in range(128) ***
That unicode error is related to logging with an extended character. I did fix it, and that fix will be included in the update I'm submitting to the repo today.  I'll see if I can duplicate your issue with Résistance.
Reply
#24
@macomeau I've tested with a folder called Résistance, and the scraper will definitely not find a show match with that folder name.  The API apparently only searches the name field, so if you want a fully automated scrape, the folder name has to match the name on TMDb.  Based on what I'm seeing from the API, the only way to get a match with "Résistance" would be to have the scraper change all the extended characters to "regular" ones, and I'm not going to do that.  I will go mad trying to correct for inconsistent data on one end or the other.  To scrape that show, you have three choices:

1- rename the folder to Resistance (be warned, you may get a Star Wars series on the first try)
2- leave the folder name as is and add a tvshow.nfo file that has the URL from TMDb to the show you want to scrape (guaranteed to get you the show you want)
3- Manually scan the show by going to the show folder in your source and selecting Scan to Library from the context menu. That will bring up a search box where you can either change the name to "Resistance" or use the tmdb id (using tmdb/<id> in the search box).

I may as well warn you now. If you have your language in that source set to anything other than French, you will not get the one poster available for the show. It's labeled as French, so the only time the scraper will return that artwork is if you have French set as your language it in source settings. That is an intentional choice so that you don't end up having to scroll through artwork from 10 different languages that you aren't ever going to use, but that does mean in this edge case that no art is returned unless French is your language. Most shows have at least one poster that has no language, so generally something gets returned.

BTW, I tested Résistance with the current default The Moviedatabase TV show scraper, and it also did not scrape Résistance because it found no match. So this has been the behavior with the TMDb scrapers for awhile.
Reply
#25
Hi. An error occurs while scanning the tvshows:
python:
2020-10-16 10:02:14.346 T:101052   ERROR <general>: CCurlFile::Stat - Failed: Failure when receiving data from the peer(56) for http://image.tmdb.org/t/p/original/3sSJc...IpGCux.jpg
2020-10-16 10:02:14.346 T:101056   ERROR <general>: CCurlFile::Stat - Failed: Failure when receiving data from the peer(56) for http://image.tmdb.org/t/p/original/zU01R...sx2eNR.jpg
2020-10-16 10:02:17.150 T:101069    INFO <general>: initializing python engine.
2020-10-16 10:02:17.252 T:101069   ERROR <general>: EXCEPTION Thrown (PythonToCppException) : -->Python callback/script returned the following error<--
                                                    - NOTE: IGNORING THIS CAN LEAD TO MEMORY LEAKS!
                                                   Error Type: <class 'AttributeError'>
                                                   Error Contents: module 'xbmcvfs' has no attribute 'translatePath'
                                                   Traceback (most recent call last):
                                                     File "/home/.kodi/addons/metadata.tvshows.themoviedb.org.python/main.py", line 27, in <module>
                                                       from libs.actions import router
                                                     File "/home/.kodi/addons/metadata.tvshows.themoviedb.org.python/libs/actions.py", line 27, in <module>
                                                       from . import tmdb, data_utils
                                                     File "/home/.kodi/addons/metadata.tvshows.themoviedb.org.python/libs/tmdb.py", line 25, in <module>
                                                       from . import cache, data_utils, api_utils, settings, imdbratings, traktratings
                                                     File "/home/.kodi/addons/metadata.tvshows.themoviedb.org.python/libs/cache.py", line 49, in <module>
                                                       CACHE_DIR = _get_cache_directory()  # type: Text
                                                     File "/home/.kodi/addons/metadata.tvshows.themoviedb.org.python/libs/cache.py", line 42, in _get_cache_directory
                                                       profile_dir = xbmcvfs.translatePath(ADDON.getAddonInfo('profile'))
                                                   AttributeError: module 'xbmcvfs' has no attribute 'translatePath'
                                                   -->End of Python script error report<--
                                                   
2020-10-16 10:02:17.275 T:101069    INFO <general>: Python interpreter stopped
2020-10-16 10:02:17.279 T:101068   ERROR <general>: GetDirectory - Error getting plugin://metadata.tvshows.themoviedb.org.python/?action=find&pathSettings=%7b%22certprefix%22%3a%22Rated%20%22%2c%22enable_fanarttv_backdrops%22%3afalse%2c%22enable_fanarttv_banner%22%3afalse%2c%22enable_fanarttv_characterart%22%3afalse%2c%22enable_fanarttv_clearart%22%3afalse%2c%22enable_fanarttv_clearlogo%22%3afalse%2c%22enable_fanarttv_landscape%22%3afalse%2c%22enable_fanarttv_posters%22%3afalse%2c%22enable_fanarttv_seasonbanner%22%3afalse%2c%22enable_fanarttv_seasonlandscape%22%3afalse%2c%22enable_fanarttv_seasonposters%22%3afalse%2c%22fanarttv_clientkey%22%3a%22%22%2c%22imdbanyway%22%3afalse%2c%22keeporiginaltitle%22%3afalse%2c%22language%22%3a%22ru-RU%22%2c%22lastUpdated%22%3a%220%22%2c%22originalUrl%22%3a%22%22%2c%22previewUrl%22%3a%22%22%2c%22ratings%22%3a%22TMDb%22%2c%22tmdbanyway%22%3atrue%2c%22tmdbcertcountry%22%3a%22ru%22%2c%22traktanyway%22%3afalse%2c%22usecertprefix%22%3atrue%2c%22verboselog%22%3afalse%7d&title=%d0%92%20%d0%bf%d0%be%d0%b8%d1%81%d0%ba%d0%b0%d1%85%20%d0%ba%d0%b0%d0%bf%d0%b8%d1%82%d0%b0%d0%bd%d0%b0%20%d0%93%d1%80%d0%b0%d0%bd%d1%82%d0%b0&year=1985
2020-10-16 10:02:17.283 T:101070    INFO <general>: initializing python engine.
v.1.2.1
What is the reason for this?
Reply
#26
@vgmedia

Please provide the full Debug Log thanks.
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
#27
Log
TMDb TV Shows v.1.2.1

Thanks.
Reply
#28
(2020-10-16, 11:17)vgmedia Wrote: Log
TMDb TV Shows v.1.2.1

Thanks.

Please update to Matrix Alpha2.  There was a change in the call for translatepath introduced in Alpha2 that means the addon is not compatible with any Matrix version before Alpha2.
Reply
#29
OK. Thanks.

Edit: upgrade to alpha 2 fixed the issue. Thank you very much.
Reply
#30
Hi,

maybe this is the wrong section but i have a question how the scraper and kodi matrix handles the images. I realized that when i use matrix + the new python scrapers, the storage of my fire tv cube is getting smaller and smaller. I used the following settings in the scraper and kodi matrix artwork section

scraper: clearart, clearlogo, poster
matrix: custom, clearart, clearlogo

after scraping law and order svu (20 Seasons), Blue Bloods (10 Seasons) the thumbnail folder was already 700mb big. Did i misss any setting? This doesnt happen on leia.

regards
r
Reply
  • 1
  • 2(current)
  • 3
  • 4
  • 5
  • 44

Logout Mark Read Team Forum Stats Members Help
TMDb TV Show scraper (Python - Default Matrix Scraper)0