• 1
  • 2
  • 3
  • 4(current)
  • 5
  • 6
  • 44
Release TMDb TV Show scraper (Python - Default Matrix Scraper)
#46
Recently I am also having the "no information" problem with new episodes; not only for new TV shows but also for shows for which I already added episodes in the past.
This happens with both "the movie database" (v3.5.5) and "The TVDB" (v3.2.8) addons running in Kodi v18.9. They are both configured with the auto-update option.
This is the log: https://paste.kodi.tv/jajeyakude.kodi
If I open the URLs with a web browser, I receive the episode content in JSON.
Any suggestion will be highly appreciated.
Thank you and best regards.
Reply
#47
@SrTaronja

TheMovieDB v3.5.5 is still partly broken. Change to this scraper which is the thread you posted in... https://kodi.wiki/view/Add-on:TMDb_TV_Shows and try scraping again.

TVDB does not work for you because you originally scraped The Mandalorian with TheMovieDB so Kodi is still searching TVDB using TheMovieDB data. If you want to use TVDB, then you need to rescrape the TV Show.
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
#48
Thumbs Up 
(2020-11-15, 11:43)Karellen Wrote: @SrTaronja

TheMovieDB v3.5.5 is still partly broken. Change to this scraper which is the thread you posted in... https://kodi.wiki/view/Add-on:TMDb_TV_Shows and try scraping again.

TVDB does not work for you because you originally scraped The Mandalorian with TheMovieDB so Kodi is still searching TVDB using TheMovieDB data. If you want to use TVDB, then you need to rescrape the TV Show.

My bad, I thought that by "changing content" and saying "no" to re-scan the whole show, only the new episodes would be scanned with tvdb.
But you are right: in the log file I provided it can be seen that it always asks to moviedb

Now I have re-scanned the whole Mandalorian show against tvdb and the chapter has been successfully added (the art was changed though, but I set it back to my preferred one).
Thank you very much for your support, and waiting for a new version of moviedb (I prefer it rather than tvdb).
Keep on with your great job!
Reply
#49
hi,

matrix alpha 3 + metadata.tvshows.themoviedb.org.python (1.3.2). iam trying to scrape The Crown S04. Its not working at all. I cant even provide any log file, because scraping this season generates a log with 113000 lines. i cant upload it to hastebin or similar services. is there another way to provide logs?

adding some other new Episodes (Lovecraft Country S01E02) results in the same.
Reply
#50
(2020-11-15, 10:41)roidy Wrote: @pkscout Seems I'm now getting a different error on some TV Shows

Line 1371 - https://paste.kodi.tv/uwocupacat.kodi

I've fixed that, but I'm not submitting an update yet, as I have another bug I need to try and squash before submitting an update. In the interim, you can download updated addon from:

Leia: https://github.com/xbmc/metadata.tvshows.../tree/leia
Matrix: https://github.com/xbmc/metadata.tvshows...ree/matrix

and install from zip.
Reply
#51
(2020-11-15, 09:29)Karellen Wrote:
(2020-11-15, 09:24)MeC!as Wrote: The Python scraper works, I apparently used an example with umlauts (mysteriöse Mordfälle). This one did not work.
Thanks. I have tried and it errors for me also. I thought we fixed this.

@pkscout anything can be done about this? Line 1254...https://paste.kodi.tv/ususoyanor.kodi
I'll try. Honestly, Unicode in Python 2.x is just about my least favorite thing in the entire world. I end up just randomly trying things until something finally works.
Reply
#52
(2020-11-15, 13:59)SrTaronja Wrote: Now I have re-scanned the whole Mandalorian show against tvdb and the chapter has been successfully added (the art was changed though, but I set it back to my preferred one).
Thank you very much for your support, and waiting for a new version of moviedb (I prefer it rather than tvdb).
Maybe I wasn't clear but I did not want you to change to TVDB. I wanted you to change to the scraper detailed in the wiki page and whose thread you are posting in now.
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
#53
(2020-11-15, 18:42)pkscout Wrote:
(2020-11-15, 10:41)roidy Wrote: @pkscout Seems I'm now getting a different error on some TV Shows

Line 1371 - https://paste.kodi.tv/uwocupacat.kodi

I've fixed that, but I'm not submitting an update yet, as I have another bug I need to try and squash before submitting an update. In the interim, you can download updated addon from:

Leia: https://github.com/xbmc/metadata.tvshows.../tree/leia
Matrix: https://github.com/xbmc/metadata.tvshows...ree/matrix

and install from zip.

Unfortunately I'm still getting the same error.

Code:
2020-11-15 18:56:28.094 T:3145974656   ERROR: [metadata.tvshows.themoviedb.org.python (1.1.19)]: **** End diagnostic info ****
2020-11-15 18:56:28.099 T:3145974656   ERROR: EXCEPTION Thrown (PythonToCppException) : -->Python callback/script returned the following error<--
                                             - NOTE: IGNORING THIS CAN LEAD TO MEMORY LEAKS!
                                            Error Type: <type 'exceptions.AttributeError'>
                                            Error Contents: 'NoneType' object has no attribute 'lower'
                                            Traceback (most recent call last):
                                              File "/storage/.kodi/addons/metadata.tvshows.themoviedb.org.python/main.py", line 32, in <module>
                                                router(sys.argv[2][1:])
                                              File "/storage/.kodi/addons/metadata.tvshows.themoviedb.org.python/libs/actions.py", line 202, in router
                                                get_episode_details(params['url'])
                                              File "/storage/.kodi/addons/metadata.tvshows.themoviedb.org.python/libs/actions.py", line 149, in get_episode_details
                                                decoded_ids['show_id'], decoded_ids['episode_id']
                                              File "/storage/.kodi/addons/metadata.tvshows.themoviedb.org.python/libs/tmdb.py", line 220, in load_episode_info
                                                if (ep_return['overview'] == '' or ep_return['name'].lower().startswith('episode')) and settings.LANG != 'en-US':
                                            AttributeError: 'NoneType' object has no attribute 'lower'
                                            -->End of Python script error report<--
Reply
#54
Sorry if this isn't the right topic to ask on, but do you expect to eventually support scraping using episode groups? I was playing around with switching from the old TMDB scraper to this new one and discovered that they don't seem to work.
Reply
#55
@jads

They worked while we were testing before release.

Please provide the link to the tv show you are trying to scrape and I will have a look.
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
#56
(2020-11-15, 20:58)roidy Wrote:
(2020-11-15, 18:42)pkscout Wrote:
(2020-11-15, 10:41)roidy Wrote: @pkscout Seems I'm now getting a different error on some TV Shows

Line 1371 - https://paste.kodi.tv/uwocupacat.kodi

I've fixed that, but I'm not submitting an update yet, as I have another bug I need to try and squash before submitting an update. In the interim, you can download updated addon from:

Leia: https://github.com/xbmc/metadata.tvshows.../tree/leia
Matrix: https://github.com/xbmc/metadata.tvshows...ree/matrix

and install from zip.

Unfortunately I'm still getting the same error.
Could you please post an entire log with debug on? The first one didn't seem to be in debug mode and was cut off right where the error would have been reported, and this snippet is helping even less.
Reply
#57
(2020-11-15, 23:18)Karellen Wrote: @jads

They worked while we were testing before release.

Please provide the link to the tv show you are trying to scrape and I will have a look.

One example was with https://www.themoviedb.org/tv/1437-firef...738a004068. When I scrape with the old TMDB scraper it picks up all 14 episodes + the movie just fine, but if I try the same scrape with the new one it gives me no episodes.

I was just trying a run where I captured my metadata, and then re-scraped using the new plugin and captured a new snapshot, to see how well it worked. It worked just fine except for the handful of shows where I used groups, so I just assumed that wasn't supported with the new scraper. A mistake, it would seem.
Reply
#58
(2020-11-15, 23:31)jads Wrote: One example was with https://www.themoviedb.org/tv/1437-firef...738a004068.
Ha, that is the show I used for testing. And it still works for me.

xml:
2020-11-16 08:39:40.304 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: performing getepisodelist action
2020-11-16 08:39:40.304 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: Getting episode list for show id 1437
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: using cached show info
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E1 - Serenity to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E2 - The Train Job to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E3 - Bushwhacked to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E4 - Shindig to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E5 - Safe to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E6 - Our Mrs. Reynolds to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E7 - Jaynestown to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E8 - Out of Gas to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E9 - Ariel to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E10 - War Stories to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E11 - Trash to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E12 - The Message to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E13 - Heart of Gold to list item
2020-11-16 08:39:40.306 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E14 - Objects in Space to list item
2020-11-16 08:39:40.306 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E15 - Serenity to list item
2020-11-16 08:39:40.306 T:2520 INFO: CPythonInvoker(5, C:\Users\Master\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org.python\main.py): script successfully run
2020-11-16 08:39:40.306 T:2520 DEBUG: CPythonInvoker::onExecutionDone(5, C:\Users\Master\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org.python\main.py)

Step out your process and I'll try to spot the mistake in what you are doing.
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
#59
(2020-11-15, 23:44)Karellen Wrote:
(2020-11-15, 23:31)jads Wrote: One example was with https://www.themoviedb.org/tv/1437-firef...738a004068.
Ha, that is the show I used for testing. And it still works for me.

xml:
2020-11-16 08:39:40.304 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: performing getepisodelist action
2020-11-16 08:39:40.304 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: Getting episode list for show id 1437
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: using cached show info
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E1 - Serenity to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E2 - The Train Job to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E3 - Bushwhacked to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E4 - Shindig to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E5 - Safe to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E6 - Our Mrs. Reynolds to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E7 - Jaynestown to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E8 - Out of Gas to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E9 - Ariel to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E10 - War Stories to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E11 - Trash to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E12 - The Message to list item
2020-11-16 08:39:40.305 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E13 - Heart of Gold to list item
2020-11-16 08:39:40.306 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E14 - Objects in Space to list item
2020-11-16 08:39:40.306 T:2520 DEBUG: [metadata.tvshows.themoviedb.org.python (1.1.18)]: adding episode information for S1E15 - Serenity to list item
2020-11-16 08:39:40.306 T:2520 INFO: CPythonInvoker(5, C:\Users\Master\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org.python\main.py): script successfully run
2020-11-16 08:39:40.306 T:2520 DEBUG: CPythonInvoker::onExecutionDone(5, C:\Users\Master\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org.python\main.py)

Step out your process and I'll try to spot the mistake in what you are doing.
Well, I just tried to re-run everything with debug logging turned on and now the problem is gone. I'm not sure if it was PEBKAC (I don't think so, I ran through the same sequence of steps multiple times), or if there was something that flaked out on the TMDB side. I think the API cache in the plugin created the illusion that the problem was more reproducible than it was.

I'm still a little weirded out by the problem only being on shows with episode groups (https://www.themoviedb.org/tv/615-futura...6c25015a52 is another example that broke, but it now also works fine). But since everything works now I'll just not think about it too much. Sorry for the trouble.
Reply
#60
(2020-11-15, 23:54)jads Wrote: and now the problem is gone
Great. No problems, TheMovieDB made some changes yesterday that ended up being reverted so it is a high chance you got caught up in the changes.
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
  • 1
  • 2
  • 3
  • 4(current)
  • 5
  • 6
  • 44

Logout Mark Read Team Forum Stats Members Help
TMDb TV Show scraper (Python - Default Matrix Scraper)0