Kodi Community Forum
Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper (/showthread.php?tid=365612)

Pages: 1 2


Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - gibxxi - 2021-11-22

As the title suggests, getting consistent (albeit random TV shows) CTD events occuring on Kodi 19.3 with Windows 10 Pro (20H2) whilst using a remote (LAN) MariaDB 10 SQL server and the 'TheTVDB (new)' scraper. NFO files are present and were exported via a previous scan using a local SQLite database. NFOs were exported using the 'separate' method, with no artwork / thumbs exported. Files therefore saved back to the NAS where the media itself resides. All communication is over CIFS/SMB/SAMBA.

The NAS in question being a QNAP TS453-PRO, running MariaDB 10 and firmware revision: QTS-5.0.0.1853.

Kodi doesn't seem to be exporting the episode durations with the NFO exports, but I can confirm the files are valid and not of '0' duration as located in the NFO I looked at. This info only appears to be updated (and subsequently exported) if episodes are 'browsed to' within the Kodi GUI prior to performing the export. Not sure if this is skin-related or Kodi-related at this stage.

Debug log here (Too big for pastebin sites): https://1drv.ms/u/s!Am5WO9nIAax8gcVpfHaNBVWDPYJ4dw

The end of the log is the point at which Kodi CTDs (Obviously).

Dan / Gib.


RE: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - Klojum - 2021-11-22

(2021-11-22, 03:38)gibxxi Wrote: This info only appears to be updated (and subsequently exported) if episodes are 'browsed to' within the Kodi GUI prior to performing the export. Not sure if this is skin-related or Kodi-related at this stage.

In my experience, I think this has been the case since the very beginning of XBMC: technical metadata of scraped videos is only fully gathered when those videos have also been 'browsed', and this modus operandi has not changed yet. So exporting a library before that browsing moment may result in "interesting" situations and also when such an export is being imported. It's very likely a Kodi bug, and not so much a skin problem. Any problems in Kodi should be re-tested with Kodi's default skin Estuary active to confirm or rule out skin defects.


RE: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - gibxxi - 2021-11-22

I'm in the process of 'browsing' my entire TV show library, to update the durations. Also made some changes to the server setup that may (or may not) have a bearing on the CTDs. Those changes being unique to the way my network is set up (part wired, part Powerline) and so not relevant posting the details here.

If I get further issues with CTDs on the back of these changes, will submit a further debug log here. I will say I didn't see anything in the log I did post that gave me any clue as to why Kodi suddenly crashed to desktop, so might be external factors at play here.

Dan / Gib.


RE: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - Karellen - 2021-11-22

I have to admit there is something weird going on in your log, but I can't figure out what.

Seems like the scanner sees your nfo files, then ignores them. I can't see why, though.

I see that you have the trakt addon installed. There was an issue a little while ago where the TVDB Python scraper and the Trakt addon did not play nice together. Can you disable the Trakt addon and run your library updated.

Also, don't run both the Music and Video lilbrary updates together when providing us a log. It makes it so much harder to read.


RE: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - gibxxi - 2021-11-23

(2021-11-22, 21:54)Karellen Wrote: I have to admit there is something weird going on in your log, but I can't figure out what.

Seems like the scanner sees your nfo files, then ignores them. I can't see why, though.

I see that you have the trakt addon installed. There was an issue a little while ago where the TVDB Python scraper and the Trakt addon did not play nice together. Can you disable the Trakt addon and run your library updated.

Also, don't run both the Music and Video lilbrary updates together when providing us a log. It makes it so much harder to read.

Aye. I've already done that @Karellen , along with artwork dump. As I 'categorize' my sources, even those on the same NAS, and tend to scan them indivdually first time around, I didn't want anything to get in the way of the scraping process while I am trying to get a complete and coherent library built-up.

With regards the music library, also stopped doing that too. Considering I seem to be a bit 'bandwidth-constrained' of late (devolo pushed out an automatic firmware update for their 'Magic 2 LAN' Powerline adapters last month, and it seems to have increased sync rate, but at the same time nerfed throughput speed a bit. At least in supposed 'MIMO' mode). So library scan with both running at the same time takes longer as each process is fighting the other for bandwidth. Not a big issue when scanning movies, as those are on the TS453-Mini, but the TV shows and audio/music are both on the TS453-Pro.

Dan / Gib.


RE: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - gibxxi - 2021-11-23

Had 1 CTD last night, but didn't have debug-logging on at that point. Neither was I scraping. This was during the 'browsing' of the library. Turns out it was a corrupt / truncated small video file (a short DVD extra, which I have since restored from a backup). I'm assuming it's the MediaInfo library that gets the duration information, because until this value is populated, media flags are missing also. So I think Kodi / MediaInfo had a 'cannot read file' moment that caused that isolated incident.

Dan / Gib.


RE: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - gibxxi - 2021-11-23

... Post I was replying to disappeared.


RE: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - Karellen - 2021-11-23

(2021-11-23, 22:07)gibxxi Wrote: ... Post I was replying to disappeared.
I moved it here... https://forum.kodi.tv/showthread.php?tid=365641


RE: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - gibxxi - 2021-11-24

(2021-11-23, 22:19)Karellen Wrote:
(2021-11-23, 22:07)gibxxi Wrote: ... Post I was replying to disappeared.
I moved it here... https://forum.kodi.tv/showthread.php?tid=365641

OK, thanks. Thought I was going mad (seeing phantom posts).

Wink

Dan / Gib.


RE: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - gibxxi - 2021-11-28

Latest bunch of crashlogs (across two sessions):

HERE.

Seems it might be related to this issue reported on Github:

https://github.com/Razzeee/script.module.arrow/issues/1

---

On a separate note, I noticed that in the video library with NFO files set for all content (TV shows AND Movies), that when the scraper is set to 'Local Information Only', Movies scrape fine, using the NFO files residing with the media. The same is not the case for TV Shows. Kodi is completely ignoring the NFO files located with the TV Show library (that were previously exported by Kodi itself from an earlier database scan which was then removed), when the scraper is set to 'Local Information Only' on TV Show sources. Not sure why it's ignoring those NFO files when it's evidently using the Movie ones as expected. The scan zips through in 0.5sec and detects / scrapes absolutely nothing, even though the NFO files are clearly there.

Had to switch scraper to 'The TVDB (New)' to get it to scrape anything at all, which at random points resulted in 'Embuary Info Error' and 'TheTVDB (New) Error' popup notifications at random points, which before long resulted in a CTD. The logs from those runs are present in the zip files referenced above.

Dan / Gib.


RE: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - Karellen - 2021-11-28

(2021-11-28, 17:20)gibxxi Wrote: Seems it might be related to this issue reported on Github:

https://github.com/Razzeee/script.module.arrow/issues/1
Yes, I haven't seen that error for quite a while. Here is the bug report... https://github.com/xbmc/xbmc/issues/17311
It seems to occur when the Trakt addons are installed, which you have installed.
No fix for this.
But you are in luck. Why don't you give the new, new TVDB scrapers a try and see how you go?
TV Shows... https://github.com/thetvdb/metadata.tvshows.thetvdb.com.v4.python/releases
Movies... https://github.com/thetvdb/metadata.movies.thetvdb.com.v4.python/releases
They are still in Beta, but you are now our guinea pig. Smile

(2021-11-28, 17:20)gibxxi Wrote: Kodi is completely ignoring the NFO files located with the TV Show library
Yes, that is a bug in Kodi. Don't set Local Info Only. Make sure you set the scraper that was used to scrape the tv shows.
Or
Delete the <episodeguide></episodeguide> tag from the tvshow.nfo file


RE: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - gibxxi - 2021-11-28

(2021-11-28, 20:27)Karellen Wrote:
(2021-11-28, 17:20)gibxxi Wrote: Seems it might be related to this issue reported on Github:

https://github.com/Razzeee/script.module.arrow/issues/1
Yes, I haven't seen that error for quite a while. Here is the bug report... https://github.com/xbmc/xbmc/issues/17311
It seems to occur when the Trakt addons are installed, which you have installed.
No fix for this.
But you are in luck. Why don't you give the new, new TVDB scrapers a try and see how you go?
TV Shows... https://github.com/thetvdb/metadata.tvshows.thetvdb.com.v4.python/releases
Movies... https://github.com/thetvdb/metadata.movies.thetvdb.com.v4.python/releases
They are still in Beta, but you are now our guinea pig. Smile
(2021-11-28, 17:20)gibxxi Wrote: Kodi is completely ignoring the NFO files located with the TV Show library
Yes, that is a bug in Kodi. Don't set Local Info Only. Make sure you set the scraper that was used to scrape the tv shows.
Or
Delete the <episodeguide></episodeguide> tag from the tvshow.nfo file

Hi @Karellen .

Yes I do have Trakt installed - but I have it disabled. Is it still a factor even in this scenario?

I will try out the new scrapers and report back. It may not be for a few days though as I have little time tonight to look at this. With regards the 'Local Info Only' option, I thought i'd try this on the back of your previous comment that it appeared my scrapes were ignoring NFOs, so decided to give that option a go, to be sure.

Smile

Dan / Gib.


RE: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - gibxxi - 2021-11-28

Looking at the new scrapers (v4) for TheTVDB.com, in the settings it mentions a 'PIN'. Do I need to get this from the TVDB website for these scrapers to work? Also, why does it want to know my 'Birth Date' for, is this to do with age restricted content?

Dan / Gib.


RE: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - Karellen - 2021-11-28

(2021-11-28, 20:45)gibxxi Wrote: Looking at the new scrapers (v4) for TheTVDB.com, in the settings it mentions a 'PIN'. Do I need to get this from the TVDB website for these scrapers to work? Also, why does it want to know my 'Birth Date' for, is this to do with age restricted content?
You can ignore those bottom three settings. They are the beginnings of the Premium account feature.


RE: Kodi 19.3 (Matrix): CTD on Library Update - TheTVDB (new) Scraper - gibxxi - 2021-11-28

(2021-11-28, 20:54)Karellen Wrote:
(2021-11-28, 20:45)gibxxi Wrote: Looking at the new scrapers (v4) for TheTVDB.com, in the settings it mentions a 'PIN'. Do I need to get this from the TVDB website for these scrapers to work? Also, why does it want to know my 'Birth Date' for, is this to do with age restricted content?
You can ignore those bottom three settings. They are the beginnings of the Premium account feature.

Too late lol. I've already signed up for a subscription. It's going to be required sooner or later anyway, so I bit the bullet now.

Done a movie libary scan, that took under 5 minutes. I wouldn't ordinarily use TVDB.com for movies, but in the interests of 'beta-testing', went ahead. Was blisteringly fast and seems to have matched everything I have, surprisingly, so all good there. No CTDs either, but then again, that was true before (for the movie library).

The TV library will take much longer due to the individual episodes requiring scraping vs. a single movie, but we'll see how it goes. Once it's done, i'll post the logs from both scans so the team can look at how it went, even if there are no issues. This might be tonight (after all) but no promises at this stage.

Dan / Gib.