Kodi Community Forum

Scraping has been working fine for me, except for the latest 2 episodes of Silicon Valley (s05e07 and s05e08), and the latest episode of Modern Family (s09e21). Lots of other TV episodes, that have been released this week, are scraping fine.

I haven't changed my file structure or file naming at all. I've tried renaming the offending episodes, it doesn't help.

If I delete all episodes of Silicon Valley from Kodi, and rescan, all the episodes will scrape apart from the latest 2.

These episodes seem to exist on TheTVDB.com, can't see a problem there.

I've gone through all the steps in  The v2.0.x TVDB scraper FAQs, both refreshing info for the shows in question, and refreshing the whole library, but the problem persists.

Log file: https://pastebin.com/pSMJ2y50

I noticed the same thing for the first time yesterday. Six episodes scraped OK, two others I cannot get to scrape, even though on the tvdb they seem alright.

I wonder if it is the same as this issue... https://forums.thetvdb.com/viewtopic.php...55#p132155 and https://forums.thetvdb.com/viewtopic.php...82#p131882
Sounds like an issue slowly becoming evident at TVDB.


@joechilds
I note you are scraping DVD Order. You state that you don't see a problem at TVDB for the episodes. But TVDB is currently not displaying DVD Order nor Absolute Order information. Nor is there currently a way to enter that data in their new site. So chances are there is no DVD Order information and, combined with the possible API issue reported above, the scraper cannot fallback to Aired Order.

I suggest changing to Aired Order. Why are you scraping DVD Order anyway? If the show was just aired, how can it possibly be released on DVD, or have a DVD Order?

Maybe @olympia might be able to see what the reported problem is?

Thanks @Karellen.

I’ve always used DVD order as the default setting for everything, as it always seemed to revert to Aired order automatically when there was no DVD information.

I’ve just tried Aired order and it works, the episodes are showing up. Great suggestion, thank you!

Ok, great.

Sounds like that issue reported at TVDB might be cause for concern for some until it is fixed. Not sure if it is at TVDB end or our end that needs the fix.

Thanks, reverting to Aired order fixed it for me as well.

I think DVD order is useful (e.g. with Firefly) but for now I'm happy again.

Debug https://pastebin.com/mZ3w33bB

So I having the issue with The Big Bang Theory, Marvels agents of shield, and Silicon Valley. Debug shows that it is scraped, but when going into library it is not there this has been going on for a few weeks now. I am using the default setting for the scrapper except I have it to get rating from IMDB as well. Any suggestions?

Hello @smitchell6879

Just a correction, the show The Big Bang Theory did not scrape. The VideoInfoScanner has found and correctly identified the TV Show and each episode. For some reason, when it has contacted TVDB, it could not find an Episode Guide as shown by the following. The scraper doesn't seem to be doing anything.

xml:
DEBUG: scraper: GetEpisodeList returned <episodeguide></episodeguide>

WARNING: No information found for item 'M:\TV Shows\General TV\Standard\The Big Bang Theory\', it won't be added to the library.

Without the Episode Guide, there is no data to import. Is the TV Show listed in your library, without the episodes? I don't think it is, unless it was added via a previous scrape. Can you check and make sure "Hide empty TV Shows" in Settings is disabled first.

1. I assume your Source is set on \Standard\
2. Are you using your own API Key?
3. If No to previous question, can you re-install TVDB again via zip... http://mirrors.kodi.tv/addons/leia/metadata.tvdb.com/
4. I have seen similar issues with logs that show MySQL is in use. Can you setup another portable Kodi and completely bypass MySQL and use the local library only. Will the show scrape then?

(2018-05-17, 02:28)Karellen Wrote: [ -> ]1. I assume your Source is set on \Standard\
2. Are you using your own API Key?
3. If No to previous question, can you re-install TVDB again via zip... http://mirrors.kodi.tv/addons/leia/metadata.tvdb.com/
4. I have seen similar issues with logs that show MySQL is in use. Can you setup another portable Kodi and completely bypass MySQL and use the local library only. Will the show scrape then?

@Karellen

1. Yes
2. No for some reason I can't even login to thetvdb since they reset the passwords, has yet to send me a email.
3. I did this
4. I setup a new portable, this time only using the built in db, but it is the same result.

Debug log https://pastebin.com/6FNbgN7Q

Thanks for the new log, but I can't figure out what the issue is. I have replicated your steps on win 10 using the same Alpha1 version, same add-on versions, but I get different results... https://paste.ubuntu.com/p/GKcyWqT8S4/

If you look at line 921 of my log and onwards, you can clearly see that the scraper has recognised The Big Bang Theory, logged into TVDB and downloaded the Search Results.

Now go to your log and line 823, and there is no finding of The Big Bang Theory folder, it just starts scanning episode numbers (it hasn't recognised the show yet, just scanning episode numbers). Your naming looks spot on, your source is one level above the TV Show, so I am not sure why it is not being found. It looks like you are using a local drive, so hard to imagine it is some sort of permission issue.

@scudlee is the add-on author, but he hasn't been around for a few months. Maybe @olympia can shed some light. I have been noticing a steady trickle of scraping problems over the last couple of days.

@Karellen You missed the trick in the log:

18:44:14.118 T:2776   DEBUG: ADDON::CScraper::GetEpisodeList: Searching 'http://api.themoviedb.org/3/tv/1418?api_key=6a5be4999abf74eba1f9a8311294c267&language=en' using The TVDB scraper (file: 'E:\Programs\Kodi_18-Meta\addons\metadata.tvdb.com', content: 'tvshows', version: '3.0.1')

@smitchell6879 
At some point you were using themoviedb TV scraper, but replaced it with the tvdb scraper.
(I'm guessing maybe because themoviedb TV scraper also appeared to stop working.)

You can't switch TV scrapers without removing the shows from the library first (or refreshing each show individually). 
When the show is first added, a scraper-specific episodeguide url is saved in the database, if you just swap out the scraper, the now-incorrect url will remain and prevent new episodes getting added.
Only by refreshing the whole show will the episodeguide url get replaced.

This is also the reason why themoviedb TV scraper may appear to stop working.  The saved episodeguide urls still contain the old, invalidated API key.
Again, only by refreshing will the urls get replaced and new episodes start getting added again.

Hi @scudlee,

Oooh, I picked up the API keys were different, that is why I asked if he used personal keys, but I didn't check where they belonged!! Another little trick to add to the list

But I was also led to believe this was a brand new portable install (item 4 above) so where did the mixed API come from? I didn't see any sign of NFO Files in use. Hopefully @smitchell6879 can clear that one up.

Thanks scudlee

(2018-05-17, 11:55)Karellen Wrote: [ -> ]Hi @scudlee,

Oooh, I picked up the API keys were different, that is why I asked if he used personal keys, but I didn't check where they belonged!! Another little trick to add to the list

But I was also led to believe this was a brand new portable install (item 4 above) so where did the mixed API come from? I didn't see any sign of NFO Files in use. Hopefully @smitchell6879 can clear that one up.

Thanks scudlee

Your right it was a new install but i export my library every so often to keep requests down on the api. A few months ago i switched to the movie db to get different art work, but as you know it didn't do as well as thetvb so i whiched back... never thought that it would make a difference but you guys are right i erased the tvhsow.nfo file for every show and that fixed. Thanks Guys.

@smitchell6879

Great that it is solved.

(2018-05-18, 02:21)smitchell6879 Wrote: [ -> ]but i export my library every so often to keep requests down on the api

Yep, I do the same. Every few weeks i export to separate files which saves all my watched, resume and play counts.

@joechilds  I had opportunity to look closer at your original issue, in case there was a bug in the DVD order handling, but there isn't (at least not in this case).

For some reason in the API response, the episodes mentioned have incorrect DVD seasons assigned to them, either through human error, or some random glitch.

This, for example, is the S05E07 of Silicon Valley as it appears in the episodeguide from your log:
Both episodes 7 and 8 have a DVD season of 0, and similarly the Modern Family episode has a DVD season of 2.
(I also compared them to the actual API output, just in case it was a blip in the scraper).

Perhaps the lack of display of the DVD ordering on the new website is making it easier for these errors to occur unnoticed.