Guest - Testers are needed for the reworked CDateTime core component. See... https://forum.kodi.tv/showthread.php?tid=378981 (September 29) x
  • 1
  • 8
  • 9
  • 10(current)
  • 11
  • 12
  • 47
Release TMDb TV Show scraper (Python - Default Matrix Scraper)
(2021-01-05, 21:02)pkscout Wrote:
(2021-01-05, 20:55)fourtysixand2 Wrote:
(2021-01-05, 20:16)Karellen Wrote: Just tested it and it works fine here.

Provide a Debug Log which captures you scraping the show.
Debugging started at 08:24 in the log.

http://paste.ubuntu.com/p/R6WZGQxgyK/
I think the problem might be that you did a scrape of Firefly with the new scraper before fixing the nfo file.  I see from the log that there is a cached copy of the show being used. You can either wait 3 hours for the cache to expire or manually delete the cache files. The cache file location varies depending on platform, so, honestly, it might be easier to wait.

I'll try it again.  But yeah, I was trying all sorts of things.  From completely removing it, db cleanup, video database cleaner, etc.  Plus I had the dvd iso versions in there I removed as well.

And it's working now!

Which cache file or files would you be referring to exactly in this case?  

Thanks
Reply
(2021-01-05, 21:20)fourtysixand2 Wrote:
(2021-01-05, 21:02)pkscout Wrote:
(2021-01-05, 20:55)fourtysixand2 Wrote: Debugging started at 08:24 in the log.

http://paste.ubuntu.com/p/R6WZGQxgyK/
I think the problem might be that you did a scrape of Firefly with the new scraper before fixing the nfo file.  I see from the log that there is a cached copy of the show being used. You can either wait 3 hours for the cache to expire or manually delete the cache files. The cache file location varies depending on platform, so, honestly, it might be easier to wait.

I'll try it again.  But yeah, I was trying all sorts of things.  From completely removing it, db cleanup, video database cleaner, etc.  Plus I had the dvd iso versions in there I removed as well.

And it's working now!

Which cache file or files would you be referring to exactly in this case?  

Thanks
Because of how Kodi does TV show scraping along with how you ask TMDb for data, as the scraper works, it builds a cache of a TV show and it's episodes so it doesn't have to keep asking TMDb for the same information during a "single" scrape.  That cache file is held in special://temp in scrapers/metadata.tvshows.themoviedb.org.python.  That special location is different for each platform, so to make it a bit easier to find, the scraper logs (only in DEBUG mode) where the cache folder is each time it starts a scrape.  You can find that path by looking in the log for a line that says something like:
 
Code:
[metadata.tvshows.themoviedb.org.python] the cache dir is <location here>
Reply
(2021-01-06, 18:11)pkscout Wrote:
(2021-01-05, 21:20)fourtysixand2 Wrote:
(2021-01-05, 21:02)pkscout Wrote: I think the problem might be that you did a scrape of Firefly with the new scraper before fixing the nfo file.  I see from the log that there is a cached copy of the show being used. You can either wait 3 hours for the cache to expire or manually delete the cache files. The cache file location varies depending on platform, so, honestly, it might be easier to wait.

I'll try it again.  But yeah, I was trying all sorts of things.  From completely removing it, db cleanup, video database cleaner, etc.  Plus I had the dvd iso versions in there I removed as well.

And it's working now!

Which cache file or files would you be referring to exactly in this case?  

Thanks
Because of how Kodi does TV show scraping along with how you ask TMDb for data, as the scraper works, it builds a cache of a TV show and it's episodes so it doesn't have to keep asking TMDb for the same information during a "single" scrape.  That cache file is held in special://temp in scrapers/metadata.tvshows.themoviedb.org.python.  That special location is different for each platform, so to make it a bit easier to find, the scraper logs (only in DEBUG mode) where the cache folder is each time it starts a scrape.  You can find that path by looking in the log for a line that says something like:
 
Code:
[metadata.tvshows.themoviedb.org.python] the cache dir is <location here>
Thanks for the explanation.  That helped me track it down and now I find the wiki entry about it.  https://kodi.wiki/view/Kodi_data_folder#cache

I had found the Caches explained entry instead expecting it there and not on a linked page.

For anyone else reading, on raspbian it would be the following file being cached for Firefly.
~/.kodi/userdata/addon_data/metadata.tvshows.themoviedb.org.python/cache/1437.pickle
Reply
(2021-01-07, 01:37)fourtysixand2 Wrote: I had found the Caches explained entry instead expecting it there and not on a linked page.
Thanks for highlighting the Caches Explained page. I think it is meant more for video caches, but I will see what I can do to make it more comprehensive.
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
(2021-01-07, 01:37)fourtysixand2 Wrote:
(2021-01-06, 18:11)pkscout Wrote:
(2021-01-05, 21:20)fourtysixand2 Wrote: I'll try it again.  But yeah, I was trying all sorts of things.  From completely removing it, db cleanup, video database cleaner, etc.  Plus I had the dvd iso versions in there I removed as well.

And it's working now!

Which cache file or files would you be referring to exactly in this case?  

Thanks
Because of how Kodi does TV show scraping along with how you ask TMDb for data, as the scraper works, it builds a cache of a TV show and it's episodes so it doesn't have to keep asking TMDb for the same information during a "single" scrape.  That cache file is held in special://temp in scrapers/metadata.tvshows.themoviedb.org.python.  That special location is different for each platform, so to make it a bit easier to find, the scraper logs (only in DEBUG mode) where the cache folder is each time it starts a scrape.  You can find that path by looking in the log for a line that says something like:
 
Code:
[metadata.tvshows.themoviedb.org.python] the cache dir is <location here>
Thanks for the explanation.  That helped me track it down and now I find the wiki entry about it.  https://kodi.wiki/view/Kodi_data_folder#cache

I had found the Caches explained entry instead expecting it there and not on a linked page.

For anyone else reading, on raspbian it would be the following file being cached for Firefly.
~/.kodi/userdata/addon_data/metadata.tvshows.themoviedb.org.python/cache/1437.pickle
Please note that the path above will only be correct for 1.3.10 and older. When 1.3.12 is released, the cache location changes to special://temp/scrapers/metadata.tvshows.themoviedb.org.python
Reply
(2021-01-07, 05:22)pkscout Wrote:
(2021-01-07, 01:37)fourtysixand2 Wrote:
(2021-01-06, 18:11)pkscout Wrote: Because of how Kodi does TV show scraping along with how you ask TMDb for data, as the scraper works, it builds a cache of a TV show and it's episodes so it doesn't have to keep asking TMDb for the same information during a "single" scrape.  That cache file is held in special://temp in scrapers/metadata.tvshows.themoviedb.org.python.  That special location is different for each platform, so to make it a bit easier to find, the scraper logs (only in DEBUG mode) where the cache folder is each time it starts a scrape.  You can find that path by looking in the log for a line that says something like:
 
Code:
[metadata.tvshows.themoviedb.org.python] the cache dir is <location here>
Thanks for the explanation.  That helped me track it down and now I find the wiki entry about it.  https://kodi.wiki/view/Kodi_data_folder#cache

I had found the Caches explained entry instead expecting it there and not on a linked page.

For anyone else reading, on raspbian it would be the following file being cached for Firefly.
~/.kodi/userdata/addon_data/metadata.tvshows.themoviedb.org.python/cache/1437.pickle
Please note that the path above will only be correct for 1.3.10 and older. When 1.3.12 is released, the cache location changes to special://temp/scrapers/metadata.tvshows.themoviedb.org.python

Cool.  Not knowing all the reasoning and not that it matters much, but that's where I was expecting to find it.

Thanks again for the information.
Reply
(2021-01-07, 14:55)fourtysixand2 Wrote:
(2021-01-07, 05:22)pkscout Wrote:
(2021-01-07, 01:37)fourtysixand2 Wrote: Thanks for the explanation.  That helped me track it down and now I find the wiki entry about it.  https://kodi.wiki/view/Kodi_data_folder#cache

I had found the Caches explained entry instead expecting it there and not on a linked page.

For anyone else reading, on raspbian it would be the following file being cached for Firefly.
~/.kodi/userdata/addon_data/metadata.tvshows.themoviedb.org.python/cache/1437.pickle
Please note that the path above will only be correct for 1.3.10 and older. When 1.3.12 is released, the cache location changes to special://temp/scrapers/metadata.tvshows.themoviedb.org.python

Cool.  Not knowing all the reasoning and not that it matters much, but that's where I was expecting to find it.

Thanks again for the information.
The scrapers seem to be the only thing that use this area as cache storage. Every other addon I've ever seen (or written) uses the addon_data directory for stuff like that.
Reply
(2021-01-07, 18:43)pkscout Wrote:
(2021-01-07, 14:55)fourtysixand2 Wrote:
(2021-01-07, 05:22)pkscout Wrote: Please note that the path above will only be correct for 1.3.10 and older. When 1.3.12 is released, the cache location changes to special://temp/scrapers/metadata.tvshows.themoviedb.org.python

Cool.  Not knowing all the reasoning and not that it matters much, but that's where I was expecting to find it.

Thanks again for the information.
The scrapers seem to be the only thing that use this area as cache storage. Every other addon I've ever seen (or written) uses the addon_data directory for stuff like that.
Just thinking about it from a sysadmin perspective, why store transient data in a directory that possibly gets backed up.

Mind if I ask what's the reason for the change in 1.3.12?
Reply
(2021-01-08, 21:53)fourtysixand2 Wrote: Mind if I ask what's the reason for the change in 1.3.12?
It came about from a conversation here... https://forum.kodi.tv/showthread.php?tid...pid2989217
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
Hi there. Would it be possible to add scraping of wallpapers with language tags as landscape images like in Universal Movie Scraper? I also noticed there is a new logos section on TMDb.
Reply
(2021-01-10, 15:29)Tobby Wrote: Hi there. Would it be possible to add scraping of wallpapers with language tags as landscape images like in Universal Movie Scraper? I also noticed there is a new logos section on TMDb.

For the first request, I don't understand what you are asking for. The TMDb TV Show scraper currently scrapes any wallpaper image that either has no language or is in your selected language. For the second, it does not appear the logos are available in the API (at least not from what I can see in the documentation or from testing). Once they are available, the scraper is already set to scrape and parse any new art types.

edit: another team member was able to point out what you're asking about regarding landscape and fanart. I'll have to look into it.
Reply
(2021-01-10, 21:41)pkscout Wrote:
(2021-01-10, 15:29)Tobby Wrote: Hi there. Would it be possible to add scraping of wallpapers with language tags as landscape images like in Universal Movie Scraper? I also noticed there is a new logos section on TMDb.

For the first request, I don't understand what you are asking for. The TMDb TV Show scraper currently scrapes any wallpaper image that either has no language or is in your selected language. For the second, it does not appear the logos are available in the API (at least not from what I can see in the documentation or from testing). Once they are available, the scraper is already set to scrape and parse any new art types.

edit: another team member was able to point out what you're asking about regarding landscape and fanart. I'll have to look into it.

Thanks for replying. To clarify I meant that wallpapers with no language tag would scrape as fanart and wallpapers with language tag as landscape image. olympia implemented the feature into UMS and it works great.

Weird with the API missing, but great that's it's not a lot of work when it is. Thanks again.
Reply
(2021-01-10, 22:19)Tobby Wrote: To clarify I meant that wallpapers with no language tag would scrape as fanart and wallpapers with language tag as landscape image.
https://github.com/xbmc/metadata.tvshows.../issues/25
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
(2021-01-10, 23:06)Karellen Wrote:
(2021-01-10, 22:19)Tobby Wrote: To clarify I meant that wallpapers with no language tag would scrape as fanart and wallpapers with language tag as landscape image.
https://github.com/xbmc/metadata.tvshows.../issues/25

Thank you
Reply
Hello,

First time I'm having this issue, for the TV Show "Il Miracolo" (https://www.themoviedb.org/tv/91253-il-miracolo), my LibreElec KODI is not displaying the Poster
I'm trying to get it in french, and the TV Poster is set in TMDB website.

Here is my debug log :

https://pastebin.com/dweuXzHG

I've checked the log but I don't know what to look for.

Can someone help me please ?

Thanks
Reply
  • 1
  • 8
  • 9
  • 10(current)
  • 11
  • 12
  • 47

Logout Mark Read Team Forum Stats Members Help
TMDb TV Show scraper (Python - Default Matrix Scraper)0