• 1
  • 10
  • 11
  • 12(current)
  • 13
  • 14
  • 21
Release TheMovieDB movie scraper - PYTHON version
(2021-06-06, 21:04)Karellen Wrote:
(2021-06-06, 18:22)wsx1 Wrote: You can see this
http://www.themoviedb.org/movie/671-harr...er-s-stone
No.
Clearart, clearlogo, discart, banners, come from fanart.tv... https://fanart.tv/movie/671/harry-potter...ers-stone/
I don't see Italian artwork there.
Sure? [emoji28]

https://fanart.tv/fanart/movies/671/hdmo...b5e71d.png
Reply
Well, it works for me. I scraped the movie and received the Italian clearlogo.

Did you set Italian for artwork in the scraper settings at the source in 5c?

Image

Provide a Debug Log.
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
This is the worst thing ever pushed on Kodi. I've used this when it started with X. It's a bad scrapper. It miss names everything. I'm floored you let this go
Reply
(2021-06-16, 05:25)dakotapod Wrote: This is the worst thing ever pushed on Kodi. I've used this when it started with X. It's a bad scrapper. It miss names everything. I'm floored you let this go
Well.... you must be doing something wrong. I have been using this scraper for around 2 years, well before it was ever released to the public, and apart from some early teething problems during development, or changes at TMDB, I have never had a problem.

So... are you here for a rant or do you want some help?

If you want some help, then provide a Debug Log which captures the problem. But first check item 1d here (which you probably enabled, so its your mistake)... https://forum.kodi.tv/showthread.php?tid=336969
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
imdb rating is broken for a few weeks now.
Reply
(2021-07-07, 10:29)marantz Wrote: imdb rating is broken for a few weeks now.
https://github.com/xbmc/metadata.themovi...on/pull/83
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
Hello Folks

I hope I've posted here correctly. I've run into some difficulty using this scraper and feel like I must b e don't something wrong.

Essentially I had some issues with scraping a tv series that I had to have some help with in this forum, in the process I realised that my folder and file naming (particularly TV Shows) needed some tlc so I updated the names using the wiki guide to help me do this, along with my movies.

Tv scraping worked perfectly but something is strange when I'm scraping the movie's, I just get multiples of a Barbie film I don't (I promise) own.

Image

Now after this happened I went through the file system and removed a bunch of .nfo .jpg .tv files sat in directories. I figured these were old and causing issues so deleted them and tried again, no dice.

I checked all add-ons were updated.

I figured that i'd messed up the video database so tried removing that from userdata/Database folder and letting kodi recreate on restart, then tried again adding from source, setting TMDB Movie Scraper python. No change still got copious barbie movies.

The running kodi user is a member of the group owning the files so access is ok, and permissions are as id expect.

My movie collection is 1000+ films so had read in here that there's been issues with the size of data being requested during a new library scan so don't know if I'm doing too much in one go.

In checking the logs I get thousands of lines repeating a block of code which would fit for scanning thousands of titles...

python:
2021-08-06 20:41:06.430 T:1809     INFO <general>: initializing python engine.
2021-08-06 20:41:06.430 T:1809    DEBUG <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): start processing
2021-08-06 20:41:06.430 T:1809    DEBUG <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): entering source directory /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python
2021-08-06 20:41:06.430 T:1809    DEBUG <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): instantiating addon using automatically obtained id of "metadata.themoviedb.org.python" dependent on version 3.0.0 of the xbmc.python api
2021-08-06 20:41:06.435 T:1809     INFO <general>: [metadata.themoviedb.org.python]: Find movie with title '24 Hour Party People' from year '2002'
2021-08-06 20:41:06.435 T:1809    DEBUG <general>: using title of 24 hour party people to find movie
2021-08-06 20:41:06.435 T:1809    DEBUG <general>: Calling URL "https://api.themoviedb.org/3/search/movie?api_key=f090bb54758cabf231fb605d3e3e0468&language=en-US&query=24+hour+party+people&year=2002"
2021-08-06 20:41:06.556 T:1808    DEBUG <general>: CCurlFile::GetMimeType - https://image.tmdb.org/t/p/original/rmHz...1WMRL9.jpg -> image/jpeg
2021-08-06 20:41:06.556 T:1808    DEBUG <general>: CurlFile::Open(0x7fb9f03d7040) https://image.tmdb.org/t/p/original/rmHz...1WMRL9.jpg
2021-08-06 20:41:06.727 T:1809    DEBUG <CAddonSettings[metadata.themoviedb.org.python]>: trying to load setting definitions from old format...
2021-08-06 20:41:06.728 T:1809     INFO <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): script successfully run
2021-08-06 20:41:06.729 T:1804    DEBUG <general>: VideoInfoScanner: Fetching url '{"tmdb": "2750"}' using The Movie Database Python scraper (content: 'movies')
2021-08-06 20:41:06.729 T:1804    DEBUG <general>: GetVideoDetails: Reading movie '{"tmdb": "2750"}' using The Movie Database Python scraper (file: '/home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/', content: 'movies', version: '1.4.0+matrix.1')
2021-08-06 20:41:06.729 T:1804    DEBUG <general>: StartScript - calling plugin The Movie Database Python('plugin://metadata.themoviedb.org.python/','2','?action=getdetails&url=%7b%22tmdb%22%3a%20%222750%22%7d&pathSettings=%7b%22RatingS%22%3a%22TMDb%22%2c%22add_tags%22%3atrue%2c%22certprefix%22%3a%22Rated%20%22%2c%22enable_fanarttv_artwork%22%3atrue%2c%22fanart%22%3atrue%2c%22fanarttv_clientkey%22%3a%22%22%2c%22fanarttv_language%22%3a%22en%22%2c%22imdbanyway%22%3afalse%2c%22keeporiginaltitle%22%3atrue%2c%22landscape%22%3atrue%2c%22language%22%3a%22en-US%22%2c%22lastUpdated%22%3a%221628007318.621317%22%2c%22multiple_studios%22%3afalse%2c%22originalUrl%22%3a%22https%3a%2f%2fimage.tmdb.org%2ft%2fp%2foriginal%22%2c%22previewUrl%22%3a%22https%3a%2f%2fimage.tmdb.org%2ft%2fp%2fw780%22%2c%22tmdbcertcountry%22%3a%22us%22%2c%22trailer%22%3atrue%2c%22traktanyway%22%3afalse%7d','resume:false')
2021-08-06 20:41:06.730 T:1804    DEBUG <general>: GetLanguageInvoker - Reusing LanguageInvokerThread 3 for script /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py
2021-08-06 20:41:06.730 T:1809     INFO <general>: initializing python engine.
2021-08-06 20:41:06.730 T:1809    DEBUG <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): start processing
2021-08-06 20:41:06.730 T:1809    DEBUG <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): entering source directory /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python
2021-08-06 20:41:06.730 T:1809    DEBUG <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): instantiating addon using automatically obtained id of "metadata.themoviedb.org.python" dependent on version 3.0.0 of the xbmc.python api
2021-08-06 20:41:06.734 T:1809    DEBUG <general>: using movie id of 2750 to get movie details
2021-08-06 20:41:06.735 T:1809    DEBUG <general>: Calling URL "https://api.themoviedb.org/3/movie/2750?api_key=f090bb54758cabf231fb605d3e3e0468&language=en-US&append_to_response=trailers%2Cimages%2Creleases%2Ccasts%2Ckeywords"
2021-08-06 20:41:06.959 T:1809    DEBUG <general>: using movie id of 2750 to get movie details
2021-08-06 20:41:06.959 T:1809    DEBUG <general>: Calling URL "https://api.themoviedb.org/3/movie/2750?api_key=f090bb54758cabf231fb605d3e3e0468&append_to_response=trailers%2Cimages"
2021-08-06 20:41:07.174 T:1809    DEBUG <CAddonSettings[metadata.themoviedb.org.python]>: trying to load setting definitions from old format...
2021-08-06 20:41:07.176 T:1809    DEBUG <general>: Calling URL "https://webservice.fanart.tv/v3/movies/2750"
2021-08-06 20:41:07.264 T:1808    DEBUG <general>: ffmpeg[0x7fb9e44cbaa0X]: [image2] Custom AVIOContext makes no sense and will be ignored with AVFMT_NOFILE format.
2021-08-06 20:41:07.322 T:1808    DEBUG <general>: Caching image 'https://image.tmdb.org/t/p/original/rmHzFvZ1rDf9C0cULfsvz1WMRL9.jpg' to 'd/d868883d.jpg':
2021-08-06 20:41:07.397 T:1808    DEBUG <general>: cached image 'special://masterprofile/Thumbnails/d/d868883d.jpg' size 480x720
2021-08-06 20:41:07.530 T:1809    DEBUG <general>: Calling URL "https://webservice.fanart.tv/v3/movies/None"
2021-08-06 20:41:07.570 T:1808    DEBUG <general>: CCurlFile::GetMimeType - https://image.tmdb.org/t/p/original/eJad...asi1oa.jpg -> image/jpeg
2021-08-06 20:41:07.570 T:1808    DEBUG <general>: CurlFile::Open(0x7fb9f03d7040) https://image.tmdb.org/t/p/original/eJad...asi1oa.jpg
2021-08-06 20:41:07.867 T:1809     INFO <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): script successfully run
2021-08-06 20:41:07.873 T:1808    DEBUG <general>: ffmpeg[0x7fb9e44cbaa0X]: [image2] Custom AVIOContext makes no sense and will be ignored with AVFMT_NOFILE format.
2021-08-06 20:41:07.878 T:1804    DEBUG <general>: VideoInfoScanner: Adding new item to moviesConfusedmb://192.168.1.247/Movies/24 Hour Party People (2002)/24 Hour Party People (2002) HDTV-1080p.mp4
2021-08-06 20:41:07.908 T:1808    DEBUG <general>: Caching image 'https://image.tmdb.org/t/p/original/eJadsFcztqQZQIKzL5cMyasi1oa.jpg' to 'c/c43a582f.jpg':
2021-08-06 20:41:07.949 T:1804    DEBUG <general>: VideoInfoScanner: Finished adding information from dir smb://192.168.1.247/Movies/24 Hour Party People (2002)/
2021-08-06 20:41:07.950 T:1804    DEBUG <CAddonSettings[metadata.themoviedb.org.python]>: trying to load setting definitions from old format...
2021-08-06 20:41:07.956 T:1804    DEBUG <general>: VideoInfoScanner: Scanning dir 'smb://192.168.1.247/Movies/25th Hour (2002)/' as not in the database
2021-08-06 20:41:07.957 T:1804    DEBUG <CAddonSettings[metadata.themoviedb.org.python]>: trying to load setting definitions from old format...
2021-08-06 20:41:07.960 T:1808    DEBUG <general>: cached image 'special://masterprofile/Thumbnails/c/c43a582f.jpg' size 480x720
2021-08-06 20:41:07.965 T:1804    DEBUG <general>: CSMBFile::Open - opened smb://192.168.1.247/Movies/25th Hour (2002)/25th Hour (2002) WEBDL-1080p.mkv, fd=10001
2021-08-06 20:41:07.986 T:1804    DEBUG <general>: CSMBFile::Close closing fd 10001
2021-08-06 20:41:07.987 T:1804    DEBUG <general>: FindMovie: Searching for '25th Hour' using The Movie Database Python scraper (path: '/home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/', content: 'movies', version: '1.4.0+matrix.1')
2021-08-06 20:41:07.989 T:1804    DEBUG <general>: StartScript - calling plugin The Movie Database Python('plugin://metadata.themoviedb.org.python/','2','?action=find&pathSettings=%7b%22RatingS%22%3a%22TMDb%22%2c%22add_tags%22%3atrue%2c%22certprefix%22%3a%22Rated%20%22%2c%22enable_fanarttv_artwork%22%3atrue%2c%22fanart%22%3atrue%2c%22fanarttv_clientkey%22%3a%22%22%2c%22fanarttv_language%22%3a%22en%22%2c%22imdbanyway%22%3afalse%2c%22keeporiginaltitle%22%3atrue%2c%22landscape%22%3atrue%2c%22language%22%3a%22en-US%22%2c%22lastUpdated%22%3a%221628007318.621317%22%2c%22multiple_studios%22%3afalse%2c%22originalUrl%22%3a%22https%3a%2f%2fimage.tmdb.org%2ft%2fp%2foriginal%22%2c%22previewUrl%22%3a%22https%3a%2f%2fimage.tmdb.org%2ft%2fp%2fw780%22%2c%22tmdbcertcountry%22%3a%22us%22%2c%22trailer%22%3atrue%2c%22traktanyway%22%3afalse%7d&title=25th%20Hour&year=2002','resume:false')
2021-08-06 20:41:07.989 T:1804    DEBUG <general>: GetLanguageInvoker - Reusing LanguageInvokerThread 3 for script /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py

...but the debug log is huge, too large to hastebin it. I've had a go at truncating a version but I've also linked the full debut log
​​​
Truncated
Full
​​​
can anyone help me figure out what I'm doing wrong?

Thanks

James
Reply
@littlejeem

Yep, that is quite a big log, and if I had a few hours I would go through it. Smile

To speed up the checking, can you go to your barbie entries in Kodi, call up the Information Page and check which movies are attached to the Barbie posters as shown in the image. Then let me know which ones. Only need three or four....

Image
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
Oh wait. I think I see the problem.

The problem is a wrong setting. Check item 1d here... https://forum.kodi.tv/showthread.php?tid=336969
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
Many thanks @Karellen will have a go at this and let you know
Reply
(2021-08-12, 01:58)Karellen Wrote: Oh wait. I think I see the problem.

The problem is a wrong setting. Check item 1d here... https://forum.kodi.tv/showthread.php?tid=336969

Hello @Karellen  this worked perfectly to solve the issue. I read that thread before posting and still missed that point. My apologies 🙈
Reply
(2021-08-12, 23:21)littlejeem Wrote: Hello @Karellen  this worked perfectly to solve the issue. I read that thread before posting and still missed that point. My apologies 🙈
No problems at all, especially as you provided all the info needed in your first post.

Glad it is all working now Smile
My Signature
Links to : Official:Forum rules (wiki) | Official:Forum rules/Banned add-ons (wiki) | Debug Log (wiki)
Links to : HOW-TO:Create Music Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
Reply
I have made pull request with logos from tmdb.
Reply
I have a strange problem that happened for the first time yesterday on my kodi installation on PC : Suddenly the scraper doesn't take artwork from fanart.tv but only from TMDB in scraper settings I enabled fanart.tv and It was working fine till yesterday.  The movie is this but it happens with all new movies that i try to scrap : https://www.themoviedb.org/movie/379170-...able-bride

Kodi log
Reply
(2021-10-01, 20:33)Zurg Wrote: I have a strange problem that happened for the first time yesterday on my kodi installation on PC : Suddenly the scraper doesn't take artwork from fanart.tv but only from TMDB in scraper settings I enabled fanart.tv and It was working fine till yesterday.  The movie is this but it happens with all new movies that i try to scrap : https://www.themoviedb.org/movie/379170-...able-bride

Kodi log

I tried to disable images from TMDB and leave only fanart.tv kodi.log
Reply
  • 1
  • 10
  • 11
  • 12(current)
  • 13
  • 14
  • 21

Logout Mark Read Team Forum Stats Members Help
TheMovieDB movie scraper - PYTHON version0