2021-08-12, 01:21
Hello Folks
I hope I've posted here correctly. I've run into some difficulty using this scraper and feel like I must b e don't something wrong.
Essentially I had some issues with scraping a tv series that I had to have some help with in this forum, in the process I realised that my folder and file naming (particularly TV Shows) needed some tlc so I updated the names using the wiki guide to help me do this, along with my movies.
Tv scraping worked perfectly but something is strange when I'm scraping the movie's, I just get multiples of a Barbie film I don't (I promise) own.
Now after this happened I went through the file system and removed a bunch of .nfo .jpg .tv files sat in directories. I figured these were old and causing issues so deleted them and tried again, no dice.
I checked all add-ons were updated.
I figured that i'd messed up the video database so tried removing that from userdata/Database folder and letting kodi recreate on restart, then tried again adding from source, setting TMDB Movie Scraper python. No change still got copious barbie movies.
The running kodi user is a member of the group owning the files so access is ok, and permissions are as id expect.
My movie collection is 1000+ films so had read in here that there's been issues with the size of data being requested during a new library scan so don't know if I'm doing too much in one go.
In checking the logs I get thousands of lines repeating a block of code which would fit for scanning thousands of titles...
...but the debug log is huge, too large to hastebin it. I've had a go at truncating a version but I've also linked the full debut log
Truncated
Full
can anyone help me figure out what I'm doing wrong?
Thanks
James
I hope I've posted here correctly. I've run into some difficulty using this scraper and feel like I must b e don't something wrong.
Essentially I had some issues with scraping a tv series that I had to have some help with in this forum, in the process I realised that my folder and file naming (particularly TV Shows) needed some tlc so I updated the names using the wiki guide to help me do this, along with my movies.
Tv scraping worked perfectly but something is strange when I'm scraping the movie's, I just get multiples of a Barbie film I don't (I promise) own.
Now after this happened I went through the file system and removed a bunch of .nfo .jpg .tv files sat in directories. I figured these were old and causing issues so deleted them and tried again, no dice.
I checked all add-ons were updated.
I figured that i'd messed up the video database so tried removing that from userdata/Database folder and letting kodi recreate on restart, then tried again adding from source, setting TMDB Movie Scraper python. No change still got copious barbie movies.
The running kodi user is a member of the group owning the files so access is ok, and permissions are as id expect.
My movie collection is 1000+ films so had read in here that there's been issues with the size of data being requested during a new library scan so don't know if I'm doing too much in one go.
In checking the logs I get thousands of lines repeating a block of code which would fit for scanning thousands of titles...
python:2021-08-06 20:41:06.430 T:1809 INFO <general>: initializing python engine.
2021-08-06 20:41:06.430 T:1809 DEBUG <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): start processing
2021-08-06 20:41:06.430 T:1809 DEBUG <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): entering source directory /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python
2021-08-06 20:41:06.430 T:1809 DEBUG <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): instantiating addon using automatically obtained id of "metadata.themoviedb.org.python" dependent on version 3.0.0 of the xbmc.python api
2021-08-06 20:41:06.435 T:1809 INFO <general>: [metadata.themoviedb.org.python]: Find movie with title '24 Hour Party People' from year '2002'
2021-08-06 20:41:06.435 T:1809 DEBUG <general>: using title of 24 hour party people to find movie
2021-08-06 20:41:06.435 T:1809 DEBUG <general>: Calling URL "https://api.themoviedb.org/3/search/movie?api_key=f090bb54758cabf231fb605d3e3e0468&language=en-US&query=24+hour+party+people&year=2002"
2021-08-06 20:41:06.556 T:1808 DEBUG <general>: CCurlFile::GetMimeType - https://image.tmdb.org/t/p/original/rmHz...1WMRL9.jpg -> image/jpeg
2021-08-06 20:41:06.556 T:1808 DEBUG <general>: CurlFile::Open(0x7fb9f03d7040) https://image.tmdb.org/t/p/original/rmHz...1WMRL9.jpg
2021-08-06 20:41:06.727 T:1809 DEBUG <CAddonSettings[metadata.themoviedb.org.python]>: trying to load setting definitions from old format...
2021-08-06 20:41:06.728 T:1809 INFO <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): script successfully run
2021-08-06 20:41:06.729 T:1804 DEBUG <general>: VideoInfoScanner: Fetching url '{"tmdb": "2750"}' using The Movie Database Python scraper (content: 'movies')
2021-08-06 20:41:06.729 T:1804 DEBUG <general>: GetVideoDetails: Reading movie '{"tmdb": "2750"}' using The Movie Database Python scraper (file: '/home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/', content: 'movies', version: '1.4.0+matrix.1')
2021-08-06 20:41:06.729 T:1804 DEBUG <general>: StartScript - calling plugin The Movie Database Python('plugin://metadata.themoviedb.org.python/','2','?action=getdetails&url=%7b%22tmdb%22%3a%20%222750%22%7d&pathSettings=%7b%22RatingS%22%3a%22TMDb%22%2c%22add_tags%22%3atrue%2c%22certprefix%22%3a%22Rated%20%22%2c%22enable_fanarttv_artwork%22%3atrue%2c%22fanart%22%3atrue%2c%22fanarttv_clientkey%22%3a%22%22%2c%22fanarttv_language%22%3a%22en%22%2c%22imdbanyway%22%3afalse%2c%22keeporiginaltitle%22%3atrue%2c%22landscape%22%3atrue%2c%22language%22%3a%22en-US%22%2c%22lastUpdated%22%3a%221628007318.621317%22%2c%22multiple_studios%22%3afalse%2c%22originalUrl%22%3a%22https%3a%2f%2fimage.tmdb.org%2ft%2fp%2foriginal%22%2c%22previewUrl%22%3a%22https%3a%2f%2fimage.tmdb.org%2ft%2fp%2fw780%22%2c%22tmdbcertcountry%22%3a%22us%22%2c%22trailer%22%3atrue%2c%22traktanyway%22%3afalse%7d','resume:false')
2021-08-06 20:41:06.730 T:1804 DEBUG <general>: GetLanguageInvoker - Reusing LanguageInvokerThread 3 for script /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py
2021-08-06 20:41:06.730 T:1809 INFO <general>: initializing python engine.
2021-08-06 20:41:06.730 T:1809 DEBUG <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): start processing
2021-08-06 20:41:06.730 T:1809 DEBUG <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): entering source directory /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python
2021-08-06 20:41:06.730 T:1809 DEBUG <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): instantiating addon using automatically obtained id of "metadata.themoviedb.org.python" dependent on version 3.0.0 of the xbmc.python api
2021-08-06 20:41:06.734 T:1809 DEBUG <general>: using movie id of 2750 to get movie details
2021-08-06 20:41:06.735 T:1809 DEBUG <general>: Calling URL "https://api.themoviedb.org/3/movie/2750?api_key=f090bb54758cabf231fb605d3e3e0468&language=en-US&append_to_response=trailers%2Cimages%2Creleases%2Ccasts%2Ckeywords"
2021-08-06 20:41:06.959 T:1809 DEBUG <general>: using movie id of 2750 to get movie details
2021-08-06 20:41:06.959 T:1809 DEBUG <general>: Calling URL "https://api.themoviedb.org/3/movie/2750?api_key=f090bb54758cabf231fb605d3e3e0468&append_to_response=trailers%2Cimages"
2021-08-06 20:41:07.174 T:1809 DEBUG <CAddonSettings[metadata.themoviedb.org.python]>: trying to load setting definitions from old format...
2021-08-06 20:41:07.176 T:1809 DEBUG <general>: Calling URL "https://webservice.fanart.tv/v3/movies/2750"
2021-08-06 20:41:07.264 T:1808 DEBUG <general>: ffmpeg[0x7fb9e44cbaa0X]: [image2] Custom AVIOContext makes no sense and will be ignored with AVFMT_NOFILE format.
2021-08-06 20:41:07.322 T:1808 DEBUG <general>: Caching image 'https://image.tmdb.org/t/p/original/rmHzFvZ1rDf9C0cULfsvz1WMRL9.jpg' to 'd/d868883d.jpg':
2021-08-06 20:41:07.397 T:1808 DEBUG <general>: cached image 'special://masterprofile/Thumbnails/d/d868883d.jpg' size 480x720
2021-08-06 20:41:07.530 T:1809 DEBUG <general>: Calling URL "https://webservice.fanart.tv/v3/movies/None"
2021-08-06 20:41:07.570 T:1808 DEBUG <general>: CCurlFile::GetMimeType - https://image.tmdb.org/t/p/original/eJad...asi1oa.jpg -> image/jpeg
2021-08-06 20:41:07.570 T:1808 DEBUG <general>: CurlFile::Open(0x7fb9f03d7040) https://image.tmdb.org/t/p/original/eJad...asi1oa.jpg
2021-08-06 20:41:07.867 T:1809 INFO <general>: CPythonInvoker(3, /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py): script successfully run
2021-08-06 20:41:07.873 T:1808 DEBUG <general>: ffmpeg[0x7fb9e44cbaa0X]: [image2] Custom AVIOContext makes no sense and will be ignored with AVFMT_NOFILE format.
2021-08-06 20:41:07.878 T:1804 DEBUG <general>: VideoInfoScanner: Adding new item to moviesmb://192.168.1.247/Movies/24 Hour Party People (2002)/24 Hour Party People (2002) HDTV-1080p.mp4
2021-08-06 20:41:07.908 T:1808 DEBUG <general>: Caching image 'https://image.tmdb.org/t/p/original/eJadsFcztqQZQIKzL5cMyasi1oa.jpg' to 'c/c43a582f.jpg':
2021-08-06 20:41:07.949 T:1804 DEBUG <general>: VideoInfoScanner: Finished adding information from dir smb://192.168.1.247/Movies/24 Hour Party People (2002)/
2021-08-06 20:41:07.950 T:1804 DEBUG <CAddonSettings[metadata.themoviedb.org.python]>: trying to load setting definitions from old format...
2021-08-06 20:41:07.956 T:1804 DEBUG <general>: VideoInfoScanner: Scanning dir 'smb://192.168.1.247/Movies/25th Hour (2002)/' as not in the database
2021-08-06 20:41:07.957 T:1804 DEBUG <CAddonSettings[metadata.themoviedb.org.python]>: trying to load setting definitions from old format...
2021-08-06 20:41:07.960 T:1808 DEBUG <general>: cached image 'special://masterprofile/Thumbnails/c/c43a582f.jpg' size 480x720
2021-08-06 20:41:07.965 T:1804 DEBUG <general>: CSMBFile::Open - opened smb://192.168.1.247/Movies/25th Hour (2002)/25th Hour (2002) WEBDL-1080p.mkv, fd=10001
2021-08-06 20:41:07.986 T:1804 DEBUG <general>: CSMBFile::Close closing fd 10001
2021-08-06 20:41:07.987 T:1804 DEBUG <general>: FindMovie: Searching for '25th Hour' using The Movie Database Python scraper (path: '/home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/', content: 'movies', version: '1.4.0+matrix.1')
2021-08-06 20:41:07.989 T:1804 DEBUG <general>: StartScript - calling plugin The Movie Database Python('plugin://metadata.themoviedb.org.python/','2','?action=find&pathSettings=%7b%22RatingS%22%3a%22TMDb%22%2c%22add_tags%22%3atrue%2c%22certprefix%22%3a%22Rated%20%22%2c%22enable_fanarttv_artwork%22%3atrue%2c%22fanart%22%3atrue%2c%22fanarttv_clientkey%22%3a%22%22%2c%22fanarttv_language%22%3a%22en%22%2c%22imdbanyway%22%3afalse%2c%22keeporiginaltitle%22%3atrue%2c%22landscape%22%3atrue%2c%22language%22%3a%22en-US%22%2c%22lastUpdated%22%3a%221628007318.621317%22%2c%22multiple_studios%22%3afalse%2c%22originalUrl%22%3a%22https%3a%2f%2fimage.tmdb.org%2ft%2fp%2foriginal%22%2c%22previewUrl%22%3a%22https%3a%2f%2fimage.tmdb.org%2ft%2fp%2fw780%22%2c%22tmdbcertcountry%22%3a%22us%22%2c%22trailer%22%3atrue%2c%22traktanyway%22%3afalse%7d&title=25th%20Hour&year=2002','resume:false')
2021-08-06 20:41:07.989 T:1804 DEBUG <general>: GetLanguageInvoker - Reusing LanguageInvokerThread 3 for script /home/jimtheoracle/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py
...but the debug log is huge, too large to hastebin it. I've had a go at truncating a version but I've also linked the full debut log
Truncated
Full
can anyone help me figure out what I'm doing wrong?
Thanks
James
