Thread Closed
TheMovieDB scraper stopped working
#1
Seems 'suddenly' it's no longer scraping movies.  Examples:

2019-09-13 11:18:34.235 T:3473146592   DEBUG: FindMovie: Searching for 'Spider-Man Far from Home' using The Movie Database scraper (path: '/home/osmc/.kodi/addons/metadata.themoviedb.org', content: 'movies', version: '5.1.8')
2019-09-13 11:18:34.251 T:3473146592   DEBUG: scraper: CreateSearchUrl returned <url>https://api.tmdb.org/3/search/movie?api_key=f090bb54758cabf231fb605d3e3e0468&amp;query=Spider-Man%20Far%20from%20Home&amp;year=2019&amp;language=en</url>
2019-09-13 11:18:34.252 T:3473146592   DEBUG: CurlFile::Open(0xc83d0cd0) https://api.tmdb.org/3/search/movie?api_...anguage=en
2019-09-13 11:18:34.252 T:3473146592    INFO: easy_acquire - Created session to https://api.tmdb.org
2019-09-13 11:18:34.462 T:3473146592   DEBUG: Get: Using "UTF-8" charset for "https://api.tmdb.org/3/search/movie?api_key=f090bb54758cabf231fb605d3e3e0468&query=Spider-Man%20Far%20from%20Home&year=2019&language=en"
2019-09-13 11:18:34.466 T:3473146592   DEBUG: scraper: GetSearchResults returned <results></results>
2019-09-13 11:18:34.466 T:3473146592   DEBUG: FindMovie: Searching for 'Spider-Man Far from Home' using The Movie Database scraper (path: '/home/osmc/.kodi/addons/metadata.themoviedb.org', content: 'movies', version: '5.1.8')
2019-09-13 11:18:34.467 T:3473146592   DEBUG: scraper: CreateSearchUrl returned <url>https://api.tmdb.org/3/search/movie?api_key=f090bb54758cabf231fb605d3e3e0468&amp;query=Spider%20Man%20Far%20from%20Home&amp;year=&amp;language=en</url>
2019-09-13 11:18:34.467 T:3473146592   DEBUG: CurlFile::Open(0xc83d0cd0) https://api.tmdb.org/3/search/movie?api_...anguage=en
2019-09-13 11:18:34.495 T:3473146592   DEBUG: Get: Using "UTF-8" charset for "https://api.tmdb.org/3/search/movie?api_key=f090bb54758cabf231fb605d3e3e0468&query=Spider%20Man%20Far%20from%20Home&year=&language=en"
2019-09-13 11:18:34.498 T:3473146592   DEBUG: scraper: GetSearchResults returned <results></results>
2019-09-13 11:18:34.498 T:3473146592 WARNING: No information found for item 'nfs://192.168.1.201/media/raid1/movie2/Marvel Collection/Spider-Man Collection/Spider-Man Far from Home (2019)/Spider.Man.Far.From.Home.2019.1080p.HDRip.x264.AC3-RPG.mkv', it won't be added to the library.



And another:

2019-09-13 11:18:35.586 T:3473146592   DEBUG: VideoInfoScanner: Scanning dir 'nfs://192.168.1.201/media/raid1/movie2/Nekrotronic (2018)/' as not in the database
2019-09-13 11:18:35.589 T:3473146592   DEBUG: CAddonSettings[metadata.themoviedb.org]: loading setting definitions
2019-09-13 11:18:35.589 T:3473146592   DEBUG: CAddonSettings[metadata.themoviedb.org]: trying to load setting definitions from old format...
2019-09-13 11:18:35.590 T:3473146592   DEBUG: CAddonSettings[metadata.themoviedb.org]: loading setting values
2019-09-13 11:18:35.597 T:3473146592   DEBUG: FindMovie: Searching for 'Nekrotronic' using The Movie Database scraper (path: '/home/osmc/.kodi/addons/metadata.themoviedb.org', content: 'movies', version: '5.1.8')
2019-09-13 11:18:35.612 T:3473146592   DEBUG: scraper: CreateSearchUrl returned <url>https://api.tmdb.org/3/search/movie?api_key=f090bb54758cabf231fb605d3e3e0468&amp;query=Nekrotronic&amp;year=2018&amp;language=en</url>
2019-09-13 11:18:35.613 T:3473146592   DEBUG: CurlFile::Open(0xcb829a10) https://api.tmdb.org/3/search/movie?api_...anguage=en
2019-09-13 11:18:35.625 T:3473146592   DEBUG: Get: Using "UTF-8" charset for "https://api.tmdb.org/3/search/movie?api_key=f090bb54758cabf231fb605d3e3e0468&query=Nekrotronic&year=2018&language=en"
2019-09-13 11:18:35.627 T:3473146592   DEBUG: scraper: GetSearchResults returned <results></results>
2019-09-13 11:18:35.628 T:3473146592   DEBUG: FindMovie: Searching for 'Nekrotronic' using The Movie Database scraper (path: '/home/osmc/.kodi/addons/metadata.themoviedb.org', content: 'movies', version: '5.1.8')
2019-09-13 11:18:35.628 T:3473146592   DEBUG: scraper: CreateSearchUrl returned <url>https://api.tmdb.org/3/search/movie?api_key=f090bb54758cabf231fb605d3e3e0468&amp;query=Nekrotronic&amp;year=&amp;language=en</url>
2019-09-13 11:18:35.629 T:3473146592   DEBUG: CurlFile::Open(0xcb829a10) https://api.tmdb.org/3/search/movie?api_...anguage=en
2019-09-13 11:18:35.643 T:3473146592   DEBUG: Get: Using "UTF-8" charset for "https://api.tmdb.org/3/search/movie?api_key=f090bb54758cabf231fb605d3e3e0468&query=Nekrotronic&year=&language=en"
2019-09-13 11:18:35.646 T:3473146592   DEBUG: scraper: GetSearchResults returned <results></results>
2019-09-13 11:18:35.646 T:3473146592 WARNING: No information found for item 'nfs://192.168.1.201/media/raid1/movie2/Nekrotronic (2018)/Nekrotronic.2018.1080p.BluRay.x264-PFa.mkv', it won't be added to the library.
2019-09-13 11:18:35.648 T:3473146592   DEBUG: VideoInfoScanner: No (new) information was found in dir nfs://192.168.1.201/media/raid1/movie2/Nekrotronic (2018)/

#2
Got the same issue - guessing they've updated their API.  Even the search bar on the website behaves differently (using y:2000 to narrow movies to that year)
#3
(2019-09-13, 21:18)craigey1 Wrote: Got the same issue - guessing they've updated their API.  Even the search bar on the website behaves differently (using y:2000 to narrow movies to that year)

Heh yea... I guess no one at themoviedb has heard of api versioning Big Grin
#4
@isamudaison

Yes, I can confirm this issue. Seems very similar to the problem that was fixed 1-2 weeks ago. It would be nice if TheMovieDB made more prominent notices of their updates.

If you use a Parsing NFO, then you are able to scrape the titles into the library.

Hopefully @olympia is available to look into it.

Moved to metadata scrapers forum
My Signature
Links to : Forum rules (wiki) | Banned_Add-ons (wiki) | Debug Log (wiki)  
Links to : HOW-TO:Create_Music_Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
#5
Same/Similar issue/s here with the nVidia Shield.

Thought there may be corruption somewhere with the OTA updates, so checked for scraper updates as always with no avail, then done a fresh install on there and scraped a folder containing my dvd rips (52 films), it only scraped 45 and a number of them were incorrect.

Second thing I did was come here to see if anyone else is having issues, and it seems so. I have no idea how to make a debug log on the Shield, never had to so far, so glad I don't need to get my head around that tonight.

I guess we'll need to wait on TmDB/TvDB to finish whatever they are doing and work on our setups later or tomorrow Smile
#6
No need to wait. Create a simple Parsing NFO file, and the scraper will find the title... https://kodi.wiki/view/NFO_files#Parsing_nfo
My Signature
Links to : Forum rules (wiki) | Banned_Add-ons (wiki) | Debug Log (wiki)  
Links to : HOW-TO:Create_Music_Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
#7
(2019-09-14, 04:23)Karellen Wrote: No need to wait. Create a simple Parsing NFO file, and the scraper will find the title... https://kodi.wiki/view/NFO_files#Parsing_nfo

Thanks matey, I know about the Parsing NFO's. I had already fresh installed and would need to use a manager for my large collection, but I can't be bothered with media managers at this time in the morning.. 03:34 here at the moment.

I have a few sd films to watch and that crackle app that's on the official repository will keep me busy for a while Smile
#8
(2019-09-14, 04:37)Rippoholic Wrote: I had already fresh installed and would need to use a manager for my large collection
A Parsing nfo is a file with a single line in it so don't confuse it with the traditional nfo files. Media managers don't even create them, so you will not need a media manager.
My Signature
Links to : Forum rules (wiki) | Banned_Add-ons (wiki) | Debug Log (wiki)  
Links to : HOW-TO:Create_Music_Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
#9
Same here, Kodi 18.4 in Android TV 8.0, TheMovieDB scraper doesn't work since yesterday Sad
#10
(2019-09-14, 05:06)Karellen Wrote:
(2019-09-14, 04:37)Rippoholic Wrote: I had already fresh installed and would need to use a manager for my large collection
A Parsing nfo is a file with a single line in it so don't confuse it with the traditional nfo files. Media managers don't even create them, so you will not need a media manager. 
From what I can see and understand from that, I'd need to do that for each movie and it won't work for tv episodes. I have near a thousand movies and no idea how much tv. I'm happy to wait until the scraper works again Smile

Just found this to play around with, so that'll keep me busy sorting and renaming some files in the mean time:
HOW-TO:Movie_universe (wiki)
#11
(2019-09-14, 14:03)Rippoholic Wrote: I have near a thousand movies
Oh right. I was under the impression it was only a few movies, had no idea you were scraping your entire library. Of course, too difficult.

(2019-09-14, 14:03)Rippoholic Wrote: and it won't work for tv episodes
That is right. It works for the TV Show, and the TV Show finds the episodes. You cannot find episodes without a tv show.
My Signature
Links to : Forum rules (wiki) | Banned_Add-ons (wiki) | Debug Log (wiki)  
Links to : HOW-TO:Create_Music_Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
#12
(2019-09-14, 20:33)Karellen Wrote:
(2019-09-14, 14:03)Rippoholic Wrote: I have near a thousand movies
Oh right. I was under the impression it was only a few movies, had no idea you were scraping your entire library. Of course, too difficult.
(2019-09-14, 14:03)Rippoholic Wrote: and it won't work for tv episodes
That is right. It works for the TV Show, and the TV Show finds the episodes. You cannot find episodes without a tv show. 

No worries matey. Yep, I need to do more than just the odd movie otherwise it'd be fine.

I'm a patient man and can wait.. For example I didn't watch any of the theatrical Hobbit movies, I waited the 3 years or so until all of the extended edition were released then had a Hobbit marathon Wink

Ah, I see. I wasn't aware of that. So TheMovieDB scrapes TV Shows now too? I thought TV was still all scraped through the TVDB.
Are they moving all the TV Shows over to TheMovieDB and going to stop running the TVDB then? Or this is just how Kodi will scrape from now on?

I thoroughly appreciate all the work you guys do, thank you Smile
#13
(2019-09-14, 21:25)Rippoholic Wrote: o TheMovieDB scrapes TV Shows now too? I thought TV was still all scraped through the TVDB.
Are they moving all the TV Shows over to TheMovieDB and going to stop running the TVDB then? Or this is just how Kodi will scrape from now on?
The Kodi changeover to use TheMOviedDB as the default TV Show scraper occurred during Nov 2018. We made the decision as TVDB had become too unreliable and many questions to them were going unanswered.

The TVDB and TheMovieDB are two separate entities, so there is no merging and both will continue to exist. You can still use TVDB if you choose by installing the TVDB scraper using the Get More button from the Set Content screen.

There is another TheMovieDB scraper for movies that is still in Beta. It is not affected by the current problems experienced by the default scraper. You can download it here... 344580 (thread)
I use it as my primary scraper for my own library.
The current issue with it is that you cannot modify settings per source as Kodi core needs a bit of work. Go to the settings page for the scraper in Add-ons>My Add-ons>Information providers>Movie Information adjust your settings there, and all sources for movies will use the same setting. For most users, this is not a problem, but some users may have different requirements for a particular source in their library.

How is the Movie Universe setup coming along?
My Signature
Links to : Forum rules (wiki) | Banned_Add-ons (wiki) | Debug Log (wiki)  
Links to : HOW-TO:Create_Music_Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
#14
(2019-09-14, 21:45)Karellen Wrote:
(2019-09-14, 21:25)Rippoholic Wrote: o TheMovieDB scrapes TV Shows now too? I thought TV was still all scraped through the TVDB.
Are they moving all the TV Shows over to TheMovieDB and going to stop running the TVDB then? Or this is just how Kodi will scrape from now on?
The Kodi changeover to use TheMOviedDB as the default TV Show scraper occurred during Nov 2018. We made the decision as TVDB had become too unreliable and many questions to them were going unanswered.

The TVDB and TheMovieDB are two separate entities, so there is no merging and both will continue to exist. You can still use TVDB if you choose by installing the TVDB scraper using the Get More button from the Set Content screen.

There is another TheMovieDB scraper for movies that is still in Beta. It is not affected by the current problems experienced by the default scraper. You can download it here... 344580 (thread)
I use it as my primary scraper for my own library.
The current issue with it is that you cannot modify settings per source as Kodi core needs a bit of work. Go to the settings page for the scraper in Add-ons>My Add-ons>Information providers>Movie Information adjust your settings there, and all sources for movies will use the same setting. For most users, this is not a problem, but some users may have different requirements for a particular source in their library.

How is the Movie Universe setup coming along? 

Ah, ok. I thought they were both run by the same team/s. I didn't realise that they were completely separate from each other. I was a little confused with some of the Stephen King stuff, Tommyknockers, IT (1990), Storm of the Century, The Langoliers, Golden Years, Salem's Lot original and remake, etc.. having both a movie and tv entry. I've put them in my TV section now, and I think a couple of them need to be there to scrape properly (When the scraper was working).

I've just had a read on the beta scraper, so it's only working for movies at the moment and not TV?
That's a couple of hoops to jump through to get it working, how would I install that on an nVidia Shield? (My Shield is my main hub for watching movies/tv.. it replaced an old pc and I was more than impressed with it)

RE: The Universe setup.. It's getting there. I only just noticed this line:
"Folder names should be clean and simple- eg Captain America The First Avenger (2011)"
..and there I was happily change the names of both folders and files.. I'm currently going back through changing the folder names back to what they were and keeping the file names renamed.
#15
Looks like there is a fix in the works for the scraper, so no need to install the beta scraper yet.

TheMOvieDB has two sections to their site - MOvies and TV Shows.

It is not immediately noticeable which is which unless you are familiar with the title or you look at the address bar and notice whether it links to \movies\ or \tv\

So what you think is a movie, could be a tv show or vice versa. Scroll the page a bit, and if you see a Seasons list, then it is TV Shows.
My Signature
Links to : Forum rules (wiki) | Banned_Add-ons (wiki) | Debug Log (wiki)  
Links to : HOW-TO:Create_Music_Library (wiki) | HOW-TO:Create_Video_Library (wiki)  ||  Artwork (wiki) | Basic controls (wiki) | Import-export library (wiki) | Movie sets (wiki) | Movie universe (wiki) | NFO files (wiki) | Quick start guide (wiki)
  Thread Closed
 
Thread Rating:
  • 0 Vote(s) - 0 Average



Logout Mark Read Team Forum Stats Members Help
TheMovieDB scraper stopped working00