Kodi Community Forum

Full Version: Universal Movie Scraper
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
A little more testing reveals the following...

Using Universal Movie Scraper:
1. Neither the Portuguese or English titles would scrape into the library
2. If I use a Parsing NFO File, then they would scrape... https://kodi.wiki/view/NFO_files
3. There is no metadata for the titles except Poster and Title. So the entry tends to look blank

Using TheMovieDB Scraper
1. Both titles scraped ok.

Either use a Parsing NFO file or switch to TheMovieDB scraper. I am guessing it has something to do with the accented à.

Just a reminder if you switch to TheMovieDB for this one movie, answer No when asked if you Do you want to refresh information for all items in this path
Hi,

I just tried with the English title but the result is the same as previous stated.

By my analysis, the problem must be in the encoding applied to the requested URL, because if i copy paste the logged URL, i obtain the 2 results, the English and the Portuguese movies. But the Universal Movie scraper don't get any results. If the request is being made with a wrong encoding, that could lead to no results, because of the á character. Its possible that the line regarding logging the generated URL is with the correct encoding and the actual URL used to make the request to tmdb is wrongly encoded.

I didn't know there as a themoviedb official scrapper for kodi. I will look into that. But i would advise some review in the encoding of those urls before making the request to tmdb.

Thanks
Yes it will be reviewed. @olympia is the developer for Universal Movie scraper and he will take a look.

TheMovieDB is the default scraper for Movies. At some stage you installed Universal Movie Scraper and changed Kodi to use it. All you have to do is go back to the Set Content page of the movie Source and change back to TheMovieDB. Nothing needs to be installed.

See Section 3 here if you can't quite remember how... https://kodi.wiki/view/Adding_video_sources
Hi,

I already proceeded with the change to themoviedb scraper, but unfortunately that scraper can't find either the movie entitled "Espectáculo Bugs Bunny 1 V1". I checked the logs, but the output seems to be identical to the other one when i used the Universal Movie Scraper. Is there any chance that the Universal Movie Scraper uses the themoviedb scraper? If so, that could explain the identical output i am getting when i try to search that specific directory (right click on the directory in kodi, i then click search new content, so it only search for that specific movie). Before that, i changed the source from Universal Movie scraper to themoviedb scraper and i cancelled the refresh to all paths associated as you suggested.

If you need to know more, just ask.

Thanks
Try with v4.1.9 once it has got updated.
Hi,

Just updated and it's working now.

Many thanks for the quick fix.

Have a good day Smile
Guys, I'm having a problem when trying to add a couple of shows to my library...

This is what I get from kodi.log that I think is related to the problem that I have
Quote:00:30:30.292 T:138485797968   ERROR: CCurlFile::FillBuffer - Failed: HTTP returned error 403
00:30:30.292 T:138485797968   ERROR: CCurlFile::Open failed with code 403 for http://api.themoviedb.org/3/tv/62286?api...anguage=en
00:30:30.292 T:138485797968   ERROR: Run: Unable to parse web site
00:30:30.293 T:138485797968 WARNING: No information found for item 'smb://192.168.1.100/Multimedia/Series/Fear of The Walking Dead/', it won't be added to the library.
00:30:30.860 T:138485797968   ERROR: CCurlFile::FillBuffer - Failed: HTTP returned error 403
00:30:30.860 T:138485797968   ERROR: CCurlFile::Open failed with code 403 for http://api.themoviedb.org/3/tv/1906?api_...anguage=en
00:30:30.860 T:138485797968   ERROR: Run: Unable to parse web site
00:30:30.861 T:138485797968 WARNING: No information found for item 'smb://192.168.1.100/Multimedia/Series/Shameless UK/', it won't be added to the library.

Alongside the log I found more stuff about this:
Quote:00:35:22.088 T:138330977360   DEBUG: VideoInfoScanner: Rescanning dir 'smb://192.168.1.100/Multimedia/Series/Fear of The Walking Dead/' due to change (041C2A018343F033E8664D7747C6BE9A != CC80256EE74AD2F4BCDAA698F9BD1E12)
00:35:22.090 T:138330977360   DEBUG: VideoInfoScanner: Found episode match smb://192.168.1.100/Multimedia/Series/Fear of The Walking Dead/S04/Fear the Walking Dead S04E01.mkv (s4e1) [s([0-9]+)[ ._x-]*e([0-9]+(?Sad?:[a-i]|\.[1-9])(?![0-9]))?)([^\\/]*)$]
00:35:22.098 T:138330977360   DEBUG: GetEpisodeId (smb://192.168.1.100/Multimedia/Series/Fear of The Walking Dead/S04/Fear the Walking Dead S04E01.mkv), query = select idEpisode from episode where idFile=2087
00:35:22.099 T:138330977360   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'smb://192.168.1.100/Multimedia/Series/Fear of The Walking Dead/S04/Fear the Walking Dead S04E01.mkv'
00:35:22.099 T:138330977360   DEBUG: GetEpisodeList: Searching 'http://api.themoviedb.org/3/tv/62286?api_key=6889f6089877fd092454d00edb44a84d&language=en' using The Movie Database scraper (file: '/storage/emulated/0/Android/data/org.xbmc.kodi/files/.kodi/addons/metadata.tvshows.themoviedb.org', content: 'tvshows', version: '2.0.3')
00:35:22.102 T:138330977360   DEBUG: CurlFile::Open(0x2044dfa500) http://api.themoviedb.org/3/tv/62286?api...anguage=en
00:35:22.102 T:138330977360    INFO: easy_aquire - Created session to http://api.themoviedb.org
00:35:22.336 T:138330977360   ERROR: CCurlFile::FillBuffer - Failed: HTTP returned error 403
00:35:22.339 T:138330977360   ERROR: CCurlFile::Open failed with code 403 for http://api.themoviedb.org/3/tv/62286?api...anguage=en
00:35:22.340 T:138330977360   ERROR: Run: Unable to parse web site
00:35:22.341 T:138330977360 WARNING: No information found for item 'smb://192.168.1.100/Multimedia/Series/Fear of The Walking Dead/', it won't be added to the library.

Very strange because he actually founds the name and episode of the serie but doesn't add in the end...
The problem is with the new season (S02) of Fear of the Walking Dead. Shameless UK is already added to my library. No way I can't add the new episodes from FTWD... tried with e01 and e02 and the same.
By the way, yesterday I was able to add the new Westworld episode.

Can anyone help me here??
@onesolo

Please don't post log snippets in the forum. If you want assistance, then post the FULL log only at a pastebin type site.
...and you are using metadata.tvshows.themoviedb.org', content: 'tvshows', version: '2.0.3' scraper on a TV Show.
This thread is for the Universal Movie Scraper...
I noticed that newly scraped movies no longer get a plot from IMDb. I haven't changed any settings, but since today none of my newly ripped movies have a plot description in Kodi (17.6).

I'm not near my HTPC now and I forgot to make a debug log, but I guess it's easily reproducible.
IMDb site layout changes...
Fixed in IMDb common scraper library v3.0.4.
Thanks! I can confirm it works again.
Universal Movie Scraper for IMDB hasn't worked properly for the "Cast" section the last few days (since at least May 1). It shows "Cast not Available" for some movies or scrapes far less actors than it had previously.

For example, right now I'm looking at Willow (1988), which I think I had rescraped on April 28. It has about fifteen actors listed under Cast. I just rescraped now, and I see only one actor.

I'm using version 4.1.9, which is the latest that I see in Kodi add-on repository.
Hi, i'm new to this forum (and a big fan of KODI for years), and to be honest, I don't know how to contact a Team Kodi member to ask my question. So I put it here and I hope it will reach someone who might be inspired by it ;-)
Well, I use the Universal Movie Scraper, and I just set it up to scrap IMDB data... I know the purpose of the addon is movie scrapping, but well, today it's not what I was looking for...

I've noticed that IMDB has now a lot of very useful infos about video games (casting, story, artists, etc).
https://www.imdb.com/search/title?title_type=video_game

I'd really love to be able to catalog my video games (PS3/PS4) as I do for movies and tv shows, enjoying fanart and cover art, voice acting infos, screenplay, story, artists involved, etc.
To do this, Universal Movie Scraper should be able to scrap the video games category of IMDB...!!!

I'll will use this feature combined with the "media stub files" feature (even better if there is a "videgame" extension file) to organize locally a list of games, and make KODI scrapping them.
I hope this idea will find some echo among your brilliant team of developpers Eek
Anyway a big thank you very much from France for all you've already done with the best piece of software I've ever seen in my life, cheers Nerd
Of course, if any addon for videogames data scrapping exists, please let me know...