Kodi Community Forum
Release Universal Movie Scraper - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302)
+----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821)



RE: [Release] Universal Movie Scraper - judocama - 2015-08-26

I'm using Universal movie scrapper and configuration I have chosen Imdb to get information.
I 've noticed that often does not collect good information from the website and specifically especially in the length of the movie .
For example I have in my bibilioteca
http://www.imdb.com/title/tt0374569/
and get 115 minutes as long as the website is 135 minutes.

Anyone know how to fix this?
Thanks in advance.


RE: [Release] Universal Movie Scraper - discoHR - 2015-08-27

Excellent add-on, love it! I'm using it for documentaries too because there is pretty much everything on IMDB. It would be perfect if we could assign it for non-movie sources such as TV Shows.


RE: [Release] Universal Movie Scraper - eggsterino - 2015-09-08

Hi

In general I want to get the titles in English, however for movies created in my own country I wish to use the local title. In my case, I want movies from Israel to get Hebrew titles.
I know there is no option for that so I've been thinking of extending the add-on with a condition that checks for the country and if it Israel (or some parameter that holds the contry) it will take the original title instead of the title.

The problem is that I have no idea how to do that.

Any suggestions?
Thanks.


RE: [Release] Universal Movie Scraper - judocama - 2015-09-10

Can anyone tell me how to get the genres of films in Spanish , just out in English.

Thanks in advance.


RE: [Release] Universal Movie Scraper - skydivertricky - 2015-09-19

Hi All
Im trying to get UK film ratings. Ive downloaded the universal scraper - set ratings data to uk, refreshed the library cache and I still get US ratings.
Any ideas? do I need to reboot kodi or remove/recreate the library?


RE: [Release] Universal Movie Scraper - wgstarks - 2015-09-19

(2015-09-19, 10:10)skydivertricky Wrote: Hi All
Im trying to get UK film ratings. Ive downloaded the universal scraper - set ratings data to uk, refreshed the library cache and I still get US ratings.
Any ideas? do I need to reboot kodi or remove/recreate the library?

If the movies have already been scraped into your library you would need to remove them and then re-scrape them. I would try this with just one movie first, just to be sure your settings are correct. Many people change the settings for the addon thinking that it will change the way their movies get scraped. Actually this only changes the default settings. For existing movie sources you have to change scraper settings by editing that source. You should also make sure that the db you're scraping from actually contains the proper ratings. It probably does, but I know in other countries they can be very incomplete.


RE: [Release] Universal Movie Scraper - subterfugium - 2015-10-03

(2015-02-18, 15:49)olympia Wrote: This is not gonna be an easy one. Previously we were scrapping from the Web. Now it is not possible anymore to lookup movies via IMDb ids on their web, it is only possible via their API. This wouldn't be a problem, moreover this would be preferable, but their API is volume limited. If we send all our queries via the same API ID to them it will stop working and reject further queries in seconds. Not sure yet how to overcome on this.

How about using beta Movie Alias part of the API? It's beta but still better than nothing.

http://developer.rottentomatoes.com/docs/read/json/v10/Movie_Alias

Example: http://api.rottentomatoes.com/api/public/v1.0/movie_alias.json?apikey=[your_api_key]&type=imdb&id=0031381

For scraper options add field for apikey and option where user can choose if (s)he is from US or not. Shared API key won't fix this unless you ask rt.com to allow univresal scraper higher request count Smile

Another option is to use the search method of the api and then loop thru results until you found imdb match:
"alternate_ids": {"imdb": "0031381"}, (returned by new API).

I tried to look at scraper files but couldn't find python source code or is this implemented in Python? If it is I can help implementing this. You don't need to regexp anything anymore instead use JSON parser in Python Smile


RE: [Release] Universal Movie Scraper - Dave the Minion - 2015-10-05

Has there been some issue with the US lately just freezing and not scraping? I've not been following along and it only seems to affect 1 of my machines but Ill run a full video update or even just scan 1 source for new content and it simply hangs. Most times I have to uit Kodi and restart the PC in order to open Kodi again. Just seems odd to have suddenly started happening.


RE: [Release] Universal Movie Scraper - nickr - 2015-10-07

Debug log (wiki)


RE: [Release] Universal Movie Scraper - judocama - 2015-10-08

Hello,
When I update the library all the movies that have accents (Á) , the letter (Ñ) don´t detect them and have to do it manually.
In Spain these signs are very common so I lot of my film library runs out automatically updated and is a lot of time do it.
As I can fix it?
Thanks in advance.


RE: [Release] Universal Movie Scraper - judocama - 2015-10-26

Hello, I want to create an .nfo file for all those movies where I have problems to detect the scraper. What is the best option to put the minimum possible data to .nfo ( I have thought just put the original title, translated and year of the film) and the rest collect the autoaticamente scraper internet.

<movie>
<id>ttxxxxxx</id>
<title>xxxxx</title>
<originaltitle>xxxxx</originaltitle>
<director>xxxxx</director>
<year>xxxx</year>
</movie>
http://www.imdb.com/title/ttxxxxxx

If I put this nfo inside the folder I would take those data and the remainder nfo (writer , actors, etc ... Scraper score ) It is correct?

Thanks in advance.


RE: [Release] Universal Movie Scraper - wgstarks - 2015-10-26

(2015-10-26, 21:29)judocama Wrote: Hello, I want to create an .nfo file for all those movies where I have problems to detect the scraper. What is the best option to put the minimum possible data to .nfo ( I have thought just put the original title, translated and year of the film) and the rest collect the autoaticamente scraper internet.

<movie>
<id>ttxxxxxx</id>
<title>xxxxx</title>
<originaltitle>xxxxx</originaltitle>
<director>xxxxx</director>
<year>xxxx</year>
</movie>
http://www.imdb.com/title/ttxxxxxx

If I put this nfo inside the folder I would take those data and the remainder nfo (writer , actors, etc ... Scraper score ) It is correct?

Thanks in advance.

You are correct. The minimum you would need is actually only the IMDb url. The XML data is only needed if you want to customize the data rather than using what IMDb provides.


RE: [Release] Universal Movie Scraper - judocama - 2015-10-26

ThanksIn my case I only want me to wear the title well translated.
It might be so ?

<!-- <meta name="PageSplit" content="1">
<meta name="uidNaming" content="title"> -->
<movie>
<title>xxx</title>
<url>http://www.imdb.com/title/tt0102926</url>
</movie>

I export the metadata from my mac software DVDpedia

Thanks a lot.


RE: [Release] Universal Movie Scraper - amergin - 2015-10-29

I'm having problems in having some movies getting recognized correctly. The movie directories have a nfo file produced by TMM in them and they point to the correct movie titles. It is as if the scraper is not even using the metadata available in the directory. Any ideas what am I doing wrong on these examples:

$ ls -lah "The Pawnshop (1916)"/
total 2292312
drwxrwxrwx@ 1 jz staff 264B Oct 28 18:28 .
drwx------@ 1 jz staff 13K Oct 29 19:33 ..
-rw-rw-rw-@ 1 jz staff 1.1G Jun 21 23:09 The.Pawnshop.1916.720p.BluRay.x264-GHOULS.mkv
-rw-rw-rw-@ 1 jz staff 503K Oct 28 18:28 fanart.jpg
-rw-rw-rw-@ 1 jz staff 4.3K Oct 28 18:28 movie.nfo
-rw-rw-rw-@ 1 jz staff 63K Oct 28 18:28 poster.jpg
(recognized as http://www.imdb.com/title/tt0007219/reference when it should be http://www.imdb.com/title/tt0007162/reference - can't find it even manually)

$ ls -lah "Agora (2009)"/
total 2859304
drwxr-xr-x 1 jz staff 364B Oct 28 18:15 .
drwx------@ 1 jz staff 13K Oct 29 19:33 ..
-rw-r--r-- 1 jz staff 701M Jun 20 2010 Agora.Cd1-iKA.avi
-rw-r--r-- 1 jz staff 40K Jun 20 2010 Agora.Cd1-iKA.srt
-rw-r--r-- 1 jz staff 695M Jun 20 2010 Agora.Cd2-iKA.avi
-rw-r--r-- 1 jz staff 47K Jun 20 2010 Agora.Cd2-iKA.srt
drwxr-xr-x 1 jz staff 264B Oct 15 2011 Sample
-rw-r--r--@ 1 jz staff 267K Oct 28 18:15 fanart.jpg
-rw-r--r-- 1 jz staff 4.4K Jun 20 2010 ika-agora.nfo
-rw-r--r--@ 1 jz staff 11K Oct 28 18:15 movie.nfo
-rw-r--r--@ 1 jz staff 86K Oct 28 18:15 poster.jpg
(recognized as http://www.imdb.com/title/tt0323411/reference when it should be http://www.imdb.com/title/tt1186830/reference)

$ ls -lah "Die Hard (1988)"/
total 2871856
drwxrwxrwx 1 jz staff 296B Oct 28 18:21 .
drwx------@ 1 jz staff 13K Oct 29 18:36 ..
-rw-rw-rw-@ 1 jz staff 733K Oct 28 18:21 fanart.jpg
-rw-rw-rw-@ 1 jz staff 9.8K Oct 28 18:21 movie.nfo
-rw-rw-rw-@ 1 jz staff 182K Oct 28 18:21 movieset-fanart.jpg
-rw-rw-rw-@ 1 jz staff 47K Oct 28 18:21 movieset-poster.jpg
-rw-rw-rw- 1 jz staff 701M Oct 15 2011 nep-dh-cd1-xvid.avi
-rw-rw-rw- 1 jz staff 700M Oct 15 2011 nep-dh-cd2-xvid.avi
-rw-rw-rw-@ 1 jz staff 71K Oct 28 18:21 poster.jpg
(recognized as http://www.imdb.com/title/tt0341553/reference)

$ ls -lah "Raid (2003)"/
total 2867432
drwxr-xr-x 1 jz staff 296B Oct 28 18:28 .
drwx------@ 1 jz staff 13K Oct 29 19:33 ..
-rw-r--r--@ 1 jz staff 4.8K Oct 28 18:28 movie.nfo
-rw-r--r-- 1 jz staff 698M Jul 11 2003 nmg-raid-xvid-cd1.avi
-rw-r--r-- 1 jz staff 26K Jul 10 2003 nmg-raid-xvid-cd1.sub
-rw-r--r-- 1 jz staff 700M Jul 11 2003 nmg-raid-xvid-cd2.avi
-rw-r--r-- 1 jz staff 64K Jul 11 2003 nmg-raid-xvid-cd2.idx
-rw-r--r-- 1 jz staff 1.1M Jul 11 2003 nmg-raid-xvid-cd2.rar
-rw-r--r-- 1 jz staff 7.0K Jul 11 2003 raid.2003.dvdrip.xvid-nmg.nfo
(recognized as http://www.imdb.com/title/tt2482826/reference - should be http://www.imdb.com/title/tt0330802/reference)


RE: [Release] Universal Movie Scraper - Critical Movie Reception - xymx - 2015-11-07

After watching a terrible movie recently with a plot preview that sounded good ("Cold Creek Manor") but was an utter waste of ... well anything - is it possible to display the Rotten Tomatoes assessment with the movie title or poster? That would save the time to check online if a recorded film is worth watching ... Confused
Thanks!