Kodi Community Forum
Release Universal Movie Scraper - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302)
+----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821)



RE: [Release] Universal Scraper - spmckenz - 2012-12-29

(2012-12-27, 05:11)spmckenz Wrote: Here's a log. I started xbmc, scanned for a movie that hasn't been scrapping right (30 Days of Night) and then exited after it had been found and added to the library. Still no synopsis or cast info. Please let me know if I'm doing something wrong in generating the log, thanks!

Woops! I guess my first mistake in generating the log was not posting it! here it is, haha.

http://xbmclogs.com/show.php?id=24298


RE: [Release] Universal Scraper - olympia - 2012-12-29

I don't think you have debug logging enabled in system/settings/system/debugging, do you?


RE: [Release] Universal Scraper - spmckenz - 2012-12-29

I thought I did but I'll double check. Also, after some more investigation, the movies that are failing to load the data all have .nfo files within their folder that read like this:


<?xml version="1.0" ?>
<movie>
<title>30 Days of Night</title>
<originaltitel>30 Days of Night</originaltitel>
<rating>7.4</rating>
<year>2007</year>
<votes>25</votes>
<outline>As the sun sets over a small isolated Alaskan town for winter, the residents prepare for 30 days of total darkness. But dusk heralds the arrival of a pack of blood-hungry vampires . . . with a month to kill.</outline>
<genre>Action</genre>
<genre>Drama</genre>
<genre>Horror</genre>
<genre>Thriller</genre>
<runtime>113 min</runtime>
<premiered>2007-10-16</premiered>
<mpaa>R</mpaa>
<id>tt0389722</id>
</movie>


Obviously this is the common link, but I'm unsure as to why this file is causing XBMC to be unable to load this data. Should I just search for and delete all these files?


RE: [Release] Universal Scraper - olympia - 2012-12-29

YES


RE: [Release] Universal Scraper - spmckenz - 2012-12-29

Thanks, it did fix it. Only wish I had noticed the files before all this...


RE: [Release] Universal Scraper - smilenkovski - 2012-12-30

olympia
Just thank you for your work.


RE: [Release] Universal Scraper - Ectholian - 2012-12-30

I keep getting spanish and other language covers, even when i force the scraper settings to us international or english?


RE: [Release] Universal Scraper - olympia - 2012-12-30

(2012-12-30, 09:45)Ectholian Wrote: I keep getting spanish and other language covers, even when i force the scraper settings to us international or english?

"Nice post", zero information...

...I can only guess, first, read first 3 posts on page 36.

...and you must have set to Spanish some time because by default the scraper doesn't return Spanish posters unless there is no poster on the preferred language (or English) available.


RE: [Release] Universal Scraper - olympia - 2012-12-30

(2012-12-29, 20:22)Mbee Wrote: Universal Scraper doesn't seem to figure out "original title" searches within IMDB.
Basically, anything with non-standard (non US) characters fails to scrape. That means nearly all 'foreign films' but also US titles that have special characters.
A "unable to connect to remote server" message pops up instead of giving the user an option to chose the correct title - what's the deal with that?

here's a small samples of movies that don't scrape.

The Lion King 1½ - (US)
http://www.imdb.com/title/tt0318403/

Bröderna Lejonhjärta - (SWEDISH)
http://www.imdb.com/title/tt0075790/

Astérix aux jeux olympiques - (FRENCH)
http://www.imdb.com/title/tt0463872/

Löggulíf - (ICELANDIC)
http://www.imdb.com/title/tt0241696/

Yes, replacing the "original title" with the "translated" crap titles works - but that would defy the purpose of this new scraper as a replacement for the old IMDB scraper, which scraped the original titles just fine.

...or is there a hidden setting somewhere in "universal scraper" that allows for origninal title searches?

cheers!

This report was pretty shameless(...and thankless), but give it a try with v2.1.3


RE: [Release] Universal Scraper - digitaltomj - 2012-12-30

I just want to say that Universal scraper is the best in the repository by far, and Olympia has done an amazing job furthering the advance of XBMC. However I was wondering if a new feature could be implemented in a future version...or perhaps it already exists and I just over looked it because I have used this scraper for so long now I might have not noticed an update.

Either way, my suggestion is this, I would like Universal scraper to have the ability to scrape "movie set" fan art and thumbnails from TheMoviedb.org (I just noticed that they have them, before I just made my own...I can still manually add them but if it could be automated it would be so much better and I'm sure everyone else that uses movie sets would love it.)

I do realize that XBMC handles sets a bit differently than movies especially when it comes to the information aspect, I'm not sure if my request is possible or if it would need an entirely new program add-on. I just think it would be really nice to have.


RE: [Release] Universal Scraper - olympia - 2012-12-30

(2012-12-30, 18:05)digitaltomj Wrote: I just want to say that Universal scraper is the best in the repository by far, and Olympia has done an amazing job furthering the advance of XBMC.

Thank you!
...and smilenkovski for you as well! It's always nice to see positive feedback, so that despite all the whining you can keep going.

(2012-12-30, 18:05)digitaltomj Wrote: Either way, my suggestion is this, I would like Universal scraper to have the ability to scrape "movie set" fan art and thumbnails from TheMoviedb.org (I just noticed that they have them, before I just made my own...I can still manually add them but if it could be automated it would be so much better and I'm sure everyone else that uses movie sets would love it.)

Unfortunatelly this will not be possible until XBMC provides proper hooks for the scraper. Hopefully this feature will get added to XBMC 13.0.




RE: [Release] Universal Scraper - Milhouse - 2012-12-31

@olympia: I posted in the "Universal Scraper for Music Albums" thread about the last.fm API Key no longer being valid, not sure if you're subscribed to that thread but I see you are posting in this thread, so just an FYI/heads up.


RE: [Release] Universal Scraper - squareatom - 2013-01-01

@olympia
Having some issues with IMDb grabbing the wrong title or not being found at all. I think it's because they are categorized as 'TV Special'

Chris Rock: Kill the Messenger - London, New York, Johannesburg
http://www.imdb.com/title/tt1213574
Not found
Named as '/media/Movies/Chris.Rock.Kill.the.Messenger.(2008)/'

Comedy Central Roast of David Hasselhoff
http://www.imdb.com/title/tt1694505
Found as 'La comtesse des no mad?'
Named as '/media/Movies/Comedy.Central.Roast.of.David.Hasselhoff.(2010)/'

Comedy Central Roast of Joan Rivers
http://www.imdb.com/title/tt1413788
Found as 'Comedy's Biggest Thursday Ever'
Named as '/media/Movies/Comedy.Central.Roast.of.Joan.Rivers.(2009)/'

Some of the Comedy Central Roasts are categorized as 'TV Special' and others as 'TV Movie'.

'TV Movie' examples that are successfully scraped
Comedy Central Roast of Bob Saget
http://www.imdb.com/title/tt1276947/

Comedy Central Roast of Charlie Sheen
http://www.imdb.com/title/tt1985970/




RE: [Release] Universal Scraper - olympia - 2013-01-02

(2012-12-31, 13:53)MilhouseVH Wrote: @olympia: I posted in the "Universal Scraper for Music Albums" thread about the last.fm API Key no longer being valid, not sure if you're subscribed to that thread but I see you are posting in this thread, so just an FYI/heads up.

I am monitoring all Universal Scraper threads, but there is no such issue on my end, I cannot reproduce this.
Even if I just copy your quoted log entry, it works for me.


RE: [Release] Universal Scraper - Milhouse - 2013-01-02

Code:
http://ws.audioscrobbler.com/2.0/?method=album.getinfo&artist=Level%2042&amp;album=World%20Machine&amp;api_key=71e468a84c1f40d4991ddccc46e40f1b&lang=en

I'm still getting it - how strange. Is the key in the URL above correct? Why else would lastfm reject it (it is also rejected on the Pi, meaning all lastfm functionality is essentially not working).