[olympia]

Hi guys

The universal movie scraper stopped scraping IMDb Top 250 info for my movies. Is that normal?


I noticed it when I reloaded some movie information, and the Top 250 icon didn't show up anymore. (The skin supports Top 250 icons for those movies.) The rest of the movie information is scraped correctly from IMDb. I'm bypassing the problem by using this add-on: http://forum.kodi.tv/showthread.php?tid=167754 . After I run that, the Top 250 info is back. But I'm guessing this is either a bug in the scraper, or something the API now forbids?

(Using Windows 10, Isengard.)

This has been fixed in v2.7.0 (available now from the Repo).

...aaaaaaaand, v2.7.0 brings back scraping Rotten Tomato ratings via OMDBAPI.com - thanks for them!

[smg669]

Is there a way to "re-scrape" movies that I added while the Rotten Tomatoes functionality was missing so I can update the movies that have a blank "rating" field?

[wgstarks]

Is there a way to "re-scrape" movies that I added while the Rotten Tomatoes functionality was missing so I can update the movies that have a blank "rating" field?

There might be easier ways to do this, but the only way I know would be to remove the movies from the database and then re-add them.
Move the file to a folder that is not scanned by Kodi.
Update and clean the database.
Move the video files back to their original location.
Update the database again.

I know this could be rather labor intensive if it's a lot of movies. Perhaps someone knows a better way.

[nickr]

Click "refresh" in the info screen?

[Cake Tiger]

I see that movieposterdb.com is offline and has been for a couple of days. It seems to be causing problems for me when scraping new movies. My scraper was set up to get posters from that website only as I like it best. I have changed my settings so that it looks for posters from other sources too but it doesn't seem to be working.

Do I have to delete the films I have added since changing my settings and re-add them under the new settings? I would have thought that using "refresh" would have worked but it hasn't so far. Is there a setting I'm forgetting to change somewhere?

I'm continuing to tinker in the meantime.

Edit - movieposterdb.com is back online now and all seems to be well

[Jay Lucky]

New movies aren't getting ratings from IMDB it seems. Using latest version, 2.7.0, is this a known issue? Would also be nice if we could refresh everything instead of having to re-add the source or go movie by movie.

[neurosis13]

New movies aren't getting ratings from IMDB it seems. Using latest version, 2.7.0, is this a known issue? Would also be nice if we could refresh everything instead of having to re-add the source or go movie by movie.

i can confirm this issue, something is wrong with imdb.

try imdb rating updater from my signature.
it resolved this issue for me at the moment, untiltill this is fixed at least.

[olympia]

I cannot reproduce this, so fixing would be hard. Debug log would be useful.

[great_vc]

I can confirm that rating is not working since last night
here is the debug log

http://pastebin.com/xVgG9qbU

[olympia]

Thanks for the log!
This doesn't seem to be a scraper issue actually (PCRE: Match limit reached).

I cannot reproduce the issue on Linux and Windows (No OSX here). Are you Jay Lucky and neurosis13 also on OSX?

[neurosis13]

Thanks for the log!
This doesn't seem to be a scraper issue actually (PCRE: Match limit reached).

I cannot reproduce the issue on Linux and Windows (No OSX here). Are you Jay Lucky and neurosis13 also on OSX?

Hi Olympia,

yes i am on OS X, it could be that this occurred after i installed the latest os x update (10.11.2)

but i am not sure at all.

Here is a screenshot of what i get after scraping, i noticed that the field Country/original title get's filled with the german Name of the movie which is wrong, normally there should be the country name.



when i switch the scraper to the movie.db then it get's the country right but also without rating/votes



when i set the rating in the moved scraper to themoviedb then votes works:

[great_vc]

Thanks for the log!
This doesn't seem to be a scraper issue actually (PCRE: Match limit reached).

I cannot reproduce the issue on Linux and Windows (No OSX here). Are you Jay Lucky and neurosis13 also on OSX?

Hi Olympia,

yes i am on OS X, it could be that this occurred after i installed the latest os x update (10.11.2)

I didn't did any update on either MacOS or Kodi, kodi add-ons.

ley us know how we can be of more help Olympia, it is getting on my OCD

[olympia]

Unfortunately I cannot be any help here. It is not an issue with the scraper, but Kodi core. Best I can suggest is to bring this up in the OSX forums.

[Jay Lucky]

Thanks for the log!
This doesn't seem to be a scraper issue actually (PCRE: Match limit reached).

I cannot reproduce the issue on Linux and Windows (No OSX here). Are you Jay Lucky and neurosis13 also on OSX?

Not on OSX, I'm on OpenELEC 6.0.0, Kodi 15.2 Git:02e7013. What can I provide to assist? It only started with the update to the scraper.

[Jay Lucky]

Here's the relevant debug log if that helps, appears similar to above with a PCRE match error.

Code:

13:05:44 T:140689155286784   DEBUG: GetVideoDetails: Reading movie 'http://akas.imdb.com/title/tt0126029/' using Universal Movie Scraper scraper (file: '/storage/.kodi/addons/metadata.universal', content: 'movies', version: '2.7.0')
13:05:44 T:140689155286784   DEBUG: CurlFile::Open(0x6a6dcc0) http://akas.imdb.com/title/tt0126029/
13:05:45 T:140689155286784   DEBUG: Get: Using "UTF-8" charset for HTML "http://akas.imdb.com/title/tt0126029/"
13:05:45 T:140689155286784   DEBUG: scraper: GetDetails returned <details><id>tt0126029</id><originaltitle>Shrek</originaltitle><year>2001</year><chain function="GetIMDBAKATitlesById">tt0126029</chain><chain function="GetIMDBCountryCert">tt0126029</chain><runtime>90</runtime><chain function="GetI
13:05:45 T:140689155286784   DEBUG: scraper: GetIMDBAKATitlesById returned <details><url cache="tt0126029-combined.html" function="ParseIMDBAKATitles">http://akas.imdb.com/title/tt0126029/combined|accept-language=en-us</url></details>
13:05:45 T:140689155286784   DEBUG: CurlFile::Open(0x6a6dcc0) http://akas.imdb.com/title/tt0126029/combined
13:05:46 T:140689155286784   DEBUG: Get: Using "ISO-8859-1" charset for HTML "http://akas.imdb.com/title/tt0126029/combined|accept-language=en-us"
13:05:46 T:140689155286784   DEBUG: scraper: ParseIMDBAKATitles returned <details><title>Shrek</title></details>
13:05:46 T:140689155286784   DEBUG: scraper: GetIMDBCountryCert returned <details><url cache="tt0126029-combined.html" function="ParseIMDBCountryCert">http://akas.imdb.com/title/tt0126029/combined|accept-language=en-us</url></details>
13:05:46 T:140689155286784   DEBUG: scraper: ParseIMDBCountryCert returned <details><mpaa>Rated PG</mpaa></details>
13:05:46 T:140689155286784   DEBUG: scraper: GetIMDBRatingById returned <details><url cache="tt0126029-main.html" function="ParseIMDBRating">http://akas.imdb.com/title/tt0126029/|accept-language=en-us</url></details>
13:05:46 T:140689155286784   ERROR: PCRE: Match limit reached
13:05:46 T:140689155286784   DEBUG: scraper: ParseIMDBRating returned <details></details>
13:05:46 T:140689155286784   DEBUG: scraper: GetIMDBTOP250ById returned <details><url cache="tt0126029-main.html" function="ParseIMDBTOP250">http://akas.imdb.com/title/tt0126029/|accept-language=en-us</url></details>
13:05:46 T:140689155286784   DEBUG: scraper: ParseIMDBTOP250 returned <details></details>
13:05:46 T:140689155286784   DEBUG: scraper: GetIMDBGenresById returned <details><url cache="tt0126029-main.html" function="ParseIMDBGenres">http://akas.imdb.com/title/tt0126029/|accept-language=en-us</url></details>
13:05:46 T:140689155286784   DEBUG: scraper: ParseIMDBGenres returned <details><genre>Animation</genre><genre>Adventure</genre><genre>Comedy</genre><genre>Family</genre><genre>Fantasy</genre></details>
13:05:46 T:140689155286784   DEBUG: scraper: GetIMDBStudioById returned <details><url cache="tt0126029-main.html" function="ParseIMDBStudio">http://akas.imdb.com/title/tt0126029/|accept-language=en-us</url></details>
13:05:46 T:140689155286784   DEBUG: scraper: ParseIMDBStudio returned <details><studio>DreamWorks Animation</studio></details>
13:05:46 T:140689155286784   DEBUG: scraper: GetIMDBCountryById returned <details><url cache="tt0126029-main.html" function="ParseIMDBCountry">http://akas.imdb.com/title/tt0126029/|accept-language=en-us</url></details>
13:05:46 T:140689155286784   DEBUG: scraper: ParseIMDBCountry returned <details><country>USA</country></details>

Full log if you need it - http://pastebin.com/dK8FMfpg