Kodi Community Forum
Release Universal Movie Scraper - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302)
+----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821)



RE: Universal Movie Scraper - Karellen - 2019-06-23

It is one of many reasons why Kodi dropped TVDB as the default scrape and now uses TheMovieDB.

TheMovieDB has a much better designed database that can accommodate multiple different orders for a single show.


RE: Universal Movie Scraper - rafikW - 2019-06-23

(2019-06-23, 12:50)Karellen Wrote: It is one of many reasons why Kodi dropped TVDB as the default scrape and now uses TheMovieDB.

TheMovieDB has a much better designed database that can accommodate multiple different orders for a single show.
Yes, that looks as a good choice.
Regarding this series... I followed instruction and unfortunately it seems on TheMovieDB group called "Netflix (Digital)" (https://www.themoviedb.org/tv/71446-la-casa-de-papel/episode_group/5ae0275b0e0a26156c00de9f) contain wrong information as well. They divided it into 3 Parts:
Part 1 9 Episodes
Part 2 6 Episodes
Part 3 1 Episode
which is not correct.
Original series aired by Antenna 3 in Spain was 15 episodes in Season 1 (each around 70 minutes) It doesn't matter that last 6 episodes (e10-e15) were aired after 4 months since e09 was aired. Still it is Season 1.
What Netflix did? Netflix took those 15 episodes, cut them and created 22 episodes (each around 45 minutes) and split into 2 Seasons:
Season 1 - 13 Episodes
Season 2 - 9 Episodes
This structure is also not reflected in TheMovieDB :-(
I will join discussion that is ongoing on TheMovieDB.

[EDIT] Can't be done: https://www.themoviedb.org/tv/71446-la-casa-de-papel/discuss/5afd7879c3a36841c5003d4b#5afda6bdc3a36841a10037ca because of some rules that are blocking both TheMovieDB and TVDB from moving forward and handle rare cases with series that are mixed/cut/reorganized. Sad that those rules causing databases can't mature and evolve.
[EDIT2] Another discussion that I was in the middle: https://www.themoviedb.org/tv/71446-la-casa-de-papel/discuss/5d0f6ddc9251412f8fb90387#5d0fb6b20e0a2641a6ccdcf4


RE: Universal Movie Scraper - Edworld - 2019-06-23

(2019-06-17, 15:37)edjalmo Wrote:
(2019-06-17, 01:23)Edworld Wrote: Issue was reported in media companion thread. For some unknown reason, not all audience ratings are being scraped
Thanks!
So, this is an issue with OMDB API, and not with Universal Movie Scraper?! 

That is my understanding


RE: Universal Movie Scraper - Karellen - 2019-06-23

(2019-06-23, 13:30)rafikW Wrote: Regarding this series... I followed instruction and unfortunately it seems on TheMovieDB group called "Netflix (Digital)" (https://www.themoviedb.org/tv/71446-la-c...156c00de9f) contain wrong information as well. They divided it into 3 Parts:
ah right.

Ok, then you are left with the NFO Files option. What I would do is...
1. scrape the episodes you have, that way you can download as much information as possible.
2. Export your library to Separate Files to get the NFO Files with all that info.
3. Delete the TV Show from your library
4. Edit your nfo files to match what episodes you have
5. Scan back into the library


RE: Universal Movie Scraper - lucianls - 2019-06-23

(2019-06-17, 23:49)Karellen Wrote: I should also add that I don't know what your scraper Settings are for this scraper, and what information you are scraping from IMDB or TMDB. But if you are in a hurry, TheMovieDB scraper will be able to scrape using original title, or change your file name to the English title.

Main settings are:
Get tile from - IMDb (also tried TMDb with same results)
Preferred title language from - Keep Original
dunno if others matter

as I mentiend before, even when trying the manual entry (both original French title and International English title), the correct title doesn't appear in the search results list.


RE: Universal Movie Scraper - K0D1User1138 - 2019-07-02

A few new titles I've scraped seem to be missing various ratings from Rotten Tomatoes and/or Metacritic. Are there changes to those API's that are causing issues?


RE: Universal Movie Scraper - olympia - 2019-07-08

Examples please


RE: [Release] Universal Scraper - stephen147 - 2019-07-12

Paranormal Activity says 2009 on TMDB with it being premiered in 2007. IMDB just displays it as 2007.

This leaves Uni-Scraper having a hard time finding the correct one. You have to manually scrape info and then choose 2007 but it then displays 2009 as the year.

Seems like a scraping issue in the search but not when writing the value to the database.

https://www.themoviedb.org/movie/23827-paranormal-activity?language=en-US
https://www.imdb.com/title/tt1179904/


RE: Universal Movie Scraper - sniferx1 - 2019-07-14

Hello...

Thanks for this awesome add-on. I have scraped around 4000+ movies and all went well excluding below titles. I think bug present and kindly investigate and fix this for other users. Note that I have tested the same titles with the "The Movie Database" scraper and it's working but I like to one scraper for my all movies.

Titles that NOT scraping:
Avengers Assemble - https://www.imdb.com/title/tt0848228/ 
Error:
When selected error showing "No Information Found!"

All Star Wars movies:
Error:
When selected error showing "No Information Found!"

Note:
I tried to give the IMDB Movies title ID via manuel search but same error. Givev most got the Avengers movie I am sure this is not hard bug to fix.


RE: Universal Movie Scraper - Karellen - 2019-07-14

@sniferx1

Please read... https://forum.kodi.tv/showthread.php?tid=336969


RE: Universal Movie Scraper - mardukL - 2019-07-22

Hello, im here to report a bug realted to certifications,espeacially the use of a PREFIX for MPAA Certificcation for Movies.


PREFIX
When i change the prefix within the settings, the old old prefix remains.
- movie refresh = same sults, old old prefix remains
- remove movie from library and re-add via context menu on files section = same result, old old prefix remains
- remove movie from library and rescan whole library = same result, old old prefix remains
- remove library source, reset library source (same path) = NEW PREFIX is used ,working as intended


CHANGE MPAA + PREFIX
- movie refresh = same sults, old old prefix /mpaa cert remains
- remove movie from library and re-add via context menu on files section = same result, old old prefix /mpaa cert remains
- remove movie from library and rescan whole library = same result, old old prefix /mpaa cert remains
- remove library source, reset library source (same path) = NEW PREFIX is NOT used ,its showing 'RATED' instead of the prefix, NEW MPAA based on certcountry value is correct

Im am unsure if i am alone with this, and may someone can reproduce this steps to confirm.

(i know changing prefix was working a while back on refresh....)

Using Leia
Kodi (18.3 Git:20190619-89472b7d69). Platform: Windows NT x86 64-bit

and Android kodi-18.3-Leia-armeabi-v7a

EDIT: forget to metion using $INFO[listitem.mpaa] if it asnt clear.


RE: Universal Movie Scraper - Karellen - 2019-07-23

@mardukL

I could not replicate the problem, but I think I know where your mistake is.

(2019-07-22, 16:38)mardukL Wrote: When i change the prefix within the settings, the old old prefix remains.
Where did you change the prefix?
1. Add-ons > My Add-ons > Information Providers > Movie Information, or
2. Videos > Files > Your Source then using the Context Menu to Change Content


Changing option 1 sets a Default combination of settings which then are used when adding a Source. It saves you making the same changes each time you add a new Source. It does not affect existing Sources
This is why you had success with remove library source, reset library source (same path) = NEW PREFIX is used ,working as intended because you removed the original settings and applied the new default settings.

Option 2 must be used to change settings to an existing Source


RE: Universal Movie Scraper - mardukL - 2019-07-23

(2019-07-23, 01:00)Karellen Wrote: @mardukL

I could not replicate the problem, but I think I know where your mistake is.

(2019-07-22, 16:38)mardukL Wrote: When i change the prefix within the settings, the old old prefix remains.
Where did you change the prefix?
1. Add-ons > My Add-ons > Information Providers > Movie Information, or
2. Videos > Files > Your Source then using the Context Menu to Change Content


Changing option 1 sets a Default combination of settings which then are used when adding a Source. It saves you making the same changes each time you add a new Source. It does not affect existing Sources
This is why you had success with remove library source, reset library source (same path) = NEW PREFIX is used ,working as intended because you removed the original settings and applied the new default settings.

Option 2 must be used to change settings to an existing Source

i know, thats strange.

i used
addon universal movie scrapper settings -> rating -> certification prefix (change the value)

than try to force refresh of a movie in the common 3 ways
a) refresh movie via videoinfo

here is an example on android with a fresh install using a fakemediathek for test , structure is
moviename (year)/moviename (year).ext
https://streamable.com/73oat
- note using 'fsk ' as prefix is before a whole library scan on empty mediathek

log: for a)

b) remove single video via context menu , and rescan library
c) delete the source, restart kodi , set source again and scan


I still dont know what i may do wrong, and why just re-set 'the whole source' is working , because i remembered it also working ob refresh a while back .But i can live with that and your expl and concluson to point 1 makes sense.


RE: Universal Movie Scraper - Karellen - 2019-07-23

(2019-07-23, 08:38)mardukL Wrote: I still dont know what i may do wrong, and why just re-set 'the whole source' is working
When you change settings for the scraper, do it from here...

Go to Videos>Files
Image

Highlight your Source, bring up the Context Menu and select Change Content
Image


SELECT SETTINGS FROM THIS SCREEN TO CHANGE THE SCRAPER SETTINGS
Image


RE: Universal Movie Scraper - mardukL - 2019-07-23

(2019-07-23, 09:02)Karellen Wrote:
(2019-07-23, 08:38)mardukL Wrote: I still dont know what i may do wrong, and why just re-set 'the whole source' is working
When you change settings for the scraper, do it from here...

Go to Videos>Files
Image

Highlight your Source, bring up the Context Menu and select Change Content
Image


SELECT SETTINGS FROM THIS SCREEN TO CHANGE THE SCRAPER SETTINGS
Image
okay thanks again, i will do it this way again.
Even if it also need a rescan of the whole library sourcepath but's the shortest solution.

Have a good day Wink