Release Universal Movie Scraper - Printable Version +- Kodi Community Forum (https://forum.kodi.tv) +-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33) +--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27) +---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147) +----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302) +----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821) Pages:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
|
RE: Universal Movie Scraper - olympia - 2022-06-14 (2022-06-13, 00:42)At2010 Wrote: Whiile the parseIMDBplot function seems correct, the cached file it runs against is not. GetIMDBPlotById is returning tt052013-main-html to work with. I experienced the same for a good while now. Not sure what is the root cause of this. For sure it's not the "web page saver" as I also experience this if I look for the page source in a browser. RE: Universal Movie Scraper - monisriz - 2022-06-23 Looking for some clarity on the intended behavior when setting the options in the addon in the Ratings section. My options/settings: Get default ratings from => IMDB Also get ratings from Rotten Tomatoes => Checked - Rating generated using => TomatoMeter All Critics Also get ratings from MetaCritic => Unchecked Also get ratings from TMDB => Unchecked I have added my OMDB api key. IMDB ratings are being set as "default" as expected. However, for Rotten Tomatoes, what I see is that "Audience" ratings are also being scraped and getting added to my MySQL db (instead of just "Critics" rating). Looking at the options and selections above, when it comes to RT-related ratings, shouldn't ONLY the "TomatoMeter All Critics" ratings (associated with the tomato icon) be scraped and other ratings (popcorn icon) be ignored? A note after some more checking: When RT is selected as default rating provider, all four RT related ratings are scrapped even if "Also get non-default RT ratings" option is unchecked. The rating type selected under "Ratings generated using" sets the correct rating type as default. It seems regardless of RT related options chosen, if RT is selected as one of the ratings provider (default or not), all four RT ratings are scraped to the library? RE: Universal Movie Scraper - monisriz - 2022-06-24 delete. RE: Universal Movie Scraper - monisriz - 2022-06-24 (2022-06-14, 21:02)olympia Wrote:(2022-06-13, 00:42)At2010 Wrote: Whiile the parseIMDBplot function seems correct, the cached file it runs against is not. GetIMDBPlotById is returning tt052013-main-html to work with. IMDB has changed the layout and some of the info (e.g. tagline) is no longer on *.main.html. However, *.reference.html has a much simpler layout with all the relevant info available on it. Minor tweaking will fix it though and I believe someone a couple of posts earlier has the solution. RE: Universal Movie Scraper - itwasallablur - 2022-06-24 Where do you add the fixes? I'm using a Nvidia shield. RE: Universal Movie Scraper - Karellen - 2022-06-24 (2022-06-24, 08:51)itwasallablur Wrote: Where do you add the fixes? I'm using a Nvidia shield.If you are referring to the code in this post... https://forum.kodi.tv/showthread.php?tid=129821&pid=3101319#pid3101319 Then it completely replaces the existing code in the imdb.xml file of metadata.common.imdb.com located in the Kodi data folder (wiki) / addons folder You also have the choice to use a different scraper. RE: Universal Movie Scraper - staindrocks - 2022-07-02 (2022-06-24, 09:23)Karellen Wrote:(2022-06-24, 08:51)itwasallablur Wrote: Where do you add the fixes? I'm using a Nvidia shield.If you are referring to the code in this post... https://forum.kodi.tv/showthread.php?tid=129821&pid=3101319#pid3101319 So why aren't you implementing this change and offering it in an update? Does it not solve the issue consistently enough, or does it break other things... basically, what is the downside to doing it this way? RE: Universal Movie Scraper - Karellen - 2022-07-02 (2022-07-02, 02:31)staindrocks Wrote: So why aren't you implementing this change and offering it in an update? Does it not solve the issue consistently enough, or does it break other things... basically, what is the downside to doing it this way?I have no idea why it has not been fixed in the official download. Maybe @olympia has some issue with it? RE: Universal Movie Scraper - Jackanory - 2022-07-04 (2022-07-02, 02:55)Karellen Wrote:Perhaps a solution is being sought, that will trickle down to those of us that rely on earlier versions. For instance my 18.6 installation is stuck at version 5.5.10 of the Universal scraper, and hasn't scraped a plot for several weeks!(2022-07-02, 02:31)staindrocks Wrote: So why aren't you implementing this change and offering it in an update? Does it not solve the issue consistently enough, or does it break other things... basically, what is the downside to doing it this way?I have no idea why it has not been fixed in the official download. Maybe @olympia has some issue with it? I'm considering writing a update query to copy plot outline to plot, where ... appropriate. RE: Universal Movie Scraper - JJarmush - 2022-07-14 Hi is there any chance I run the universal movie scraper without kodi running? The idea is that each day the scraper is launched silently, detect any change in the video or music database, and stores the relevant data locally so when i launch kodi everything is already up-to date. A less polished alternative would be to
thanks RE: Universal Movie Scraper - At2010 - 2022-07-19 Hello again. https://paste.kodi.tv/qanufefaga.kodi This is my latest effort to improve imdb.xml. It implements fixes for the Plot and Tagline functions to use xx-reference.html instead of xx-main.html. I have verified this works consistently for a variety of test movies. functions changed: GetIMDBPlotById ParseIMDBPlot GetIMDBTaglineById ParseIMDBTagline To use, copy the pastebin code to a new imdb.xml. Backup and replace the imdb.xml file in %appdata%\Kodi\addons\metadata.common.imdb.com @ RE: Universal Movie Scraper - Karellen - 2022-07-19 Thanks @At2010 Are you in a position to create a PR here... https://github.com/xbmc/repo-scrapers/pulls RE: Universal Movie Scraper - At2010 - 2022-07-19 (2022-07-14, 18:39)JJarmush Wrote: Hi Beware of using Auto update on startup with this addon. IMDB still uses scraper functions on a web pages that change whenever Amazon wants. This can lead to a corruption or loss of information provided. I would recommend the TheMovieDB python addon for an automated process. There is also a Program addon in the repository called Library Auto Update by robweber that updates media libraries on a timer (so it says). I have not tried it but it may work for you. RE: Universal Movie Scraper - At2010 - 2022-07-19 (2022-07-19, 09:25)Karellen Wrote: Thanks @At2010 I have a github id, yes (at2010) . But i have not done anything for Kodi. Is there a how-to for information provider pull requests? Thanks, at2010 RE: Universal Movie Scraper - Karellen - 2022-07-19 (2022-07-19, 10:03)At2010 Wrote: Is there a how-to for information provider pull requests?Not anything comprehensive. Try section 3 here... https://kodi.wiki/view/Submitting_Add-ons#Pull_requests Maybe @olympia can help if you ask specific questions. If you make a mistake, don't stress. One of the developers will let you know how it should have been done. |