+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: Movie Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=302)
+----- Thread: Release Universal Movie Scraper (/showthread.php?tid=129821)
Pages:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
RE: [Release] Universal Movie Scraper - texasfrank - 2014-12-08
Is UMS broken in Gotham, latest ATV2 release 13.2?
I can't add any videos to the DB using the Universal Movie Scraper, have to revert to theMovieDB-Scraper.
Though that does work, too, I'd rather have the fully-equipped UMS back. Any API changes or sthing like that?
RE: [Release] Universal Movie Scraper - bluenote - 2014-12-14
I suddenly found myself with trailers (movie name-trailer.mov in movie folder) showing up in my library as if they are movies. I didn't change any settings to my knowledge. How could this happen, and how do I fix it?
Thx
RE: [Release] Universal Movie Scraper - komadori - 2014-12-28
Hi,
first post (long time lurker and user of Xbmc/Kodi).
I think I found a bug in UMS recently.
It's "100%" reproducible.
Using IMDB as the name source and getting US Names, some movies cannot be found. Case in point is for example the OpenMovie "Sintel" from 2010. Parsing my log, UMS uses this string as search:
http://akas.imdb.com/find?q=Sintel&s=tt
but the user information box doesn't return Sintel as the valid choice. So... I was wondering why Interstellar (the second result in the akas search box) is in the result list and Sintel was not (the first result). And my only explanation is, that Interstellar does have actual AKAs and different language names, whereas Sintel does not.
The same is true for Tears of Steel (same OpenMovie releaser). But that movie does have a language name.
Either way, to me it seems sometimes the first result is somehow dropped. The result html in the debug log also starts with Interstellar... maybe it just ignores the first result, but that'd also mean that a lof of movies would never be found, which is unlikely.
Either way, I just wanted to let you know.
RE: [Release] Universal Movie Scraper - nickr - 2014-12-28
I vaguely recall an option to ignore short movies - check ums settings.
RE: [Release] Universal Movie Scraper - maxdido - 2015-01-03
Is it just me? I don't get any plot text and ratings for my movies?
When I manually refresh/update a movie it scrapes the internet and finds plot and ratings and more.
But I can't do this manually for 400+ movies.
I make use of NFO files. They look like this:
PHP Code:
<?xml version="1.0" encoding="UTF-8" ?>
<movie>
<title>300</title>
<set>300</set>
<year>2006</year>
<thumb>nfs://192.168.1.3/volume2/HD2-Movies/fanart/300[Cover].jpg</thumb>
<fanart>
<thumb>nfs://192.168.1.3/volume2/HD2-Movies/fanart/300[Backdrop].jpg</thumb>
</fanart>
<playcount>1</playcount>
<id>tt0416449</id>
</movie>
As you can see in below pictures the difference. First one is from the NFO and the Second one is the refresh from internet. I thought the scraper would first catch all info from NFO and what is not in the NFO it scrapes from the internet?
RE: [Release] Universal Movie Scraper - wgstarks - 2015-01-03
For the scraper to include information from the nfo and also from the internet you need to include an IMDB url in the nfo file. Example
RE: [Release] Universal Movie Scraper - maxdido - 2015-01-03
I will give it a try. Thing is now I have to go through 400+ nfo files.That sucks.
RE: [Release] Universal Movie Scraper - maxdido - 2015-01-03
I managed to change all NFO files at once with TextCrawler and Regular Expressions. Nice.
See my post for TextCrawler How I did it: Here
RE: [Release] Universal Movie Scraper - wgstarks - 2015-01-03
(2015-01-03, 16:05)maxdido Wrote: I will give it a try. Thing is now I have to go through 400+ nfo files.That sucks.
(2015-01-03, 17:24)maxdido Wrote: I managed to change all NFO files at once with TextCrawler and Regular Expressions. Nice.You know that in most cases nfo files are not necessary for Kodi, right?
See my post for TextCrawler How I did it: Here
RE: [Release] Universal Movie Scraper - nickr - 2015-01-04
Why are you using nfo files at all. Rename properly and it wont be needed.
RE: [Release] Universal Movie Scraper - LawF0rge52 - 2015-01-04
(2014-12-28, 12:22)komadori Wrote: It's "100%" reproducible.
Using IMDB as the name source and getting US Names, some movies cannot be found. Case in point is for example the OpenMovie "Sintel" from 2010. Parsing my log, UMS uses this string as search:
http://akas.imdb.com/find?q=Sintel&s=tt
Hey folks,
I have exactly the same issue but with a German title:
Filename: Verdammnis (2009).mkv
Debug logfile shows that this URL will be used to get the results: http://akas.imdb.com/find?q=Verdammnis&s=tt
But as komadori already wrote the correct one is not included in the scraper results (in debug log as well). If I use the same URL via web browser I can retrieve the correct one.
There is something odd but don't know what.
Please let me know if someone needs more information about this issue or further investigation.
Thanks so much!
Cheers
RE: [Release] Universal Movie Scraper - olympia - 2015-01-04
Finding titles on the selected language is best effort. Given we are not using an API from IMDb, but scraping the web, and IMDb is not very consistent, you will never get 100% accuracy. There will always be exceptions which won't work. You will need to rename these manually. Let me know if there is an issue with the langauge in more than 3 cases out of 10 and I will look at it.
Maybe you will get better results by using Movie titles from themoviedb.org.
RE: [Release] Universal Movie Scraper - LawF0rge52 - 2015-01-04
(2015-01-04, 17:35)olympia Wrote: Finding titles on the selected language is best effort. Given we are not using an API from IMDb, but scraping the web, and IMDb is not very consistent, you will never get 100% accuracy. There will always be exceptions which won't work. You will need to rename these manually. Let me know if there is an issue with the langauge in more than 3 cases out of 10 and I will look at it.
Maybe you will get better results by using Movie titles from themoviedb.org.
No, IMDb is consistent in that case. The correct entry exists in IMDb but the scraper doesn't retrieve the correct one. Naming is totally correct. Searching on IMDb web page will find needed entry.
But anyway... You're totally right. themoviedb.org seems to be much better! Specially the API is very nice and much faster then IMDb scraping.
Cheers
RE: [Release] Universal Movie Scraper - olympia - 2015-01-04
(2015-01-04, 17:46)LawF0rge52 Wrote:(2015-01-04, 17:35)olympia Wrote: Finding titles on the selected language is best effort. Given we are not using an API from IMDb, but scraping the web, and IMDb is not very consistent, you will never get 100% accuracy. There will always be exceptions which won't work. You will need to rename these manually. Let me know if there is an issue with the langauge in more than 3 cases out of 10 and I will look at it.
Maybe you will get better results by using Movie titles from themoviedb.org.
No, IMDb is consistent in that case. The correct entry exists in IMDb but the scraper doesn't retrieve the correct one. Naming is totally correct. Searching on IMDb web page will find needed entry.
But anyway... You're totally right. themoviedb.org seems to be much better! Specially the API is very nice and much faster then IMDb scraping.
Cheers
Well, for you, nickr already suggested the proper solution. To find Sintel you need to enable "Include All Movie Categories" in the scraper settings. Sintel is a short movie and to increase accuracy of automatic scraping, shorts are disabled by default.
Other than that I didn't mean using the themoviedb.org scraper over UMS as UMS is more feature rich; I meant to set scraping titles from themoviedb.org in UMS settings instead of IMDb.
...and lastly, better not making statements what is consistent and what is not unless you know a lot about HTML and how web scraping works in overall
RE: [Release] Universal Movie Scraper - olympia - 2015-01-04
(2015-01-04, 13:42)LawF0rge52 Wrote:(2014-12-28, 12:22)komadori Wrote: It's "100%" reproducible.
Using IMDB as the name source and getting US Names, some movies cannot be found. Case in point is for example the OpenMovie "Sintel" from 2010. Parsing my log, UMS uses this string as search:
http://akas.imdb.com/find?q=Sintel&s=tt
Hey folks,
I have exactly the same issue but with a German title:
Filename: Verdammnis (2009).mkv
Debug logfile shows that this URL will be used to get the results: http://akas.imdb.com/find?q=Verdammnis&s=tt
But as komadori already wrote the correct one is not included in the scraper results (in debug log as well). If I use the same URL via web browser I can retrieve the correct one.
There is something odd but don't know what.
Please let me know if someone needs more information about this issue or further investigation.
Thanks so much!
Cheers
The scraper can't handle well the fact that there is a movie in the search results with the string "in development" is a place where it was expecting the "year". No easy solution and as being said there are too many exceptions to handle all.
Easy workaround: create an .nfo file with the same name as the movie file and insert the IMDb link of the correct movie into it.