[Release] Universal Movie Scraper

  Thread Rating:
  • 7 Vote(s) - 5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
hac_ Offline
Junior Member
Posts: 10
Joined: Mar 2011
Reputation: 0
Post: #1246
(2017-06-03 19:57)scudlee Wrote:  html/xml tags are automatically cleaned out by default.
You'd need to add (e.g.) noclean="1" as an attribute to the <expression> for that not to happen (on the first capturing group).

Code:
<RegExp input="$$1" output="&lt;outline&gt;\1&lt;/outline&gt;" dest="2">
<expression fixchars="1" trim="1">itemprop=&quot;description&quot;&gt;(.+?)&lt;/div&gt;</expression>
</RegExp>
Would probably do it.

Sorry, I forgot about this for a while.

Thank you, your fix works. I don't have Sully in my library anymore, but Little Dieter Needs to Fly and Fog of War got fixed after I used your regexp in the plugin.

Edit: Helps also with Citizenfour. I checked some movies that were correct before and they seem to be fine also with this new version.
(This post was last modified: 2017-06-23 11:39 by hac_.)
find quote
Mordred Offline
Junior Member
Posts: 43
Joined: May 2011
Reputation: 0
Post: #1247
Is anyone able to get this scraper to grab posters/fanart from fanart.tv? I've enabled both, and still the only images I get are from themoviedb.org. I've tried with multiple movies now and nothing ever comes up. I disabled tmdb in the fanart section -- leaving fanart.tv enabled -- just to see if there was some precedence thing, and my movies suddenly had no fanart.

I tried Ghost in the Shell, Raw, Moana, and Genius (2016) which seems like a representative sample. All had fanart available on fanart.tv and none ever got added to the database.
find quote
Karellen Offline
Super Moderator
Posts: 2,475
Joined: Apr 2017
Reputation: 45
Post: #1248
@Mordred

Look through this thread. Issue is discussed and a solution is available... https://forum.kodi.tv/showthread.php?tid...pid2610986

My Signature
Links to : Forum Rules | Banned Add-Ons | Free Movies/TV Shows | Debug Log |


find quote
Mordred Offline
Junior Member
Posts: 43
Joined: May 2011
Reputation: 0
Post: #1249
Hey Karellan. I looked at that thread, and I don't think it's solving my problem. I went and updated the metadata.common.fanart.tv scraper as I think it was out of date, but I'm still not having any luck. After a restart and trying to refresh data for Ghost in the Shell (2017):

Code:
22:31:07.404 T:11644   DEBUG: scraper: GetFanartTvFanartByIdChain returned <details><url function="ParseFanartTvFanart" cache="fanarttv-tt1219827.json">http://webservice.fanart.tv/v3/movies/tt1219827?api_key=ed4b784f97227358b31ca4dd966a04f1</url></details>
22:31:07.405 T:11644   DEBUG: scraper: ParseFanartTvFanart returned <details><fanart></fanart></details>

the URL works, and I even checked the cached file on a whim, and it has the same data.
find quote
Karellen Offline
Super Moderator
Posts: 2,475
Joined: Apr 2017
Reputation: 45
Post: #1250
Hi Mordred,

How do you have the scraper setup?
  1. Plot info is coming from IMDB or TMDB?
  2. In Posters, you specifically have fanart.tv enabled?
  3. In Fanart, you specifically have fanart.tv enabled?
  4. If you select TMDB as the provider for fanart and posters, does it work?
  5. Can you provide a debug log recording you trying to scrape the movie.

My Signature
Links to : Forum Rules | Banned Add-Ons | Free Movies/TV Shows | Debug Log |


find quote
Mordred Offline
Junior Member
Posts: 43
Joined: May 2011
Reputation: 0
Post: #1251
1. IMDB (cast from TMDB though)
2. Yes
3. Yes
4. Yes, when TMDB is enabled it gets TMDB fanart and posters (whether fanart.tv is enabled or not) and when disabled I get nothing.
5. https://pastebin.com/7p0wtp3U
find quote
Mordred Offline
Junior Member
Posts: 43
Joined: May 2011
Reputation: 0
Post: #1252
@Karellen was that log any help?
find quote
olympia Offline
Team-Kodi Member
Posts: 2,718
Joined: May 2008
Reputation: 39
Post: #1253
Yes, fanarttv scraping is broken due to the api switched to https. I wonder for how long this is the case... Smile
Will submit a fix now.

You will need fanarttv scraper library v3.1.5.
(This post was last modified: 2017-08-14 13:56 by olympia.)
find quote
wgstarks Offline
Posting Freak
Posts: 2,033
Joined: Jun 2013
Reputation: 18
Location: North Carolina, USA
Post: #1254
(2017-08-14 13:53)olympia Wrote:  Yes, fanarttv scraping is broken due to the api switched to https. I wonder for how long this is the case... Smile
Will submit a fix now.

You will need fanarttv scraper library v3.1.5.

Will this also fix downloading from TMDB? Or do we still need to use the developer API's.

ASUS Chromebox M004U (LibreELEC 7.0.2/Aeon Nox SiLVO)--->HDMI--->Onkyo TX-NR646--->HDMI--->Panasonic P65VT30
find quote
olympia Offline
Team-Kodi Member
Posts: 2,718
Joined: May 2008
Reputation: 39
Post: #1255
(2017-08-14 14:04)wgstarks Wrote:  
(2017-08-14 13:53)olympia Wrote:  Yes, fanarttv scraping is broken due to the api switched to https. I wonder for how long this is the case... Smile
Will submit a fix now.

You will need fanarttv scraper library v3.1.5.

Will this also fix downloading from TMDB? Or do we still need to use the developer API's.

I am not aware of this issue, could you refer me to the discussion around this?
find quote
wgstarks Offline
Posting Freak
Posts: 2,033
Joined: Jun 2013
Reputation: 18
Location: North Carolina, USA
Post: #1256
(2017-08-14 14:15)olympia Wrote:  
(2017-08-14 14:04)wgstarks Wrote:  
(2017-08-14 13:53)olympia Wrote:  Yes, fanarttv scraping is broken due to the api switched to https. I wonder for how long this is the case... Smile
Will submit a fix now.

You will need fanarttv scraper library v3.1.5.

Will this also fix downloading from TMDB? Or do we still need to use the developer API's.

I am not aware of this issue, could you refer me to the discussion around this?

I don't know what I'm thinking. Too early in the morning here and I haven't finished my coffee yet. Smile
I think the cause may be the same, but it's an Artwork Downloader issue. Starts at post 2740 (ish).

ASUS Chromebox M004U (LibreELEC 7.0.2/Aeon Nox SiLVO)--->HDMI--->Onkyo TX-NR646--->HDMI--->Panasonic P65VT30
find quote
Post Reply