Work in Progress - Ember Media Manager 1.4.x BETA - Discussion Thread

  Thread Rating:
  • 8 Vote(s) - 4.38 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
zerocool_ie Offline
Senior Member
Posts: 130
Joined: Jun 2012
Reputation: 2
Location: Ireland
Post: #2161
(Yesterday 14:48)DanCooper Wrote:  ... or subscribe the feature request in our bug tracker.

But in my way, he gets to see all the cool new features you add with each new build Tongue

Main Room Helix 14.1 | Bello v3 | ASRock ION 330HT-BD | Win 8.1 x64 | SAMSUNG 55" 3D LED HDTV
Bedroom Helix 14.1 | Bello v3 | DELL Studio 17 | Win 8.1 x64 | PHILLIPS 42" LCD HDTV
Server Helix 14.1 | Confluence | HP Evo D530 | Win 7 x32 | MySQL 5.6.21 as primary DB | Ember Media Manager 1.4 BETA
NAS Synology DS411 | 12TB usable | MariaDB 5.5.39 as backup DB
find quote
Poland Offline
Member
Posts: 57
Joined: Dec 2013
Reputation: 0
Post: #2162
I ask again. Tell yet, I have to set the outline of the plot (Plot Outline) was also in Polish .. ??
find quote
richarddscott76 Offline
Junior Member
Posts: 5
Joined: Feb 2015
Reputation: 0
Post: #2163
Hi, I am having a bit of a problem, I needed to run a re-scrape on all of my .nfo files but for some reason the scraper for 1.4 seems to be incredibly slow and is taking around 20 seconds per movie.which may not sound all that bad but when you have 3000 movies to scrape thats over 16 hours of scraping. 1.3 was scraping much much faster than this. Am I doing something wrong or is there a setting I need to change to speed things up?
(This post was last modified: Today 13:49 by richarddscott76.)
find quote
Esky Offline
Junior Member
Posts: 6
Joined: Mar 2010
Reputation: 0
Post: #2164
Hi There,

just installed 1.4.3.1 version, and have an issue with "Settings / TV Shows / Scrapers - Images", in that I can't seem to get Fanart.tv to stay first in the scraper order. I have also tried unabling the TVDB scraper, but it shows as enabled when I go back into the settings menu.

Is this a known problem?

Cheers,

Esky.
(This post was last modified: Today 14:20 by Esky.)
find quote
Cocotus Online
Moderator
Posts: 385
Joined: Mar 2011
Reputation: 9
Post: #2165
(Today 13:49)richarddscott76 Wrote:  Hi, I am having a bit of a problem, I needed to run a re-scrape on all of my .nfo files but for some reason the scraper for 1.4 seems to be incredibly slow and is taking around 20 seconds per movie.which may not sound all that bad but when you have 3000 movies to scrape thats over 16 hours of scraping. 1.3 was scraping much much faster than this. Am I doing something wrong or is there a setting I need to change to speed things up?

How you do scrape? If I want to only update NFO I do a NFO only scrape. I just did some test: I have TMDB Data scraper first then IMDB (all fields activated). I hit scrape while I was downloading ouside of Ember --> took over 30seconds! I then canceled my download outside Ember and started scraping process again: Now around 11s with all fields in IMDB/TMDB activated. Then I looked in the log and noticed that TMDB scraper only took 2s but IMDB around 9seconds! So now I deactivated IMDB and only TMDB DataScraper was activated -> Bingo! 3seconds per movie at NFO only! I can't disable IMDB though, because I need that scraper as a fallback source for missing fields on TMDB. So now I activated IMDB again and disabled some fields to check if theres a field that took long to scrape. In my tests it was the trailer field in IMDB Data scraper. So I have now all fields checked in IMDBData Scraper but "trailer" and now duration for a NFO scraper is around 4seconds - which is acceptable!

To sum it up, I would suggest to disable the trailer field in IMDB Datascraper and try to scrape 1,2 movies and check time. Maybe it also works for you?
(This post was last modified: Today 14:32 by Cocotus.)
find quote
Boulder Offline
Junior Member
Posts: 27
Joined: Nov 2014
Reputation: 0
Post: #2166
Is EMM supposed to fallback from the top scraper to the next one if no match is found? I have several cases in which I get no results from IMDB and have to cancel scraping the movie/concert because the TMDB results are not used.

Also, is there some way to make EMM show more results, like partial matches? I have a lot of stuff that is found on the IMDB but still I need to enter the actual IMDB id because I don't get any automatic results.
find quote
richarddscott76 Offline
Junior Member
Posts: 5
Joined: Feb 2015
Reputation: 0
Post: #2167
(Today 14:30)Cocotus Wrote:  
(Today 13:49)richarddscott76 Wrote:  Hi, I am having a bit of a problem, I needed to run a re-scrape on all of my .nfo files but for some reason the scraper for 1.4 seems to be incredibly slow and is taking around 20 seconds per movie.which may not sound all that bad but when you have 3000 movies to scrape thats over 16 hours of scraping. 1.3 was scraping much much faster than this. Am I doing something wrong or is there a setting I need to change to speed things up?

How you do scrape? If I want to only update NFO I do a NFO only scrape. I just did some test: I have TMDB Data scraper first then IMDB (all fields activated). I hit scrape while I was downloading ouside of Ember --> took over 30seconds! I then canceled my download outside Ember and started scraping process again: Now around 11s with all fields in IMDB/TMDB activated. Then I looked in the log and noticed that TMDB scraper only took 2s but IMDB around 9seconds! So now I deactivated IMDB and only TMDB DataScraper was activated -> Bingo! 3seconds per movie at NFO only! I can't disable IMDB though, because I need that scraper as a fallback source for missing fields on TMDB. So now I activated IMDB again and disabled some fields to check if theres a field that took long to scrape. In my tests it was the trailer field in IMDB Data scraper. So I have now all fields checked in IMDBData Scraper but "trailer" and now duration for a NFO scraper is around 4seconds - which is acceptable!

To sum it up, I would suggest to disable the trailer field in IMDB Datascraper and try to scrape 1,2 movies and check time. Maybe it also works for you?

Thanks, I have taken the trailer field out and I'm averaging 4 seconds now, much better!!
find quote
Cocotus Online
Moderator
Posts: 385
Joined: Mar 2011
Reputation: 9
Post: #2168
(Today 14:50)richarddscott76 Wrote:  
(Today 14:30)Cocotus Wrote:  
(Today 13:49)richarddscott76 Wrote:  Hi, I am having a bit of a problem, I needed to run a re-scrape on all of my .nfo files but for some reason the scraper for 1.4 seems to be incredibly slow and is taking around 20 seconds per movie.which may not sound all that bad but when you have 3000 movies to scrape thats over 16 hours of scraping. 1.3 was scraping much much faster than this. Am I doing something wrong or is there a setting I need to change to speed things up?

How you do scrape? If I want to only update NFO I do a NFO only scrape. I just did some test: I have TMDB Data scraper first then IMDB (all fields activated). I hit scrape while I was downloading ouside of Ember --> took over 30seconds! I then canceled my download outside Ember and started scraping process again: Now around 11s with all fields in IMDB/TMDB activated. Then I looked in the log and noticed that TMDB scraper only took 2s but IMDB around 9seconds! So now I deactivated IMDB and only TMDB DataScraper was activated -> Bingo! 3seconds per movie at NFO only! I can't disable IMDB though, because I need that scraper as a fallback source for missing fields on TMDB. So now I activated IMDB again and disabled some fields to check if theres a field that took long to scrape. In my tests it was the trailer field in IMDB Data scraper. So I have now all fields checked in IMDBData Scraper but "trailer" and now duration for a NFO scraper is around 4seconds - which is acceptable!

To sum it up, I would suggest to disable the trailer field in IMDB Datascraper and try to scrape 1,2 movies and check time. Maybe it also works for you?

Thanks, I have taken the trailer field out and I'm averaging 4 seconds now, much better!!

Thanks for feedback! I think I'm going to check why trailer scraping of IMDB is such a time consuming task. Huh
find quote
Post Reply