Login at Kodi Home

Afonzo · 2022-08-30, 19:20

I installed two Embers today. They scrape very slowly. For the second, I left the defaults. I tried it with a movie folder containing only about 100 movies. The scraping lasts about 20 to 30 minutes.

Is there a way to make Ember scrape faster?

DanCooper · (This post was last modified: 2022-08-30, 21:53 by DanCooper.)

Disable the YouTube, Apple and DavesTrailerPage trailer scrapers.

Afonzo · (This post was last modified: 2022-08-30, 22:20 by Afonzo.)

Aren't they disabled by defaut? They obviously all are disabled:

Afonzo · 2022-08-31, 15:41

How could one resize the column width?

codygp · (This post was last modified: 2022-08-31, 22:20 by codygp.)

I have the same issue with Ember scraping very slowly. And would like to figure it out.

I followed the advise you posted earlier and made sure the extra scrapers were disabled, they already were.

What I notice is that after images and trailer scrape is done it goes into "Downloading and saving contents into database"

Here is a log output from one I am working on right now. It shows a 4 minute delay between the rename and some OnNFOSave_Movie task.

https://paste.kodi.tv/sacahevebi

And just to clarify, this is running on an i7-7700K, very high spec system with 1Gbps fiber internet connected via 10GB wired ethernet. System power and internet speed are not issues here.

EDIT: And my issue is solved. Its just the trailers being downloaded. TMDB is as slow as Youtube. Disable all trailer scrapers and all goes just fine.

DanCooper · 2022-09-01, 21:26

(2022-08-31, 21:42)codygp Wrote: TMDB is as slow as Youtube.

TMDb also use links to YouTube trailers.

codygp · 2022-09-02, 01:56

Any idea why it's so slow? I can download via browser extensions quite quickly from YouTube.

**jbinkley60** · 2022-09-02, 03:46

(2022-09-01, 21:26)DanCooper Wrote:
(2022-08-31, 21:42)codygp Wrote: TMDB is as slow as Youtube.
TMDb also use links to YouTube trailers.

I am not sure what library is being used to grab the You Tube trailers but if it is youtube-dl there are many reported issues of slowness and it capping out at 60kbs. I have confirmed that myself.

Jeff

madmax2 · 2022-09-02, 05:23

(2022-09-02, 01:56)codygp Wrote: Any idea why it's so slow? I can download via browser extensions quite quickly from YouTube.

yeah, downloading of trailers increase the scraping time quite significantly.

I also disabled this after comparing it on/off.

Just set it to autoscrape then go do something and come back later.
if you got like 200 movies it could take about approx 1hr+

madmax2 · 2022-09-02, 06:30

(2022-09-01, 21:26)DanCooper Wrote:
(2022-08-31, 21:42)codygp Wrote: TMDB is as slow as Youtube.
TMDb also use links to YouTube trailers.

I also notice an issue,
the trailer downloader can redownload new trailers with .mov extension
even though the directory might already have a trailer.

Anyway to fix this issue?