+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: Linux Scraping 1800 tv shows (/showthread.php?tid=210107)
Scraping 1800 tv shows - Sagiigi340 - 2014-11-29
Hi! I have about 1800 different TV-Shows on my seedbox and I want to scrape the data for all of them. I've tried using the TheTVDB one but it has been about 24 hours and it is only at the ~200th series.
What can\should I do?
Re: Scraping 1800 tv shows - nickr - 2014-11-29
Wait 9 more days?
RE: Scraping 1800 tv shows - Sagiigi340 - 2014-11-29
(2014-11-29, 23:33)nickr Wrote: Wait 9 more days?
Is there any option to multithread the scraping feature?
RE: Scraping 1800 tv shows - Martijn - 2014-11-29
Nope
Re: Scraping 1800 tv shows - nickr - 2014-11-29
I suspect your problem lies in either using a weak computer to scrape (rpi is slow at this). Or in the fact that you are connected over a relatively slow internet connection.
RE: Scraping 1800 tv shows - Sagiigi340 - 2014-11-29
(2014-11-29, 23:49)nickr Wrote: I suspect your problem lies in either using a weak computer to scrape (rpi is slow at this). Or in the fact that you are connected over a relatively slow internet connection.
Having i5 4870 and 16gb ram, 7200rpm hdd, 15mb/s internet connection.
What else can I do?
RE: Scraping 1800 tv shows - Martijn - 2014-11-30
Wait
Tvdb is dead slow
RE: Scraping 1800 tv shows - Sagiigi340 - 2014-11-30
(2014-11-30, 00:02)Martijn Wrote: Wait
Tvdb is dead slow
Do you know of any faster services?
Scraping 1800 tv shows - sp1d3y - 2014-12-02
1800- what's your storage like? I'm running out of physical space in the box and trying to upgrade to 4-TB drives- sorry not to hijack