Kodi Community Forum
AdultScraper for Ember released - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Supplementary Tools for Kodi (https://forum.kodi.tv/forumdisplay.php?fid=116)
+---- Forum: Ember Media Manager (https://forum.kodi.tv/forumdisplay.php?fid=195)
+---- Thread: AdultScraper for Ember released (/showthread.php?tid=360299)

Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30

RE: AdultScraper for Ember released - adultmm - 2021-07-02

(2021-07-02, 09:30)beuter Wrote:
(2021-07-01, 17:17)adultmm Wrote:
(2021-07-01, 00:45)josavvyy Wrote:  

So, Nubiles doesn't support search, at least without registration, so we use Google to find the videos. Google limits the count of the search request. It causes the error. 

I have no idea at the moment what we could do. Does anybody have any?
I'm having the same issues but with Holed and Lubed. These are not part of the Nubiles network i think? 
I've read something about the amount of requests in a short time spam beeing the reason of the 429. So maybe its possible to ratelimit the Google search to 10 requests/min or something?

Edit : 
Found out that Cum4k, POVD arent working either.

Holed, Lubed, Cum4k, Povd, and many others, where there isn't a searching possibility, I can use Google (or another search engine) to find the videos.

RE: AdultScraper for Ember released - adultmm - 2021-07-02

Guys, I implemented a rate limiter for Google search. The default settings are 10 requests/minute, and at least 1 second waiting between requests, but you can change the settings in AdvancedSettings.xml under EMM's Profile directory.

For more info and download, please visit the release notes page:
https://github.com/adultmm/AdultMediaManager/releases/tag/v0.7.6.1-beta

Please, tell me what settings were successful, if any. 

@beuter 
@josavvyy 

Thanks

RE: AdultScraper for Ember released - beuter - 2021-07-02

(2021-07-02, 16:07)adultmm Wrote: Guys, I implemented a rate limiter for Google search. The default settings are 10 requests/minute, and at least 1 second waiting between requests, but you can change the settings in AdvancedSettings.xml under EMM's Profile directory.

For more info and download, please visit the release notes page:
https://github.com/adultmm/AdultMediaManager/releases/tag/v0.7.6.1-beta

Please, tell me what settings were successful, if any. 

@beuter 
@josavvyy 

Thanks

Thnx! Will try some settings and post back,

quick test : default values, gave me a 429. They do work, the scrape process is much slower then before. 
Will test 5 requests per minute next..

RE: AdultScraper for Ember released - beuter - 2021-07-03

(2021-07-02, 19:42)beuter Wrote:
(2021-07-02, 16:07)adultmm Wrote: Guys, I implemented a rate limiter for Google search. The default settings are 10 requests/minute, and at least 1 second waiting between requests, but you can change the settings in AdvancedSettings.xml under EMM's Profile directory.

For more info and download, please visit the release notes page:
https://github.com/adultmm/AdultMediaManager/releases/tag/v0.7.6.1-beta

Please, tell me what settings were successful, if any. 

@beuter 
@josavvyy 

Thanks

Thnx! Will try some settings and post back,

quick test : default values, gave me a 429. They do work, the scrape process is much slower then before. 
Will test 5 requests per minute next..

So, with below values still getting the 429.

<Setting Section="AdultScraper.Shared" Content="Movie" Name="GoogleRateLimiterMinimumWaitInMillis" DefaultValue="">1500</Setting>
  <Setting Section="AdultScraper.Shared" Content="Movie" Name="GoogleRateLimiterRequestsPerTimeFrame" DefaultValue="">5</Setting>
  <Setting Section="AdultScraper.Shared" Content="Movie" Name="GoogleRateLimiterTimeFrameInMillis" DefaultValue="">60000</Setting>

RE: AdultScraper for Ember released - adultmm - 2021-07-03

(2021-07-03, 09:13)beuter Wrote:
(2021-07-02, 19:42)beuter Wrote:
(2021-07-02, 16:07)adultmm Wrote: Guys, I implemented a rate limiter for Google search. The default settings are 10 requests/minute, and at least 1 second waiting between requests, but you can change the settings in AdvancedSettings.xml under EMM's Profile directory.

For more info and download, please visit the release notes page:
https://github.com/adultmm/AdultMediaManager/releases/tag/v0.7.6.1-beta

Please, tell me what settings were successful, if any. 

@beuter 
@josavvyy 

Thanks

Thnx! Will try some settings and post back,

quick test : default values, gave me a 429. They do work, the scrape process is much slower then before. 
Will test 5 requests per minute next..

So, with below values still getting the 429.

<Setting Section="AdultScraper.Shared" Content="Movie" Name="GoogleRateLimiterMinimumWaitInMillis" DefaultValue="">1500</Setting>
  <Setting Section="AdultScraper.Shared" Content="Movie" Name="GoogleRateLimiterRequestsPerTimeFrame" DefaultValue="">5</Setting>
  <Setting Section="AdultScraper.Shared" Content="Movie" Name="GoogleRateLimiterTimeFrameInMillis" DefaultValue="">60000</Setting>

Bad news. Thanks for testing.

RE: AdultScraper for Ember released - slappy - 2021-07-07

Thanks for this great scraper !
I dont see support for analvids.com (www.legalporno.com).
Can someone confirm please.

Also
Is there a way we can see images for poster and fanart from the huge database of vipergirls.to or planetsuzy web ?



Thanks

RE: AdultScraper for Ember released - beuter - 2021-07-07

Hi, 

i was just wondering thy the scraper isnt getting info from ThePornDB instead of the separate networks ? 

All scenes/movies i've tested are there, an api is also available. 

https://metadataapi.net/

RE: AdultScraper for Ember released - adultmm - 2021-07-07

(2021-07-07, 14:07)beuter Wrote: Hi, 

i was just wondering thy the scraper isnt getting info from ThePornDB instead of the separate networks ? 

All scenes/movies i've tested are there, an api is also available. 

https://metadataapi.net/

Hi,

when I tested this site, it had a very poor result rate. I'll check it again. 

Otherwise, I'm working on a new search engine integration. We will see.

Thanks

RE: AdultScraper for Ember released - adultmm - 2021-07-07

So, Guys, our next try is another search engine. I hope it will work.

You can download it here:
https://github.com/adultmm/AdultMediaManager/releases/tag/v0.7.6.2-beta

Please, tell me your experiences. 

@beuter 
@josavvyy 

Thanks

RE: AdultScraper for Ember released - beuter - 2021-07-07

(2021-07-07, 21:02)adultmm Wrote: So, Guys, our next try is another search engine. I hope it will work.

You can download it here:
https://github.com/adultmm/AdultMediaManager/releases/tag/v0.7.6.2-beta

Please, tell me your experiences. 

@beuter 
@josavvyy 

Thanks

Hi, 

tried it, now it throws a 403 forbidden.

RE: AdultScraper for Ember released - adultmm - 2021-07-14

Hi Guys,

I hope, I've fixed the security error. Could you try it?

You can download it here:
https://github.com/adultmm/AdultMediaManager/releases/tag/v0.7.6.3-beta


@beuter 
@josavvyy 

Thanks

RE: AdultScraper for Ember released - Zertos - 2021-07-14

Thanks for this scraper!

I have a few questions:
  • Is the module scraper compatible with the newest ember version 1.10? I copied the modules folder to the ember modules but I can't find the scraper under the modules tab of the settings.
  • Can you add the site anidb.net to scrape hentais? They are tv shows there.
  • Could you add Sexart and Vivthomas to your scraper? 


RE: AdultScraper for Ember released - beuter - 2021-07-15

(2021-07-14, 00:04)adultmm Wrote: Hi Guys,

I hope, I've fixed the security error. Could you try it?

You can download it here:
https://github.com/adultmm/AdultMediaManager/releases/tag/v0.7.6.3-beta


@beuter 
@josavvyy 

Thanks

Hi, now i get a 418  Confused

RE: AdultScraper for Ember released - josavvyy - 2021-07-17

(2021-07-15, 14:00)beuter Wrote:
(2021-07-14, 00:04)adultmm Wrote: Hi Guys,

I hope, I've fixed the security error. Could you try it?

You can download it here:
https://github.com/adultmm/AdultMediaManager/releases/tag/v0.7.6.3-beta


@beuter 
@josavvyy 

Thanks

Hi, now i get a 418  Confused
I no longer get the google error. I scraped 100 videos and all was well. It's much faster as well.
Thanks!

RE: AdultScraper for Ember released - adultmm - 2021-07-19

(2021-07-15, 14:00)beuter Wrote:
(2021-07-14, 00:04)adultmm Wrote: Hi Guys,

I hope, I've fixed the security error. Could you try it?

You can download it here:
https://github.com/adultmm/AdultMediaManager/releases/tag/v0.7.6.3-beta


@beuter 
@josavvyy 

Thanks

Hi, now i get a 418  Confused
Hi,

This error comes from DDG Searcher. I cannot reproduce it with my movies but I implemented a rate limiter there. We'll see, but I released the new version (v0.7.7) because it has a much better result.