[adultmm]

 

So, Nubiles doesn't support search, at least without registration, so we use Google to find the videos. Google limits the count of the search request. It causes the error. 

I have no idea at the moment what we could do. Does anybody have any?

I'm having the same issues but with Holed and Lubed. These are not part of the Nubiles network i think? 
I've read something about the amount of requests in a short time spam beeing the reason of the 429. So maybe its possible to ratelimit the Google search to 10 requests/min or something?

Edit : 
Found out that Cum4k, POVD arent working either.

Holed, Lubed, Cum4k, Povd, and many others, where there isn't a searching possibility, I can use Google (or another search engine) to find the videos.

[adultmm]

Guys, I implemented a rate limiter for Google search. The default settings are 10 requests/minute, and at least 1 second waiting between requests, but you can change the settings in AdvancedSettings.xml under EMM's Profile directory.

For more info and download, please visit the release notes page:
https://github.com/adultmm/AdultMediaMan...7.6.1-beta

Please, tell me what settings were successful, if any. 

@beuter 
@josavvyy 

Thanks

[beuter]

Guys, I implemented a rate limiter for Google search. The default settings are 10 requests/minute, and at least 1 second waiting between requests, but you can change the settings in AdvancedSettings.xml under EMM's Profile directory.

For more info and download, please visit the release notes page:
https://github.com/adultmm/AdultMediaMan...7.6.1-beta

Please, tell me what settings were successful, if any. 

@beuter 
@josavvyy 

Thanks

Thnx! Will try some settings and post back,

quick test : default values, gave me a 429. They do work, the scrape process is much slower then before. 
Will test 5 requests per minute next..

[beuter]

Guys, I implemented a rate limiter for Google search. The default settings are 10 requests/minute, and at least 1 second waiting between requests, but you can change the settings in AdvancedSettings.xml under EMM's Profile directory.

For more info and download, please visit the release notes page:
https://github.com/adultmm/AdultMediaMan...7.6.1-beta

Please, tell me what settings were successful, if any. 

@beuter 
@josavvyy 

Thanks

Thnx! Will try some settings and post back,

quick test : default values, gave me a 429. They do work, the scrape process is much slower then before. 
Will test 5 requests per minute next..

So, with below values still getting the 429.

<Setting Section="AdultScraper.Shared" Content="Movie" Name="GoogleRateLimiterMinimumWaitInMillis" DefaultValue="">1500</Setting>
  <Setting Section="AdultScraper.Shared" Content="Movie" Name="GoogleRateLimiterRequestsPerTimeFrame" DefaultValue="">5</Setting>
  <Setting Section="AdultScraper.Shared" Content="Movie" Name="GoogleRateLimiterTimeFrameInMillis" DefaultValue="">60000</Setting>

[adultmm]

Guys, I implemented a rate limiter for Google search. The default settings are 10 requests/minute, and at least 1 second waiting between requests, but you can change the settings in AdvancedSettings.xml under EMM's Profile directory.

For more info and download, please visit the release notes page:
https://github.com/adultmm/AdultMediaMan...7.6.1-beta

Please, tell me what settings were successful, if any. 

@beuter 
@josavvyy 

Thanks

Thnx! Will try some settings and post back,

quick test : default values, gave me a 429. They do work, the scrape process is much slower then before. 
Will test 5 requests per minute next..

So, with below values still getting the 429.

<Setting Section="AdultScraper.Shared" Content="Movie" Name="GoogleRateLimiterMinimumWaitInMillis" DefaultValue="">1500</Setting>
  <Setting Section="AdultScraper.Shared" Content="Movie" Name="GoogleRateLimiterRequestsPerTimeFrame" DefaultValue="">5</Setting>
  <Setting Section="AdultScraper.Shared" Content="Movie" Name="GoogleRateLimiterTimeFrameInMillis" DefaultValue="">60000</Setting>

Bad news. Thanks for testing.

[slappy]

Thanks for this great scraper !
I dont see support for analvids.com (www.legalporno.com).
Can someone confirm please.

Also
Is there a way we can see images for poster and fanart from the huge database of vipergirls.to or planetsuzy web ?



Thanks

[beuter]

Hi, 

i was just wondering thy the scraper isnt getting info from ThePornDB instead of the separate networks ? 

All scenes/movies i've tested are there, an api is also available. 

https://metadataapi.net/

[adultmm]

Hi, 

i was just wondering thy the scraper isnt getting info from ThePornDB instead of the separate networks ? 

All scenes/movies i've tested are there, an api is also available. 

https://metadataapi.net/

Hi,

when I tested this site, it had a very poor result rate. I'll check it again. 

Otherwise, I'm working on a new search engine integration. We will see.

Thanks

[adultmm]

So, Guys, our next try is another search engine. I hope it will work.

You can download it here:
https://github.com/adultmm/AdultMediaMan...7.6.2-beta

Please, tell me your experiences. 

@beuter 
@josavvyy 

Thanks

[beuter]

So, Guys, our next try is another search engine. I hope it will work.

You can download it here:
https://github.com/adultmm/AdultMediaMan...7.6.2-beta

Please, tell me your experiences. 

@beuter 
@josavvyy 

Thanks

Hi, 

tried it, now it throws a 403 forbidden.

[adultmm]

Hi Guys,

I hope, I've fixed the security error. Could you try it?

You can download it here:
https://github.com/adultmm/AdultMediaMan...7.6.3-beta


@beuter 
@josavvyy 

Thanks

[Zertos]

Thanks for this scraper!

I have a few questions:

• Is the module scraper compatible with the newest ember version 1.10? I copied the modules folder to the ember modules but I can't find the scraper under the modules tab of the settings.
  
• Can you add the site anidb.net to scrape hentais? They are tv shows there.
  
• Could you add Sexart and Vivthomas to your scraper? 
  

[beuter]

Hi Guys,

I hope, I've fixed the security error. Could you try it?

You can download it here:
https://github.com/adultmm/AdultMediaMan...7.6.3-beta


@beuter 
@josavvyy 

Thanks

Hi, now i get a 418 

[josavvyy]

Hi Guys,

I hope, I've fixed the security error. Could you try it?

You can download it here:
https://github.com/adultmm/AdultMediaMan...7.6.3-beta


@beuter 
@josavvyy 

Thanks

Hi, now i get a 418 

I no longer get the google error. I scraped 100 videos and all was well. It's much faster as well.
Thanks!

[adultmm]

Hi Guys,

I hope, I've fixed the security error. Could you try it?

You can download it here:
https://github.com/adultmm/AdultMediaMan...7.6.3-beta


@beuter 
@josavvyy 

Thanks

Hi, now i get a 418 

Hi,

This error comes from DDG Searcher. I cannot reproduce it with my movies but I implemented a rate limiter there. We'll see, but I released the new version (v0.7.7) because it has a much better result.