[mrjwm2]

I have written a music video scraper that searches musicbrainz for data. It returns artist, album, year, studio, length, plot (artist info or, if found, song info), and album thumb url. The only problem I have is getting an error 503 from MB server. I think the scraper is sending to many requests , to fast. If I scrape groups of <20 videos I have no problem. If I scrape a group >20 videos I get error 503. Not good if you have a large library.

Is there a way to set or slow down url request interval time in the scraper??

Thanks

[zag]

There are a few music rains mirrors online that you might want to look at that don't have the rate limiter.

No idea how to slow it down in code though.

The official music brains site is pretty useless for scraping to be honest. It's limited to 1 request each second.

[mrjwm2]

zag, right that limit is hard to work with. I'll have look at other mirrors. I was hoping there was an easy delay for the xml.

Thanks

----edit----

working now. quite a bit slower, but similar to what it would be with a delay coded in I think.

Thanks again!