2011-01-30, 10:12
The Cancel button works in version 0.8.0. There are also some more features included. You can download it manually and install via zip file.
Yes, scraping is very slow in RCB. With the default settings it scrapes 3 different sites and most of the sites require several requests to get all data. Additionally RCB supports 5 different types of artwork that need to be downloaded. The slowest scraper is mobygames as we have to request 7 different pages to get all data we need. But atm mobygames has the most complete database (with more or less non-restrictive terms of use). So we can't drop it.
There are two new game database projects in the pipeline that promise to have an equal or even bigger database than moby or others and both provide fast APIs where we can fetch all data with 1-2 requests. I hope they will both be up and running in the next months.
For the next version we are working on some improvements of the scrape process that will make the handling a bit more easy. E.g. you will be asked what scrapers you want to use before scraping is started. There will also be different scraping modes (Automatic:Accurate - will only import the rom if we are 100% sure that it is the correct game, Automatic:Guess Matches - will try to guess the correct game and may lead to wrong results, Interactive: Select Matches - import all 100% roms automatically and ask for the ones that we are not sure about). But this is more for accuracy than speed.
Yes, scraping is very slow in RCB. With the default settings it scrapes 3 different sites and most of the sites require several requests to get all data. Additionally RCB supports 5 different types of artwork that need to be downloaded. The slowest scraper is mobygames as we have to request 7 different pages to get all data we need. But atm mobygames has the most complete database (with more or less non-restrictive terms of use). So we can't drop it.
There are two new game database projects in the pipeline that promise to have an equal or even bigger database than moby or others and both provide fast APIs where we can fetch all data with 1-2 requests. I hope they will both be up and running in the next months.
For the next version we are working on some improvements of the scrape process that will make the handling a bit more easy. E.g. you will be asked what scrapers you want to use before scraping is started. There will also be different scraping modes (Automatic:Accurate - will only import the rom if we are 100% sure that it is the correct game, Automatic:Guess Matches - will try to guess the correct game and may lead to wrong results, Interactive: Select Matches - import all 100% roms automatically and ask for the ones that we are not sure about). But this is more for accuracy than speed.