[malte]

ok, topfs2. I'm determined to do a scraper, and I'm determined to do it right.

Great that you took up the task. I am planning to resume my work on the scrapers for RCB in some days/weeks so I think I can greatly benefit from your additions. But I guess there may still be some things left that could be too RCB specific to implement it in XBMCs scrapers itself.

Some questions about your current implementation and your future plans (sorry for interrupting your academical discussion, feel free to ignore or park my post for later consideration):

1. artwork download:
I have seen that you removed the artwork download in latest commits. Do you want to remove it completely from heimdall or do you just plan to move it to another module?

2. platform detection:
It looks like you do platform detection via file extension. I am afraid this will always be error-prone at least when you have to deal with multi platform extensions like .img or .bin. Any plans how to solve this? Of course this depends on the way you plan to integrate all this in XBMC/RetroPlayer but isn't it possible to let the user define the platform before (s)he starts scraping? Usually all users that I had to deal with in the past have organized their collections separated by platform. So it should be easy to define sources on a per platform basis and let the user specifiy the platform per folder/source.

3. title matching:
Same with games, movies and music, finding the correct item by title is an uphill battle. XBMCs current scrapers often fail with not finding movies although they are present on the searched site or they come back with mismatches. Not sure how good "difflib.get_close_matches()" is doing this task but I can imagine some scenarios where this approach might fail. For example "Super Mario Bros.", "Super Mario Bros. 2" and "New Super Mario Bros." might be looking quite similar to a computer algorithm, some users will also name their games "Super Mario Bros. II" instead of "Super Mario Bros. 2", etc.

In RCB I added some more logic to this part of the program to get better scrape results. E.g. trying to find 100% matches as automatic as possible (replacing metadata in [] and (), handling sequel numbers with digits or romes, ...) and also offer an interactive mode where the user gets a list of matches and can select the correct item manually. Is this a feature that you might consider as part of heimdall?