Scraping is not perfect yet.
You can help by enabling Debug in Settings and putting your xbmc.log on pastebin.com, but keep in mind it might be awhile to work out all the kinks with scraping.
How I 'fixed' it is I setup remote mysql library across 3 XBMC setups and I do my scanning on an OSX machine which updates the atv2 in real-time, for now.