[Disgrace2029]

Nevermind I found it

Could you confirm it's what I wrote above? That one needs to select the "Watch cloud folder" option but not select a scheduled run. As a normal "run" does what you were trying to avoid, that is deleting everything and rescanning everything. 

Its under the Google Drive settings "Export Service" Before export to library, remove previous files and folders