Hi Marcal - I completely agree. This is exactly what I witness too.
Also I had opened a ticket with Support and they too didn't have a solution. They asked me to proceed the way it is (with user downloading everything again) as the sync time (with everything getting downloaded) was around 4 min and was acceptable.
Thank you for all your support.