Maybe, the Desktop & Document Folder is the cause of the issue. I tried not to include 'Desktop & Document Folder' on the iCloud, then upload and download works normally.