We’re Still Here to Help (Even Over the Holidays!) - find out more here.
Forum Discussion
Solved
Backblaze is backing up Smart Sync’d files
I turned on Smart Sync (in our business account) and it seemed to be working as promised, until Backblaze kicked in and started backing up all 1.8TB of our “online only” files. What gives?
- When a file is marked as online only, if that file is accessed, Dropbox will download the file and mark it as Local. This is how you're able to open a file that's marked as online only.
Best guess, BackBlaze is trying to access the file to back it up, so Dropbox is downloading it and marking it as Local again. You'll probably need to add an exclusion in your backup set for those files/folders that are marked as online only.
I work at Backblaze on the client that does the backups. Can you reach out to Backblaze support and get them some info on this issue:
> when I try to restore them from Backblaze those files are corrupt
I'm trying to figure out how that is possible, and what you mean by "corrupt"? Are you on Window or Macintosh (you said "Finder" so I'm guessing Macintosh), and by "corrupt" can you provide a correct file and a "corrupt" file for me/Backblaze/support to examine?
Backblaze is pretty profoundly simple - it looks for file modification times that have changed, and if they have changed then Backblaze reads the file into RAM, encrypts it, and sends it to Backblaze. I'm trying to figure out how Dropbox can function AT ALL if reading the files does not result in the correct original bytes. My first guess is your files are corrupt locally, in Dropbox, and in Backblaze - consistent.
> Does anyone know whether Backblaze detecting it is feasible?
We have a good relationship with Dropbox, and we can probably work that out between our engineers. The only question we have is: "what is the correct behavior customer wants?" If you want those files backed up, then they pretty much have to be downloaded to be local so Backblaze can read them. If you NEVER want anything in Dropbox to be backed up, hopefully if you exclude them in your Backblaze interface and they won't be backed up (or downloaded locally).
Hi @brianwski,
Thanks for your response! I’m replying from memory here to explain the issues, but if you’re serious about addressing this I’ll be happy to verify and provide details/testing etc.
With Dropbox’s SmartSync, certain files and folders will be kept in the cloud, but will appear to the user as if they are on your hard drive. The key feature here is that these cloud stored files are not simple in a folder, they are intermixed alongside regular files all throughout my Dropbox hierarchy. So I was having problems making this point to backblaze support because IIRC the solutions offered were all along the lines of telling me to “exclude that folder” but there is no specific folder unless I exclude the entire dropbox!
I’m glad that you have a good relationship with Dropbox because my dream solution (#3 below) would probably be easiest in coordination with them.
Solutions:
1. The default seems to be that each time BB runs across a smartsynced file, it tries to download the file and then back it up to backblaze. This is problematic for two reasons (a) because apparently glitches occur where it backs up the file that is not (yet?) fully downloaded, with no error message. When I attempt to restore the file I get some incomplete/corrupt version. (b) it’s also problematic because it causes all those offloaded files to be reloaded to my hard drive, defeating the space saving benefits of the smartsync
2. You could simply recognize smartsynced files and not back them up. This should be fairly straightforward since a user can determine that a file is smartsynced by the size showing in the get info window.
3. My dream solution would be that you recognize those smartsynced files, and then (with my permission) go get them directly from Dropbox rather than having to download and the reupload through my system. This would save me time and bandwidth, avoid defeating the purpose of the smartsync system, and presumably avoid the corruption issue that I described.
> 3. My dream solution would be that you recognize those smartsynced files, and then (with my permission) go get them directly from Dropbox
We were discussing this internally at Backblaze on Friday, and came up with the same proposal for an "ideal solution". Everybody agrees it would be a great solution. Let me see what we can do.
-- BrianW
Any update on this "ideal solution"? Our company is running into the same situation and ideally would like to grab full dropbox files without forcing them to download locally.
I would also be very keen to see Paul's 'ideal solution' implemented. I found this thread by googling around the subject in the hope it had been sorted already, I guess there's nothing like being on the cutting edge!
