We’re Still Here to Help (Even Over the Holidays!) - find out more here.
sync
31 TopicsHow to fix being stuck on Indexing forever loop of death on multi million file DBs after db crash
Ok so I've used Dropbox for almost as long as its existed and recently due to frustration with the never finishing indexing bug I was forced to find out why this kept happening so I could prevent it. Bear with me on this long post but trust me its worth it, what I found was mind blowing and game changing. So our business Dropbox is more than 9 million files strong, I've noticed REALISTICALLY any machine handling over 2 million will just enter an indexing loop at some point from which it will never recover, after its happened 5 times in the last week I was pissed enough to that I decided I was going to find out why this is happening, I know I'm pushing the limits but we've had machines with 2.5m files running fine for years, why some work fine and some don't was a mystery, one I was determined to find out. When you add stuff to your Dropbox, Dropbox has to index it so it can know what to do with it. If you add "too much stuff" (copying 200,000 files of small size in one go, coders know what I'm talking about) or do it "too fast" (changing access permissions on 1.5 million files located within Dropbox in one go in less than 5 minutes) on a computer with too many files (1-2+m) this causes Dropbox to start indexing them all at once causing the system to slow to a crawl however if you don't let Dropbox finish before doing something else (like adding more files or using the computer for other tasks) or someone else adds a bunch of files on another machine its almost for sure going to cause Dropbox to crash and restart during this process (it happens quite frequently), this crashing and restarting triggers a full reindexing of the ENTIRE database, ALL files, and since the machine is already trying to download or upload some of the new files while trying to reindex the current millions of files, doing both at once overtaxes it, which causes it to crash, and were back to square one with the infinite indexing crash loop. This kept happening to us all the time, the only solution was to unlink and relink the Dropbox account so all pending changes were lost, we got a bunch of conflicted copies and spent days sorting out the mess. So I figured I needed to see what was going on with Dropbox, what it was doing when it was "indexing" to find out what was causing the crashes. So after looking for a while I found using Microsoft's sysinternals process monitor (https://docs.microsoft.com/en-us/sysinternals/downloads/procmon) configured in a certain way allowed me to look at EXACTLY what dropbox was doing and I found out all I just told you and another very important piece of info. (if you want to see how awesome it looks in action check out THIS video:) When you click PAUSE FILE SYNCING you would think Dropbox pauses and ceases all operations, but you are wrong!, it pauses all incoming and outgoing transfers but any INDEXING tasks keep going! This is an absolute game changer! now if I see a machine that says "Indexing" for a long time, I turn on the process monitor, hit pause on the file syncing and watch as the machine does the indexing at super high speed (5-10 times faster than doing it while downloading), it usually finishes doing the full file reindexing in a couple of minutes once its done I can hit back resume and keep going, I've never had the app crash while doing this "offline" or "paused" indexing, thus avoiding the inevitable crash, and reindex loop. I have been successful in recovering 4 machines from the indexing loop of death using this method, where before I was screwed and had to eat the duplicate files and cleanup for a week and a TON of annoyed users in the office. Basically if your machine is taking too long indexing or is stuck indexing after a crash just hit "pause for 1 hour" and forget about it, it will still be working on the indexing in the background, and when it restarts it should have finished the re-index avoiding a crash when trying to download/upload the new files. Id wish Dropbox would have told us this, I never expected it to keep indexing while paused, I assumed pause was PAUSE, as in, cease all operations, it would have saved me so many headaches. All they need to do now is let us have a "log viewer" or something so we can tell when its done doing its thing and we can hit resume, also show us, even when in pause, when its indexing and when its not, so when its done we know we can restart it safely, or the better yet, set it to where if Dropbox has to index a large volume of files (say over 100), it will automatically pause all other disk operations until the indexing is complete, then restart the downloads, trying to do both does not work, i know you want it to but it just doesn't, and just causes the whole thing to explode non stop in a loop of death, maybe enable this on a setting somewhere? or auto enable it on machines with over 500k files? something has to be able to be done. TLDR: If your Dropbox is stuck indexing, hit pause 30 mins, and let it do its thing until its done, it will keep on doing it even when paused, you wont know if its doing anything or working unless you use procmon, but its working, and try avoid using the hard drive or the machine until its done, (usually less than 30 mins), and your indexing/crashing problem will be fixed. Message to Dropbox: Dear Dropbox, Please give us a way to view this info without having to resort to third party programs, this way we can help auto troubleshoot our Dropbox issues and take a lot of load off your customer service guys. Something like: Enabling a setting somewhere saying "activate/enable troubleshoot/server mode" or something that allows us to turn on an always shown (ALWAYS, NOT ONLY WHEN MOUSE OVER, BUT ALWAYS!!!) 3 tab little window, containing: Indexing files. (with a current list of the exact files being indexed and their speed (x files per sec)/paths) Downloading Files.(with a current list of the exact files being downloaded and their speed/paths) Uploading Files (with a current list of the exact files being uploaded and their speed/paths) There's another issue with slow uploads due to Dropbox connections stuck in a "stagnant state" (force closing the TCP socket connection using netmon restarts the download/upload and speed goes back up again) but that's another problem for another time. I hope this was helpful to some other sysadmin and sorry for the long message but it needed explaining.Solved36KViews16likes12CommentsUsing Selective Sync to free up space
Today on Twitter we'll be talking about Selective Sync. If you have a folder in your Dropbox account that you rarely use - such as back ups of important documents, photos from old holidays, or work files that you don't need on your home PC - you can use Selective Sync to free up that space on your hard drive. You can view your Selective Sync settings in the 'preferences' of your Dropbox desktop app. For a more detailed guide, check out our help center article here. Do you use Selective Sync at home or at work? Do you find it works well for your needs, or do you have any suggestions on how we could improve it? We'd love to hear your thoughts!2.2KViews6likes0CommentsiPad Files app not showing Dropbox folders and how I managed to solve this.
In working with a new iPad, I discovered that the Files app was not correctly connecting with Dropbox. No Dropbox folders showed up either in the Files app or in any other app with an open feature that would normally have been able to access Dropbox files. Oddly, when I clicked “Dropbox” in the list, there were no folders but I could add a folder and that new folder showed up in Dropbox on other devices (and in the Dropbox app on the iPad)! So there was some connection but not much… This is not an issue I’m experiencing on any of my other Apple devices (Mac or iOS). In talking with Apple support they had me delete the Files app, reboot the iPad, then reinstall “Files.” I did that, but to no effect. They escalated me to a higher level of support but while I was waiting, I also deleted Dropbox and reinstalled it. That solved the problem! So, if you can’t access your Dropbox folders and files in Files or in any of your other iPad apps, just delete and reinstall Dropbox—problem solved (at least for me, this time!)5.8KViews4likes6CommentsQr code to upload photos
Maybe an idea would be to offer a qr code to upload pictures to a set drive drive. So like at a wedding the guests could scan the code and upload the photos they have took that day/evening. Then maybe within your dropbox you could team up with a photo printing company like FreePrints and get prints straight away quoit the need of downloading photos and uploading to their site Just an idea Chris14KViews4likes1CommentSOLUTION: Print Screen Button opens Snipping Tool (or Snip & Sketch) instead of saving to Dropbox
I initially was going to post to ask for help, but I finally got this figured out!! First of all, Dropbox has a feature to save screenshots automatically. Go to preferences and then Backup and you should find a setting to "share screenshots to dropbox". Now the problem/solution: So, I have a new Lenovo laptop running windows 10. I noticed that instead of saving screenshots to Dropbox when I press the "print screen" button on my keyboard that it would open Snip & Sketch software. I tried uninstalling that software and now it just opens Snipping Tool instead. For the life of me I couldn't figure out how to simply save a screenshot into Dropbox . I tried restarting, reinstalling. I tried all the different variations of taking a screenshot, such as Windows Key + PrtSc etc etc. I tried removing Snipping Tool with registry edit but couldn't find it. I turned off the setting “Print Screen Shortcut” in the “Easy of Access Keyboard” settings which SHOULD have done the trick but did NOT. It even says I need to restart which I did, and it still didn't work. Then I read online you can take screenshots with WINDOWS KEY + VOLUME DOWN And I got the beautiful notification "A SCREENSHOT WAS ADDED TO DROPBOX" WOOHOO! Problem Solved!! For some reason, that command now behaves like the old print screen button used to. (You might need to also find your “ease of access keyboard settings” and turn off the setting “Print Screen Shortcut” which I did prior to discovering this awkward solution, so if this didn’t work for you, try turning that setting off and trying again) I hope this helps someone out there. It took me 2 hours to figure this out.5.1KViews4likes3CommentsHow to free up space with online and offline file options
Storing and saving your files is important, and making sure your files are available where you need them can help with that. So, let’s figure out if you need to have your files available online or offline. Why should I make my Dropbox files available offline? Whatever device you’re using with Dropbox, whether it’s a computer, tablet, or phone, you can make your files and folders available offline. This is similar to downloading your files, except it also keeps them in Dropbox. This way, your files are saved offline on your device as well as online in your Dropbox account. So, whether you’re on the move, or you have wifi that drops, you can make your files available offline and keep on working. While you’re offline, changes made to your offline files won’t “sync”. This means that the changes you make offline won’t sync between your offline device and everywhere else you access your files in Dropbox. Once you are back online, Dropbox will sync the changes you made to your offline files everywhere you access them in Dropbox. How do I make files available offline? The short version of it is, within your Dropbox folder in File Explorer (Windows) or Finder (Mac), find the file you’re looking for and right-click on it, and then simply choose Make available offline. Easy! For more info, you can head over here. What are Dropbox online-only files? As the name suggests, these files are available only when you’re online. Since this frees up space on your computer or your hard drive, it is the perfect option if your laptop is at capacity, but you still want to access your files. If you set a file or folder to online-only, you’ll still see the file or folder in the Dropbox folder on your computer, but it’s just a placeholder. You can only open it if you’re connected to internet. Dropbox removes it from your computer’s hard drive, so that it only takes up space in your Dropbox account online. How to make a file or folder online-only: To set a file or folder to online-only manually: Open File Explorer (Windows) or Finder (Mac). Open the Dropbox folder. Right-click the file or folder you’d like to set to online-only. Under Quick Actions, click Make online-only. If you’d like to save your file or folder back to your computer’s hard drive, repeat this step and click Make available offline. So, now you know the difference between online-only and offline files and when each one might suit better. So, why not look at your files and folders and see if you can free up some space? Do you separate your files depending on where and when you need them?8.9KViews3likes1CommentHow Andy took his life off of flash drives with Dropbox Folders and Paper
Meet Andy, a Dropbox devotee who has moved his personal and work files from flash drives to Dropbox. This is Andy’s story… What brought me to Dropbox Before I used Dropbox, it was such a pain transferring files between by devices when I was on the go, or needed to do work somewhere that wasn't my main computer. I have a similar story to Drew, really. I never left my flash drive anywhere by accident, but it was a pain to carry flash drives or external hard drives around, and constantly copy data to and from them to transfer. With Dropbox, for both me, and our media production, I don't have to think about it anymore. How I use Dropbox Even for personal use, I've been using Dropbox for more than 8 years now, and Dropbox as a whole has just made everything so much simpler. Especially when collaborating, I find Paper to be a big help. I've used Selective Sync a bit, but as far as actual core productivity and help goes, the big two are just the application itself, and collaborating with Paper. In Dropbox, for the most part, I don't really have a structure. I have general folders for related things, but it's sort of all over the place, since it's all personal for the most part anyway. As far as Paper goes, I don't have a lot of structure. For work, everything tends to be organized into folders, and the main folder is shared between everyone. Because of how small our company is, we don't have a whole lot to organize. I myself don't have a lot of organization either. I certainly am glad Dropbox has the features it has, and I use most of them at least sometimes. Tips for the community Plan ahead and keep organized. Know what you want to do, and know your options before you actually do anything. Do you use Dropbox in a similar way? Have questions for Andy about their workflow? Reply below with your thoughts!2.7KViews3likes0Comments'Don't Sync' to Dropbox context menu is very useful
All, Just wanted to promote the 'don't sync' to drobox option that has appeared with a recent update (seems to coincide with the File Provider releases?) as I have seen some users confused as to what it does/can do so i thought I'd share how i use it (rightly or wrongly). I work in several apps that save/store files in one or more of the following: - Databases - External references (files referenced into other files such as Cubase, AutoCAD etc) - apps that temporarily generate massive amounts of files and then delete them (renamers, automators etc) - or perhaps it's not always a good idea for the rest of the team to be able to see/read a file that is in flux/revision and should only be 'issued' once all the checks and balances required have been completed. The 'don't sync to drobox' command which i first saw appear in the right click menu does exactly what it suggests. If you select this option on a folder which contains many subfolders and files, then wait a few minutes (depending on how big it is of course) and check the same folder on the web app, you'll see it gone. not renamed to '.'folder, actually gone. Think of this as the opposite of selective sync. You're kind of saying, here's my dropbox, in fact here is everything on my machine. i'm going to put it allllllll in the dropbox folder. Oh - but don't sync that particular folder from our trip to Vegas last year. You with me? I love this, truth is, i don't really like 'syncing' at all. I've got a fundamental issue with something co-existing in two places at once. they can't both be identical, one has to be newer than the other, who is responsible for this file is there is two of them? i could go on (yep, I'm that sort of guy). If you don't see the 'don't sync to drobox' option in the right click menu (current version) that's because you've moved the standard DB location haven't you? Yes you have, naughty - but good on you. I pay for this app, you work for me not the other way around, I'll put the folder wherever i like thank you, im an adult and i have been one for some time now. Good used for this i;ve found are: - a kind of check in and out system. I check a whole folder out, do what i need, check it't correct then put it back up by selecting the 'sync to dropbox' command that appears on any fodler thats previously selected as 'dont sync'. - an easy way to not sync anything you want in a hurry. In the extreme example, you could have two folders at the root of your machine. Dropbox->Folder A and Folder B. Folder A is synced in real time like usual, Folder B is set to 'don't sync to dropbox' and they're both blank. As you go along your way creating files all over the place in your standard folder A, you come across some old stuff, you can't remember their purpose or if they're current nor do you have the time to investigate it right at that moment. Well, just cut or move than folder into Folder B. It's a graveyard folder for anything you're not sure on or will probably be eventually thrown out. If you can't use the right click or want to automate it you can run powershell commands on PC and most likely something similar for mac (don't quote me on that, haven;'t tried on the mac yet). See below: Get-ChildItem "C:\Users\myname\Dropbox\Folder B" -Recurse -File | ForEach-Object { try { Set-Content -Path $_.FullName -Stream com.dropbox.ignored -Value 1 } catch { Write-Host "Failed to process $($_.FullName)" } }580Views2likes0CommentsHow to Sync Two Business Accounts on the Same Computer
Requires two local users to be configured on the computer While logged in to the first local user, log in to business account #1 on the Dropbox app. Choose a shared location for the files to sync to. Log in to the second local user, then log in to business account #2 on the Dropbox app. Choose the same root folder for the files to sync to as you did in the first step. Ensure that both of the folders are shared to all local users and all local users have read/write permissions.1.2KViews1like1CommentWhat you need to know about storing and backing up your photos with Dropbox
We see a lot of questions about storing, sharing and backing up your photos on Dropbox so here are some tips to make that as easy as possible! Back up photos automatically to your Dropbox account You know we love an automatic process, so whether it’s your camera roll photos, your screenshots or your document scans, your cloud photos are some of the most important files you have. In fact our own Emmet told us about a time when he almost lost his photos due to a tech malfunction - “One of my old hard drives of photos got corrupted several years ago. This was almost a year of photos. Thankfully, lot of these had been saved to my Dropbox account automatically, and this was important as a couple who I was friends with wanted a high definition photo of them from the first night they went out together, and I was only able to share it on their wedding day because it was saved on Dropbox.“ Keeping full-resolution copies backed up with online photo storage means you can access them anytime, and you know there is a safe and secure copy in the cloud. Here are just a few ways Dropbox can keep your photos safe: Camera uploads: Once you turn this on, photos from your phone or tablet will be automatically backed up to Dropbox. Or in our desktop app, photos will be copied from cameras, memory cards, or mobile devices whenever you connect one to your computer. Screenshot backups: You can set up our desktop app to automatically move screenshot images to your Dropbox, or have mobile device screenshots backed up using camera uploads. Document scanning: The native/built-in scan functionality in the Dropbox mobile app lets you use your phone’s camera to scan and make digital backups of receipts, whiteboards, and paper documents. Share your photos with links, shared folders and control access Storing your photos is great, but chances are you will want to share some - whether it’s with family members, teammates or the expense team at work. There are a few ways you can do that, and you can manage the access with a few clicks as well. Shared links: You can easily create a link to share any file or folder in your Dropbox. Copy and paste your link into an email, text message, or chat, to share with anyone—even if they don’t have a Dropbox account. Access control: Keep your photos in the right hands by adding password protection, expiration dates, and sign-in requirements to your shared links. Shared folders: Want to collect your photos and someone else’s in the same place? Share files back and forth by inviting other people to sync a folder between your account and theirs. Organize your photos: Saving and sharing your photos can be great but it’s no use if you can’t find the one your looking for, so organizing and viewing your photos is essential too! Here are some tips on how to do that, and if that’s not enough you can see how our own Eliene organizes her photos. Photo browsing: View and browse all of your photos and videos from the Photos tab in our mobile app or on the web. Image previews: View over 35 image file types from dropbox.com or our mobile app. You can preview common files like JPEG, PNG, TIFF, and GIF; app-specific types like Photoshop and Illustrator; raw formats like CR2, DCR, and DNG; and even iOS HEIC photos. Best of all, there’s no need for special photo software. Image tagging: Find your photos fast by adding searchable hashtags to individual photos or an entire folder. How do you manage your photos with Dropbox? Share your tips in the comments below, or if you have any questions you, we can answer those too!4.7KViews1like2Comments