We’re Still Here to Help (Even Over the Holidays!) - find out more here.
Forum Discussion
Having Trouble Moving Files Out of Dropbox With rclone
Hello community,
My team has ~115 TB of data stored in Dropbox. Last week, I abruptly received word that the unlimited storage option for the plan we've been using is being "sunsetted", effective Nov 27th. It feels like we are being evicted with ~1 month's notice. Not fun.
I have obtained a large NAS to replace the role Dropbox is currently playing for my team, but the issue is that we have a lot of subdirectories that are either very large, contain large numbers of files, or both.
Generally speaking, my rclone commands look like this:
rclone copy --progress --transfers=10 --copy-links ${REMOTE}:${DIR} ${LOCAL}/${DIR}
The program works for a while, but then I start getting errors like this:
2023-10-30 13:20:26 NOTICE: too_many_requests/..: Too many requests or write operations. Trying again in 300 seconds.
Does anyone have suggestions on how to avoid these errors?
Patrick
2 Replies
Hi pmjboyle,
Unfortunately, Dropbox doesn't allow unlimited transfer rate (or if allow it's for limited period only). That's why you're receiving such error. Instead of increasing parallelism, better limit explicitly to one download at a time. Would works much more stable in spite slower.
Hope this helps.
So far, this is working out better:
rclone copy --progress --transfers=40 --copy-links --tpslimit 10 ${REMOTE}:${DIR} ${LOCAL}/${DIR}
About Dropbox API Support & Feedback
Find help with the Dropbox API from other developers.
