Forum Discussion

tXiao95's avatar
tXiao95
New member | Level 2
7 years ago

How to use the Python SDK to download netcdf files

I have some large netcdf4 files in my personal Dropbox on the order of about 12GB. I'd like to use the Python SDK to read these files directly into my session without having to download them locally ...
Developers
Greg-DB's avatar
Greg-DB
Icon for Dropbox Community Moderator rankDropbox Community Moderator
7 years ago

The files_download method gives you a requests.Response object that you can read from, optionally in pieces, without downloading the entire file to your local filesystem.

For example, you might want to read it a piece at a time, like:

metadata, f = dbx.files_download(path)

for partial_data in f.iter_content(chunk_size=1024):
    print(partial_data)
    raw_input()  # whatever you need to do

I can't offer help with netCDF4 or xarray though, as those are not made by Dropbox.

 

About Discuss Dropbox Developer & API

Node avatar for Discuss Dropbox Developer & API
Make connections with other developers

The Dropbox Community team is active from Monday to Friday. We try to respond to you as soon as we can, usually within 2 hours.

If you need more help you can view your support options (expected response time for an email or ticket is 24 hours), or contact us on X, Facebook or Instagram.

For more info on available support options for your Dropbox plan, see this article.

If you found the answer to your question in this Community thread, please 'like' the post to say thanks and to let us know it was useful!