It's not possible to download multiple specific files at once like this, but I'll pass this along as a feature request. You can either download them file by file, or download entire folders as zips, as you mentioned.
We love to learn from the educators who use Dropbox. Whether you teach kids, teens, adults or a combination of all three, we want to know what apps and integrations you use with Dropbox to help with teaching. Which of the ones below is your favorite, or most used tool?