If anyone else is interested, just using Chrome and uploading entire folders via the Digital Ocean Spaces UI is a really easy way of doing this.
Nevermind, I answered my own question. Looks great so far, thanks.
Awesome. So as long as the folder structure at the root of the space matches to what WordPress is expecting for a media folder, it should all just work?