s3cmd get an entire directory

Question

I have a directory in my s3 that has only another directory inside it, but I don't know it's name. Using command line "get" tools, i'd like to download that directory, but it doesn't seems to want to.

The structure looks like: my-production/top-dir/sub-dir/some-files.jpg then s3cmd get s3://my-production/top-dir/* local-dir

The "sub-dir" directory does not download. Do I have to get the directory name, make the directory locally, then "get" all it's contents?

score 56 · Answer 1 · edited Sep 19 '17 at 20:23

56

You have to pass parameter --recursive eg. s3cmd get --recursive s3://my-production/top-dir/ local-dir.

edited Sep 19 '17 at 20:23

WattsInABox

4,548
2
33
43

answered Aug 27 '16 at 20:17

Adam Dobrawy

1,145
13
14

score 1 · Answer 2 · edited Oct 15 '18 at 20:05

1

aws s3 sync s3://bucket-name my-local-dir

edited Oct 15 '18 at 20:05

Marco Bonelli

63,369
21
118
128

answered Oct 15 '18 at 16:26

holmb

562
1
5
10

score -2 · Answer 3 · answered Mar 28 '15 at 00:48

-2

you have to use "sync" instead of "get"

answered Mar 28 '15 at 00:48

hogsolo

13,565
6
24
25

1

nope, spoke to soon, you really have to pay attention to the paths. s3cmd get --recursive --force s3://bucket/subdirwithothersubdirsinit/ localbucket/subdirwithothersubdirsinit/ will pull all files and "subdirectories" . – hogsolo Mar 29 '15 at 23:09

s3cmd get an entire directory

3 Answers3