How do i use wildcards to copy group of files in AWS CLI

Question

For some reason, I am having trouble using * in AWS CLI to copy a group of files from a S3 bucket.

Adding * to the path like this does not seem to work

aws s3 cp s3://myfiles/file*

Any suggestions?

Answer 1

If you are getting an error when using *, and if you want to download multiple files from an aws bucket to your current directory, you can use recursive, exclude, and include flags like this:

aws s3 cp s3://myfiles/ . --recursive --exclude "*" --include "file*"`

You can learn more from the AWS Training in Houston.

Answer 2

Here's a UNIX/Linux shell way.

for f in `aws s3 ls my-bucket | awk '{print $NF}'`
do
  aws s3 cp s3://my-bucket/$f .
done

You can even check out the details of Migrating to AWS with the AWS Cloud Migration Course.