Question

Is it possible to perform a batch upload to Amazon S3? I have a project that needs to upload each night ~100K of files that can be up to 1G but most of them are files of small sizes. 

Does the s3 API support uploading multiple objects in a single HTTP call?

All the objects must be available in S3 as individual objects. I cannot host them anywhere else. That is an external requirement that I cannot change.

Answer 1

You can upload S3 via AWS CLI tool using the sync command.

aws s3 sync local_folder s3://bucket-name

You can use this method to batch upload files to S3 very fast.