Exclude multiple Folders with AWS S3 Sync

How to Exclude multiple Folders with AWS S3 Sync #

In order to exclude multiple folders when using S3 sync, pass multiple --exclude parameters to the command, specifying the path to the folders you want to exclude.

Copied!
aws s3 sync s3://YOUR_BUCKET . --exclude "my-folder-1/*" --exclude "my-folder-2/*" --exclude "my-folder-3/*"

In the example above we've used the exclude parameter to filter out 3 folders from the sync command.

Because we've passed the root of the bucket after the sync keyword in the command (e.g. s3://my-bucket ), we have to specify the whole path for the values of the --exclude parameter.

Let's look at an example where we have the following folder structure in the S3 bucket:

Copied!
my-folder-1/
    file1.txt
    file2.txt
    nested-folder-1/
    nested-folder-2/

We want to exclude nested-folder-1 and nested-folder-2 from the sync command and both of them are in the my-folder-1 directory. Therefore we can add the suffix to the bucket name, instead of repeating it in the value of all --exclude parameters.

Copied!
aws s3 sync s3://YOUR_BUCKET/my-folder-1 . --exclude "nested-folder-1/*" --exclude "nested-folder-2/*"

In the example above we've specified the my-folder-1 suffix to the bucket name, which means that all of our --exclude parameters start from that path.

The following example excludes all files with the .png and .pdf extensions that are in the my-folder-1 directory.

Copied!
aws s3 sync s3://YOUR_BUCKET . --exclude "my-folder-1/*.png" --exclude "my-folder-1/*.pdf"

In the example above we've excluded all of the .png and .pdf files in the my-folder-1 directory, however files with other extensions in the folder have not been excluded, nor .png or .pdf files in other directories in the bucket.

Further Reading #

• Get the Size of a Folder in AWS S3 Bucket
• How to Get the Size of an AWS S3 Bucket
• Add a Bucket Policy to an AWS S3 Bucket
• Configure CORS for an AWS S3 Bucket
• Allow Public Read access to an AWS S3 Bucket
• Copy a Local Folder to an S3 Bucket
• Download a Folder from AWS S3
• List all Files in an S3 Bucket with AWS CLI
• How to Rename a Folder in AWS S3
• Copy Files and Folders between S3 Buckets
• How to Delete a Folder from an S3 Bucket
• Count Number of Objects in S3 Bucket
• Download an Entire S3 Bucket - Complete Guide
• AWS CDK Tutorial for Beginners - Step-by-Step Guide
• How to use Parameters in AWS CDK