Transferring data from AWS S3 storage

Guide below is meant for users who want to transfer data using AWS CLI to HUNT Cloud lab.

TIP

This guide is meant to help you setup correct parameters for your transfer and is not indented as a full guide to AWS S3 client. For proper guidance, follow official AWS documentation.

Configuration

WARNING

Configure bandwidth limits such that your data transfer does not affect your lab mates.

Before you begin your transfer, make sure to setup below parameters in aws.config:

[profile default]
s3 =
    max_concurrent_requests = 4
    max_queue_size = 100
    multipart_threshold = 64MB
    multipart_chunksize = 16MB
    max_bandwidth = 200MB/s