Transferring data from Azure Storage

Guide below is meant for users who want to transfer data from Azure Storage to HUNT Cloud lab.

WARNING

This guide is meant to help you setup correct parameters for your transfer and is not indented as a full guide to azcopy. For proper guidance, follow official Microsoft documentation.

Installation

If this is your first time using conda, follow our guide for proper installation in your lab. Afterwards, you can run following command in conda environment to install azcopy.

conda install -c conda-forge azcopy

Setup parameters

Before you begin your transfer, make sure to setup below parameters

export AZCOPY_CONCURRENCY_VALUE=16

# First test with timeout
timeout 900 azcopy cp --cap-mbps 400 --recursive  ...

# If all is fine remove timeout
azcopy cp --cap-mbps 400 --recursive  ...