Moving Data

The process of data movement will depend of whether the data sits in the CADES Open or Moderate data enclaves. Most users' data are in the CADES Open enclave. Only the NSED and GIST condos are in the Moderate enclave.

CADES Open Data Movement

For CADES Open Data enclave users, the Globus web interface is the recommended method for data movement. The CADES globus endpoint is called CADES-OR.

However, you may use tools rsync and scp from or-slurm-login.ornl.gov for small data transfers.

CADES Moderate Data Movement

Currently, the CADES Moderate Data enclave, which contains the NSED and GIST condos, does not have DTNs or public Globus endpoints. CADES Moderate users will need to use data transfer tools, like rsync or scp, that can utilize the Moderate Condo login nodes.

Transfer Tools

There are several transfer tool/protocol options to choose from to fit your needs.

  1. Globus has a web interface or command line tools that you can use to transfer data between your personal endpoints or securely share access to your data. This is the preferred method of transfer for CADES Open users.

  2. Secure copy (scp) via the command line to and from storage locations, including local computers. scp username@remote-host1.gov:/path/to/directory/example.txt username@remote-host2.gov:/path/to/directory/

  3. Secure (or SSH) file transfer protocol (SFTP) can be used to transfer files between two remote storage locations (similar to scp) but also allows the user to list directories and see content. You can use SFTP as long as you have SSH access to that host. sftp username@remote_hostname_or_IP

  4. Graphical clients (SFTP) will allow you to use a graphical user interface with drag-and-drop capabilities. CADES maintains documentation for CyberDuck and WinSCP.

    For Linux users, there is no clear recommendation for SFTP clients. No one free client supports all of CADES storage services and behaves consistently. However, Cloud Explorer supports all of CADES services and typically behaves predictably on Linux systems. See here for a how-to guide using CloudExplorer and AWS/S3 storage.

  5. rsync or rclone (supports s3) are other command line utilities that may suit your data transfer needs.

    If you are using rsync to move data between CADES NFS and Lustre on any of the CADES login nodes, please limit your bandwidth to 100M to prevent disrupting other users’ access. This can be done using the --bwlimit 100 flag. 

  rsync --bwlimit 100 foo.txt /lustre/or-scratch/cades-birthright/user-id/