Chicago to San Diego, USA

On August 16, we transported the ~800 GB BESTDR3 Sloan Digital Sky Survey astronomical dataset from Chicago, USA, to San Diego Supercomputing Center, in San Diego, California USA, in approximately 6.2 hours. The average transfer speed was 314 Mb/s with a median speed of 294 Mb/s.

The data was transferred disk-to-disk from an NCDM server at the StarLight Facility in Chicago, USA to a machine at the San Diego Supercomputing Center (SDSC) facilities in San Diego, California USA. The StarLight machine was a dual AMD Opteron server with a 10 Gb/s network card. The SDSC machine was a dual Intel Xeon machine.

The data was transported from StarLight facilities in Chicago to SDSC over the 10 Gb/s routed Abilene network using NCDM's UDT transport protocol and NCDM's UDT Gateway.

Data Set:
Sloan Digital Sky Survey BESTDR3 dataset
64 separate compressed SQL Server backup files
Total Size: 785,185,433,450 bytes

Transfer Speed:
Total Time: 22,396 seconds (6.22 hours)
Average Transfer Speed: 314 Mb/s
Median Transfer Speed: 294 Mb/s
Standard Deviation: 108.67
Fasted file transfer: 612 Mb/s

Software Used:
UDT v2.1
UDT Gateway v0.5 alpha

Date & Time:
August 16, 2005

Hardware:
Machine at StarLight:
3U rack mount Opteron Server
Dual AMD Opteron 250 (2.4 GHz, 64 bit processors)
NIC: Neterion XFrame 10 Gb/s
OS: GNU/Debian Linux 3.1
Memory: 4 GB
Storage: 3WARE 4 disk raid-5 array

Machine at SDSC:
Dell 2850
Dual 2.8 GHz XEON
NIC:
OS: Linux RHEL3 mirrored on 2 73Gb disks
Memory: 2 GB
Storage: Powervault (7x160GB disks - RAID5)

Network:
The data was transported from StarLight facilities in Chicago to SDSC over the 10 Gb/s routed Abilene network.

Uploaded Image: Picture-1b.png

Transfer rate (Mb/s) at each second during the transfer of File 1

Uploaded Image: Picture-21.png

Transfer rate (Mb/s) at each second during the transfer of File 2