iGrid - San Diego to Chicago

On September 27, 2005 we transported the ~800 GB BESTDR3 Sloan Digital Sky Survey astronomical dataset from the iGrid Conference in San Diego, Callifornia, USA, to Chicago, IL, USA, in approximately 2.6 hours. The average transfer speed was 653 Mb/s with a median speed of 712 Mb/s.

The data was transferred disk-to-disk from an NCDM server at the iGrid 2005 Conference in San Diego, CA, USA to an NCDM machine at the StarLight Networking facilities in Chicago, IL, USA. The machines at both ends were dual AMD Opteron servers with 10 Gb/s network cards.

The data was transferred via the Abilene network and using NCDM's UDT transport protocol and NCDM's UDT-HTTP Gateway.

Dataset:
Sloan Digital Sky Survey BESTDR3 dataset
64 separate compressed SQL Server backup files
Total Size: 785,185,433,450 bytes

Transfer Speed:
Total Time: 9,174 seconds (2.55 hours)
Average Transfer Speed: 653 Mb/s
Median Transfer Speed: 712 Mb/s
Standard Deviation: 255.05
Fasted file transfer: 1,008.00 Mb/s

Software Used:
UDT v2.1
UDT Gateway v0.5 alpha

Date & Time:
September 27, 2005

Hardware:
Machine at iGrid
3U rack mount Opteron Server
Dual AMD Opteron 250 (2.4 GHz, 64 bit processors)
NICs: Neterion XFrame 10 Gb/s
OS: GNU/Debian Linux 3.1
Storage: 3WARE 4 disk raid-5 array

Machine at StarLight
3U rack mount Opteron Server
Dual AMD Opteron 250 (2.4 GHz, 64 bit processors)
NIC: Neterion XFrame 10 Gb/s
OS: GNU/Debian Linux 3.1
Memory: 4 GB
Storage: 3WARE 4 disk raid-5 array

Network:
The data was transferred from the iGrid 2005 Conference in San Diego, CA, USA, to the StarLight Networking facilities in Chicago, IL, USA, via the Abilene network

Uploaded Image: Picture-1b.png

Transfer rate (Mb/s) at each second during the transfer of one of the 64 files.