Chicago to Amsterdam, The Netherlands
On August 19, we transported the ~800 GB BESTDR3 Sloan Digital Sky Survey astronomical dataset from Chicago, USA, to SARA Computing & Networking Services, in Amsterdam, The Netherlands, in approximately 5.9 hours. The average transfer speed was 288 Mb/s with a median speed of 272 Mb/s.The data was transferred disk-to-memory from disk on an NCDM server at the StarLight Facility in Chicago, USA to the memory of machines at the SARA Computing & Networking Services facilities, in Amsterdam, The Netherlands. The StarLight machine was a dual AMD Opteron server with a 10 Gb/s network card. The SARA machines are Dell model 2650.
The data was transported from StarLight facilities in Chicago to SARA over the 10 Gb/s routed Abilene and Surfnet networks using NCDM's UDT transport protocol and NCDM's UDT Gateway.
Data Set:
Sloan Digital Sky Survey BESTDR3 dataset
64 separate compressed SQL Server backup files
Total Size: 785,185,433,450 bytes
Transfer Speed:
Total Time: 21,242 seconds (5.90 hours)
Average Transfer Speed: 288 Mb/s
Median Transfer Speed: 272 Mb/s
Standard Deviation: 93.15
Fasted file transfer: 560 Mb/s
Software Used:
UDT v2.1
UDT Gateway v0.5 alpha
Date & Time:
August 19, 2005
Hardware:
Machine at StarLight:
3U rack mount Opteron Server
Dual AMD Opteron 250 (2.4 GHz, 64 bit processors)
NIC: Neterion XFrame 10 Gb/s
OS: GNU/Debian Linux 3.1
Memory: 4 GB
Storage: 3WARE 4 disk raid-5 array
Machine at SARA:
Dell 2650
Dual 2.8 GHz XEON
NIC: 1Gb/s
OS: Linux Redhat 7.2
Memory: 1 GB
Storage: 5 disk raid-5 array
Network:
The data was transported from StarLight facilities in Chicago to SARA facilities in Amsterdam, The Netherlands over the 10 Gb/s routed Abilene network to Surfnet.