Chicago to Korea

During the week of August 1, we transported the ~800 GB BESTDR3 Sloan Digital Sky Survey astronomical dataset from Chicago, USA, to Daejeon, South Korea, in approximately 6.56 hours. The average transfer speed was 208 Mb/s with a median speed of 226 Mb/s.

The data was transferred disk-to-disk from an NCDM machine at the StarLight Facility in Chicago, USA to a machine at the Korea Astronomy and Space Science Institute (KASI) facilities in Daejeon, South Korea. The StarLight machine was a dual AMD Opteron server with a 10 Gb/s network card. The KASI machine was a dual Intel Xeon machine with a 1 Gb/s network card.

The data was transported using NCDM's UDT transport protocol and NCDM's UDT Gateway. The first hop went from StarLight facilities in Chicago, USA, to Korea Institute of Science and Technology Information (KISTI) facilities in Daejeong, S. Korea, using the 10 Gb/s GLORIAD and Abilene networks. The second hop went from KISTI to KASI using a 1 Gb/s dedicated Korean network.

Dataset:
Sloan Digital Sky Survey BESTDR3 dataset
64 separate compressed SQL Server backup files
Total Size: 785,185,433,450 bytes

Tranfer Speed:
Total Time: 23,628 seconds (6.56 hours)
Average Transfer Speed: 208 Mb/s
Median Transfer Speed: 226 Mb/s
Fasted file transfer: 260 Mb/s

Software Used:
UDT v2.1
UDT Gateway v0.5 alpha

Date & Time:
Week of August 1, 2005

Hardware:
Machine at StarLight:
3U rack mount Opteron Server
Dual AMD Opteron 250 (2.4 GHz, 64 bit processors)
NIC: Neterion XFrame 10 Gb/s
OS: GNU/Debian Linux 3.1
Memory: 4 GB
Storage: 3WARE 4 disk raid-5 array

Machine at KASI:
Dell PowerEdge 2850
Dual Intel Xeon 64 bit 3.4 GHz
NIC: Dual Embedded Intel Gigabit Adapter
OS: RED HAT Enterprise Linux ES Version 3, EM64T
Memory: 4GB
Storage: Approximately 10 TB

Network:
The data was transported over two networks:
1) The first hop involved sending the data from NCDM's Opteron server at StarLight facilities in Chicago, USA to the Korea Institute of Science and Technology Information (KISTI) in Daejeon, South Korea using the 10 Gb/s GLORIAD and Abilene networks.

StarLight, Chicago, USA TO Seattle, WA, USA via Abilene TO KISTI, Daejeon, South Korea via GLORIAD.

2) The second hop was from KISTI to the astronomer's machine at the Korea Astronomy and Space Science Institute (KASI) using a 1 Gb/s dedicated Korean network.

Uploaded Image: Picture-1.png

Transfer rate (Mb/s) at each second during the transfer of File 1

Uploaded Image: Picture-2.png

Transfer rate (Mb/s) at each second during the transfer of File 60