iGrid - San Diego to Tokyo
On September 27, 2005 we transported the ~800 GB BESTDR3 Sloan Digital Sky Survey astronomical dataset from the iGrid Conference in San Diego, Callifornia, USA, to Tokyo, Japan, in approximately 4.3 hours. The average transfer speed was 389 Mb/s with a median speed of 416 Mb/s.The data was transferred disk-to-disk from an NCDM server at the iGrid 2005 Conference in San Diego, CA, USA to an NCDM machine at JGN2 Research Center facilities in Tokyo, Japan. The machines at both ends were dual AMD Opteron servers with 10 Gb/s network cards.
The data was transferred via the JGN 2 network and using NCDM's UDT transport protocol and NCDM's UDT-HTTP Gateway.
Dataset:
Sloan Digital Sky Survey BESTDR3 dataset
64 separate compressed SQL Server backup files
Total Size: 785,185,433,450 bytes
Transfer Speed:
Total Time: 15,400 seconds (4.28 hours)
Average Transfer Speed: 389 Mb/s
Median Transfer Speed: 416 Mb/s
Standard Deviation: 96.02
Fasted file transfer: 448.00 Mb/s
Software Used:
UDT v2.1
UDT Gateway v0.5 alpha
Date & Time:
September 27, 2005
Hardware:
Machine at iGrid
3U rack mount Opteron Server
Dual AMD Opteron 250 (2.4 GHz, 64 bit processors)
NICs: Neterion XFrame 10 Gb/s
OS: GNU/Debian Linux 3.1
Storage: 3WARE 4 disk raid-5 array
Machine in Tokyo
3U rack mount Opteron Server
Dual AMD Opteron 250 (2.4 GHz, 64 bit processors)
NICs: Neterion XFrame 10 Gb/s
OS: GNU/Debian Linux 3.1
Storage: 5 disk raid 0 array
Network:
The data was transferred from the iGrid 2005 Conference in San Diego, CA, USA, to the JGN 2 Research Center in Tokyo, Japan, via the JGN 2 network
10 Gb/s lambda from StarLight to JGN 2
1 Gb/s copper ethernet to NCDM machine
Transfer rate (Mb/s) at each second during the transfer of one of the 64 files.