60 likes | 247 Views
On Demand File Access over the Wide Area with GPFS Bandwidth Challenge 2003. SCinet. L.A. Hub. Booth Hub. TeraGrid Network. Southern California Earthquake Center data Scalable Visualization Toolkit. Gigabit Ethernet. Gigabit Ethernet. Myrinet. Myrinet. SAN. SDSC SC Booth. SDSC.
E N D
On Demand File Access over the Wide Area with GPFSBandwidth Challenge 2003 SCinet L.A. Hub Booth Hub TeraGrid Network Southern California Earthquake Center data Scalable Visualization Toolkit Gigabit Ethernet Gigabit Ethernet Myrinet Myrinet SAN SDSC SC Booth SDSC 40 1.5 GHz dual Madison processor nodes GPFS mounted over WAN No duplication of data 128 1.3 GHz dual Madison processor nodes 77 TB General Parallel File System (GPFS) 16 Network Shared Disk Servers
Southern California Earthquake Center • Earthquake moving along a simple faultline • Two snapshots from the simulation • Birds-eye view of the movement of the ground • Images are colored using a simple transfer function • Blue representing slow moving material • Red fast moving material • Green material moving at speeds in-between the two extremes • Dataset consists of 600 1.1 GB files • 3000 timesteps • Data generated on TG Linux • Recall time sequence data randomly SCEC: Geoff Ely Prof Jean-Bernard Minster SDSC Marcio Faerman Steve Cutchin
Access to GPFS File Systems over the WAN • Goal: sharing GPFS file systems over the WAN • WAN adds 10-60 ms latency • … but under load, storage latency is much higher than this anyway! • New GPFS feature • GPFS NSD now allows both SAN and IP access to storage • SAN-attached nodes go direct • Non-SAN nodes use NSD over IP • Work in progress • Technology demo at SC03 • Work toward possible product release