140 likes | 256 Views
Results of Prior NSF RI Grant: TITAN. David E. Culler Computer Science Division U.C. Berkeley NSF Site Visit March 2, 1998. Titan Agenda.
E N D
Results of Prior NSF RI Grant: TITAN David E. Culler Computer Science Division U.C. Berkeley NSF Site Visit March 2, 1998
Titan Agenda • Develop a new type of system which harnesses breakthrough communications technology to integrate a large collection of commodity computers into a powerful resource pool that can be accessed directly through its constituent nodes or through inexpensive media stations. • SW architecture for global operating system • programming language support • advanced applications • multimedia application development Previous NSF RI
Results • Constructed three prototypes, culminating in 100 processor UltraSparc NOW • GLUnix global operating system layer • Active Messages providing fast, general purpose user-level communication • xFS cluster file system • Fast sockets, MPI, and SVM • Titanium and Split-C parallel languages • ScaLapack libraries • Heavily used in dept. and external research => instrumental in establishing clusters as a viable approach to large scale computing => transitioning to an NPACI experimental resource Previous NSF RI
Highly Leveraged Project • Large industrial contribution • HP media stations • Sun compute stations • Sun SMPs • Intel media stations • Bay networks ATM, ethernet • Enabled several federal grants • NOW • Titanium • Daedalus • Castle • Berkeley Multimedia Research Center Previous NSF RI
Software Warehouse • Coherent software environment throughout the research program • Billions bytes of code • Mirrored externally • New SWW-NT Previous NSF RI
Novel Systems Design • Virtual networks • integrate communication events into virtual memory system • Implicit Co-scheduling • cause local schedulers to co-schedule parallel computations using a two-phase spin-block and observing round-trip • Co-operative caching • access remote caches, rather than local disk, and enlarge global cache coverage by simple cooperation • Network virtual memory, fast sockets • Large-scale Storage Clusters • ISAAC “active” security • Internet Server Architecture • TACC Proxy architecture Previous NSF RI
Novel Cluster Design • Tertiary Disk • very low cost massive storage • hosts archive of Museum of Fine Arts • Pleiades Clusters • functionally specialized storage and information servers • constant back-up and restore at large scale • NOW tore apart traditional AUSPEX servers • CLUMPS • cluster of SMPs with multiple NICs per node Previous NSF RI
Multi-Tier Networking Infrastructure • Myrinet Cluster Interconnect • ATM backbone • Switched Ethernet • Wireless Previous NSF RI
Applications • Inktomi Search Engine • World Record Disk-to_Disk store • RSA 40-bit key • IRAM simulations, Turbulence, AMR, Lin. Alg. • Parallel image processing • Protocol verification, Tempest, Bio, . . . • Services that utilize NOW on demand • TACC (transcoding) Proxy • Transcend • Wingman • MBONE media gateway Previous NSF RI
Sample of 98 Degrees from Titan • Amin Vahdat: WebOS • Steven Lumetta: Multiprotocol Communication • Wendy Heffner: Multicast Communication Protocols • Doug Ghormley: Global OS • Andrea Dusseau: Implicit Co-scheduling • Armando Fox: TACC Proxy Architecture • John Byers: Fast, Reliable Bulk Communication • Elan Amir: Media Gateway • David Bacon: Compiler Optimization • Kristen Wright: Scalable web cast • Jeanna Neefe: xFS • Steven Gribble: Web caching • Ian Goldberg: Wingman • Eshwar Balani: WebOS security Previous NSF RI
Demo before Tour Previous NSF RI
UCB CSCW Class Sigh… no multicast, no bandwidth, no CSCW class... Problem Enable heterogeneous sets of participants to seamlessly join MBone sessions. Previous NSF RI
A Solution: Media Gateways • Software agents that enable local processing (e.g. transcoding) and forwarding of source streams. • Offer the isolation of a local rate-controller for each source stream. • Controlling bandwidth allocation and format conversion to each source prevents link saturation and accommodates heterogeneity. GW GW Previous NSF RI
A Solution: Media Gateways Sigh… no multicast, no bandwidth, no MBone... AHA! MBone Media GW Previous NSF RI