150 likes | 296 Views
Genomics at the Speed of Light: Understanding the Living Ocean. The Gordon and Betty Moore Foundation 2nd Annual Marine Microbiology Investigator Symposium The Golden Gate Club, The Presidio of San Francisco July 17-19, 2006. Dr. Larry Smarr
E N D
Genomics at the Speed of Light: Understanding the Living Ocean The Gordon and Betty Moore Foundation 2nd Annual Marine Microbiology Investigator Symposium The Golden Gate Club, The Presidio of San Francisco July 17-19, 2006 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technologies Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD
Dedicated Optical Channels Makes High Performance Cyberinfrastructure Possible (WDM) Source: Steve Wallach, Chiaro Networks “Lambdas” Parallel Lambdas are Driving Optical Networking The Way Parallel Processors Drove 1990s Computing
National Lambda Rail (NLR) and TeraGrid Provides Cyberinfrastructure Backbone for U.S. Researchers NSF’s TeraGrid Has 4 x 10Gb Lambda Backbone International Collaborators Seattle Portland Boise UC-TeraGrid UIC/NW-Starlight Ogden/ Salt Lake City Cleveland Chicago New York City Denver Pittsburgh San Francisco Washington, DC Kansas City Raleigh Albuquerque Tulsa Los Angeles Atlanta San Diego Phoenix Dallas Baton Rouge Las Cruces / El Paso Links Two Dozen State and Regional Optical Networks Jacksonville Pensacola DOE, NSF, & NASA Using NLR Houston San Antonio NLR 4 x 10Gb Lambdas Initially Capable of 40 x 10Gb wavelengths at Buildout
Countries are Aggressively Creating Gigabit Services:Interactive Access to CAMERA and LOOKING Systems Visualization courtesy of Bob Patterson, NCSA. www.glif.is Created in Reykjavik, Iceland 2003
Calit2’s Direct Access Core Architecture Will Create Next Generation Metagenomics Server Dedicated Compute Farm (1000 CPUs) W E B PORTAL Data- Base Farm 10 GigE Fabric Local Environment Flat File Server Farm Direct Access Lambda Cnxns Web (other service) Local Cluster TeraGrid: Cyberinfrastructure Backplane (scheduled activities, e.g. all by all comparison) (10000s of CPUs) • Sargasso Sea Data • Sorcerer II Expedition (GOS) • JGI Community Sequencing Project • Moore Marine Microbial Project • NASA Goddard Satellite Data • Community Microbial Metagenomics Data Traditional User Request Response + Web Services Source: Phil Papadopoulos, SDSC, Calit2
The Future Home of the Moore Foundation Funded Marine Microbial Ecology Metagenomics Complex First Implementation of the CAMERA Complex Major Buildout of Calit2 Server Room Underway Photo Courtesy Joe Keefe, Calit2
Moore CAMERA Server Facility Environmental Upgrade Underway • Addition of 1000 sf to server facility underway • Adding 500kva Transformer, 6 225A Breakers, Starline Power Grid • Adding 66 Ton of Cooling, Ducting and Registers • Adding Plumbing, Electrical Raceway, Overhead Cable Trays • Supporting an Additional 20 Racks of Equipment • Completion September 2006 Source: Greg Hidley, Calit2
Moore CAMERAProduction Environment • Creation of Initial Production Environment – September 2006 • Status – RFP to Appear August 1 – Targeting September Installation • Hardware (Best Approximation Today) • Compute Nodes – • ~200 4 CPU Nodes = ~800 Processing Cores • Storage Servers – • 10 systems = ¼ Petabyte raw (100-125TB usable raided and replicated) storage • Database Servers • Larger 20-40TB • Smaller 5-10TB • Network Management – • Force10 E1200 Router w/12 10GigE Interfaces to Each System Ports • Expansion Late 2007—Will be Tuned by Initial Usage and Load • Compute Nodes – • Towards 1600+ Processing Cores • Storage and Databases – • Towards 200+ TB of Storage Source: Greg Hidley, Calit2; Phil Papadopoulos, SDSC, Calit2
OptIPuter Scalable Adaptive Graphics Environment (SAGE) Allows Integration of HD Streams OptIPortal– Termination Device for the OptIPuter Global Backplane
Calit2 and the Venter Institute Will Combine Telepresence with Remote Interactive Analysis 25 Miles Venter Institute OptIPuter Visualized Data HDTV Over Lambda Live Demonstration of 21st Century National-Scale Team Science
Calit2 and the Venter Institute Test CineGrid™ with HDTV Movie by John Carter StarLight Chicago Sony HDTV JH-3 JCVI Calit2 Auditorium JC Venter Institute Rockville, MD Live Demonstration of 21st Century Entertainment Delivery June 14, 2006
OptIPortal– Termination Device for the OptIPuter Global Backplane • 20 Dual CPU Nodes, 20 24” Monitors, ~$50,000 • 1/4 Teraflop, 5 Terabyte Storage, 45 Mega Pixels--Nice PC! • Scalable Adaptive Graphics Environment ( SAGE) Jason Leigh, EVL-UIC Source: Phil Papadopoulos SDSC, Calit2
UIC/UCSD 10GE CAVEWave on the National LambdaRail Emerging OptIPortal Sites OptIPortals UW NEW! UIC EVL MIT NEW! JCVI UCI UCSD SIO SunLight SDSU CICESE CAVEWave Connects Chicago to Seattle to San Diego…and Washington D.C. as of 4/1/06 and JCVI as of 5/15/06
First Remote Interactive High Definition Video Exploration of Deep Sea Vents Canadian-U.S. Collaboration Source John Delaney & Deborah Kelley, UWash
High Definition Still Frame of Hydrothermal Vent Ecology 2.3 Km Deep 1 cm. Source: John Delaney and Research Channel, U Washington White Filamentous Bacteria on 'Pill Bug' Outer Carapace