1 / 54

Florida High Performance Computing Summit March 21-22, 2001 Gainesville, Florida

Florida High Performance Computing Summit March 21-22, 2001 Gainesville, Florida. Sunshine Grid: Motivation. “The foundation we’re laying today, like the physical infrastructure of a building or city, is the supporting framework necessary for the scientific discoveries of the future.”

kimama
Download Presentation

Florida High Performance Computing Summit March 21-22, 2001 Gainesville, Florida

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Florida High Performance Computing Summit March 21-22, 2001 Gainesville, Florida

  2. Sunshine Grid: Motivation “The foundation we’re laying today, like the physical infrastructure of a building or city, is the supporting framework necessary for the scientific discoveries of the future.” Arden L. Bement, Director National Science Foundation, 2004-2010

  3. Sunshine Grid: Florida’s Research and Education Cyberinfrastructure • Describe the New Florida Initiative • Motivation for the Sunshine Grid proposal • What is the Sunshine Grid • Deliverables • Sunshine Grid Web and DB (Dan Majchrzak) • Support for three science areas (Paul Avery) • Time for your thoughts and insights

  4. New Florida Initiative • The 2010 Florida Legislature invested a total of $12 million in New Florida Initiative • Designed to: • Demonstrate the power of the SUS when it collaborates in areas critical to Floridians. • Produce meaningful outcomes in a short timeframe

  5. New Florida Initiative • Should serve as a change agent for FL • Transform FL’s economy beyond tourism, agriculture, and housing • Should promote the creation of high-skill, high-wage, knowledge-based employment • Results should foster economic recovery, growth, and future prosperity

  6. New Florida Initiative • Commercialization Assistance Grants Program • link research activities at Univ. with commercial products • $2 million of the $12 million • State University Research Commercialization Assistance Grants (SURCAG) Program • New Florida Scholars Boost Grants Program • Assist in hiring, retaining, and equipping the best faculty candidates and existing faculty • Similar to the former “21st Century World-class Scholars Program,” but with less funding • New Florida Clustering Grants Program • Focus a collaboration between or among universities • Fast time-to- delivery • Associated with health, engineering, and/or science

  7. New Florida Initiative • Announced in late-summer 2010 • Proposals were due mid-Sept. • Each University independently selected and ranked proposals • Ranked lists were submitted to BOG for final review

  8. Sunshine Grid • Announcement was made • We hit the Ground Running

  9. Sunshine Grid: MotivationOther Efforts • Florida Center for Computational Biology (FCCB) • Lead by UFL, in collaboration with FSU, UCF, FIU, and USF • Board of Governors Centers of Excellence Competition, 2007 • Collaborative Acquisition of High-performance Storage and Visualization Infrastructure • UF and FSU collaboration • Major Research and Instrumentation – Recovery and Reinvestment Act, NSF, 2009

  10. Sunshine Grid: MotivationScience Paradigms (a la Jim Gray) • Experiments • Describing natural phenomena • Theory • models for generalizations • Computations • Simulate complex phenomena • Large-scale Data Exploration • unify experimentation, theory, and simulation

  11. “Shared NIT infrastructure – be it computational resources, communication networks, community databases, or collaboration tools – has become essential to research in virtually all fields.” • President’s Council on Science and Technology (PCAST), 2010 • “By working together, the HPC and CI communities best serve the mutually reinforcing goals of (1) sustaining the entire computational pyramid while (2) generating economic growth via breakthroughs in science and engineering.” • NSF sponsored workshop on Sustainable Funding and Business Models for Academic Cyberinfrastructure Facilities, 2010 • “Institutions of higher education should lead efforts to fund and invest in university-specific, state-centric, and regional cyberinfrastructure to create local benefits (in research accomplishment and local economic development) and to aid the global competitiveness of the US and thus the long-term welfare of US citizens.” • NSF Advisory Committee for Cyberinfrastructure Task Force on Campus Bridging, 2011 • “Development and acquisition of research instrumentation for shared inter- and/or intra-organizational use are encouraged, as are development efforts that leverage the strengths of private sector partners to build instrument development capacity at academic institutions.” • NFS Major Research Instrumentation Solicitation, 2011 Sunshine Grid: Motivation

  12. Sunshine Grid: Motivation • Florida’s Universities are home to a wealth of world-class resources • Talented scientists • High-end computing facilities • Massive data storage systems • Specialized research instruments • High-speed state-wide network (FLR)

  13. Sunshine Grid: Motivation Organize assets in such a way as their collective impact is greater than the sum of their individual parts.

  14. Sunshine Grid: Motivation • Workforce Florida and Enterprise Florida • 2010-2015 Strategic Plan for Workforce Development strongly endorses STEM development at FL Univ. • Florida STEM Council • Promote ties between industry and academia • “Florida will be a national leader in market relevant STEM talent development and retention”

  15. Sunshine Grid: Proposal • Build a coherent cyber-infrastructure across three state universities: • University of Florida • University of South Florida • Florida State University • Use this as a base for future development to include ALL of Florida’s public and private Universities.

  16. CyberinfrastructureCampus Cyberinfrastructure Working Group (EDUCAUSE)& Coalition for Academic Scientific Computation (CASC) Consists of computational systems, data and information management, advanced instruments, visualization environments, and people, all linked together by software and advanced networks to improve scholarly productivity and enable knowledge breakthroughs and discoveries not otherwise possible.

  17. Sunshine Grid: Proposal • Goals of proposal closely aligned with New Florida Initiative • Increase research funding • Enable leading-edge research • Provide educational opportunities • Promote healthy economic development

  18. Sunshine Grid: Deliverables • Two-pronged approach • Catalog High-end Resources • Internal use: track assets and progress related to linking assets • Showcase STEM resources; attract positive attention to Florida • Support three well defined research projects • well defined goals • need for data storage and compute cycles • What we asked from New Florida • 400K per University • $280K in salaries • $120K in capital

  19. New Florida: Cluster Awards • 93 proposals submitted to the BOG • Cumulatively worth $32.4 million • 31 projects were funded • Successful Cluster Awards: • Aerospace, Aging Issues in North Florida, Biomedical Engineering, Climate Change, Coastal Watersheds, Community Health, Cyber-infrastructure, Family Medicine, Geophysical Threats, Medical Prostheses, Neuroscience, Professional Science Master’s Degree, Smart Sensors, and Vector Borne Diseases. • Sunshine grid was funded because close alignment with New Florida’s Goals and quick turn around

  20. Sunshine Grid: Award

  21. Sunshine Grid: Award • What we got from New Florida • UF: $200K • FSU: $150K • USF: $100K • Internal matching was honored • UF: $200K • FSU: $150K • USF: $140K

  22. Sunshine Grid: Day-to-Day Leadership • HPC Directors at UF, FSU, USF  - Erik Deumens (UF)  - Daniel Majchrzak (USF)  - Jim Wilgenbusch (FSU)

  23. Sunshine Grid: Advisory Panel Members • Paul Avery (High Energy Physics) (UF) • Scott Stagg (Bio Imaging) (FSU) • Qingnong  Xiao (Climate Modeling) (USF) • Joel Hartman (Florida Lamda Rail/SUS CIO) (UCF) • Nick Tsinoremas (Private Florida Univ.) (UM) • Sunshine Grid PIs (ex officio)

  24. Sunshine Grid: Key Milestones • Jan/Feb – Advertise new positions • Feb – Invite Sunshine Grid advisory panel members • Feb/May – Hire staff at each University • April/May – Release version of Sunshine Grid DB/Web • May/June – Convene first Sunshine Grid Advisory meeting • July – Demonstrate shared storage over FLR • Aug – Release Showcase on web of three science projects • Nov – Host industry forum to bridge industry and academia • Nov – Supercomputing 2011 (SC11), Seattle, WA • Nov – Solicit ideas for additional projects

  25. Sunshine Grid: Architecture • Components • Searchable catalog of research resources in the state of Florida • Showcase of Florida’s high-end resources • Web-based outreach and education resources • Statewide cyber-infrastructure • People

  26. Sunshine Grid: Architecture • Searchable catalog of research resources in the state of Florida • Researchers are a resource ! • Efficient use of resources • Help industry find resources • Enable collaboration

  27. Sunshine Grid: Architecture • Searchable catalog of networked research resources in the state of Florida • Web based for easy access • High available cluster infrastructure • Updated by grid personnel • CMS based for ease of maintenance

  28. Sunshine Grid: Architecture • Using cloud tag technology • Databases are too inflexible for rapidly changing technologies which leads to inflexible searching and underutilization • Tags are contributor generated labels: FSU, UF, HPC, high energy physics • The Tag Cloud will show the top N tags. The larger or more prominent a tag is, the more it has been used to describe a resource

  29. Sunshine Grid: Architecture • Cloud tag technology – example music

  30. Sunshine Grid: Architecture • Web-based Outreach and Education • Florida’s Universities (e.g., python tutorials) • Community Colleges • K-12

  31. Sunshine Grid: Architecture • A state-wide cyberinfrastructure • Leverages expertise at Universities with existing HPC centers • Allows universities without HPC to provide resources without startup investment • Provides interface to national and international resource (Open Science Grid, TeraGrid/XD) • Provides competitive edge to state researchers, universities, and industry

  32. Sunshine Grid: Architecture • A state-wide cyberinfrastructure • Common Authorization/Access Method • Open Science Grid • InCommon • Home-grown

  33. Sunshine Grid: Architecture • A state-wide cyberinfrastructure • High speed storage available from across the state • Data may be the most difficult problem to solve • File sharing via distributed Lustre implementation • Shared computational resources • Shared to other Florida Universities • Shared to outreach partners • Built on Florida Lambda Rail (FLR)

  34. Sunshine Grid: Architecture • A state-wide cyberinfrastructure • People • Experts • Ambassadors • Collaborators

  35. Sunshine Grid: Research Projects • CMS experiment at CERN • UF, FSU (+ FIT, FIU) • Cryo Electron Microscopy (CryoEM) • FSU and UF • Coupled Ocean Atmosphere • USF and FSU

  36. CMS Experiment at CERN’s Large Hadron Collider

  37. A Proton-Proton CollisionWill Record ~109 collisions/year

  38. CMS Computing • ~10s PB of collision data collected per year • Similar amount of simulated data • Worldwide distributed computing resources • US part supported by Open Science Grid • UF is a “Tier-2” university site • Data repository for physics analyses • Supports FSU, FIT, FIU

  39. >2000 physicists, 60 countries • 10s of Petabytes/yr • CERN / Outside = 10-20% CMS Experiment CMS Experiment Global Grid Online System CERN Computer Center 300 MB/s Tier 0 10-40 Gb/s Tier 1 Korea Russia FermiLab UK >10 Gb/s OSG U Florida Caltech Tier 2 UCSD 2.5-10 Gb/s Tier 3 FSU FIU FIT Physics caches PCs

  40. LHC Miami 2010 (Dec. 16, 2010) Paul Avery A. Farbin M. Ernst, BNL

  41. Worldwide LHC Computing Grid Miami 2010 (Dec. 16, 2010) Paul Avery From Ian Bird

  42. Open Science Grid:LHC, Chemistry, Bioinformatics, Etc.

  43. CMS Supported Faculty • UF • Darin Acosta, Paul Avery, Ivan Furic, Richard Field, Jacobo Konigsberg, Andrey Korytov, Konstantin Matchev, Guenakh Mitselmakher, John Yelton • FSU • Todd Adams, Andrew Askew, Harrison Prosper, Sharon Hagopian, Vasken Hagopian, Kurtis Johnson • FIT & FIU • Marc Baarmand, Marcus Holhmann, Steve Linn, Pete Markowitz, Jorge Rodriguez

  44. Other Information • http://cms.web.cern.ch/cms/ • http://www.phys.ufl.edu/ihepa/cms.html • http://www.hep.fsu.edu/cms.html • http://research.fit.edu/hep/ • http://casgroup.fiu.edu/physics/pages.php?id=3091

  45. CryoEM • Automated Cryogenic Transmission Electron Microscope • Determine the three-dimensional structures of large biological molecules at high resolution • Many medical and basic science applications • Instruments • FSU: Titan Krios at Institute for Molecular Biology • UF: G2 F20 (forthcoming) • Both have high resolution & high data rates

  46. Resolution ~1 nm Titan Krios EM at FSU

  47. CryoEM Integration with HPC • Bring image data and metadata produced by both microscopes to HPC facilities at FSU & UF • Improved retention and availability of cryoEM data • Data will be placed on Lustre file systems for transparent sharing between both campuses • Available to other research groups in Florida

  48. CryoEM Supported Faculty • FSU • Scott Stagg, Kenneth Taylor, Kenneth Roux Thomas Roberts, Beth Stroupe • UF • Byung-Ho Kang, Mavis Agbandje-McKenna, Robert McKenna

  49. Coupled Ocean-Atmosphere Models • State-of-the-art ensemble ocean-atmosphere-wave coupled forecasting system • Utilizes latest developments in regional mesoscale atmospheric, ocean, and wave models as well as in ocean and hurricane vortex initialization

More Related