1 / 12

TG User Services Coordination December 2006

TG User Services Coordination December 2006. PSC. PU. UC/ANL. NCAR. IU. NCSA. ORNL. TACC. SDSC. Strategic Issues.

naif
Download Presentation

TG User Services Coordination December 2006

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TG User Services Coordination December 2006 PSC PU UC/ANL NCAR IU NCSA ORNL TACC SDSC

  2. Strategic Issues • Petascale simulation needs strongly coupled TeraGrid resources for pre- and post-processing, data analysis,mining/filtering, visualization, steering, and management at various time scales. • We need to get ready: engineer applications & workflows to efficiently use ultrascale systems and Grid based technologies; train our consultants and users; implement a scalable information system to support this work. • We have made a start: SC06 successes, user information design.

  3. TeraGrid Wins Again! • SC|06 HPC Analytics Challenge Winning team: CMU/U Texas Austin/UC Davis/PSC "Remote Runtime Steering of Integrated Terascale Simulation and Visualization" Recall that SC|05 Analytics Challenge was also won on TG systems, with ASTA support! • SC|06 Bandwidth Challenge Honorable Mention: IU/PSC/ORNL Lustre-WAN experiments: "All in a Day's Work: Advancing Data Intensive Research with the Data Capacitor"

  4. Impact of Completed ASTA Projects Published TG Science Features, News, Nuggets: • Arterial Karniadakis (Brown U) CTS mpich-G2, Grid interop, GridFTP, Remote Viz, PDIO Steering • Vortonics Boghosian (Tufts U) CTS mpich-G2, Grid interop, Remote Viz • SPICE Coveney (UCL) CHE Grid interop, Steering, GridFTP ; AHE • ENZO Norman (UCSD) AST GridFTP, WAN-GPFS, DMOVER, SRB, Task Mapping • SCEC yr1 Olsen (SDSU) GEO pegasus-VDS, GridFTP/tgcp, WAN-GPFS, SRB • BIRN Ellisman (SDSC) BIO WAN-GPFS, SRB • CMS Newman (Caltech) PHY MyCluster/GridShell • Crystal Deem (Rice) PHY MyCluster/GridShell • Tstorms Droegemeier (OU) ATM parallel scalability,I/O design, ensemble simulations • GADU Maltsev (U Chicago) BIO pegasus-VDS, Grid interop Infrastructural enablers: Injector Heister (Purdue) ASC parallel scalability MD-Data Jakobsson (UIUC) BIO gsicp, gsissh; customized portal NREL Brady (Cornell) BIO parallel scalability CIG Gurnis (Caltech) GEO community code development, SGW development EarthScope Pavlis (IU) GEO parallelization

  5. GADU on TeraGrid and OSG… Bioinformatics is all about Comparative analysis: • Insights of Biology are gained by Comparative Analysis: • Comparative analysis to know what is same and different between strains of an Organism • Difference between Pathogenic and non-pathogenic organisms. Tools BLAST , Blocks, Chisel, Interpro etc. : An embarrassingly parallel workload. GADU uses TeraGrid and OSG resources simultaneously: • Opportunistic use of resources without reservations. • An interoperable setup to use both the Grids. • Site selection and scheduling across OSG and TeraGrid Sites. • GADU uses Pegasus based Virtual Data System (developed under the Griphyn Project) to generate resource specific job submission files. • A common installation and job submission setup for both the Grids.

  6. Results: Last Run .. ( November 2006) Ran75000 BLAST Jobs Ran 40800 Blocks Jobs Usage: 70% OSG : 30% Teragrid • GADU was able to get about 700 CPUs throughout the last run on OSG and TeraGrid together. • TeraGrid Community Space helped in standardizing the GADU’s installation of various TeraGrid sites. • On the Application Level (OSG and TeraGrid resources helped in) : • Analyzing more than 1,000 Prokaryotic and Eukaryotic genomesusing various tools such as BLAST, Blocks and Chisel via PUMA2, Pathos and Target • Analyzing User submitted genomes via GNARE for groups such “Shewanella Federation” (Analyzed 13 Strains of Shewanella) and “Center for Genomic Sciences” at West Penn Allegheny Health System (Analyzed Strains of Beggiatoa and Haemophilus influenzae) • Acknowledgements: • TeraGrid User Support Group - ASTA • David O’Neal (GIG/PSC), Joseph Insley (UC/ANL), Krishna Muriki (SDSC) • OSG Operations – Support in getting more resources for GADU VO. • Globus and VDS Support.

  7. Current ASTA Projects SCEC yr.2 Olsen (SDSU) GEO Cui (SDSC), Reddy (GIG/PSC) Turbulence Woodward (U Minn) ASC Reddy (PSC) Nemo3D Klimeck (Purdue) ECD Raymond (GIG/PSC), Muriki (SDSC) Epidemiology Barrett (VA Poly) Cuticchia (Duke) BCS Marcusiu (NCSA) Demography Lansing (U Arizona) DBS Majumdar (SDSC), Gomez (PSC) Remote Biological Microscopy Gilpin(U Texas) MCB Hempel (TACC) Adaptive GIN MD/QM Nakano (USC) DMR Brown (PSC) Pulmonary Immunity Benos (Pitt) MCB Raymond (GIG/PSC) Pleistocene Hydrology Person (IU) EAR Wang (IU) Failure of Human Bone Keaveny (UCB) MCA Majumdar (SDSC) QUAKE Bielak (CMU) MCA Urbanic (PSC)

  8. Info In Wiki Ticket System Knowledge Base MDS Resources Catalog DB (TGCDB) Science Gateways Accounting User News DB Systems monitors Software repository (from users, systems, and staff) Info Out User Info Knowledge Base (in User Info) Portal Wiki Science Gateways RP site User Guides User News Display Inca Software pages Vision for TeraGrid Information Flow

  9. Portal Wiki Inca Elements of the TeraGrid Information System Docs Coord,WG, Portal, KB, Doc Group, & other Staff KBWill be in User Info Allocated Users Ticket System DB Knowledge Base User News DB Accounting (TGCDB) RP Web Sites Resource Catalog (TGCDB) MDS INCA DB Software Repository Help Desk Consultants, User Services/ASTA Automated/Dynamic Human-mediated RP Site Systems User Info User News

  10. Info systems under development for 2007 KB Staff RP site staff KBWill be in User Info Allocated Users Ticket System DB User News DB Knowledge Base Resource Catalog (TGCDB) Help Desk Consultants, etc. INCA DB RP Web Sites User Info TG STaff. Allocated Users Wiki MDS User Info Inca RP Site Systems User News Portal Automated/Dynamic Human-mediated

More Related