230 likes | 368 Views
The Telescience Project - ATOMIC ( A pplications t o M iddleware I nteraction C omponents) https://telescience.ucsd.edu Transparent Grid Access for Scientific Communities Jason Novotny jnovotny@ncmir.ucsd.edu Abel W. Lin awlin@ncmir.ucsd.edu
E N D
The Telescience Project - ATOMIC (Applications to Middleware Interaction Components) https://telescience.ucsd.edu Transparent Grid Access for Scientific Communities Jason Novotny jnovotny@ncmir.ucsd.edu Abel W. Lin awlin@ncmir.ucsd.edu National Center for Microscopy and Imaging Research University of California San Diego
Mission: Develop and implement technologies to determine and reveal supramolecular details in their cellular and tissue contexts. NCMIR forges innovations in CI and IT to enable solutions for grand challenges in biomedical imaging research Scales of NS data from Maryann Martone
NCMIR is an Accessible Resource Center for Advanced Biomedical ResearchFielding High-throughput Imaging Instruments, Computational Analysis Tools and Databases
Databases & Digital Libraries Computation Partnership Visualization Network Connectivity Remote Instrumentation Training and Dissemination The Telescience Core Methodology Integrate resources, technologies and applications using standardized Grid middleware technologies and advanced networking to provide an end-to-end solution for challenges like multi-scale biomedical imaging.
For example, some or all, of these components are necessary for end-to-end computation Interaction with Middleware appears to be unified ... Portals and Applications Portal and Applications MyProxy CAS CACL LDAP NMI CoG GridPort DataCutter Pegasus Compute Resources Condor (-G) Globus SRB NWS GridFTP GRAM MDS Grid Security Infrastructure Physical Resources but is actually very fragmented Interacting with the Grid
Telescience ATOMIC bridges the Gap between middleware and applications Portal and Applications ATOMIC Collective Services: MyProxy, Pegasus, DataCutter, GridFTP, etc. Local (Services): GSI, Globus, Condor, RLS, SRB, NWS, etc. Physical Resources: Data Storage, Compute Resources, etc.
ATOMIC provides tools for users and developers Provides an intuitive GUI for end-users to launch jobs and manage data Telescience Portal and Applications ATOMIC: TeleAuth/GAMA, TeleWrap, TeleRun, etc. Provides a programming interface and other tools for developers (Telescience Portal and others) to access to Telescience Grid (compatible with other Scientific Grids).
Telescience is reducing the threshold to the use of Grid technologies Gridsphere Portals framework serves as a rich GUI for end-users (bench scientists) ATOMIC services scientific applications developers (mathematicians, physicists, etc…) ATOMIC supports legacy applications and native grid applications with equal intensity. Motivation for ATOMIC: The Grid should be brought to bear for scientific processes...scientific processes should not necessarily have to conform to the Grid
Telescience spurs development, integration, and interoperability along all levels of CI
This model is for all data generator devices: microscopes (EM/LM), shaker tables, particle accelerators, oceanic observers, ecological sensor networks Telescience is realized in the context of microscopy but extendsdirectly to analogous applications that are data and compute intensiveand require parity between computers and instruments Telescience Infrastructure Richly integrated user environment ATOMIC: applications (portal) enabler NMI Data Devices: generate, compute, store
ATOMIC Bundles Available GAMA/TeleAuth: End-to-End GSI Security TeleWrap: Transparent Data Grid I/O for applications TeleRun: Information Gathering for Globus/MPI based applications
GAMA/TeleAuth GAMA is complete GSI credential management and integration solution tailored for use in emerging cyberinfrastructure through web portals or web service-based clients. GAMA makes grid security as easy to use as any commercial web site while maintaining the security and delegation capabilities of GSI.
Telescience CA recently accepted by TeraGrid (1st non-CS organization) ATOMIC also motivated by Data Generation and Computation Resources and Requirements Osaka Univ. KBSI/KISTI Utrecht Univ./ SARA NCHC Heterogeneity places increase burden on application developers
Portals “The portal ecosystem and portal fabric will become the dominant models of application delivery by 2005." - Gartner Research Group • Telescience Portal is built on the JSR168 GridSphere Project: • extends the suite of richly integrated, grid enabled tools for the end user • provides a new level of flexibility, customization, and seamless (administration free) harnessing of the power of global grids • accomplishes this while also reducing the complexity of its own creation and management. • amplifies the extensibility of its underpinnings to other scientific domains with analogous needs.
Portals: Launching Heterogeneous GridApplications No CS information, only biologically relevant parameters
ATOMIC is built out of Applied Experience, not only leading CS concepts… ATOMIC is more than just a packaging of technologies, it is the bundling of nearly a decade of interdisciplinary experience in bringing these technologies to bear for scientific applications. Especially critical at this juncture, given the growing sophistication of GUI interface components
Future activities • ATOMIC Web/Grid Services • Extension of GTS (Generalized Telemicroscopy System) as ATOMIC-based services • Telescience ATOMIC "Rocks Rolls" For more information: https://telescience.ucsd.edu http://ncmir.ucsd.edu
Subject Analysis Group Analysis Recruit Subject Scan Visit Localizer Pre-Processing Structural Analysis Functional Post-Processing Expressing and Executing Workflows • Laboratory Process • Application Pipelines