Download
1 / 13
130 likes | 143 Views
Explore the Open Science Grid (OSG) project achievements, commitments, and goals from 2006 to 2011. Learn about the infrastructure, community contributions, software releases, and future challenges the OSG Council faces.
E N D
Thank you! To Abhishek and Chris for putting this all together. To all of you for spending your time to report and input to make OSG better and be more useful
Slices and Layers User Science Codes and Interfaces VO Middleware Applications Biology Portals, databases etc HEP Data and workflow management etc Astrophysics Data replication etc OSG Release Cache: OSG specific configurations, utilities etc. Virtual Data Toolkit (VDT) core technologies + software needed by stakeholders:many components shared with EGEE Infrastructure Core grid technology distributions: Condor, Globus, Myproxy: shared with TeraGrid and others Existing Operating, Batch systems and Utilities.
Horizontal and Vertical Integrations User Science Codes and Interfaces Applications Biology Portals, databases etc HEP Data and workflow management etc Astrophysics Data replication etc Infrastructure
End of Phase II Project start End of Phase I 2006 2007 2008 2009 2010 2011 2006 2007 2008 2009 2010 2011 Our Commitments over the 5 Years Contribute to Worldwide LHC Computing Grid LHC Event Data Distribution and Analysis LHC Simulations Support 1000 Users; 20PB Data Archive Contribute to LIGO Workflow and Data Analysis LIGO data run SC5 Advanced LIGO LIGO Data Grid dependent on OSG STAR, CDF, D0, Astrophysics CDF Simulation CDF Simulation and Analysis D0 Simulations D0 Reprocessing STAR Data Distribution and Jobs 10KJobs per Day +1 Community +1 Community +1 Community +1 Community +1 Community +1 Community +1 Community +1 Community +1 Community Additional Science Communities Facility Security : Risk Assessment, Audits, Incident Response, Management, Operations, Technical Controls Plan V1 1st Audit Risk Assessment Audit Risk Assessment Audit Risk Assessment Audit Risk Assessment Facility Operations and Metrics: Increase robustness and scale; Operational Metrics defined and validated each year. Interoperate and Federate with Campus and Regional Grids VDT and OSG Software Releases:Major Release every 6 months; Minor Updates as needed VDT 1.4.0 VDT 1.4.1 VDT 1.4.2 … … … … OSG 0.6.0 OSG 0.8.0 OSG 1.0 OSG 2.0 OSG 3.0 … VDT Incremental Updates dCache with role based authorization Accounting Auditing Federated monitoring and information services VDS with SRM Common S/w Distribution with TeraGrid Transparent data and job movement with TeraGrid EGEE using VDT 1.4.X Transparent data management with EGEE Extended Capabilities & Increase Scalability and Performance for Jobs and Data to meet Stakeholder needs SRM/dCache Extensions “Just in Time” Workload Management VO Services Infrastructure Integrated Network Management Data Analysis (batch and interactive) Workflow Improved Workflow and Resource Selection Work with SciDAC-2 CEDS and Security with Open Science
Year 1 - coming to an end • Made a plan last September. • Did we stick to it? • More or less with some reservations
Year 2 starting • How can we do better? • Focus areas on ｷOperations stability ｷAbility of users to determine status and source of failures to increase usability ｷMetrics (accounting & presentation) ｷProgress on data movement/management ｷStrengthen customer support function • If you give us Action Items from this meeting we will pursue them with vigor!
The Open Science Grid (OSG) vision Transform processing and data intensive science through a cross-domain self-managed national distributed cyber-infrastructure that brings together campus and community infrastructure and facilitating the needs of Virtual Organizations (VO) at all scales
The OSG Consortium and the OSG Project • OSG is a large collaborative activity. Its implicit goal is to dramatically “lower the bar” for users and resource providers to join together • The OSG Consortium comprises all institutions and projects that contribute to OSG. • The OSG Council is the governing body of the Consortium and provides the scientific coordination and oversight of OSG activities. • The OSG Project is funded to provide staff for specific aspects of managing and sustaining the OSG.
Long Term Issues OSG Council Is Facing • How to set expectations for providing opportunistic services • Surplus, probability, joint scheduling • What can people count on • Timing conflicts • How to make the bar to participation low, but effective • For users to join and get access to resources – most VOs use multiple resources, some dedicated to them, some not • For sites to join – few sites provide resources only to OSG • Resource providers to offer quality software • Sites and VO alignments/mis-alignments • OSG does not develop nor does it control any SW it uses • What does it mean to be a facility that has no physical resources • How to evolve to a sustaining effort
Becoming a Full OSG Citizen Join the OSGEDU VO: Run small applications after learning how to use OSG from schools Be part of the Engagement program and Engage VO: Support within the Facility to bring applications to production on the distributed infrastructure Be a standalone VO and a Member of the Consortium: Ongoing use of OSG & participate in one or more activity groups.
