160 likes | 313 Views
OSG Accounting Service Requirements. Matteo Melani ( matteom@slac.stanford.edu ) SLAC for the OSG Accounting Activity. Who are we?. The team Matteo Melani – SLAC Philippe Canal – Fermilab Sudhir Borra –Fermilab. And we are talking to. Ian Foster, Frank Siebenlist – Globus
E N D
OSG Accounting ServiceRequirements Matteo Melani (matteom@slac.stanford.edu) SLAC for the OSG Accounting Activity
Who are we? The team • Matteo Melani – SLAC • Philippe Canal – Fermilab • Sudhir Borra –Fermilab
And we are talking to • Ian Foster, Frank Siebenlist – Globus • Sebastien Goasguen –TeraGrid • David Kant – LCG • Andrea Guarise - EGEE
What are the Activity Goals? • To provide the OSG stakeholders with a reliable and accurate set of views of the Grid resources usage. • The Grid Accounting Project will: • design (or choose) the accounting data model • ensure the necessary meters and collectors are in place at the resource provider sites, • define and deploy repositories and access tools for the reporting and analysis of the grid wide accounting information • ensure interoperability with other Grids (LCG, TeraGrid,...)
Project Charter OSG Document 131: http://osg-docdb.opensciencegrid.org/0001/000131/004/AccountingProjectDefinition1.pdf
What are we doing? • Just finish the Requirements document • OSG Accounting Service Requirements v1.0 - Just released! • Working at the Design • Architecture Overview Document (DRAFT in preparation) • Talking to the stakeholders • OSG stakeholders • Other Grids stakeholders: LCG, TeraGrid, EGEE, Globus… • Reviewing other Accounting Systems • DGAS, APEL, SGAS • GGF groups RUS/UR/GESA/OGSA-WGs, • IETF’s AAA, Telecommunications Network
Why a Requirements doc? • Verba volant, scripta manent • Define the Accounting System scope • Establish a common accounting model and terminology so that we can understand each other and we can communicate with OSG stakeholders and other Grids stakeholders • Understand OSG needs so that: • do not build what we do not need and want • reuse what is out there • Accounting is a fairly new topic in distributed systems and in IT
Admins. Subscribe to VO VO Manger Grid User uses uses Gets VO info uses manages Grid Access Service uses Accounting Sys. Admin, uses Grid Manager uses OSG Auth. & Auth. Infrastructure OSG Accounting Service Site administration domain & Computing Environment Resource Manager OSG Monitoring Service Grid wide Accounting System VO Management System Resources Grid Service Grid Wide Monitoring System Grid Service OSG Grid Services Network Resources Storage Resources Software Resources Site Accounting system Site Monitoring System Accounting System Scope
Main Functionalities (1) • The ability to collect resources and services usage data at each resources and services provider site. • The ability to combine authentication, authorization and resource usage data related to a Grid user request to produce detailed accounting records. • The ability to store and manage accounting records and accounting data. • The ability to present accounting records in tabular format at the Grid wide and site level
Main Functionalities (2) • The ability to apply various (statistical) functions to analysis accounting records and data to facilitate the spotting of trends and patterns in the usage of resources and services. • The ability to present the results of this analysis with graphical views. • The ability to support auditing processes by storing the raw usage data and maintaining links between the accounting records and the raw usage data used to generate them.
Main Functionalities (3) • No user charging system, • No resources or services pricing • No support for an economic model for resource allocation But we have to keep them in mind!
System Properties(1) • Interoperability • The Accounting System should leverage existing standards to maximize interoperability with other Grids and Accounting Services. • Fault Tolerance • The Accounting System must reduce as much as possible usage data and accounting records loss. • The Accounting System must be resilient to temporary communication failures over LAN and WAN. • The Accounting System must be resilient to the failure of one of its component.
System Properties(2) • Security • The Accounting System will guarantee integrity and non–repudiation of the accounting records at the site level. • The Accounting System must protect accounting information using secure communication channels (mutual authentication, message integrity, confidentiality) and access control lists. • Scalability and Performance • Not really an issue • Other • The Accounting System should leverage existing tools and infrastructures to solve related problems.
Open Questions • How do we measure resource usage? • Specific metrics • What are the specific graphs and tabular views the stakeholders want? • What (and how) Authentication & Authorization information the OSG infrastructure can supply? • DN-UID mappingissue • Template account
What are your accounting needs? OSG-ACCOUNTING@OPENSCIENCEGRID.ORG
Accounting &Monitoring Logging Monitoring Accounting Auditing