1 / 6

WG2011 Accomplishments Metrics Planning and Reporting H. K. (Rama) Ramapriyan NASA GSFC

WG2011 Accomplishments Metrics Planning and Reporting H. K. (Rama) Ramapriyan NASA GSFC Clyde Brown NASA LaRC Co-Chairs, MPARWG 10 th Earth Science Data Systems Working Group Newport News, VA November 2011. MPAR Working Group. Mission Statement for the WG

teneil
Download Presentation

WG2011 Accomplishments Metrics Planning and Reporting H. K. (Rama) Ramapriyan NASA GSFC

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WG2011 Accomplishments Metrics Planning and Reporting H. K. (Rama) Ramapriyan NASA GSFC Clyde Brown NASA LaRC Co-Chairs, MPARWG 10th Earth Science Data Systems Working Group Newport News, VA November 2011

  2. MPAR Working Group • Mission Statement for the WG • Review and recommend program-level performance metrics and collection tools that measure how well each data activity supports the NASA Science Mission Directorate’s Earth science, application and education programs. • Membership in WG • WG membership open to NASA data and service provider community (REASoN, ACCESS and MEaSUREs projects, DAACs, SIPSs, etc.). • We are open to suggestions for participation by others. • Scope of Work • WG provides on-going MPAR review, evaluation, recommendations and metrics evolution for the NASA Earth Science (ES) data and service provider community. • WG recommends additions, deletions or modifications to set of metrics. Recommendations may be approved, modified or rejected by NASA HQ. If approved, NASA Science Mission Directorate (SMD) funded ES data and service providers will have to make recommended changes in their reporting.

  3. Accomplishments in 2011 • Metrics Mission Statement: • To measure the success of each project in meeting its stated goals and objectives, to show the role and contribution of each project to the NASA science, application, and education programs, and to enable an overall assessment of the success of programs such as REASoN / ACCESS / MEaSUREs and their contribution to NASA’s goals. • The MPARWG is currently pursuing two sets of metrics that will provide a tangible measure of the progress and success of projects: Product Quality metrics and Citation metrics. • They are “Outcome” metrics that measure success in meeting program and project goals. • They complement the occasional “Impact Metric” that projects may send in as warranted. • They complement the continued collection of products and services metrics.

  4. Accomplishments in 2011: Product Quality Metrics • The Goal of MEaSUREs Projects is to create Earth System Data Records (ESDRs) – each a unified and coherent time series of observations of a given Earth system parameter • ESDRs are critical to: • Understanding Earth System Processes • Assessing variability, long term trends, and change in the Earth System • Provide input and validation means to Earth System modeling • Progress on definition of Product Quality metrics • Purpose is to track MEaSUREs projects’ and DAACs’ progress towards delivery to users of high quality ESDRs. • Objective is small but meaningful set of program level metrics based on project level information on progress with ESDRs. • “Product Quality” considers science quality, documentation, accessibility and support services. • This will be the major MPARWG topic at this ESDSWG meeting. • An approach toward developing Product Quality Metrics has been agreed to. • Goal is an MPARWG recommendation to NASA HQ for Product Quality metrics.

  5. Accomplishments in 2011: Citations Metrics • Collection of initial set of Citations Metrics: • The objective of the Citations metrics is to obtain a better measure of user satisfaction with project’s products and services and enable a better assessment of their contribution to the NASA science and applications programs and Earth science research in general. • An MPARWG Recommendation for Citations Metrics was approved by NASA HQ in October 2010, with collection to begin in FY2011. • 14 MEaSUREs projects contributed citation counts and lists, and descriptions of their citation collection methods. • The MPARWG will discuss their experiences, lessons learned, and agree on a plan for 2012. • A report will be provided to NASA HQ in November 2011 addressing the results of the 2011 citations collection effort, the MPARWG discussion, and plans for 2012.

  6. Accomplishments in 2011: Products and Services Metrics • Continued Products and Services metrics collection: • 18 MEaSUREs, 11 ACCESS, and 2 REASoN projects currently reporting, • Provided summary reports and project highlights to NASA HQ. • Maintained and improved the Metrics Collection Tool (MCT): • Improved / simplified the user interface; • Improved performance and robustness. • Successfully implemented the EMS (ESDIS Metrics System) – MCT Bridge System: • Allows automated collection of dynamic metrics once product archiving and distribution has been migrated to a DAAC and is tracked by the DAAC’s inputs to EMS.

More Related