200 likes | 339 Views
International Conference on “Monitoring & Evaluation of Country Planning and Policies” of the National Development and Reform Commission of China " AUSTRALIAN EXPERIENCES WITH MONITORING AND EVALUATING PUBLIC SECTOR PERFORMANCE 25-26 October 2006 Peter Wilkins. Overview.
E N D
International Conference on“Monitoring & Evaluation of Country Planning and Policies”of the National Development and Reform Commission of China"AUSTRALIAN EXPERIENCES WITH MONITORING AND EVALUATING PUBLIC SECTOR PERFORMANCE25-26 October 2006Peter Wilkins
Overview • Performance Management Governance System • Responsibility and accountability • Monitoring, performance reporting & evaluation • Better Practices in Monitoring & Evaluation • Multiple levels • Information use and involving citizens • Future Directions for Monitoring & Evaluation
Australia, its States & Territories Western Australia
Responsibility & accountability Crown Electors Parliament Executive Government Agencies
Government Portfolio Minister/s, Minister/s, Parliamentary Secretary Legislative and regulatory framework Outcomes & Outputs Structure Corporate Planning & Governance Business Planning Performance Review & Feedback Generalised Performance Management Framework Source: After Management Advisory Committee (2001).
Research and Evaluation in a Department RESEARCH AND ANALYSIS Gather information and data Analyse information Draw conclusions Identify implications Source: Department of Education, Science and Training(2005).
Evaluation • Mandatory approach introduced in the 1980s replaced by a highly devolved approach and a shift to the publication of performance information • A regular flow of performance audit reports provides a broad coverage of public sector performance issues.
BETTER PRACTICES IN MONITORING & EVALUATION • Performance reporting and related monitoring at multiple levels:jurisdiction, agency and sector level reporting. • Whole-of-government reporting has emerged over the last 10 years.
Community-based outcome TASMANIA TOGETHER 2001 • Goal: To have a community where people feel safe and are safe in all aspects of their lives • Indicator 2.1.5: Crime victimisation ‘rate’ • Target: Reduce from 14% in 1998 to 6% in 2020 Progress Reports 2004 &2006 • Actual: 12.8% 2002 8.6% 2005
Basic outcome & outputs structure Source: Department of Finance and Administration (2006).
Agency-based outcome WA Police Service Outcome 1: • Lawful behaviour and community safety Main indicators: • Community satisfaction with services provided by/received from police • Extent to which assault, illegal drugs etc are a problem in their own neighbourhood • Number of emergency management plans in place • Percent of police districts that had the required number of officers with a key emergency-related qualification
Evaluation • Healthy range of detailed and at times probing evaluations • Robust and publicly reported evaluations most evident for programs that involve both the Federal and State/Territory governments • Broader view of evaluation-type activity identified broader range and depth of evidence-based analysis.
Evaluation linked to reporting Implementation of the WA State Homelessness Strategy monitored: • develop & report a set of performance indicators aligned with the priority outcomes (10 headline indicators & 24 strategic change indicators) • Evaluations that are intertwined with monitoring
Factors that will affect usage Characteristics of the information: • quality; credibility; relevance; communication; findings; timeliness; accessibility Characteristics of the policy & management environment: • information needs; decision characteristics; types of activity being reported; skills and work-styles of senior managers; political climate; competing information; leadership and interest groups. Wilkins 2006
Community engagement • Range of levels: inform, consult, involve, collaborate & empower • Increasingly being used by governments • Little indication of input for performance reporting regimes and measures • Exceptions: • Tasmania Together • Reporting the quality of health services Wilkins 2006
FUTURE DIRECTIONS FOR MONITORING &EVALUATION • Balancing efficiency & serving the public interest • Context of a low level of confidence in the integrity of public institutions • Further embedding M&E • Performance information and evaluation of public sector management systems.
Contact details Dr Peter Wilkins c/o Office of the Auditor General 4th floor Dumas House 2 Havelock St WEST PERTH Western Australia 6005 AUSTRALIA Phone: +61 8 9222 7588 Mobile: +61 407 380 772 Fax: +61 8 9322 5664 Email: pwilkins@audit.wa.gov.au