110 likes | 258 Views
PRACTICAL ISSUES OF STATING THE VALUES OF AN EVALUATION COMMUNITY. MIRELA CERKEZ ADER & IAPE workshop November, 2013. REFERENCES. Australasian Evaluation Society, 2006, Guidelines for the Ethical Conduct of Evaluations
E N D
PRACTICAL ISSUES OF STATING THE VALUES OF AN EVALUATION COMMUNITY MIRELA CERKEZ ADER & IAPE workshop November, 2013
REFERENCES Australasian Evaluation Society, 2006, Guidelines for the Ethical Conduct of Evaluations Australasian Evaluation Society, 2000, Policy on the Application of the Code of Ethics Australasian Evaluation Society, 2000, Code of Ethics African Evaluation Association, 2006, African Evaluation Guidelines - Standards and Norms American Evaluation Association, 2004, Guiding Principles for Evaluators Bustelo, Maria, 2006, The Potential Role of Standards and Guidelines in the Development of an Evaluation Culture in Spain, Evaluation, vol. 12(4), pp. 437-453 Canadian Evaluation Society, 2012, Program Evaluation Standards
REFERENCES Communication for the Commission from the President and Mrs. Schreyer. Evaluation standards and Good Practice. C/2002/5267.23/12/2002 Dezvoltarea unei Comunităţi de Evaluare Profesioniste în România - PHARE RO/2005/017-553.05.03.02 – code of ethics proposal German Evaluation Society, 2008, Evaluation Standards Israeli Association for Program Evaluation, 2009, Guidelines for responsible ethical evaluation Japan Evaluation Society, 2012, Guidelines for the Ethical Conduct of Evaluation
REFERENCES Joint Committee on Standards for Educational Evaluation, 1981, 1988, 1994, 2003, apud Stufflebeam, Daniel L. and Shinkfield, Anthony, 2007, Evaluation Theory, Models & Applications, Jossey-Bass, San Francisco Polish Evaluation Society, 2008, Evaluation Standards Schweigert, Francis J., 2007, The priority of justice: a framework approach to ethics in program evaluation, Evaluation and Program Planning, vol. 30, pp. 394-399 Société Française de l’Évaluation, 2003, Charter of evaluation guiding principles for public policies and programmes Swiss Evaluation Society, 2000, Evaluation Standards United Kingdom Evaluation Society, 2013, Guidelines for good practice in evaluation
DEVELOPING PRINCIPLES / STANDARDS / GUIDELINES FOR EVALUATION. An (partial) overview • 1981 - Standards of the Joint Committee • 1994 – Guiding Principles of the American Association of Evaluation • 1996 - Canadian Evaluation Society • 1997 - Australasian Evaluation Society • 2000 - Swiss Evaluation Society, Australasian Evaluation Society • 2001 - African Evaluation Association, German Evaluation Society • 2003 - Société Française de l’Évaluation • 2008 - Polish Evaluation Society • 2009 - Israeli Association for Program Evaluation • 2012 - Canadian Evaluation Society, Japan Evaluation Society • 2013 - United Kingdom Evaluation Society
DEVELOPING PRINCIPLES / STANDARDS / GUIDELINES FOR EVALUATION. Establishing the language • principles: how evaluators should behave (Wolfgang Beywl/German Evaluation Society); ethical norms (Japan Evaluation Society) • standards: the attributes of a good evaluation (Wolfgang Beywl); expected manners in practice (Japan Evaluation Society) • guidelines: specific actions that evaluators should engage in order to fulfill principles and standards (Wolfgang Beywl) Bustelo (2006): Specific guidelines can be established in mature and non-competitive evaluation communities.
DEVELOPING PRINCIPLES / STANDARDS / GUIDELINES FOR EVALUATION. Establishing the language Arguments: • the evaluation community in Romania is not consolidated so as to be able to define common views on evaluation. In that respect, the document we will develop should rather focus on ethical principles. • taking into account that the evaluation community in Romania is rather young, recommendations of practice for certain sensible aspects of the evaluation process may be useful. Challenge: keeping the balance between too general or too specific / detailed
DEVELOPING PRINCIPLES / STANDARDS / GUIDELINES FOR EVALUATION. The subjects (1) • UKES (2002) and IAPE (2009) have developed sets of recommendations for several potential actors of the evaluation process: • the evaluators • the commissioners • evaluation participants • self-evaluators PROPOSAL: The document should address all the above mentioned subjects. Argument: In order to create a good environment for evaluation, all the stakeholders of an evaluation process should have an evaluation culture.
DEVELOPING PRINCIPLES / STANDARDS / GUIDELINES FOR EVALUATION. The subjects (2) • members of ADER Challenge: the document might be isolated, ignored by the evaluation community • all the members of the evaluation community in Romania Challenges: • the evaluation community might lack the feeling of ownership and, thus reject it Who will be the guardian?
DEVELOPING PRINCIPLES / STANDARDS / GUIDELINES FOR EVALUATION. Outline proposal • Preamble • Principles • Standards and guidelines • Planning the evaluation • evaluators • commissioners • evaluation participants • Performing the evaluation • evaluators • commissioners • evaluation participants • Communicating evaluation results • evaluators • commissioners • evaluation participants