90 likes | 97 Views
What is Evaluation?. Evaluation is…. Applied social science research (Trochim) A way of viewing the project, its participants, it effect Accounting for CONTEXT and MEANING Determining the VALUE of something Measurements are the currency. Defining Evaluation Research.
E N D
Evaluation is…. • Applied social science research (Trochim) • A way of viewing the project, its participants, it effect • Accounting for CONTEXT and MEANING • Determining the VALUE of something • Measurements are the currency
Defining Evaluation Research • Evaluation is the systematic assessment of the worth or merit of some object • Evaluation provides useful feedback • This definition is hardly perfect • Many evaluations do not result in an assessment of worth or merit - Trochim
Understanding Evaluation Research 1.Systematically define what data will be collected, how, when & by whom 2.Process the data to determine what it means within specified contexts 3.Tell constituents about findings in appealing & appropriate ways 4.Disseminate broader findings to share within disciplines
The Process: STARS Overall Informed Decisions & Actions • How is STARS making a difference? • Corps Students • CS Faculty • CS Depts. • K12 outreach participants • Multiple perspectives from: • Corps Students • CS Faculty • CS Depts. • K12 outreach participants • EA projects • External evaluator input • National comparisons • How, what, when, who measures? • Corps Students • Surveys & interviews • CS Faculty • Surveys & focus groups • CS Depts. • Chair interviews • K12 outreach participants • EA projects • How is STARS making a difference? • Corps Students & Faculty say collectively + individual stories • Exemplars • Modifications Revise, Reform & Disseminate
Evaluative Thinking • Reflective practice of systematically using data to inform decisions • Ongoing process • Approach to making decisions, what actions to take, to become/remain effective at the organizational (or individual) goals • It is LEARNING and APPLYING learning
Evaluation and Academic Research Evaluation Academic Research Applies research methods to answer questions about a program’s efficacy & value Considers context (stakeholders, climate, etc.) Makes a judgment call on WORTH, and defines value structure (i.e. value to whom?) Applies research methods to answer a research question Knowledge gained in scientific discipline Does not apply value structure; values are seen as bias
In summary, evaluation… • Uses research methods • Applies methods to social, political and economic realities • Helps to interpret academic research within larger socio-economic/geo-political realities • Answers the “so what?” of observed outcomes Research = Knowledge Discovery Evaluation = Extracting Meaning from Knowledge