200 likes | 301 Views
Evaluation Issues in Programs that Promote Self-Determination Anita Yuskauskas, Ph.D. SD Evaluation Issues. How can we assess: Power Personal Worth Equality Liberty. More SD Evaluation Issues.
E N D
Evaluation Issues in Programs that Promote Self-DeterminationAnita Yuskauskas, Ph.D.
SD Evaluation Issues How can we assess: • Power • Personal Worth • Equality • Liberty
More SD Evaluation Issues • SD based on principles – operationalization is individualized; systems become decentralized and more complex • Experimental - wide variety of approaches • Experience of SD varies by role • Knowledge about SD is limited: are we asking the right questions? Are we in agreement on projected outcomes? Are we in agreement on language? • More research is needed to guide policy and legislative decision making
WHY ARE THESE ISSUES? • Evaluation results can influence federal and state policies and practices around the use of government support dollars
SYSTEMS & COMMUNITY CHANGE EFFORTSJohn G. Ott & Associates, Santa Fe, NM • Results – Shared agreements about outcomes we can we expect from self-determination • Indicators – measurable data sources that assess whether we are achieving desired results • Strategies – Initiatives and programs we employ to achieve desired results • Performance Measures – measures we use to judge the effectiveness of implementing strategies
RESULTS FROM SELF-DETERMINATIONTom Nerney • Freedom to design a life plan • Authority to control a targeted amount of resources • Supports organized in an individualized way • Responsibility for the wise use of public dollars and to contribute to one’s community
IN ORDER TO ASSESS ACHIEVEMENT OF OUTCOMES THERE MUST FIRST BE AGREEMENT ON OUTCOMES • “If there is no agreement on results, there will likely be arguments over dollars or who is more pious. John G. Ott
Self-Determination Requires a Multifaceted Approach to Evaluation Both Qualitative and Quantitative Methods Can Provide Understanding & Answers About Effectiveness
QUALITATIVE METHODS • Reality is socially constructed: • Mutual • Subjective/Perspective • Phenomenology • Constructivism • Symbolic Interactionism • Ethnomethodology
FROM: Objective Hierarchy Simple, Mechanistic TO: Perspective Heterarchy Complex FROM CHANGING WORLD ORDER…TO METHODOLOGICAL CONSISTENCYSchwartz & Ogilvy
QUALITATIVE METHODS • Provide an evaluation process that is consistent with the values of self-determination • Provide a means to define results • Completes the picture
WHO & WHAT WILL BE STUDIED QUALITATIVELY? • How people define & experience self-determination versus its effectiveness • How self-determination works versus if it works. • Understanding SD versus finding an outcome
DECENTRALIZED & INDIVIDUALIZED • Self-Determination is defined on an individual basis • Whether SD works is decided on an individual basis
MUTUALITY Contribution and Benefit are Understood to be Mutual and Beneficial
HOW WILL IT BE STUDIED? • Design, Data Collection, & Analysis Occur Simultaneously; Learning process is continuous, flexible, subject to change, responsive, interactive • Subject is empowered to define the topics of research that are pertinent, in a way that is consistent with their own belief system. • Methods include: observation, open –ended interviewing, participant observation, and document reviews
Validity and Reliability in Qualitative • Provide adequate detail about how the study was conducted, the people and their environments • Provide information about gaining access in the field and the rapport with subjects • Provide evidence of member checks, triangulation, and peer co-analysis
CONCLUSIONS • Establish a research institute that will integrate qualitative & quantitative research results on self-determination • Utilize integrated and accurate info to feed future research, policies, and practices • Establish a research agenda; agree on outcomes • Focus research on showing how people are and are not realizing empowerment, personal worth, equality, liberty, etc. • Attempt to define the individual threshold point where support becomes restrictive