Selecting Criteria and Setting Standards

1. Selecting Criteria and Setting Standards

2. Useful Criteria and Standards • Criteria need to reflect intent of the program • Select criteria that can be influenced • Select criteria that can be measured reliably • Criteria that stakeholders participate in selecting

3. Developing Goals and Objectives • How much agreement on Goals is needed? • Felt or expressed needs Vs. Ascribed Needs • Understanding Behavior Change • Impacting Key Indicators

4. Different Types of Goals • Implementation Goals • Activities that must be completed (resources, activities, and KOSA especially Knowledge and Opinions) to meet goals • Intermediate Goals • KOSA, especially Skills and Aspirations and some forms of Practice Change • Outcome Goals • Practice Change and SEEC Change

5. Goal That Apply to all Programs • Some goals are unstated but expected! • Treat program participants with respect • The golden rule • No negative side effects • Fiscal responsibility • Ethical treatment of all stakeholders

6. Evaluation Criteria & Evaluation Questions • Does the program plan match the values of stakeholders? • Does the program or plan match the needs of people to be served? • Ascribed Needs/Secondary Data • Research • Literature • Felt Needs/Primary Data • Needs assessments using any of a variety of techniques • Key and Action Informants • Advisory Groups

7. Evaluation Criteria & Evaluation Questions • Does the program as implemented fulfill the plans? • Plan your work and work your plan! • Exceptions to this rule: • Programs that cannot be implemented as planned • Value conflicts that make implementation impossible • Unintended side effects

8. Evaluation Criteria & Evaluation Questions • Do the Outcomes Achieved Match the Goals? • The level of outcome achieved • Specifying level of outcome • Outcomes and black boxes / The importance of program theory

9. Using Program Theory • Social programming should explicitly state a conceptual framework linking interventions or educational strategies with outcomes. • This avoids the black box and allows proper planning

10. Using Program Theory • Bennet’s Hierarchy is a general Behavioral Change logic model • This scheme can and should be enhanced with specific knowledge of a program area • Some things will be constant: • Multiple contacts with the same audience • A variety of techniques will reach more people • KOSA is necessary for practice change • Practice Change is necessary for SEEC change

11. Social,Economic, Environmental Conditions Practices Knowledge, Opinions, Skills, Aspirations Activities Resources Program Logic in Program Development Bennett’s Hierarchy Program Logic Model Planning Performance

12. Using Program Theory • Implausible Program Theories • PSAs • Creates Awareness but not practice change • Must have some form of follow-up that is more intensive • Tenuous links or not following the logic all the way through • Alligators in Florida

13. Final Considerations in Criteria and Standards • Is the Program Accepted? • Immediate Program Satisfaction • Are the resources devoted to the program being expended appropriately? • Program costs in the planning phase Vs. implementation phase • Is the program fair to all stakeholders • Monies spent as described in plans • Outcomes justify the expense

14. Final Considerations in Criteria and Standards • Evaluation Budget • Time • Credible Criteria with Stakeholders