Goal Attainment Scaling:

1. Goal Attainment Scaling: Measuring and Monitoring Project Objectives December 11, 2007 Ella Taylor Tom Udell National Consortium on Deaf-Blindness The Teaching Research Institute Western Oregon University

2. Objectives for Webinar • Understand what GAS is including benefits and uses. • Understand the steps for developing a GAS. • Understand how to implement a GAS to track progress.

3. Let face it my friends, We’re not exactly rocket scientists.

4. What isGoal Attainment Scaling(GAS) • A tool for tracking and recording the achievement of project activities. • Regular use of a GAS across objectives and activities can be used to determine if • (a) timelines are being met, • (b) milestones or bench marks are met on a regular basis, • (c) resources need to be reallocated, • (d) new strategies are needed due to a shift from an intended outcome, or • (e) new targets need to be developed with project officer.

5. Benefits of GAS • Monitors improvement and achievement. • Can be applied to all project outcomes and activities at any and all stages of implementation. • Enables comparison between very different activities. • Aligns with OSEP’s Grant Performance Reports. • Provides proposal reviews a “snapshot” of targets across all activities.

6. GAS Scores or Degrees of Achievement • Level +2: Much higher than anticipated outcome. • Level +1: Higher than anticipated outcome • Level 0: Met anticipated outcome. • Level -1: Less than anticipated outcome • Level -2: Much less that than anticipated outcome

8. Comparison between very different activities. • Difficult to compare outcomes of… a. 85% b. 25 c. December 1st • Giving a numeric value to each enables comparison… a. 85% becomes 0 b. 25 becomes -2 c. December 1st becomes +1

9. Example of GAS (in back of Handout)

10. Steps in Developing a GAS • Step 1: Develop objectives for the project. • Step 2: Develop activities needed to met or complete each objective. • Step 3: Set an anticipated outcome for each activity. • Step 4: For each outcome, set targetsfor each degree of achievement.

11. Step 1: Develop objectives for the project. • Driven by the RFP priorities the project must address. • Statements describing each aspect of what a project will do. • Lead to achieving the project’s overall outcome or goal. • Outline accomplishments that are critical for the project to be considered successful. • Should be stated in terms of observable performance.

12. Do I develop degrees of achievement for objectives? • Average degree of achievement for anticipated outcomes. • Percentage of anticipated outcomes met.

14. Step 2: Develop activities needed to meet or complete each objective. • Clear and specific language. • Discrete steps. • Logically lead to accomplishment of the objective.

15. Step 3: Set an anticipated outcome for each activity. • Set a standard of quality and/or quantity. • Stated in observable and measurable terms. • Acceptable evidence that the activity was completed.

16. How do I determine criteria? • Use previous project data. • Consider funding level. • Consider available resources. • Use project staff experiences. • Use advisory committee input.

17. Do I set up the GAS for a quarterly, annual or 5 year review? • Dependents on what decisions you need to make and what data you need to make decisions. • Criteria for anticipated outcomes should be based on review period.

18. Step 4: For each outcome, set targets for each degree of achievement. • For each identified outcome targets are set for the degree of achievement scale. • Level 0: Met anticipated outcome is simply the criteria set within the outcome. • Levels -1 and -2 are lower degrees of success or achievement using the same measurement or criteria type. Conversely, • Levels +1 and +2 are higher degrees of achievement that go beyond what is satisfactory for meeting the outcome and completing the respective activity.

19. Implementation • Summarize and record data. • Identify degree of achievement. • Reflection. • Planning.

20. Incorporating outcomes into project activities… Activity (Grant activities) Needs Assessment (Objectives) PROJECT GOALS Evaluation (Measures & Outcomes) Beginning: Identifying what needs to be done and selecting OPIs related to the needs. Middle: (1) Planning and delivering TA to meet the needs. (2) Planning on how you will evaluate effort. End: Documenting and evaluating your efforts to determine your effects.

21. Reporting Example Effort Language Number of TA providers who received training about goal attainment scaling (n = 50) Number of workshops conductedfocusingon strategies to improve the use of goal attainment scales (n = 4)

22. APR Example Effect Language Mean rating of TA providers reporting increased knowledge about goal attainment scales (m = 4.0 (5.0 scale) [APR 40/50] Mean rating of TA providers reporting progress in implementing strategies to use goal attainment scaling (m = 3 (5.0 scale))[APR 30/50)]

23. APR (ED 524B report) languageProject Objective: Assess the impact of TA & D activities

24. APR (ED 524B report) languageProject Objective: Assess the impact of TA & D activities

25. APR (ED 524B report) languageProject Objective: Assess the impact of TA & D activities

26. Example of GAS (in back of Handout)