1 / 8

Guidelines for Developing Level 3 Evaluation Metrics

Guidelines for Developing Level 3 Evaluation Metrics. 5 KEY CRITERIA. Criteria 1: Relevant.

phil
Download Presentation

Guidelines for Developing Level 3 Evaluation Metrics

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Guidelines for Developing Level 3 Evaluation Metrics

  2. 5 KEY CRITERIA

  3. Criteria 1: Relevant • The learning objectives show the expected action, the conditions under which the trainee is to perform, and the level or standard of performance. The outcomes we want to measure must be based on the learning objectives. • Learning Objectives: • Demonstrate thorough knowledge of the PEX process and its implications for the NCP, including how PEX fits into the overall child support program. • Navigate and apply the Property Execution Challenges Procedure to perform actions within the PEX process. • Develop skills in ASSETS to perform daily PEX functions; including reviewing case information, understanding and updating system codes and fields, building PEX records, and writing and interpreting case remarks. • Conduct a holistic case review and apply the PEX Fact Gathering Worksheet to appropriately process a case. • Differentiate between valid and invalid challenges, take the appropriate actions to determine whether challenges should be upheld or denied, and respond to challenges and other correspondence in a timely manner. • Generate and save documents pertinent to the PEX process.

  4. Criteria 2: Observable • What outcomes can we observe? How? • Methods of observation could include: • Physically observing behavior • Reviewing information (i.e., case review) • Inspecting data from a database or reports • Example of outcome we can’t observe: • “Demonstrate thorough knowledge of the PEX process and its implications for the NCP, including how PEX fits into the overall child support program.”

  5. Criteria 3: Measurable Outcomes must be transformed into quantifiable metrics. If job performance is being measured, then it should be broken down into discrete tasks and translated into either: Dichotomous Variables Scale Variables

  6. Criteria 4: Practical • Balance the rigor of our evaluation with the amount of time and resources needed to conduct it. • Example: • For a particular process, we want to evaluate performance by: • Observing a caseworker conducting an interview • Reviewing information inputted into the case file • However, both of these tasks would take a supervisor up to 40 minutes per caseworker to complete. • While doing both of these would result in a more rigorous evaluation, it isn’t practical to dedicate this much time to it.

  7. Criteria 5: Specific Metrics must have only one intended meaning and cannot be open to interpretation. Example: Was a registration form completed & submitted? Yes No  • Depending on the situation, “No” can mean one very specific thing or it can mean several different things: • A registration form was completed but not submitted • A registration form was submitted but not complete • A registration form was neither completed nor submitted • This particular situation did not warrant a registration form

  8. CASE STUDY: ADVANCED PEX • Learning Objectives: • Demonstrate thorough knowledge of the PEX process and its implications for the NCP, including how PEX fits into the overall child support program. • Navigate and apply the Property Execution Challenges Procedure to perform actions within the PEX process. • Develop skills in ASSETS to perform daily PEX functions; including reviewing case information, understanding and updating system codes and fields, building PEX records, and writing and interpreting case remarks. • Conduct a holistic case review and apply the PEX Fact Gathering Worksheet to appropriately process a case. • Differentiate between valid and invalid challenges, take the appropriate actions to determine whether challenges should be upheld or denied, and respond to challenges and other correspondence in a timely manner. • Generate and save documents pertinent to the PEX process.

More Related