The Child Outcomes Summary Competency Check (COS-CC)

1. The Child Outcomes Summary Competency Check (COS-CC) Amy Nicholas, Naomi Younggren, Siobhan Colgan & Kathi Gillaspy 2013 Improving Data, Improving Outcomes Conference

2. Getting to Know You Early Childhood Outcomes Center

3. What is the COS-CC? A set of materials to assess staff understanding of the essential knowledge and skills needed to contribute to the COS process. Early Childhood Outcomes Center

4. Purpose of the COS-CC • To provide states with a mechanism to verify that staff have basic competencies • To identify professional development needs Early Childhood Outcomes Center

5. The COS Competency Check • The COS-CC is not a training tool. • It is expected that staff using the COS-CC would have attended training on the basic competencies prior to using the assessments. Early Childhood Outcomes Center

6. The Development Process • Responding to needs in the field • Workgroup process with ECO staff, state and national experts for content validity • Release in early 2014 Early Childhood Outcomes Center

7. Essential Knowledge and Skills Includes: • General COS process information • Content of the three child outcomes • The 7-point rating scale • Age-expected child development Early Childhood Outcomes Center

8. Essential Knowledge and Skills Does not include: • Observation of children’s skills and behaviors • Collaborative teaming These are essential to the COS process, but are difficult to assess. Early Childhood Outcomes Center

9. Passing the COS-CC • Passing the COS-CC doesn’t make you an expert – it only verifies that you have the basic competencies needed to contribute to the COS discussions. Early Childhood Outcomes Center

10. Organization of the COS-CC Package • Two levels of information (Levels 1 & 2) • Banks of questions and answers (both levels) • Case studies and videos (level 2) • Level 1 must be passed before moving on to Level 2. • Instructions will be included, with options for customizing the materials for your state. Early Childhood Outcomes Center

11. COS-CCLevel 1 • Over 100 multiple choice and true/false questions about: • The COS process; • The three child outcomes; and • The 7-point rating scale. • Answer key Early Childhood Outcomes Center

12. Administering Level 1 Questions • 20 items for Level 1 should be chosen accordingly: • 5 questions about the COS process • 5 questions about the three child outcomes • 10 questions about the 7-point rating scale • When selecting the questions, select questions that represent a range of content (i.e. all three outcomes, all 7 points on the rating scale). Early Childhood Outcomes Center

13. Sample Level 1 Questions Competency Self-Check! Source: Google Image Early Childhood Outcomes Center

14. Proceeding to Level 2 • Criteria for “passing” Level 1 are being developed. • Considerations include: • Cut score needed to “pass” and proceed to Level 2 • Providing additional opportunities to complete Level 1 items after engaging in professional development • Conducting an error analysis of the questions that were answered incorrectly Early Childhood Outcomes Center

15. COS-CC Level 2 Case Studies • Practical • Hands-on • Authentic • Include • Video clips • Write-ups • Competency questions • Rating Key (AE-IF-F) • Scoring guidance (under development) Early Childhood Outcomes Center

16. Case Studies • Three Early Intervention • 4, 19, and 31 months • Three Early Childhood Special Education • 3, 4, and almost 5 years old Early Childhood Outcomes Center

17. SampleMeeting Euriah • Video clip • Write-up • Competency Questions • Rating Key Early Childhood Outcomes Center

18. Video Clip Early Childhood Outcomes Center

19. Write-up • Referral information • Intake (EI) / Observation (ECSE) • Birth/medical history • Evaluation (5 domains & test results) • Present levels by 3 outcomes Early Childhood Outcomes Center

20. Write-up Early Childhood Outcomes Center

21. COS-CC Level 2Competency Questions • Outcome content • Which of the following is not a skill associated with Outcome 1 for Euriah? • Age anchoring • For each of the following, identify if the skill is age-expected, immediate foundational, or foundational. • Rating • What rating should the team assign Euriah for Outcome 1? Early Childhood Outcomes Center

22. Rating Key • Skills from • Evaluation, video, & present levels • Organized by • Age-expected (AE) • Immediate foundational (IF) • Foundational (F) • Rating given by number (1-7) Early Childhood Outcomes Center

23. Rating Key Early Childhood Outcomes Center

24. Terms of Use • No changes or adaptations may be made to the case studies or videos • Adaptations to questions for state terminology or procedures only • Online use encouraged – without posting answers Early Childhood Outcomes Center

25. Terms of Use • Materials available from the ECO/ECTA Center upon request • Support available to help determine how to use materials within a state • Acknowledgement of acceptance of terms prior to use Early Childhood Outcomes Center

26. Implementation • Plan to have those who use the materials first participate in a learning community to share challenges and successes for implementation • Will develop mechanisms for gathering feedback from state staff and providers completing the COS-CC Early Childhood Outcomes Center

27. Options for States to Disseminate COS-CC Materials • Paper/pencil administration • Provide downloadable “forms” of the CC on a secured website or distribute via email • Create an online assessment • Examples of free options: • ClassMarker (http://www.classmarker.com) • ProProfs (http://www.proprofs.com/quiz-school) • QuizStar (http://quizstar.4teachers.org) Early Childhood Outcomes Center

28. What do you think? • What excites you about this? • What are you concerned about? • What supports and resources will states need from ECO/ECTA in order to use the COS-CC effectively? • How might we best use a learning community to support implementation of this product? Early Childhood Outcomes Center

29. Need answers? Kathi Gillaspy: kathi.gillaspy@unc.edu Siobhan Colgan: siobhan.colgan@unc.edu Amy Nicholas: anicholas@jhu.edu Naomi Younggren: naomi.younggren@googlemail.com Early Childhood Outcomes Center