1 / 45

Involving Families

Involving Families. Informing Families. What are you doing to inform families about the data collection? Why it is occurring What it involves What it means for them and their child. www.the-eco-center.org. Federal and State Activities State Activities

zavad
Download Presentation

Involving Families

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Involving Families Early Childhood Outcomes Center

  2. Informing Families • What are you doing to inform families about the data collection? • Why it is occurring • What it involves • What it means for them and their child Early Childhood Outcomes Center

  3. www.the-eco-center.org Federal and State Activities State Activities http://www.fpg.unc.edu/~eco/whatstates.cfm#State_sites Early Childhood Outcomes Center

  4. Early Childhood Outcomes Center

  5. Preparing Families • Helping families be active participants in the discussion • What is working? • What is not working? • General principle: Families need to know what to expect Early Childhood Outcomes Center

  6. What Do We Expect from Families • Yes - That they will be able to provide rich information about their child’s functioning across settings and situation • Maybe but not necessarily – That they will know whether their child is showing age appropriate behavior Early Childhood Outcomes Center

  7. Involving Families in a Conversation about Their Child • Avoid jargon • Avoid questions that can be answered with a yes or no • “Does Anthony finger feed himself?” • Ask questions that allow parents to tell you what they have seen • “Tell me about how Anthony eats” Early Childhood Outcomes Center

  8. Involving Families in a Conversation about Their Child • What is working? • What is not working? Early Childhood Outcomes Center

  9. Involving Families in the Rating Discussion • What % of families are participating? • How are you doing this? • What is working? • What is not working? Early Childhood Outcomes Center

  10. Families’ Right to COSF Information All families have a right to know what ratings have given to their child -- and to the records containing the information. Early Childhood Outcomes Center

  11. Quality Review of Discussion Activity Including Families in the Rating Discussion Early Childhood Outcomes Center

  12. Looking for Quality Data I know it is in here somewhere Early Childhood Outcomes Center

  13. Activity • What factors work to improve the quality of your data? • What factors work to lessen the quality of your data? • How to address these factors? Early Childhood Outcomes Center

  14. Take Home Message If you conclude the data are not (yet) valid, they cannot be used for program effectiveness, program improvement or anything else. What do you if the data are not as good as they should be? Answer: Continue to improve data collection through ongoing quality assurance Early Childhood Outcomes Center

  15. Many steps to ensuring quality data Early Childhood Outcomes Center

  16. Many steps to ensuring quality data Early Childhood Outcomes Center

  17. Promoting quality data Training and support before and during data collection Analysis of the data after data collection Data system and verification after data collection Early Childhood Outcomes Center

  18. Promoting Quality Data Through training and communication related to: • Assessment • Understanding the COSF process • Age expectations • Data entry Early Childhood Outcomes Center

  19. Promoting Quality Data Through training materials, such as • Video team and child examples • Written child examples • “Quizzes” for ensuring learning Refresher trainings – Beware of Drift!! Early Childhood Outcomes Center

  20. Promoting Quality Data Through data systems and verification, such as • Data system error checks • Good data entry procedures Early Childhood Outcomes Center

  21. Many steps to ensuring quality data Early Childhood Outcomes Center

  22. Ongoing supervision • Review of the process • Is the process high quality? • Are teams reaching the correct rating? • Methods • Observation • Videos Early Childhood Outcomes Center

  23. Quality Review of COSF Team Discussion 1. Do all team members participate in the discussion? 2. Is parent input considered in the rating? Give examples. 3. Is the team documenting the rating discussion? Give examples. 4. Does the team discuss multiple assessment sources? What are they? Early Childhood Outcomes Center

  24. Quality Review of COSF Team Discussion 5. Does the team describe the child’s functioning, rather than just test scores? Give examples. 6. Does the discussion include the child’s full range of functioning, including skills and behaviors that are age appropriate, immediate foundational, and leading to immediate foundational? Give examples. Early Childhood Outcomes Center

  25. Quality review through process checks • Provider surveys • Self assessment of competence • Knowledge checks • Process descriptions (who participates?) • Identification of barriers • Kansas survey • Alaska’s survey Early Childhood Outcomes Center

  26. Questions from Alaska’s Survey

  27. Ongoing Supervision • Feedback to teams is critical • Refresher training • Beware of • Auto pilot • Drift Early Childhood Outcomes Center

  28. Quality Review of COSF Team Discussion Activity Observe team video Evaluate quality Early Childhood Outcomes Center

  29. Many steps to ensuring quality data Early Childhood Outcomes Center

  30. Quality Review of Completed COSFs Is the COSF complete? Is there adequate evidence for the basis for the rating? Does the evidence match the appropriate outcome area? Is the evidence based on functional behaviors? Early Childhood Outcomes Center

  31. Quality Review of Completed COSFs Is there evidence that the child’s functioning across settings and situations considered? Are the ratings consistent with the evidence? Early Childhood Outcomes Center

  32. Quality Review of COSF Activity Review completed COSF with errors Early Childhood Outcomes Center

  33. Promoting quality data through data analysis • Examine the data for inconsistencies • If/when you find something strange, look for other data that might help explain it. • Is the variation caused by something other than bad data? Early Childhood Outcomes Center

  34. The validity of your data is questionable if… • The overall pattern in the data looks ‘strange’ • Compared to what you expect • Compared to other data • Compared to similar states/regions/school districts Early Childhood Outcomes Center

  35. COSF Ratings - Fall Early Childhood Outcomes Center

  36. Outcome 3: Appropriate Action

  37. Outcome 3: Appropriate Action

  38. Outcome 3: Appropriate Action

  39. Outcome 3: Appropriate Action

  40. OSEP Categories Early Childhood Outcomes Center

  41. Questions to ask • Do the data make sense? • Am I surprised? Do I believe the data? Believe some of the data? All of the data? • If the data are reasonable (or when they become reasonable), what might they tell us? Early Childhood Outcomes Center

  42. Validity • Validity refers to the use of the information • Does evidence and theory support the interpretation of the data for the proposed use? Or • Are you justified in reaching the inference you are reaching based on the data? Standards for Educational and Psychological Testing (1999) by American Educational Research Association, American Psychological Association, National Council on Measurement in Education Early Childhood Outcomes Center

  43. The validity of your data is questionable if: ? Early Childhood Outcomes Center

  44. ….not all providers are not knowledgeable about in the COSF process • …not all providers are careful with the COSF process • …the data look “strange” • …etc. Early Childhood Outcomes Center

  45. Many steps to ensuring quality data Early Childhood Outcomes Center

More Related