1 / 37

The Evolution of the Connecticut Kindergarten Entrance Inventory

The Evolution of the Connecticut Kindergarten Entrance Inventory. Peter Behuniak University of Connecticut. AERA Presentation. Understanding Students’ Skills at Kindergarten Entry: Findings from Connecticut Jessica Goldstein, Ph.D., Melissa Eastwood, M.A., & Peter Behuniak , Ph.D.

alvin-wyatt
Download Presentation

The Evolution of the Connecticut Kindergarten Entrance Inventory

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Evolution of the Connecticut Kindergarten Entrance Inventory Peter Behuniak University of Connecticut

  2. AERA Presentation • Understanding Students’ Skills at Kindergarten Entry: Findings from Connecticut • Jessica Goldstein, Ph.D., Melissa Eastwood, M.A., & Peter Behuniak, Ph.D. • Presentation at the Annual Conference of the American Educational Research Association, April 2012, Vancouver, B.C.

  3. The presentation • Connecticut’s Kindergarten Entrance Inventory (KEI) • Validity research • Predictive studies of the KEI • Quantitative study of structure of teacher ratings • Lessons for the future

  4. A mandated measure The 2007 Legislation required that:“(h) Within available appropriations, the Commissioner of Education shall, not later than October 1, 2007, develop and implement a state-wide developmentally appropriate kindergarten assessment tool that measures a child’s preparedness for kindergarten, but shall not be used as a measurement tool for program accountability pursuant to section 10-16s, as amended by the act.”

  5. From mandate to policy LEGISLATIVE MANDATE CSDE POLICY Developmentally appropriate kindergarten assessment tool that measures a child’s preparedness for kindergarten A statewide snapshot of the skills and behaviors students demonstrate, based on teachers’ observations, at the beginning of the kindergarten year

  6. Structure of the KEI • Census measure • Administered annually in October • Ratings assigned on 6 domains • Domains are defined by 3-5 indicators each

  7. D1: Language skills • Participate in conversations • Retell information from a story read to him/her • Follow simple 2-step verbal directions • Speak using sentences of at least 5 words • Communicate feelings and needs • Listen attentively to a speaker

  8. D2: Literacy skills • Hold a book and turn pages from the front to the back • Understand that print conveys meaning • Explore books independently • Recognize printed letters, especially in their name and familiar printed words • Match/connect letters and sounds • Identify some initial sounds • Demonstrate emergent writing

  9. D3: Numeracy skills • Count to 10 • Demonstrate one-to-one correspondence while counting (e.g., touches objects as he/she counts) • Measure objects using a variety of everyday items • Identify simple shapes such as circles, squares, rectangles, and triangles • Identify patterns • Sort and group objects by size, shape, function (use), or other attributes • Understand sequence of events (e.g., before, after, yesterday, today, or tomorrow)

  10. D4: Physical/motor skills • Run, jump, or balance • Kick or throw a ball, climb stairs or dance • Write or draw using writing instruments (e.g., markers, chalk, pencils, etc.) • Perform tasks, such as completing puzzles, stringing beads, or cutting with scissors

  11. D5: Creative/aesthetic skills • Draw, paint, sculpt, or build to represent experiences • Participate in pretend play • Enjoy or participate in musical experiences (e.g., singing, clapping, drumming, or dancing)

  12. D6: Personal/social skills • Engage in self-selected activities • Interact with peers to play or work cooperatively • Use words to express own feelings or to identify conflicts • Seek peer or adult help to resolve a conflict • Follow classroom routines

  13. Rating scale

  14. Rating scale

  15. Rating scale

  16. What do the data look like?2007 KEI Ratings

  17. Classifications of validity evidence AERA, APA, NCME Standards for Educational & Psychological Testing (1999)

  18. Validity evidence Based on test content

  19. Validity evidence based on test content • Indicators were developed from • Connecticut Preschool Curriculum Framework • Connecticut Preschool Assessment Framework • Connecticut Curriculum Standards for Language Arts • Connecticut Curriculum Standards for Mathematics • Indicators were reviewed by • Preschool and kindergarten teachers • Representation from urban and suburban districts, special education, and educators of English language learners

  20. Validity evidence Based on relationships to other variables

  21. Validity evidence based on relationships to other variables • Are ratings on the KEI in kindergarten associated with performance on the state’s summative assessment in third grade? • Fall 2007 Kindergarten Entrance Inventory data • Spring 2010 Grade 3 Connecticut Mastery Test • 2007 KEI Ratings / 2010 CMT Data Study • Matched sample of students statewide (n= 29845)

  22. 2007 KEI Ratings by 2010 Grade 3 CMT Reading Proficiency

  23. 2007 KEI Ratings by 2010 Grade 3 CMT Reading Proficiency

  24. 2007 KEI Ratings by 2010 Grade 3 CMT Reading Proficiency

  25. Validity evidence based on relationships to other variables • Are ratings on the KEI at the start of kindergarten associated kindergarten retention? • Fall 2008 Kindergarten Entrance Inventory data (n = 40,713) • Fall 2009 dichotomous retention variable 4% of 2008 kindergarten students were retained in 2009 • The type of student who is the most likely to be retained for a second year of kindergarten is • Young • Male • Eligible for free or reduced lunch • Has KEI Ratings of “1” on Language, Literacy, Numeracy, and Personal/Social domains

  26. Validity evidence Based on internal structure

  27. Language skills • Participate in conversations • Communicate feelings and needs • Speak using sentences of at least 5 words • Follow simple 2-step verbal directions • Listen attentively to a speaker • Retell information from a story read to him/her

  28. A new structure for teacher ratings

  29. Re-conceptualized language domain

  30. Language domain in detail

  31. Language domain in detail

  32. Language domain in detail

  33. Validity evidence based on internal structure

  34. Validity evidence based on test consequences • Fall 2010 survey study of K teachers (n = 1084) • Teachers believe the KEI is an appropriate representation of students’ skills at the start of the kindergarten year. • Teachers felt the rating scale was appropriate. • Teachers reported that they had appropriate time and training to complete the Inventory. • Teachers were neutral about administrative support to complete the instrument.

  35. Looking across the studies

  36. What have we learned? • Teachers can form accurate judgments of student knowledge and skills at the start of the kindergarten year. • Teacher judgments at the start of the kindergarten year are related to academic performance in later grades. • Higher ratings at the domain level are related to higher levels of proficiency in each of the domains covered by the CMT. • Future development of the KEI • Ratings of simple, discrete skills are easier than general domains. • More detailed indicators provide more information about students. • KEI focused on specific discrete skills could be rated dichotomously.

  37. Conclusion • Questions • Discussion • Follow-up issues or thoughts: PeterBehuniak@cox.net

More Related