1 / 12

Assessing Early Years Writing

Sandy Heldsinger and Melanie Osborne. Assessing Early Years Writing. Research partners.

laken
Download Presentation

Assessing Early Years Writing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Sandy Heldsinger and Melanie Osborne Assessing Early Years Writing

  2. Research partners • Dr Stephen Humphry (Australian Research Council Linkage grant with the Australian Curriculum and Reporting Authority and Western Australian Curriculum Council as Industry Partners, on which Stephen Humphry and David Andrich are chief investigators.) • Western Australian Primary Principals’ Association (WAPPA), Comet Bay PS and Noranda PS • Association of Independent Schools of Western Australia (AISWA), Moerlina School

  3. Research • Is it possible that given the right method of assessment, teacher judgements could be as reliable and comparable as large-scale tests? • Yes • Two stages of research • Calibrated 60 exemplars (ordered them from easiest to hardest) and developed a rubric • Assessed 29 performances using the calibrated exemplars

  4. Stage 1 – Calibrating the exemplars and developing the rubric • Over 300 samples were collected from 11 schools; 60 samples were selected to represent the range: pre-primary to year 2. • 15 ECE teachers (from DoE) were asked to compare pairs of performances, and select the better performance in pair. • The person separation index was 0.994 (very high agreement of what constituted a better performance) • Allowed us to generate an Early Writing Scale

  5. The 15 teachers reviewed the ordering and began to articulate why one performance was better than another. • Based on that work we devised a rubric. We trialled the rubric and refined it. • Marked 118 year 1 and year 2 performance using the NAPLAN guide and the Early Writing guide – The correlation was 0.9

  6. Stage 2 – Assessing using calibrated exemplars • 15 AISWA teachers • 29 samples (pre-primary to year 2) • The participants were asked to compare each of the samples with the calibrated exemplars and judge which exemplar each sample was closest to. • Once they selected the closest exemplar they allocated the scale score to the sample performance.

  7. Inter-rater reliability: Cronbach’salpha - 0.992. (This indicates a very high level of inter-rater reliability.) • The judges’ estimates were compared with the mean from all other judges. The correlations range from 0.897 to 0.984 • The correlation of the early writing scale score to the NAPLAN total score was 0.895

More Related