620 likes | 872 Views
Assessment at Carroll. Glens Colman Director of Curriculum Carroll Lower School May 2013. May, 2013. Carroll School Belief Statement. Smart children with language learning disabilities become successful students given proper instruction within a positive environment. Agenda.
E N D
Assessment at Carroll Glens Colman Director of Curriculum Carroll Lower School May 2013 May, 2013
Carroll School Belief Statement Smart children with language learning disabilities become successful students given proper instruction within a positive environment.
Agenda • 1. What is assessment? • 2. Why do we assess? • 3. How does Carroll assess its students? • 4. How is assessment information used at Carroll?
What is Assessment? • Assessment is the process of collecting data for the purpose of: • (1) Specifying and verifying problems • (2) Making decisions about students
Testing ≠ Assessment • School personnel sometimes equate testing and assessment. Testing consists of administering a particular set of questions to an individual or group of individuals to obtain a score. That score is the end product of testing. A test is only one of several assessment techniques or procedures for gathering information. During the process of assessment, data from observations, recollections, tests, and professional judgments all come into play. Assessment in Special and Inclusive Education, 11th Edition, p. 13
To Consider: The Whole Child • Cognition • Language • Attention • Executive Functioning • Memory • Visual-Spatial • Visual-Motor • Logic • Speech • Content-Area Achievement • Background Experience/Educational Opportunity • Motivation/Interests/Social/Emotional
Characteristics of Assessments • Standardized: • A test in which the administration, scoring, and interpretation procedures are standard or set; usually norm-referenced meaning that norms have been established so scores can be interpreted in terms of validated referent. • Criterion Referenced: • A test linked to predefined content and designed to measure student achievement of that content. • Measures that are used to determine if a student can demonstrate their knowledge by reaching a specified performance level (i.e criteria) on a task. • Give a picture of whether a student does or doesn’t have a particular skill Adapted from Pamela E. Hook, Ph.D.
Types of Assessments • Screening • Diagnostic • Progress Monitoring • Outcomes Adapted from Pamela E. Hook, Ph.D.
SCREENING • Purpose: To identify children in need of extra instructional supports • Often given to a large number of individuals-needs to be efficient • Examples: Pre-Literacy Skills Screening Adapted from Pamela E. Hook, Ph.D.
DIAGNOSTIC ASSESSMENT • Purpose: To determine student’s specific instructional needs • Often involves in-depth individual assessment • Examples: CELF-4, CTOPP Adapted from Pamela E. Hook, Ph.D.
PROGRESS MONITORING • Purpose: Ensure that adequate progress is achieved throughout the year - also called Formative or Dynamic Assessment • Involves repeated assessment • Examples: Fry Words, DIBELS, Benchmarker, MAP Adapted from Pamela E. Hook, Ph.D.
OUTCOMES ASSESSMENT • Purpose: To evaluate overall outcomes - also called Summative Assessment • Examples: MCAS, GRADE, SAT Adapted from Pamela E. Hook, Ph.D.
Review of Scoring: Definitions • Raw Score: • The number of correct responses or any original data obtained by a student on a test. • Standard Scores (SS) • A score derived from comparing a raw score to scores of children of the same age (based on the normal curve – often has a mean of 100 and a standard deviation of 15) • Scaled Scores • A derived score similar to a standard score (often has a mean of 10 and a standard deviation of 3) Adapted from Pamela E. Hook, Ph.D. and http://www.wrightslaw.com/links/glossary.assessment.htm
Testing Terms • Percentile Ranks (PR) • How the student scored when compared to other children who are the same age or grade. Percentage of scores that fall below a point on a score distribution; for example, a score at the 75th percentile indicates that 75% of students obtained that score or lower • Stanines • A standard score between 1 and 9, with a mean of 5 and a standard deviation of 2. The first stanine is the lowest scoring group and the 9th stanine is the highest scoring group. • Age and Grade Equivalents* • The age or grade for which a raw score is the average score • Composite Scores* • Total score made up of sum of scores on two or more subtests *Interpret with caution Adapted from Pamela E. Hook, Ph.D.
Level 1Diagnostic Testing In order to admit a student to the Carroll School, our Admissions Department must receive important diagnostic information about that student. That information may include (but is not limited to); Cognitive Testing (WISC-4) Academic Testing (ex. WIAT-III or Woodcock-Johnson) Memory Testing(WRAML2, Rey-Osterrieth) Speech and Language Testing: (PPVT-4, CELF-4) Motor Testing: (VMI) Executive Functioning (BRIEF, NEPSY-II, Delis-Kaplan) - Social-Emotional: (BASC-2, CBCL)
Level 2:Carroll Annual Assessments • Purposes: • To assess outcomes in achievement relative to the baseline performance in the instructionally relevant dimensions of phonological skills, decoding accuracy and speed. • To monitor progress and inform instructional group/planning from year-to year. • To understand how well a child is applying newly learned skills. • To analyze errors and determine appropriate intervention strategies. • To understand how an individual performs relative to same-age peers across the nation (percentile rank). • To evaluate our curriculum and make sure we are effectively teaching students what they need to know to be effective learners.
Facts: Carroll Annual Assessment • The CAA is a battery of standardized assessments that, in combination, take a close look at the skills required to be an effective learner. • The battery has been developed in response to findings from the National Reading Panel • The battery represents a combination of individual and group administered assessments. • The battery is administered during the spring to all students at Carroll * • * Subtests administered may vary by the age and testing history of a student
Comprehensive Test of Phonological Processing (CTOPP) Assesses phonological awareness (the awareness and access to the phonological structure of oral language) and phonological memory (the ability to code information phonologically for temporary storage in working or short-term memory). • Elison: measures the ability to delete individual phonemes from words presented orally and to reintegrate the remaining sounds into a new word. Highly correlated to early reading and spelling skill acquisition. • Say /clump/. Now say /clump/ without the /k/ • Segmenting Words: measures the ability to isolate and separate all of the phonemes in a spoken word by pronouncing the isolated phonemes in sequence after hearing and pronouncing the whole word. This skill highly correlates with word analysis skills or “sounding-out.”
Rapid Automatic Naming/Rapid Alternating Stimulus (RAN/RAS) • Measures how quickly and efficiently a student is able to retrieve phonological information from long-term or permanent memory. Rapid naming is highly correlated with acquisition of reading fluency and comprehension skills. • Colors • Numbers, • Objects, • Letters, • 2-Set (letters and numbers)
Woodcock Reading Mastery Test- Revised (WRMT) An untimed test that assesses the student’s accuracy and range of sophistication in pronouncing complex real words and nonsense words. • The Word Identification (WI) tests requires a natural sounding reading of a list of progressively difficult real words. This untimed task measures the accuracy of a student’s recognition of both decodable words and sight words. • The Word Attack (WA) test requires the student to produce a natural sounding reading of a list of progressively pseudo words that follow predictable English spelling patterns. This untimed task measures how well a student had learned and can apply phonetic and structural analysis strategies to unknown words.
Test of Word Reading Efficiency (TOWRE) This timed test is an efficient way of monitoring the two kinds of word reading skills that are critical in overall reading ability: the ability to accurately recognize familiar words in whole units (sight words) quickly, and the ability to “sound out” words quickly. • The Sight Word Sight Word Efficiency (SWE) subtest, taps not only the accuracy, but also automaticity of real word recognition and speed of retrieval. • The Phonemic Decoding Efficiency (PDE) subtest, taps not only the accuracy, but also the automaticity in applying phonetic and structural analysis strategies to unknown words.
Group Reading Assessment and Diagnostic Evaluation (GRADE) • Group administered reading assessment • Vocabulary & Word Meaning, Sentence Comprehension, Passage Comprehension, Listening Comprehension
Carroll Math Assessments • Group Mathematical Assessment and Diagnostic Evaluation (GMADE) • Group administered math assessment • Concepts & Communication, Operations & Computation, Process &Applications • Symphony Benchmarker/Track My Progress • The Symphony Math Benchmarker is an untimed, computer adaptive assessment which provides a benchmark measure of overall mathematics learning against the Common Core State Standards. CCSS fluency standards.
Level 3Curriculum-Based Assessments • Measure how a student is responding to the curriculum. Aligned with curriculum in that students are being tested specifically on what and how they are being taught. • Help to provide diagnostic data, monitor progress and make educational decisions • Is usually criterion-referenced • Help teachers to understand trends in a student’s learning.
Language CBA Descriptions • Phonemic Awareness and Rhyme: Measures the ability to identify and manipulate sound. Skills include; syllable blending, initial sound, phoneme blending, phoneme segmentation, rhyme • Decoding/Encoding: Measures the ability for students to use patterns and rules to identify words in reading and create words through spelling. Carroll School OG levels include: • L1: Base + AS prefixes or inflected suffix (runner) • L2: Base + AS, most common Latin prefix and suffix (precooked) • L3: assimilated prefixes and up to 2 suffixes, some incongruent syllable boundaries (artistic) • L4: Base + stress shifts ( vowel change), “unfair Latinate endings” (magician)
Language CBA Descriptions (Cont.) • Fry words: measures the ability to quickly identify “sight” or known words that occur frequently in reading. Words are bundled in group s of 50 by level of frequency used in English. Student must make less than 5 errors to master a bundle. • Morphological Awareness: measures the ability to break down words by their parts (i.e suffixes, roots and prefixes). 4 bundles of 15 each with increasing difficulty • Fluency: Measures the ability to read quickly and accurately. Read Naturally benchmarks used to calibrate oral reading progress against a grade level standard. • Writing: Assessments that use rubrics to score
Progress Monitoring 2013-2014 Progress monitoring tools will continue to include both standardized and criterion-references forms. • Pilot NWEA MAP testing which is a computerized set of assessments, similar to the Symphony Benchmarker, that measure individual progress in the areas of reading, language and math. • Improve efficiency of assessment • Provide mechanism for assessment to inspire instruction • Move away from paper/pencil/bubble sheets • Preserve teaching time • Improve communication with parents • Report with greater detail.
Team Collaboration The Carroll School has many mechanisms for gathering and sharing information about students. • Robust Student Information System • Team-to-Team Transfers • Teacher-Tutor Meetings • Weekly Team Meetings • Regular Coaching Meetings • Child Study
Case Study JOHNNY
Admissions • When Johnny first enters Carroll, our Admissions Department does a thorough review of a Johnny’s “file” which includes…. • Parent Questionnaire • Previous School Reports • Diagnostic Testing * • Admissions Testing *
Diagnostic Testing Information gathered from diagnostic evaluations may include (but is not limited to…) • background information review • cognitive profile • academic skills • memory skills • speech and language skills • motor skills • executive functioning skills • social-emotional skills