300 likes | 471 Views
The Ecology of Language Assessment. Carl Falsgraf, Director CASLS. The Language Education Ecosystem. Curriculum. REFLECTION. REFLECTION. STANDARDS. Instruction. Summative Assessment. REFLECTION. Formative Assessment. REFLECTION. Can one assessment do it all?. NO!.
E N D
The Ecology of Language Assessment Carl Falsgraf, Director CASLS
The Language Education Ecosystem Curriculum REFLECTION REFLECTION STANDARDS Instruction Summative Assessment REFLECTION Formative Assessment REFLECTION
ASSESSMENT CONTINUUM Teacher administered Customized Curriculum dependent Expert administered Standardized Curriculum independent STAMP? • + high validity • + supports instruction • low reliability • context dependent • + high reliability • + context independent • low validity • divorced from instruction
OPI Proficiency STAMP? Achievement Performance Weekly quiz Final exam Oral quiz Service learning project
Specifications of Intended Test Use (SITU) (Norris, 2003) Norris (2000) STAMP? • Who are the test takers? • Who are the test score users? • What is the purpose of the test? • What information should the test provide? • What are the intended consequences of using the test?
ILR 5 4+ ACTFL 4 Superior 3+ BENCHMARKS 3 2+ Benchmark 6 Advanced Plus Advanced 2 Benchmark 5 1+ Intermediate-High Intermediate-Mid Intermediate-Low Assessment Benchmark 4 1 Benchmark 3 0+ Novice-High Novice-Mid Novice-Low Benchmark 2 0 Benchmark 1
STAMP 101 • • By teachers, for teachers • Designed to inform, not just measure • • Online: Anywhere, anytime, anybody • • Computer adaptive reading/listening • • Computer assisted speaking/writing
Level 3 Level 4
Proficiency Levels by Years (Spanish - High School - 7500 students) 2 years of study 1 year of study 3 years of study 4 years of study
NEEDS ASSESSMENTS • AUDIT • CERTIFICATION • PROGRAM EVALUATION • PROGRESS CHECK • DIAGNOSIS • IMPROVE INSTRUCTION • MOTIVATE STUDENTS NCLB/STAMP AP/OPI STAMP MIDTERM LINGUAFOLIO LINGUAFOLIO LINGUAFOLIO
DEVELOPING AN ASSESSMENT PLAN • CLARIFY GOALS • DEFINE PURPOSES/USES • RESEARCH EXISTING TOOLS • DEFINE INTERNAL TOOLS • INITIATE ASSESSMENT LITERACY PROFESSIONAL DEVELOPMENT