720 likes | 731 Views
Online Assessment and Evaluation Techniques at the K-12 Level. Dr. Curtis J. Bonk Indiana University and CourseShare.com http://php.indiana.edu/~cjbonk cjbonk@indiana.edu. Online Student Assessment.
E N D
Online Assessment and Evaluation Techniques at the K-12 Level Dr. Curtis J. Bonk Indiana University and CourseShare.com http://php.indiana.edu/~cjbonk cjbonk@indiana.edu
How the Internet Will Help Large-Scale Assessment Reinvent Itself(2001, Feb). Education Policy Analysis Archives, Volume 9 Number 5, By Randy Elliot Bennett, Educational Testing Service, U.S.A. • In the same way that the Internet is already helping to revolutionize commerce, education, and even social interaction, this technological advance will help revolutionize the business and substance of large-scale assessment.
Assessments Possible • Online Portfolios of Work • Discussion/Forum Participation and Feedback • Online Mentoring • Weekly Reflections or Logs • Tasks Attempted or Completed, Usage… • Quizzes, Tests, Problems, Cases, Group Work???
Students as Infotectives(Jamie McKenzie, Grazing the Internet: Rasing a generation of free-ranging students. Sept. 1998, pp. 26-31, Phi Delta Kappan) • Inquiry and Detective Skills • changing course, asking for help, • framing essential questions and subsidiary questions, • planning voyage, • screening garbage, analyzing data. • Suggesting and testing hypotheses • Envisioning what’s possible, invent, rearrange • Seeing what’s missing • Suspending judgment
Students as Authors of Knowledge(Lehrer, 1993) • Ability to use electronic databases • Locate and select information • Segment information into useful categories • Interpret and summarize information from multiple sources
Issues to Consider… • Bonus pts for participation? • Peer evaluation of work? • Assess improvement? • Is it timed? Give unlimited time to complete? Allow retakes? • How measure competency? How demo learning? • Cheating. Is it that student?
Reducing Cheating Online($7-$30/page, http://www.syllabus.com/ January, 2002, Phillip Long, Plagiarism: IT-Enabled Tools for Deceit?) • http://www.plagiarism.org/ (resource) • http://www.turnitin.com/ (software, $100, free 30 day demo/trial)
What is Available? • Online Rubric Examples/Builders • Online Gradebooks • Online Test Tools & Exam Reviews • Survey and Polling Tools • E-Portfolios (Student and Teacher)
II. Electronic Gradebooks(Vockell & Fiore, 1993) • Calculate scores, store info • Weight scores • Flag students with certain characteristics • Print reports by individual or group • Provide prompt feedback • But inflexible, impersonal, & can be incorrect
eduTest from Lightspan • Tailored Assessments for You • Customize and design assessments to meet your district and state objectives. • Control assessment content and delivery. • Access a powerful search engine with over 60,000 test items. • Create and add tailored test items. • Develop your own test items in additional languages and in other subject areas.
Test Selection Criteria (Hezel, 1999; Perry & Colon, 2001) • Easy to Configure Items and Test • Handle Symbols, Timed Tests • Scheduling of Feedback (immediate?) • Flexible Scoring and Reporting • (first, last, ave, by individual or group) • Easy to Pick Items for Randomizing • Randomize Answers Within a Question • Weighting of Answer Options Web Resource: http://www.indiana.edu/~best/
Web-Based Survey Advantages • Faster collection of data • Standardized collection format • Computer graphics may reduce fatigue • Computer controlled branching and skip sections • Easy to answer clicking • Wider distribution of respondents
Sample Survey Tools • Zoomerang (http://www.zoomerang.com) • IOTA Solutions (http://www.iotasolutions.com) • QuestionMark(http://www.questionmark.com/home.html) • SurveyShare (http://SurveyShare.com; from Courseshare.com) • Survey Solutions from Perseus (http://www.perseusdevelopment.com/fromsurv.htm) • Infopoll (http://www.infopoll.com)
Survey Student Opinions(e.g., InfoPoll, SurveySolutions, Zoomerang, SurveyShare.com)
V. Digital Portfolios • “A purposeful collection of work, captured by electronic means, that serves as an exhibit of individual efforts, progress, and achievements in one or more areas.” (i.e., demo how they know what came to know; how knowledge increased and evolved) • Terry Wiedmar, 1998
Learning Logs (Paul Hickman, Northeastern University) • Combines journal writing and portfolios. • Interactive (student-student, student-tchr) • Collaborative (share thoughts, consensus) • Electronic (word processed & exchanged) • Essentially portfolios of student work. • Generate q’s, summarize articles, reflect on what learned, test models, propose explanations for results
E-Portfolios: What might they include? • Multimedia presentations (video, animation, voice-over testimonials) • Examples of work • Personal statement • Self-reflections on that work • Connections between experiences • Standard biographical info • i.e., progress, achievements, efforts… • Large, complex, time to grade
E-Portfolios: Skills Learned(Sanders, 2000) • Planning, design, and reflection on work • Revision and evaluation of work • Communication of work • Consideration of audience • Track personal improvements and accomplishments
Richness Coherence Elaboration Relevancy Timeliness Completeness Persuasiveness Originality Insightful Clear/Logical Original Learning Fdback/Responsive Format Thorough Reflective Overall Holistic Sample Portfolio Scoring Dimensions(10 pts each)(see: http://php.indiana.edu/~cjbonk/p250syla.htm)
Digital pictures of student activities Handouts from coursework Philosophy statements Videotapes of teaching Audio recordings Lesson plans Letters to parents Letters of rec Sample writing Newspaper clippings of their activities Work from students Student evaluations Self-evaluations What about Teacher E-Portfolios