10 likes | 154 Views
Component 1 Evaluation planning. R e p o r t. Component 4 Evaluation of educational impact. Component 2 Evaluation of educational value. Component 4a Evaluation of impact on instructors’ perceptions Component 4b Evaluation of impact on educational environment Component 4c
E N D
Component 1 Evaluation planning R e p o r t Component 4 Evaluation of educational impact Component 2 Evaluation of educational value Component 4a Evaluation of impact on instructors’ perceptions Component 4b Evaluation of impact on educational environment Component 4c Evaluation of impact on student outcomes Component 4d Evaluation of sustainability of impact Component 2a Evaluation of web design Component 2bEvaluation of web content Component 3 Evaluation of use of the educational resource R e p o r t R e p o r t The Evaluation of the Web-basedARTIST Ann Ooms, Joan Garfield, Bob delMas – University of Minnesota • Assessment Resource Tools for Improving Statistical Thinking (ARTIST) • The goal of the Web-based ARTIST is to help teachers asses statistical literacy, statistical reasoning and statistical thinking. • The ARTIST website provides a variety of assessment resources for teaching first courses in statistics and contains: • Item Database: a collection of over 1,200 items organized by topic and learning outcome • 11 Assessment Topic Scales and the Comprehensive Assessment of Outcomes in a first Statistics Course (CAOS) • Information, guidelines, and examples of alternative assessments • Information on implementation issues related to designing, administering, and evaluating assessments • Direct links to or copies of articles on assessment in statistics • References and links to other related assessment resources • Copies of conference papers and presentations on the ARTIST project and handouts from ARTIST mini-courses • Information on upcoming ARTIST events • Information about ways to participate as a scale tester Funded by NSF CCLI-ASA-0206571 The Iterative Evaluation Model for Improving Online Educational Resources Evaluation Instruments Evaluation Findings • Web design: concrete recommendations have been made to improve the web design • Web content: recommendations have been made to include large data sets to the Item Database and to add additional item topics. • Use: Many statistics educators are actively using ARTIST and value the resource. The main reasons for statistics educators to not use ARTIST are time and misconceptions about what ARTIST has to offer. Because of the evaluation, several non-users became more aware of goal of ARTIST and started using ARTIST since. • Educational impact: instructors are changing assessment practices but there is no impact yet on student outcomes because, so far, newly developed ideas have not been implemented by instructors. ARTIST https://ore.gen.umn.edu/artist// Contact information Ann Ooms ooms0001@umn.edu