280 likes | 412 Views
Online Testing Programs. EDCI 750 Emerging Technologies Spring 2012. Presenters: Kris Oswald Shaun Rosell. Introduction. What are Online Testing Programs? Websites or applications that allow instructors to share assessments using various platforms
E N D
Online Testing Programs EDCI 750 Emerging Technologies Spring 2012 Presenters: Kris Oswald Shaun Rosell
Introduction • What are Online Testing Programs? • Websites or applications that allow instructors to share assessments using various platforms • Used in various environments, not just education • Lower education • Higher education • Corporate • Government
Education Formative assessment Summative assessment Standardized testing Preparatory or practice tests Self-assessment Corporate Customer and employee training Competency / compliance training Employee skills evaluations Multiple offices and locations Settings
Types • Create your own assessment and upload • Use online database to generate questions for assessment • Use other databases to generate questions for assessment and upload • Use a combination of the above methods • Computer Adaptive Testing (CAT)*
Uses • Create assessment • Share assessment • Administer assessment • Grade assessment • Statistical analysis for assessment • Provide information for individualized learning
Computer Adaptive Testing (CAT) • Adjusts questioning based on student responses to identify the level of the student • Tailored to each student • More accurate than traditional testing • Provides educators with better information • More efficient than traditional testing • More secure than traditional testing
Examples of Use • Online Testing and Computer Adaptive Testing • Pearson • ALEKS • Assessment Technology Incorporated (ATI)
Example of a written test question. Example of a written test report.
Class report including student knowledge of individual topics.
ePortfolios • Display student growth and achievement • Allow students to reflect on learning • Multiple types • Current work • Showcase of best work • Work that demonstrates mastery of specific learning objectives
Rubrics for Assessment • Needed for written responses, oral assessments, and ePortfolios • Provide equitable grading • Allow students to know standards before composing responses
X Benefits • No technical or programming skills needed • Minimal management needed • Assessments are customizable • Assessments can be shared in any setting • Track students throughout test • Assessments instantly graded • Instant reports and analysis • Saves paper
Challenges • Creating easy-to-use interface and navigation • Creating interface that does not distract from content • Student variability within and across age ranges • Accommodating students with disabilities • Control over who is taking the testing
Paper vs. Computer-based • Mixed results on test mode effect • Factors • Content familiarity • Computer familiarity • Gender • Race • Computer-based assessment success depends on usability and usefulness • Computer-based assessment has potential to be more sophisticated and a more accurate measure
Common Core State Standards (CCSS) • SMARTER Balanced Assessment Consortium (SBAC) and Partnership for Assessment of Readiness for College and Careers (PARCC) • Developing next-generation assessments aligned to the CCSS that: • Inform instruction • Guide interventions • Help target professional development • Ensure accurate measurement of student progress PARCC: http://www.parcconline.org/ SBAC: http://www.smarterbalanced.org/
Summary • When the usability and usefulness meets the needs of individuals, online testing programs: • Provide opportunity for sophisticated assessment administered in various settings • Provide instant feedback that can help educators individualize instruction • Can be used to help students progress to college or careers
Online Testing Program Companies • Hosting Sites • ClassMarker • HostedTest • OnlineTesting.net • Online Testing and Databases • Assessment Technology Incorporated (ATI) • Oxford University Press • ProProfs • Respondus • Computer Adaptive Testing • ALEKS • ETS
References • Clariana, Roy and Wallace, Patricia (2002). Paper-based versus computer-based assessment: key factors associated with the test mode effect. Retrieved March 03, 2012 from http://www.speakeasydesigns.com/SDSU/student/SAGE/compsprep/Paper_vs_Computer_Assessments.pdf • Electronic portfolios. In Wikipedia. Retrieved March 08, 2012 from http://en.wikipedia.org/wiki/Electronic_portfolio • Harms, Michael and Adams, Jeremy (2008). Usability and design considerations for computer-based learning and assessment. Retrieved March 03, 2012 from http://www.pearsonassessments.com/NR/rdonlyres/E2B44D39-6235-4E9F-8AB8-F6EF2CAF7502/0/UsabilityandDesignConsiderationsforComputerBasedLearningandAssessment.pdf?WT.mc_id=TMRS_Usability_and_Design_Considerations • Clariana, Roy and Wallace, Patricia (2002). Paper-based versus computer-based assessment: key factors associated with the test mode effect. Retrieved March 03, 2012 from http://www.speakeasydesigns.com/SDSU/student/SAGE/compsprep/Paper_vs_Computer_Assessments.pdf • Electronic portfolios. In Wikipedia. Retrieved March 08, 2012 from http://en.wikipedia.org/wiki/Electronic_portfolio • Harms, Michael and Adams, Jeremy (2008). Usability and design considerations for computer-based learning and assessment. Retrieved March 03, 2012 from http://www.pearsonassessments.com/NR/rdonlyres/E2B44D39-6235-4E9F-8AB8-F6EF2CAF7502/0/UsabilityandDesignConsiderationsforComputerBasedLearningandAssessment.pdf?WT.mc_id=TMRS_Usability_and_Design_Considerations
References Continued • Rubrics. In Kennesaw State University. Retrieved March 08, 2012 from http://edtech.kennesaw.edu/intech/rubrics.htm • Way, Walter D (2006). Practical questions in introducing computer adaptive testing for k-12 assessments. Retrieved March 03, 2012 from http://www.pearsonassessments.com/NR/rdonlyres/EC965AB8-EE70-46E5-B1A5-036BE41AB899/0/RR_05_03.pdf?WT.mc_id=TMRS_Practical_Questions_in_Introducing_Computerized • Way, Walter D., Lin, Chow-Hong, and Kong, Jadie (2008). Maintaining score equivalence as tests transition online: issues, approaches, and trends. Retrieved March 03, 2012 from http://www.pearsonassessments.com/hai/images/tmrs/Maintaining_Score_Equivalence_as_Tests_Transition_Online.pdf
References Continued • Way, Walter D., Davis, Laurie L., and Strain-Seymour, Ellen (2008). The validity case for assessing direct writing by computer. Retrieved March 03, 2012 from http://www.pearsonassessments.com/NR/rdonlyres/CAF6FF48-F518-4C68-AF2F-2959F902307E/0/TheValidityCaseforOnlineWritingAssessments.pdf?WT.mc_id=TMRS_The_Validity_Case_for_Assessing_Direct
Resources • Educause http://www.educause.edu/ELI/LearningPrinciplesandPractices/ITAssessment/12398 2. Web 2.0 Testing Tools http://web20teach.blogspot.com/2008/05/top-5-quiz-generators-for-online.html 3. Easy TestMaker http://www.easytestmaker.com/default.aspx 4. EdTech Toolbox: Web 2.0 Tools by Task – Surveys, Quizzes, and Polls http://edtechtoolbox.blogspot.com/p/web-2-tools-by-task.html 5. Engrade http://www.engrade.com/
Resources Continued 6. Fifty Sneakers http://www.fiftysneakers.com/ 7. Jeopardy Labs http://www.jeopardylabs.com/build 8. Free Rice http://www.freerice.com 9. Digi[cation] http://www.digication.com 10. Gooru http://www.goorulearning.org
Resources Continued 11. Christopher Long’s ePortfolio – Blogging Scoring Rubric http://www.personal.psu.edu/cpl2/blogs/cplportfolio/Blogging%20Scoring%20Rubric.pdf 12. University of Alaska-Southeast Online Discussion Rubric http://www.uas.alaska.edu/sitka/IDC/resources/onlineDiscussionRubric.pdf 13. Penn State University - VoiceThread Rubric http://voicethread.psu.edu/2011/06/rubrics-for-using-voicethread-in-your-course.html 14. University of Wisconsin-Stout School of Education Assessment Rubrics http://www.uwstout.edu/soe/profdev/rubrics.cfm 15. iRubric http://www.rcampus.com/indexrubric.cfm