1 / 15

SAM Challenge

SAM Challenge. Looking for a test-in/test-out solution for Intro to Computing? Jon Haber - Executive Editor SAM and Digital Strategy Amanda Shelton – Senior Editor, SAM. Why Test Out?. Technology literacy requirement for school entrance Technology literacy requirement for school graduation

baka
Download Presentation

SAM Challenge

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SAM Challenge Looking for a test-in/test-out solution for Intro to Computing? Jon Haber - Executive Editor SAM and Digital Strategy Amanda Shelton – Senior Editor, SAM

  2. Why Test Out? • Technology literacy requirement for school entrance • Technology literacy requirement for school graduation • Need to ensure an common level of technology skill within a student population • Limited resources for training • Need to prevent already ICT literate students from having to take unnecessary classes • Need to create course sections containing students of common ability

  3. Certification Option • Existing standard with an associated examination • Internet and Computing Core Certification (IC3) – Digital Literacy • Microsoft Office Specialist – Microsoft Office applications • Advantages • Research-based standard and validated examinations • Associated courseware tied to the standard • College credit or job opportunities associated with certification • Disadvantages • Price • Someone else’s standard and test design

  4. Alternatives to Certification • “Free” academic resources (Microsoft Digital Literacy, faculty-created assessments) • Advantages: Cost • Disadvantages: Lack of courseware, limited nature and unknown quality of exam content • Build Your Own • Advantages: Can be built on existing internal standards to meet exact needs • Disadvantages: Time and resources for exam development, need for support materials for an internal standard

  5. Create Your Own Test Out • Determine your goals • Determine your standard • Create content guidelines • Create test design plan • Create the examination • Exam piloting • Create of additional materials (courseware, infrastructure) • Deployment

  6. Test Out Goals • Opt-in/out Guidelines • Pass/fail • Optimal pass rate • Prescriptive • Determine which classes to take • Determine section placement • Determine learning path within an online learning environment

  7. Select a Standard • Existing local, state or national standard • Existing training or certification standard • Existing curriculum for the opt-out course • Custom-built standard Should consist of measureable objectives!

  8. Content Guidelines • Examination blueprint • Similar to, but not identical with, an class curriculum • Should consist exclusively of measurable objectives Objective 1.1.4 - Identify the features and benefits (storage capacity, shelf-life, size, etc.) of different storage media, including: • Hard disks (internal and external) • Optical media (CD-ROM, CD-R, CD-RW, DVD, DVD-R, DVD-RW) • Portable/removable media (USB/flash memory, older media like diskettes) • Network drives • Remote storage (Wide Area Network, Internet, etc.)

  9. Test Design Guidelines • All exam information not having to do with content • Test time • Deployment method • Paper • Online • Proctored vs. remote testing • Nature of testing • Linear (Objective-based – MCQ, matching, etc.) • Performance-based • “Hands on” (Projects, portfolios, etc.) • Scoring methodology (pass/fail, etc.) • Cost considerations

  10. Exam Creation • Write your own (usually linear) • ExamVue • LMS internal tools • Program your own (or create hand-scored projects) • Leverage third-party content library such as SAM (SAM Challenge)

  11. SAM Challenge Demonstration

  12. Exam Piloting • “Test the test” with users of known ability level • Formal validation (if necessary) • Obtain feedback from skilled users • Test a population similar to the target audience • Obtain preliminary test feedback • Weed out of problematical items • “Cut score” determination • Used as the basis to determine remediation and reporting guidelines

  13. Infrastructure and Deployment • Publication of test guidelines • Deployment of training and support materials • Test infrastructure implementation • Process of placement or other options for candidates based on test scores

  14. Summary • Work backwards from goals • Make sure you have buy-in from all stakeholders • Think through all aspects of pre-testing, testing and post-testing steps in the process • Document your procedures and development processes • Ensure resources are in place for all aspects of the project

  15. Questions and Answers

More Related