1 / 18

Organization

Western Governors University: an Online, Entirely Competency-based University Dr. Philip Schmidt, Western Governors University ( pschmidt@wgu.edu ). Organization. The Importance of Domains. Example Competency Statement.

noelani-price
Download Presentation

Organization

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Western Governors University: an Online, Entirely Competency-based UniversityDr. Philip Schmidt, Western Governors University (pschmidt@wgu.edu)

  2. Organization

  3. The Importance of Domains

  4. Example Competency Statement “The graduate demonstrates application of each of the standard arithmetic algorithms: addition, subtraction, multiplication, division, exponentiation, on the set whole numbers.”

  5. Example Objective “Find the sum of the first 100 counting numbers.” What issues does this example raise?

  6. Assessment Development Subject-Matter Experts Psych Editors P.C.s Psych. Course Mentors Project Coord.

  7. Purpose of Objective Exams • Foundational knowledge and skill assessment • Higher-order thinking skills with determinate outcomes Analyze Evaluate Recommend Create Discuss Contrast Apply Identify Recognize Understand Recall List Define Explain

  8. Forms Item Pool Pre-Assessment Form A Form B

  9. Example • Objective: Recognize the causes of World War II • Item #1- Pre-assessment: Which of the following was instrumental in causing World War II? • Item #2- Form A: What effect did the Versailles Treaty have on the German economy? • Item #3- Form B: How did Japan’s invasion of Indo-China affect European international policy?

  10. Cut Scores • Modified Angoff: “What percentage of students, based on the definition of minimal competence, will correctly answer this question?” • Content Difficulty • Item Difficulty • Random Variance

  11. Purpose of Performance Assessments

  12. High Stakes Summative Performances • Objective, lower cognitive demand assessments must be passed before referral can be made • Published in TaskStream • Two forms (two possible resubmissions) • Five level rubric multiple aspects • Turnitin.com and Caveon • Summative, integrative with focus on beginner performance • Simulations and case studies (high fidelity) • Internships (Demonstration Teaching, nursing rotations, service projects, etc.)

  13. Mentor Evaluation Program Evaluation Institutional Data Assessment QA Candidate Assessment Protocol Quality Assurance Of Unit Employer Survey Performance Outcomes Candidate Survey Other Outcome Measures

  14. Assessment • Pre-assessments • Assessments • Performance Assessments • Objective Assessments • Essay Assessments • Pre-clinical Experiences • Demonstration Teaching • Laboratories • Collaborative Projects

  15. Assessment Development Steps: Part 1 A program is approved that will require assessment support: • Development Planning: Requirements, resources, schedules • SME Participation: Initiate recruitment and training of subject matter experts • Content Definition: Define and organize assessment domains • Alignment: Align domains to independent learning resources • Specification: Build an assessment specification

  16. Item/Task Approved Item/Task Approved Assessment Development Steps: Part 2 • Item & Task Creation: Create (or revise) specified items and performance tasks • Item & Task Review: Perform 5-step content and editorial review of each item and task • Committee Review: Convene SME review committee for additional content review • Data Entry: Place approved items in an online item bank/delivery system No No Yes Yes

  17. Assessment Development Steps: Part 3 • Standard Setting: Determine item difficulty level to enable setting of test form passing scores • Form Development: Build individual exam forms • Field Testing: Use bootstrap method to gather initial performance statistics; revise items/exams as necessary • Administration; and 14. Scoring: Announce, schedule, administer assessments; score, record, report • Maintenance: Continuously review and update assessment materials

More Related