1 / 11

PADI Wizard: A Tool for Assessment Design

Learn about the innovative PADI Wizard, its goals, design variations, and practical examples to streamline assessment creation. Discover the benefits, potential challenges, and future developments of this wizardly tool.

bdorothy
Download Presentation

PADI Wizard: A Tool for Assessment Design

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. AERA April 2005 A Wizard for PADI Assessment Design Larry Hamel, CodeGuild, Inc. Patricia Schank, SRI International

  2. 2 What is a Wizard? An interview that gathers information from users through a series of simple questions • E.g., Tax forms via Intuit’s TurboTax

  3. 3 PADI Wizard Goals • Easy assessment design, based on expertly-crafted foundations: scaling up the number of designers who use PADI • Good interaction for interviewees (designers) • Allow users to stop/restart, go back & forth • Status of completion available at a glance • Integrate well with PADI interface • Wizard-creation system for experts • Add or edit wizard steps • Reorder steps • Adaptive, dynamic wizard (phase 2)

  4. 4 1st Design: Editing Wizard • Provides context, but fairly complex • Costly to implement: start simpler?

  5. 5 2nd Design: Sequential Wizard • Simple question-answer interview • But how to handle constraints of early criteria that cascade to rest of interview? E.g.: If trying to measure proficiency in “planning investigation”, must include activity for it.

  6. 6 3rd Design: Selection Wizard • User’s criteria selects preconfigured templates (one per combination of criteria) • Selected templates can be arbitrarily complex • Example: Three criteria • What is the goal of the assessment? (2 choices) • Grade level of the students? (3 ranges) • What is the content area? (6 choices) • Yields 2x3x6 combinations: 36 templates, each of which is customized with appropriate constraints that cascade from user’s answers

  7. 7 Example: Running a Wizard • Begin with a welcome page • Next, exit buttons to navigate

  8. 8 Running a Wizard (cont.) • Example criteria question • Ask about goal of assessment, explain choices and offer menu selection

  9. 9 Running a Wizard (cont.) • Finishing wizard • If a template matching the criteria is found, it is cloned so user can customize it further

  10. 10 Wizard Creation • Constructing a wizard is itself an interview • Add and specify steps, decision matrix

  11. 11 Discussion • Many lessons learned (see paper), e.g. • Abstract way to define steps • Tension between simplicity and detail • Many combinations in Selection wizard • Future work • Revisit priority for dynamic, adaptive steps • Completion wizard • Fill in the template identified by the Selection wizard. Selection wizard handles the cascading constraints first; the rest is easy (?). • Under development—more to come!

More Related