190 likes | 284 Views
A Template Construction Path. Updated 10/22/03 - C. Kennedy. How might a designer get started?. A Template Design Process - Overview -. Determine the curricular goals (cognitive model, student learning objectives, progress maps, design patterns, etc.) for the instructional module.
E N D
A Template Construction Path Updated 10/22/03 - C. Kennedy
A Template Design Process- Overview - • Determine the curricular goals (cognitive model, student learning objectives, progress maps, design patterns, etc.) for the instructional module. • Determine the work products (evidence) from which inferences can be drawn regarding student knowledge relevant to the cognitive model. • Determine how the evidence will be assessed – the rubrics (categorizations of responses) that will be used relative to the cognitive model. • Define the measurement model that transforms evidence to inferences.
SMV A SMV B 1. Design the Cognitive Model SM
WORK PRODUCT(S) SMV A SMV B ACTIVITY 2. Design the Evidence SM
OBS. VAR.1 EVALUATION PHASE(S) OBS. VAR. 2 3. Design the Evaluation Procedure SM WORK PRODUCT(S) SMV A SMV B ACTIVITY OBS. VAR. 3
OBS. VAR.1 MMF 1 SMV B OBS. VAR. 2 MMF 2 MMF 3 4. Design the Measurement Model SM EVALUATION PHASE(S) WORK PRODUCT(S) SMV A ACTIVITY OBS. VAR. 3
SM OBS. VAR.1 MMF 1 EVALUATION PHASE(S) OBS. VAR. 2 MMF 2 WORK PRODUCT(S) SMV A SMV B ACTIVITY OBS. VAR. 3 MMF 3 A template is an abstraction of a family of assessment tasks.
OBS. VAR.1 WORK PRODUCT(S) ACTIVITY OBS. VAR. 2 OBS. VAR. 3 Evaluation Phases transform work products of an activity into observable variables. EVALUATION PHASE(S)
OBS. VAR.1 SM SMV B SMV A OBS. VAR. 2 OBS. VAR. 3 Measurement Model Fragments connect observable variables with student model variables. MMF 1 MMF 2 MMF 3
How is a template related to an assessment task a student interacts with?
A fully specified template (aka task specification) spawns an assessment task. (This is done by the application.)
OBS. VAR.1 OBS. VAR. 2 OBS. VAR. 3 The work product is evaluated to produce observable variables. (This may be done by the application automatically, or by human raters online or offline.)
OBS. VAR.1 MMF 1 MMF 2 MMF 3 SM SMV B SMV A OBS. VAR. 2 OBS. VAR. 3 The complete measurement model is sent to Scoring Engine. (This is done by the application.) Packaged in XML and sent to Scoring Engine
A Template Development Process • Design the Template - consider using template component summary areas to capture design ideas. • Determine relevant Student Model Variables and the Student Model. • Determine the Activities and Work Products. • Determine the Evaluation Procedures and the Observable Variables they generate (both intermediate and final OVs). • Determine the Measurement Models linking each “final” Observable Variable with associated Student Model Variables.
Construct the Template • Define • Student Model Variables • Student Models • Work Products • Observable Variables • Define • Evaluation Procedures (and Phases) • Measurement Models • Define Activities • Define Template
SM OBS. VAR.1 MMF 1 EVALUATION PHASE(S) OBS. VAR. 2 MMF 2 WORK PRODUCT(S) SMV A SMV B ACTIVITY OBS. VAR. 3 MMF 3 Then, on to Task Model Variables and Presentation specifications!