290 likes | 415 Views
e:Vision Project. Results II - Education. Introduction. Results II Pilot: Health Science First Year papers Philosophy Dept. Marketing Dept. Semester 1 & 2, 2013 Run e:Vision (DEV) in parallel with existing systems Go Live Semester 1, 2014 if successful. Introduction. Objective:
E N D
e:Vision Project Results II - Education
Introduction Results II Pilot: • Health Science First Year papers • Philosophy Dept. • Marketing Dept. Semester 1 & 2, 2013 Run e:Vision (DEV) in parallel with existing systems Go Live Semester 1, 2014 if successful
Introduction Objective: • Test the system with real life data and scenarios • Identify issues • Confirm data set up • Define reporting requirements Principles: Standard e:Vision (no modification) Config: • Results online (Students and Staff) • Examination board reporting
Schedule Day 1 • Overview relevant e:Vision tables • Assessment Patterns • Results Records • Advanced Assessment Patterns • Mark Schemes Day 2 • Recap • Enter Marks/Calculate Results • Scaling • Reassessment
SITS/e:Vision Tables Module (MOD) paper SPR Student Route STU Students x10,000 x150 MAV When paper available SMO Students taking papers x40,000 x100 MAP Ass. Pattern SMR Paper Result x100 x40,000 SAS Generate Assessment Records MAB Assessment Components SAT Component Results If 3/paper = 300 x120,000 ATP (exam paper) x90
Assessment Patterns Need to be set up before generating student assessments Can recycle each semester (unless details change) Code = Module/Paper + version (e.g. BSNS105_1)
Assessment Patterns Assessment Pattern maintenance will be performed by Student Records Office using “Client” screens Exercise
e:Vision Tables Module (MOD) paper SPR Student Route STU Students x10,000 x150 MAV When paper available SMO Students taking papers x100 x40,000 MAP Ass. Pattern SMR Paper Result x100 x40,000 SAS Generate Assessment Records MAB Assessment Components SAT Component Results If 3/paper = 300 x120,000 ATP (exam paper) x90
Results Enter component marks SAT Component Results Essay (20%) Mark = 80% Labs (10%) Mark = 90% Test (20%) Mark = 70% Exam (50%) Mark = 60% SMR Paper Result Paper Result 69% B- Pass Calculate Overall Result
Results Actual Agree Essay (20%) Mark = 80% Essay (20%) Mark = 80% Labs (10%) Mark = 90% Labs (10%) Mark = 90% Test (20%) Mark = 70% Test (20%) Mark = 70% Exam (50%) Mark = 60% Exam (50%) Mark = 60% Paper Result 71% B Pass Paper Result 69% B- Pass Agreed
Results Actual and Agreed marks/grades retained permanently The Agreed Module (SMR) mark/grade/result either calculated from assessments (SAS) or entered at module level. An Audit trail will be kept of all changes
Generate Results Records Generate SMR and SAT records. Exercise
Advanced Assessment Patterns Variable Assessment Weights Enter component marks Essay 1 Mark = 30% Essay (20%) Mark = 80% Labs (10%) Mark = 90% Test (20%) Mark = 70% Exam (50%) Mark = 60% Essay 2 Mark = 80% Paper Result 69% B- Pass Best Mark Calculate Overall Result
Mark Schemes Define relationship between Marks, Grades and Result (e.g. Pass/Fail) Mark Grade Result Pass 90% A+ Mark Scheme = Otago Fail 35% E Mark Scheme = Otago Pass C- Mark Scheme = Grade
Mark Schemes Define relationship between Marks, Grades and Result (e.g. Pass/Fail) Result can be Deferred (e.g. Special Consideration, Plagiarism) Can define rules, e.g. Not obtaining a MAB qualifying mark is an automatic fail Plagiarism grade automatically defers the result Special Consideration grade defers the result and creates reassessment Can have multiple Mark Schemes, e.g. Standard Otago marks and grades Grades only* Pass/Fail* * not applicable to Results II
Mark Schemes Standard OTAGO mark scheme (to be confirmed):
e:Vision Project Results II - Education
Recap What is e:Vision speak for “Paper”? Module Name the two tables that define the Assessment Pattern? MAP (Module) and MAB (assessment components) What is the name of the table that stores students’ paper results? Student Module Result (SMR) What is the name of the table that stores students’ assessment component marks? Student Assessment Table (SAS) - but SAT menu The minimum mark that must be achieved in an assessment is called…….? Qualifying Mark When the Examination board confirms Actual Marks/Grades they become..? Agreed Marks/Grades
e:Vision Tables Module (MOD) paper SPR Student Route STU Students x10,000 x150 MAV When paper available SMO Students taking papers x100 x40,000 MAP Ass. Pattern SMR Paper Result x100 x40,000 SAS Generate Assessment Records MAB Assessment Components SAT Component Results If 3/paper = 300 x120,000 ATP (exam paper) x90
Assessment Patterns Need to be set up before generating student assessments Can recycle each semester (unless details change) Code = Module/Paper + version (e.g. BSNS105_1)
Results Actual Agree Essay (20%) Mark = 80% Essay (20%) Mark = 80% Labs (10%) Mark = 90% Labs (10%) Mark = 90% Test (20%) Mark = 70% Test (20%) Mark = 70% Exam (50%) Mark = 60% Exam (50%) Mark = 60% Paper Result 71% B Pass Paper Result 69% B- Pass Agreed
Enter Results Enter Assessment marks Calculate module result Confirm module result Exercise
Scaling Original Scale Essay (20%) Mark = 80% Essay (20%) Mark = 85% Essay (20%) Mark = 80% Labs (10%) Mark = 90% Labs (10%) Mark = 90% Labs (10%) Mark = 90% Test (20%) Mark = 70% Test (20%) Mark = 70% Test (20%) Mark = 70% Exam (50%) Mark = 60% Exam (50%) Mark = 60% Exam (50%) Mark = 60% Actual Paper Result 71% B Pass Paper Result 70% B Pass Paper Result 69% B- Pass Agree Agreed
Scaling Scale selected students or entire class Scale an Assessment Component and re-calculate the Result OR scale the overall mark only Scale by: Fixed amount Percentage Translation Linear Interpolation Graded by percentage Bell Curve Scaling ranges, e.g. 0% – 50% scaled by +5% 50% - 100% scaled by -3%
Scale Marks Exercise
Reassessment Enter component marks Essay (20%) Mark = 80% Labs (10%) Mark = 90% Test (20%) Mark = 70% Exam (50%) Mark = 47% • Initial and Reassessment component results both retained • Overall Module result calculated on either the reassessment or highest mark • Reassessment exams can be scheduled • Reassessment Mark Scheme must be defined Reassessment - SRA (50%) Special Exam Mark = 60% Paper Result 69% B- Pass Calculate Overall Result
Generate Reassessments Exercise
Questions/Comments Next Steps: Enter pilot MAPs/MABS Confirm mark scheme Confirm FEO process
e:Vision Project Results II - Education