1 / 47

Diagnostic Testing : only the beginning A component in a longer process

Diagnostic Testing : only the beginning A component in a longer process. CDC Steele University of Manchester. University of Manchester. Dates back as far as 1824 by several different routes but took its present form in 2004. 35 000 students 29 000 Home/EU 6 000 Overseas 26 000 UG

charis
Download Presentation

Diagnostic Testing : only the beginning A component in a longer process

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Diagnostic Testing : only the beginning A component in a longer process CDC Steele University of Manchester

  2. University of Manchester • Dates back as far as 1824 by several different routes but took its present form in 2004. • 35 000 students • 29 000 Home/EU • 6 000 Overseas • 26 000 UG • 9 000 PG

  3. University of Manchester • 11 500 staff • 4 000 academic • 2 000 research • 341 Buildings

  4. University of Manchester • Four Faculties • Engineering and Physical Sciences • Life Sciences • Medical Sciences • Humanities

  5. University of Manchester • School of Mathematics • 90 academic staff • 400-500 mathematics students per year

  6. Aerospace Engineering Civil Engineering Mechanical Engineering Chemical Engineering Electrical Engineering Chemistry Optometry Computer Science Materials Science Foundation Year Service courses to ~ 1000 students in various parts of the University.

  7. Entry Profiles of Maths Students • A-levels • C1, C2, C3, C4 • 2 more modules from Mechanics (M1, M2 etc,) Statistics (S1, S2 etc), Decision (D1, D2 etc) • Many students students AS- or A-level in Further Maths • Generally require A+ in maths A-level

  8. Entry Profiles of Service Students • A-levels • C1, C2, C3, C4 • 2 more modules from Mechanics (M1, M2 etc,) Statistics (S1, S2 etc), Decision (D1, D2 etc) • Some students AS- or A-level in Further Maths

  9. Entry Profiles of Students • A-levels. Most Engineering schools ask for Grade B in maths (part of ABB etc) • Other UK Qualifications • International or European Qualifications • University of Manchester Foundation Year

  10. Degree Structure • Most Students : 3 year degree. (BSc, BEng etc) • Some able students : 4 year undergraduate masters, M Math, M Eng etc • Each year : 2 semesters : Sept – Jan and Feb – June. 12 weeks teaching plus exams at end of semester.

  11. The streamed system for Engineers : 1996-2009 • Engineers in several schools ‘streamed’ into P-stream, Q/M-stream, R-stream. • Streaming follows diagnostic test but not only outcome of diagnostic test P – stream. ‘Elite’ Q/M – stream. ‘Standard’ R – stream. ‘At Risk’

  12. Typical P-stream student • A at A-level or equivalent • Strong on sections C1, C2, C3 • May be weak on some C4 material • May also be weak on a little earlier material.

  13. Typical Q-stream student • B,C at A-level or equivalent • Reasonable on sections C1, C2, • May be weak on some C3 material • Not terribly good on C4 material • May also be weak on a little earlier material.

  14. Typical R-stream student • May not have officially satisfied entry offer • May have large areas of maths which are causing difficulty.

  15. The diagnostic and followup programmes • A means to measure weaknesses and concentrate efforts of students in the early weeks towards areas where they may have underachieved in the diagnostic test • Rusty • Not time for teaching • Genuine difficulty with topic. • May not have been taught certain material

  16. Pre-diagnostic mailshot • Mock diagnostic posted to prospective students mid-August including • Mock test paper • Answers • Other possible questions • Links to paper and web-based resources describing the topics. • Computerised Practice Questions

  17. Diagnostic Test • A test in Freshers’ week designed to measure student profiles across various mathematical topics.

  18. Diagnostic Testing at UMIST/Manchester • Carried out since 1996 • 1997-2001 : 24 questions (6 sections) in 40 minutes • 2002-2009 : 48 questions (12 sections) in 80 minutes • Change following curriculum 2000. • Total mark less important than series of ‘mini-marks’ for various sections.

  19. Diagnostic Testing at UMIST/Manchester • Carried out since 1996 • 1996-2004 Short answers • 2005-2008 Multiple-choice (optical reader) • 2009 Multiple-choice (manual entry) • Carried out in Freshers’ week (week 0). Different times for different schools etc.

  20. Questions and Answer box 1996-2004

  21. Questions 2005-2009

  22. A : Arithmetic and Algebra B : Geometry and Trig C : Sequences D : Functions and Algebra E : Polynomials F : Logarithms and Exponentials G : Simple Differentiation H : Simple Integration I : Rational Functions J : Further Differentiation K : Further Integration L : Vectors Diagnostic Test : Sections A-H : C1, C2, C3 Material : I-L : C4 material

  23. Diagnostic Followup Programme • For students on P- and Q- streams. • R-stream could itself be considered as a followup • Allocates up to 2 sections from A-L for P-stream, up to 2 sections from A-H for Q-stream.

  24. Diagnostic Followup Programme • Allocates up to two sections based on marks of 0/4, 1/4, or 2/4. • Sections A (Arithmetic and Algebra) and D (Functions and Algebra) allocated preferentially, then in alphabetical order. • Students told of relevant sections via web-site towards end of week 1 of semester.

  25. Diagnostic Followup Programme • Students informed of • Relevant section(s) • References to relevant materials • Includes HELM Resources • Pro-active and re-active sessions in Mathematics Resource Centre. • Practice ‘tests’ on computer. • Leading up to

  26. Diagnostic Followup Programme • Computerised test in week 4 of semester on relevant topic(s) • Similar to practice tests. • Exercise counts 20% towards coursework for relevant course unit (itself worth 20% of unit assessment).

  27. Diagnostic Followup Programme • HELM Resources • HEFCE FDTL4 project 2002-2005 • Workbooks on various mathematical topics.

  28. Workbooks on mathematical topics

  29. Example

  30. Engineering Application

  31. Diagnostic Followup Programme • Manchester Mathematics Resource Centre. • Support Centre for students to drop into with Mathematical Enquiries. • Also runs pro-active sessions centring on material on Diagnostic Followup. • Centre is within an Engineering Building but open to ALL students.

  32. Diagnostic Followup Programme • Computer-assessment • Use of STACK, developed by Dr Chris Sangwin, University of Birmingham • Accepts mathematical input • Gives specific feedback • Varies coefficients sensibly

  33. Diagnostic Followup Programme

  34. Diagnostic Followup Programme

  35. Results 2007

  36. Results 2008

  37. Diagnostic Results 2002-09

  38. Longer Consequences of Diagnostic Test • Practice Tests, HELM Materials, Resource Centre all there for further use etc.

  39. Purposes of Diagnostic Test • Used to assign students to lecture course groupings (until now) • Used to assign students to tutorial groups • Used to inform staff of entry profiles of students • Used to assign each student an individualised programme of work

  40. Diagnostic Followup for Maths Students • Same procedure up to diagnostic test i.e. mailshot, practice questions, • Followup made available to maths students but not feeding into coursework. • Students told of weaker sections and encouraged to take part in followup on these. • Can be used as ‘indicator’ of students who may or may not be engaging with the course.

  41. Other Diagnostic Tests

  42. University of Manchester Foundation Year • Students from countries with an educational system which stops slightly short of level for entry to 1st year • Students desiring a change of direction • Students not quite reaching the level for entry to 1st year

  43. University of Manchester Foundation Year • Test B • 40 minute test. • Three sections from Test A plus 3 sections on more basic work • Practice questions provided in advance plus opportunities to try questions electronically. • Used to inform staff, to allocate students to lecture courses and tutorial groups etc.

  44. Materials Science • Cannot ask for Mathematics A-level or equivalent. Major variations in arrival mathematics profile

  45. Materials Science • Test D : 50 minutes. 8 sections i.e. six from Test B test plus two more from test A. • Used to decide which students need to go in group for more intensive sessions.

  46. Late arrivals • Can be a problem with compulsory followup. • Test session a week or two later etc. • ‘Envelope’-based test system.

  47. Conclusions • Students arrive with potential weaknesses in some areas. • Take Diagnostic test and weak areas are identified • Diagnostic Followup addresses areas of weakness • Students can continue to access materials after exercise officially finishes.

More Related