200 likes | 529 Views
OPs and tertiary entrance Orienteering through the tertiary pathways in Queensland. OPs and tertiary entrance Orienteering through the tertiary pathways in Queensland. Currently, there’s a bit of a confusing thicket We’re going to need a compass Validity, reliability, equity.
E N D
OPs and tertiary entrance Orienteering through the tertiary pathways in Queensland
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland Currently, there’s a bit of a confusing thicket • We’re going to need a compass • Validity, reliability, equity
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland Validity • Is it useful for the purpose? • Does it pick the right kids? • Is it based on demonstrated achievement? • Does that achievement predict achievement in the courses where it is used for selection?
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland Reliability • Is the evidence it is based on reliable? • Is it based on enough evidence? • Is the evidence collected at a sufficiently fine-grained level?
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland Equity • No pathway should have an advantage over another • All students have the same opportunity regardless of where they live • All students have the same opportunity regardless of how well resourced they are • Inbuilt bias… towards highly achieving students
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland Let’s test out our compass • Inclusion of 100m sprint times • Reliable, equitable – not valid
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland • “No single selection criterion…can select adequately now, or in the future among such a diverse range of applicants.” “It follows logically now, and for the future, that highly competitive courses at universities (along with all others) need to use multiple selection criteria to match students to courses” Nancy Viviani, 1990
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland Why are we still, in essence, using a single rank then? • QSA, not universities, can defend the decisions • FP eligibility has been a topic to be avoided • Equity in single pathway • Queensland built a pretty good one
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland Backwash – you have to build a TE system based in what you do at school • School-based assessment and teacher judgment • SAIs • Scaling test based in what is taught
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland You can have simple, or you can have fair • The basic idea is simple • SAIs awarded by teachers, two stages of scaling using QCS • A quick run over our quality control processes
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland QCS Test construction and marking • Item writing and trialling • Test construction • Marking
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland SAI surveillance • Purpose • 285 out of 334 schools • 1192 out of 3602 distributions • Clerical errors!
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland Small and intermediate groups • Not enough information for robust scaling • Small group boundaries • Smooth transition to large group process
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland Down-weighting of unusual QCS results • Within school measures • Isoweights
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland Scaling anomalies committee • Polyscores • QCS-polyscore mismatch • School identified cases
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland Year to year comparability of OPs • Why do it? • Using QCS • Using levels of achievement
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland Individual interventions • Finding similar students • The graph • The profile
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland Compass check • Valid • Reliable • Equitable
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland The game doesn’t stay the same – the challenges we face • Fine-grained ranks • Multiple pathways and game-playing behavior • Ineligible schedules • VET included in calculations • Fewer subjects • National agenda • Bradley review
OPs and tertiary entranceOrienteering through the tertiary pathways in Queensland In the forest, we all have to ensure we consult our compass