160 likes | 288 Views
Ontario’s experience in AHELO’s Civil Engineering Strand. Presented by: Mary Catharine Lennon Senior Research Analyst Higher Education Quality Council of Ontario Presented to: State Higher Education Executive Authority August 9, 2012 Chicago, Illinois.
E N D
Ontario’s experience in AHELO’s Civil Engineering Strand Presented by: Mary Catharine Lennon Senior Research Analyst Higher Education Quality Council of Ontario Presented to: State Higher Education Executive Authority August 9, 2012 Chicago, Illinois Informing the Future of Higher Education
Canada is 1 of 9 countries participating in Engineering Australia Canada Columbia Egypt Japan Mexico Russia Slovakia United Arab Emirates Informing the Future of Higher Education
HEQCO is implementing AHELO on behalf of MTCU Informing the Future of Higher Education
What is HEQCO? “The objective of the Council is to assist the Minister in improving all aspects of the postsecondary sector, including improving the quality of education provided in the sector, access to post-secondary education and accountability of post-secondary institutions.”
Ontario activities timeline Informing the Future of Higher Education
AHELO’s Civil Engineering strand Pilot managed by the Australian Council on Educational Research (ACER) Expected learning outcomes were developed through Tuning process Assessment tool developed by ACER, Japan’s National Institute for Educational Policy Research (NIER), the European and Global Engineering Education network (EUGENE), in collaboration with international Engineering education experts Informing the Future of Higher Education
The Engineering Test framework Engineering design Engineering practice Engineering analysis Generic engineering skills Basic engineering skills Understanding and application of design methodologies to meet requirements Practical competencies required to solve problems, conducting investigations, and designing engineering devices and processes. Covers non-technical elements of civil engineering practice like professional ethics, responsibilities and the impact of engineering solutions in a global economic, societal and environmental context Using analytical methods to identify, formulate and solve problems Effective communication and awareness of the wider civil engineering context Knowledge and understanding of underlying scientific and mathematical principles – general sciences; materials and construction; structural engineering; geotechnical engineering; hydraulic engineering and urban and rural planning Informing the Future of Higher Education
The test Students are provided 2 of 3 performance tasks, each requiring 30 minutes to complete Students are provided 20 of 40 multiple choice questions, together requiring 30 minutes to complete Students complete the context survey Informing the Future of Higher Education
How it works Online tests and contextual questionnaires are completed by students submitted directly to ACER for evaluation Short written responses are graded by trained Ontario-based Civil Engineering faculty and submitted to ACER All analysis of Civil Engineering strand occurs at ACER ACER provides result of Engineering strand to OECD Informing the Future of Higher Education
9 of 10 Ontario universities participated Informing the Future of Higher Education
Student recruitment Having specific and small population simplified recruitment Recruitment examples: emails, websites, classroom announcements, meetings of class and civil engineering student society representatives Informing the Future of Higher Education
Student incentives Limited funds and lots of creativity! Incentive examples: class pictures, voucher for formal end of term dinner, donation to the engineering societies, individual gift cards, increased amount on gift card if certain percentage of participation achieved, food after exam, raffles for ipad3 Informing the Future of Higher Education
The results *Note: Institution 9 had 62.5% of their students write the test, but only 5.4% were electronically captured, altering the final numbers for analysis to 56%* Informing the Future of Higher Education
AHELO Transmission of Results • ‘Institution Report’: Institutions receive a report detailing the performance of the cohort of students from their individual institution • ‘Jurisdictional report’:will outline the performance of Ontario’s Civil Engineering programs • ‘Inter-jurisdictionalreport’: Australia and Canada have agreed to share data for comparative purposes • ‘International Report’: The OECD will provide a final report reviewing the feasibility study Informing the Future of Higher Education
Challenges and successes • Institutional Research Ethics Board approval made it data linking impossible. • Technical issues at one institution • Considerable ‘buy-in’ from all levels • Discipline-strand simplified sampling and recruitment • Weekly Institutional Coordinator teleconferences were extremely useful • Lessons Learned • Get to institutions early in the academic year • Allow time for Ethics approval • Ensure adequate IT support ChallengesSuccesses Informing the Future of Higher Education
Find out more! Visit heqco.ca Informing the Future of Higher Education