‘Enhancing the First Year Experience – A Case Study From Biomedical Sciences’

1. ‘Enhancing the First Year Experience – A Case Study From Biomedical Sciences’ Paul Hagan Stephen McClean University of Ulster

2. Evaluation • There are many, many variables to be considered when evaluating student performance. • What works for one individual may not offer a solution for another. • How do we assess the efficacy of all the ‘fixes’ we offer and how do they impact on each of the many experience groups which we have to accommodate. • We need to use some medium-weight statistics to get at the detail of the ‘fixes’ versus student performance with prior educational experience factored in.

3. EVALUATION • This evaluation step is CRUCIAL in the whole exercise and it is actually the detail of the EVALUATION which I am communicating, and what it can offer. • We all need to justify what we do in terms of committing additional resources to remedial classes. • These robust analyses give us the ammunition we require to promote and justify these activities.

4. 2005-2006 - 62% 82% 2006-2007 – 68% 81% 2007-2008 65% 84% • Normal Distribution fits are for the two groups of students • Those with previous ‘A’ level experience • Those without ‘A’ level experience

5. BOXPLOTS

6. Good correlation between coursework and examination mark. Three students with low coursework and > pass marks in the examination obviously defied all attempts to improve their coursework submissions. 2005-2006 2006-2007

7. Possibility of producing a ‘tailor made’ report for individual student. Position in cohort can be highlighted from registration number.

8. 2005-2006 2006-2007 The expected correlation between attendance and examination score, increased absence from lectures, practicals and tutorials leads to depressed examination marks. Outliers suggest that some poor attendees have sufficient prior ‘knowledge’ or alternative access to course materials, to enable a pass.

9. 2005-2006 In all 6 extra ‘voluntary’ tutorials were offered in semester one. All students attending at least one extra tutorial passed the exam.

10. 2006-2007 A total of two examination revision sessions were offered immediately prior to the examination after the Semester one examinations.

11. 2005-2006 2006-2007 Students with no ‘A’ level chemistry experience (‘A’ or ‘AS’ level) or with no chemistry at Irish Higher or Irish Ordinary level improve their probability of passing by attending at least one extra ‘voluntary tutorial’ It can be shown that the students who failed to achieve at least a pass grade were not sufficiently motivated to attend extra tutorial classes and this lack of motivation would be reflected in their level and quality of examination preparation

12. Attendance at both pre-examination revision tutorials improved the mean examination mark of students without chemistry ‘A’ levels by 21% on average. None of these students gained lower than a pass grade.

13. Picture is broadly similar in 2007 - 2008

14. 2005-2006 2006-2007 Students with previous ‘A’ level experience generally do not exhibit a significantly improved examination performance by attending both pre-examination revision tutorials. It is however not detrimental to their performance and may be viewed as a ‘confidence-building’ exercise.

15. Multivariate analysis 2006-2007

16. 2006-2007 2005-2006 Students with ‘A’, ‘AS’, or equivalent level chemistry, on average, score least 15% higher in the examination.

17. WIFT WHAT’S IN IT FOR THEM? 2005 - 2006 Examination marks for second semester BIOCHEMISTRY module

18. 2007 - 2008

19. Conclusions • Attendance is a crucial factor • Specific groups can be identified as being deficient in chemistry and mathematics • Targeted tutorials are very effective • Practice MCQ’s appreciated by students • Some ‘A’ levels better than others.