Lifelong Skills: To R ubric or Not to R ubric

1. Lifelong Skills: To Rubric or Not to Rubric School of Management Joy Jia SALT Conference 2019

2. Lifelong learning skills are must-have in the future SALT Conference 2019

3. Lifelong Learning Skills Are Must-have in the Future SALT Conference 2019

4. Reskill at Digital Age Connected learner continuous learning SALT Conference 2019

5. Source: Siue.edu SALT Conference 2019

6. Problem-based Learning Module Year 3 student-centred Why companies pay dividend? Whether quantitative easing works? How social media such as twitter impact on financial market e.g. stock market Does market benefit from high frequency trading? SALT Conference 2019

7. Intended Learning Outcomes: • Able to identify phenomena/issues and critically evaluate theoretical framework and apply them to resolve issues (Problem solving and critical thinking skills) E.g. any gaps in financial services? Design and launch new products; Change in policies in respond to new development • Presentation skills at an advanced level • Produce a high level summary and communicate a research report on the issue(s) investigated SALT Conference 2019

8. Assessment: 15% × 3 group presentations (15 minutes long) 3000 words 45% individual research report on 1 of 3 questions SALT Conference 2019

9. Set-up: Group of 4 to solve 3 questions/issues. Each question/issue has 3 weeks Week 1: deliver background knowledge+ first paper reading Week 2: group discussion session (relevant tasks are set before the session)+Q&A Week 3: presentation SALT Conference 2019

10. Rubric:3 features: assessment criteria, a grading strategy and standards/quality definitions (Popham, 1997) SALT Conference 2019

11. 6 SALT Conference 2019

12. Key Literature: Criteria-referenced self-assessment is one of the tools can be used to boost learning and achievement and promote academic self-regulation (i.e. monitor and manage students’ own leaning) (e.g. Pintrich, 2000;Zimmerman&Schunk, 2004. Bigg, 2007 ) Lower achievers tend to overestimate and higher achievers to underestimate themselves.(Landrum, 1999; Lejk & Wyvill, 2001) Promote higher learning strategies use, and improve performance and accuracy. However, more problems coping with stress and higher performance/avoidance self-regulation observed (Panadero, E., & Romero, M, 2014) SALT Conference 2019

13. Research Aim: Is rubric an effective tool in problem-based learning? Does rubric help students to get on with research question? Does rubric help students to improve performance? Does rubric help students to develop a higher level learning strategy? SALT Conference 2019

14. 17 SALT Conference 2019

15. Method: Quantitative Analysis Quantitative Analysis T test: whether there is statistically significant positive difference Panel regression model: f(group performance) it :{ rubric, gender, performance, programmes}it SALT Conference 2019

16. Method: Qualitative Analysis Quick survey after each group presentation: What has gone well? What has not gone well? 1. Do you feel overall rubric is of help to formulate a learning strategy? Rate 0-10 in particularly helps you to start the work? in particularly helps you to plan the work? in particularly helps you to target appropriate resource (i.e. literature) in particularly helps you to focus on your task? SALT Conference 2019

17. Method: Qualitative Analysis cont’d 2.Do you feel overall rubric is of help to improve your performance? In particularly helps you to better understanding the criteria? In particularly helps you to reduce the time to complete the task? In particularly helps you to better focus on your task? In particularly helps you to develop a more efficient way to interpret the literature? SALT Conference 2019

18. Method: Qualitative Analysis cont’d 3. Do you feel overall rubric is of help to achieve your objective? In particularly helps you to better understanding the criteria? In particularly helps you to reduce the time to complete the task? In particularly helps you to better focus on your task? In particularly helps you to develop a more efficient way to interpret the literature? Do you feel rubric helps you to regulate your time and work? In particularly, do you feel actually a better understanding of the criteria burdens you (more stress)? And have tendency to avoidance self-regulation. SALT Conference 2019

19. Highlights: Plan and set up the goal: students’ perspective: 👍 80 out of 100 students gave positive (5+) rating 2. Understanding the criteria Students’ perspective: 👍 75 out of 100 students gave positive rating SALT Conference 2019

20. Highlights: 3. Learning, performance and self-regulation: Students’ perspective: 👍 Stats: 👍 Performance has been improved. It seems beneficial to middle groups 50% to 60-70% Top groups: doesn’t seem have any impact 4. Resilience: Students’ perspective: some became more stressed 👎 20 out of 100 Some tried to avoid self-regulation 👎 15 out of 100 SALT Conference 2019

21. Overall positive but not benefit for top studentsand can have negative impact for some studentsSelf-assessment/grading should not be included in summative assessment. SALT Conference 2019