HOW TO GET YOUR SCHOOL MOVING AND IMPROVING

1. HOW TO GET YOUR SCHOOL MOVING AND IMPROVING Professor Steve Dinham Research Director- Teaching, Learning and Leadership ACER Monash Network Conference May 11 2009

2. Opening Thoughts “The chains of habit are too weak to be felt until they are too strong to be broken.” Dr Samuel Johnson • Much of what we do in education is the result of taken-for-granted routines, habits, mind-sets, ideologies, superstitions and untested assumptions and beliefs. • However, we are now in the age of evidence and we need to ask some hard questions (what?, why?, how?, effects?).

3. WHAT ARE WE HERE FOR? “ …the focus of every school, every educational system and every education department or faculty of education – [should be] student learning and achievement.” Dinham, 2008: 1).

4. The Melbourne Declaration (2008) • The Declaration articulates two important goals for education in Australia: • Goal 1: Australian schooling promotes equity and excellence • Goal 2: All young Australians become: ■ successful learners ■ confident and creative individuals ■ active and informed citizens.

5. Background • Until the mid-1960s the view was that schools make almost no difference to student achievement, which was largely pre-determined by socio-economic status, family circumstances and innate ability. • However, research has powerfully refuted that view. • We now know that teachers, teaching and schools make a significant difference to student success.

6. Background • As a result, there has been a major international emphasis on improving the quality of teachers and teaching since the 1980s. • We now know how teacher expertise develops and we know what good teaching looks like. However we also know that teacher quality varies within schools and across the nation. • A quality teacher in every classroom is the ultimate aim, but how to achieve this is the big question and challenge.

7. It’s the Teacher … ‘... the most important factor affecting student learning is the teacher. ... The immediate and clear implication of this finding is that seemingly more can be done to improve education by improving the effectiveness of teachers than by any other single factor’. Wright, S.; Horn, S. & Sanders, W. (1997). 'Teacher and Classroom Context Effects on Student Achievement: Implications for Teacher Evaluation', Journal of Personnel Evaluation in Education, 11, pp. 57-67.

8. *Dinham (2008) ACER Presshttp://shop.acer.edu.au/acer-shop/product/A4066BK

9. Four Fundamentals of Student Success(Dinham, 2008)* QUALITY TEACHING FOCUS ON THE STUDENT (Learner, Person) LEADERSHIP PROFESSIONAL LEARNING

10. Unpacking The Four Fundamentals • Student Learning and Achievement* • Quality Teaching in Action* • Leadership for Quality Teaching and Learning • Professional Learning* * today’s focus

11. Student Learning and Achievement What Does Current Research Tell Us?

12. Research Evidence Prof John Hattie (Uni Auckland): Meta-analysis of over 50,000 studies Major sources of variance in student achievement: • Student: accounts for 50% of variance in student achievement • Home: 5-10% • School: 5-10% (principals, other leaders an influence) • PeerEffects: 5-10% • Teachers: 30% • “It is what teachers know, do, and care about which is very powerful in this learning equation”. • Reference: Hattie, J. (2003). ‘Teachers Make a Difference: What is the Research Evidence?’, http://www.leadspace.govt.nz/leadership/articles/teachers-make-a-difference.php

13. Note on Effect Size • Effect size (ES) is a name given to a family of indices that measure the magnitude of a treatment effect. Unlike significance tests, these indices are independent of sample size. • ES measures are the common currency of meta-analysis studies that summarize the findings from a specific area of research. • The larger the ES, the greater the influence of the treatment effect. • Note: As a guide, ES < 0.0 negative impact; 0.0 > 0.2 no/weak impact; 0.2 – 0.4 small, possibly significant impact; 0.4 – 0.6 moderately significant impact; > 0.6 large, significant impact.

14. Note on Effect Size • An ES of 1.0 indicates an increase of one standard deviation on the outcome, typically advancing achievement by 2-3 years or about 50% (see Hattie, 2009: chapter 2) • Almost everything works • We need to set the bar at about 0.4 at which point we start to see real difference • However we also need to consider variance – it won’t be 0.4 for every student • We also need to think about how various interventions work together, or not.

15. Professor John Hattie Uni of Auckland 2007 • Over 750 Meta-analyses of over 50,000 international studies • See Hattie, J. (2007). ‘Developing Potentials for Learning: Evidence, assessment, and progress’, EARLI Biennial Conference, Budapest, Hungary. http://www.education.auckland.ac.nz/uoa/education/staff/j.hattie/presentations.cfm

16. Student Achievement InfluenceEffect Size Mobility (shifting schools) -.34 Retention -.16 Television -.14 Summer vacation -.09

17. Student Achievement InfluenceEffect Size Open v Traditional .01 Multi-grade/age classes .04 Inductive teaching .06 Reading: whole language .06 Perceptual-motor programs .08 Out of school experiences .09 Distance education .09 Web based learning .09

18. Student Achievement InfluenceEffect Size Ability grouping .11 Teacher training .11 Diet on achievement .12 Teacher subject matter knowledge .12 Gender (boys-girls) .12 Multi-media methods .15 Problem based learning .15 Home school programs .16

19. Student Achievement InfluenceEffect Size Extra-curricular programs .17 Family structure .18 Co-/team teaching .19 Learning hierarchies .19 Aptitude/treatment interventions .19 Individualised instruction .20 Charter schools .20 Religious schools .20

20. Student Achievement InfluenceEffect Size Class size .21 Teaching test taking .22 Finances .23 Summer school .23 Competitive learning .24 Programmed instruction .24 Within class grouping .25 Mainstreaming .28

21. Student Achievement InfluenceEffect Size Desegregation .28 Exercise/relaxation .28 Audio-based teaching .28 Home visiting by teachers .29 Reducing anxiety .30 Principals/school leaders .30 Ability grouping for gifted students .30 Homework .31

22. Student Achievement InfluenceEffect Size Inquiry based teaching .31 Simulations and gaming .32 Reading: exposure to reading .36 Bilingual programs .37 Teacher positive expectations .37 Computer assisted instruction .37 Enrichment on gifted .39 Integrated curriculum programs .39

23. Student Achievement InfluenceEffect Size Adjunct aids .41 Hypermedia instruction .41 Behavioural objectives/adv organisers .41 Self-concept on achievement .43 Frequent/effects of testing .46 Early intervention .47 Motivation on learning .48 Small group learning .49

24. Student Achievement InfluenceEffect Size Questioning .49 Cooperative learning .49 Reading: Second/third chance programs .50 Play programs .50 Visual based/audio-visual teaching .51 Outdoor programs .52 Concept mapping .52 Peer influences .53

25. Student Achievement InfluenceEffect Size Keller's mastery learning program .53 Reading: Phonics instruction .53 Reading: Visual-perception programs .55 Parental Involvement .55 Peer tutoring .55 Goals – challenging .56 Mastery learning .57 Social skills programs .57

26. Student Achievement InfluenceEffect Size Socio-economic status .57 Home environment .57 Providing worked examples .57 Reading: Comprehension programs .58 Direct instruction .59 Time on task .59 Study skills .59

27. Student Achievement InfluenceEffect Size Acceleration of gifted .60 Problem solving teaching .61 Teacher professional development .64 Reading: Repeated reading programs .67 Reading: Vocabulary programs .67 Meta-cognition strategies .67 Teaching students self-verbalisation .67 Creativity programs .70 Prov. Formative evaluation to teachers .70

28. Student Achievement InfluenceEffect Size Feedback .72 Teacher-student relationships .72 Prior achievement .73 Reciprocal teaching .74 Quality of teaching .77 Classroom behavioural .80 Absence of disruptive students .86 Self-report grades 1.44

29. Effect Size Research: Key Points • The teacher and the quality of his or her teaching are major influences on student achievement, along with the individual student and his or her prior achievement (all have large effect sizes). • School-based influences (beyond the classroom) have weaker effects on student achievement. • Structural and organisational arrangements (open vs traditional classrooms; multi-age vs age graded classes; ability grouping; gender; class size; mainstreaming) have negligible or small effects on student learning. It is the quality of teaching that occurs within these structural arrangements which is important.

30. Effect Size Research: Key Points • Examples of ‘active teaching’ (reciprocal teaching; feedback; teaching self-verbalisation; meta-cognition strategies; direct instruction; mastery learning; testing) have large to moderate effects on student achievement. • Effect sizes are negligible or small for ‘facilitory’ teaching (simulations and games; inquiry-based teaching; individualised instruction; problem-based learning; differentiated teaching for boys and girls; web-based learning; whole language reading; inductive teaching). • Strategies to promote and remediate literacy figure prominently in Hattie’s full list. Literacy is the foundation of student achievement.

31. What About SES? • SES and family background do have moderate/large effect sizes • SES is about: • Foundations/advantage • Opportunity • Support • Role models and encouragement • SES is not about: • Innate ability • Social-biological determinism • Potential

32. Facts About SES • Poor student performance is spread across the SESspectrum • Schooling represents an obstacle course. Some students have certain advantages and others have obstacles. • Life is not fair, but good teaching and good schools can help overcome SES disadvantage

33. Feedback • “Look at learning or mastery in fields as diverse as sports, the arts, languages, the sciences or recreational activities and it’s easy to see how important feedback is to learning and accomplishment. An expert teacher, mentor or coach can readily explain, demonstrate and detect flaws in performance. He or she can also identify talent and potential, and build on these. • In contrast, trial and error learning or poor teaching are less effective and take longer. If performance flaws are not detected and corrected, these can become ingrained and will be much harder to eradicate later. Learners who don’t receive instruction, encouragement and correction can become disillusioned and quit due to lack of progress.” (Dinham, Feedback on Feedback, 2008)

34. Feedback The four questions of Students: • What can I do? • What can’t I do? • How does my work compare with that of others? • How can I do better?

35. Feedback “When asked to provide evidence and guidance on enhancing the quality of teaching and student performance, I’m usually equivocal about advocating quick fixes … In the case of feedback, however, I’m prepared to state categorically that if you focus on providing students with improved, quality feedback in individual classrooms, departments and schools you’ll have an almost immediate positive effect. The research evidence is clear: great teachers give great feedback, and every teacher is capable of giving more effective feedback.” (Dinham, Feedback on Feedback, 2008).

36. What Sort of Feedback? G. Nuthall (2007). The Hidden Lives of Learners. Wellington: NZCER. • 80% of feedback students receive about their work in primary school comes from other students • 80% of this student-student feedback is incorrect.

37. Some Questions to Ask I suggest that you begin a professional conversation about feedback by asking eight questions: • What are our present approaches – formal and informal – to student feedback? Conduct an audit. • Are our assessment methods and criteria clear, valid and reliable? Identify the links between assessment and feedback. • Do our students understand what is meant by feedback? • Is the feedback our students receive infrequent, unfocused, unhelpful, inconsistent or negative? OR

38. Some Questions to Ask • Is the feedback we provide focused, comprehensive, consistent and improvement oriented, addressing the four key questions raised above? (especially How can I do better?) • How does the feedback our students receive relate to parental feedback through reports, interviews and parent nights? Is feedback to students and parents consistent? • How can we provide our students with improved feedback? • How will we know if it works? What evidence will we need? • The answers to these questions will provide an important foundation for improving the quality of teaching and student achievement in our schools. • However, feedback is only one part of the equation. It is not a substitute or remedy for poor teaching.

39. …and if you are the parent of a school-age child: • Don’t ask “What did you do today?” or “What did you learn today?” but • “What feedback on your learning did you get today?”

40. Quality Teaching in Action Case Study: Successful Senior Secondary Teaching

41. ‘EXPERT’ TEACHERS - PREVIOUS RESEARCH • Experts notice features and meaningful patterns of information that are not noticed by novices. • Experts have acquired a great deal of content knowledge that is organised in ways that reflect a deep understanding of their subject matter. • Experts’ knowledge cannot be reduced to sets of isolated facts or propositions but, instead, reflects contexts of applicability. • Experts are able to flexibly retrieve important aspects of their knowledge with little attentional effort.

42. ‘Expert’ Teachers • May appear ‘arational’, intuitive, non-analytic • Understand and solve problems at a deeper level • ‘Know’ their students; students ‘know’ them • Though experts know their disciplines thoroughly, this does not guarantee that they are able to teach others. • Both teacher and students have high expectations • Experience gained over time important • Expert teachers can’t (easily) articulate their practice

43. The Senior Secondary Successful Teaching Study

44. Aims • identify the relationship between teaching methods and HSC outcomes for students • identify the characteristics of successful HSC teaching methodology • consider the implications of the study findings for improving teacher efficiency

45. FACTORS CONTRIBUTING TO TEACHING SUCCESS • School Background • Subject Faculty • Personal Qualities • Relationships With Students • Professional Development • Resources and Planning • Teaching Strategies

46. Quality Teaching: Overall Findings from the HSC Study • Teachers genuinely expert in their subject area(s), and enjoyed teaching • Three sorts of knowledge essential: • Subject content knowledge (what subject content to teach) • Subject pedagogic knowledge (how to teach particular subject content) • Subject course knowledge (subject curriculum, assessment, exam knowledge)

47. HSC Findings • Lessons were student centredandteacher directed. • Teachers were highly responsive to students and highly demanding, i.e. authoritative, rather than uninvolved, permissive or authoritarian. • Mutual respect, confidence and high expectations.

48. HSC Findings • Although wide range of strategies used, key common factor was emphasis on having students think, solve problems and apply knowledge. • Understanding built in layers, connections. • Frequent assessment and feedback. • Teachers saw their role as challenging students beyond demands of the HSC.

49. HSC Findings • Assisted note building, ownership of note-making • Group work, community learning more common than might be expected • Good relationships and positive classroom climate essential • Overall, no instant recipe for teaching success, yet much can be learned from successful teachers and faculties – a framework for reflection and action

50. Key Points • Overall, the quality of the teacher and the quality of teaching (large effect sizes) are much more important than structural or working conditions (negligible or small effect sizes), demonstrating the futility and waste of ‘fiddling around the edges’ of schooling without sufficiently addressing the quality of teachers and the quality of teaching within schools and classrooms.