An Overview of South Africa’s Schooling System

1. An Overview of South Africa’s Schooling System NicSpaull.com Siyavula Cape Town | 6 December 2013

2. Outline • SA performs extremely poorly on local and international assessments of educational achievement • In large parts of the schooling system there is little learning taking place • In SA we have TWO public schooling systems, not one. • Selected issues – teacher content knowledge, textbook availability (SMS) • Accountability & Capacity

3. 1) South Africa performs extremely poorly on local and international assessments of educational achievement

4. State of SA education since transition • “Although 99.7% of South African children are in school…the outcomes in education are abysmal” (Manuel, 2011) • “Without ambiguity or the possibility of misinterpretation, the pieces together reveal the predicament of South African primary education” (Fleisch, 2008: 2) • “Our researchers found that what students know and can do is dismal” (Taylor & Vinjevold, 1999) • “It is not an overstatement to say that South African education is in crisis.” (Van der Berg & Spaull, 2011)

5. Student performance 2003-2011 prePIRLS(2011) TIMSS (2011) ANA (2011) TIMSS (2003)  PIRLS (2006) SACMEQ (2007) TIMSS 2003 (Gr8 Maths & Science) • Out of 50 participating countries (including 6 African countries) SA came last • Only 10% reached low international benchmark • No improvement from TIMSS 1999-TIMSS 2003 PIRLS 2006(Gr 4/5 – Reading) • Out of 45 participating countries SA came last • 87% of gr4 and 78% of Gr 5 learners deemed to be “at serious risk of not learning to read” SACMEQ III 2007(Gr6 – Reading & Maths) • SA came 10/15 for reading and 8/15 for maths behind countries such as Swaziland, Kenya and Tanzania ANA 2011 (Gr 1-6 Reading & Maths) • Mean literacy score gr3: 35% • Mean numeracy score gr3: 28% • Mean literacy score gr6: 28% • Mean numeracy score gr6: 30% TIMSS 2011(Gr9 – Maths & Science) • SA has joint lowest performance of 42 countries • Improvement by 1.5 grade levels (2003-2011) • 76% of grade nine students in 2011 still had not acquired a basic understanding about whole numbers, decimals, operations or basic graphs, and this is at the improved level of performance prePIRLS2011 (Gr 4 Reading) • 29% of SA Gr4 learners completely illiterate (cannot decode text in any langauge) • NSES 2007/8/9 • Systemic Evaluations 2007 • Matric exams

6. 2) In large parts of the schooling system there is little learning taking place

7. Quantifying learning deficits in Gr3 Figure 1: Kernel density of mean Grade 3 performance on Grade 3 level items by quintiles of student socioeconomic status (Systemic Evaluation 2007) • Following Muralidharan & Zieleniak (2013) we classify students as performing at the grade-appropriate level if they obtain a mean score of 50% or higher on the full set of Grade 3 level questions. (Grade-3-appropriate level) 16% Only the top 16%of grade 3 students are performing at a Grade 3 level 51% 11%

8. NSES question 42NSESfollowed about 15000 students (266 schools) and tested them in Grade 3 (2007), Grade 4 (2008) and Grade 5 (2009). Grade 3 maths curriculum: “Can perform calculations using appropriate symbols to solve problems involving: division of at least 2-digit by 1-digit numbers” Even at the end of Grade 5 most (55%+) quintile 1-4 students cannot answer this simple Grade-3-level problem. “The powerful notions of ratio, rate and proportion are built upon the simpler concepts of whole number, multiplication and division, fraction and rational number, and are themselves the precursors to the development of yet more complex concepts such as triangle similarity, trigonometry, gradient and calculus” (Taylor & Reddi, 2013: 194) (Spaull & Viljoen, forthcoming)

9. By Gr 3 all children should be able to read, Gr 4 children should be transitioning from “learning to read” to “reading to learn” Red sections here show the proportion of children that are completely illiterate in Grade 4 , i.e. they cannot read in any language

10. SACMEQ 2007 – Grade 6 By this definition of functional illiteracy, if students are functionally illiterate they cannot read a short and simple text and extract meaning  i.e. they cannot read for meaning

11. Insurmountable learning deficits(Spaull & Viljoen, forthcoming)

12. Rationale • Learning is a cumulative process that builds on itself i.e. it follows a hierarchical structure (see Gagne, 1962; Aubrey, Dahl, & Godfrey, 2006; Aubrey & Godfrey, 2003; Aunio & Niemivirta, 2010). • Mathematics, in particular, follows a coherent, explicit and systematically principled structure (vertically integrated subject – Bernstein, 1999) • With respect to South Africa, Taylor et al. (2003, p. 129): “At the end of the Foundation Phase, learners have only a rudimentary grasp of the principles of reading and writing... it is very hard for learners to make up this cumulative deficit in later years...particularly in those subjects that...[have] vertical demarcation requirements (especially mathematics and science), the sequence, pacing, progression and coverage requirements of the high school curriculum make it virtually impossible for learners who have been disadvantaged by their early schooling to ‘catch-up’ later sufficiently to do themselves justice at the high school exit level.” (see also Schollar, 2008)

13. Data • Systemic Evaluation 2007 (Grade 3) • 51 000+ Gr3 students wrote the test in September in the mother tongue • NSES 2007/8/9 (Grade 3/4/5) • 15 000 students tested using the SE Gr3 test in Gr 3/4/5 (same test), but test administered in English in each grade. • NSES Grade 3 test conducted in October (1 month after SE) • SACMEQ 2007 (Grade 6) • 9071 Gr6 students wrote the test in Eng/Afr • TIMSS 2011 (Grade 9) • 11969 Gr9 students wrote the TIMSS Gr8 exam in 2011

14. Hill, Bloom, Black, Lipsey 2007 - USA

15. Quantifying learning in a year in SA

16. Insurmountable learning deficits: 0.3 SD

17. Possible simulations? Minimum years needed to improve NB: If SA improved at the best possible rates seen around the world, South Africa would take 34 years to attain the level of performance of non-Asian OECD countries • (Source: Gustafsson, 2013: p. 134)

18. Possible simulations? Minimum years needed to improve with actual examples NB: Using 0.08 SD per year as a benchmark, it would take16.7 yearsto raise the average mathematics achievement of Grade 9 students in Quintile 1, 2 and 3 to that of Grade 9 students in Quintile 5 in 2011. • (Source: Gustafsson, 2013: p. 135)

19. South African teacher content knowledge

20. Importance of basic content knowledge • Mathematics teachers need “a thorough mastery of the mathematics in several grades beyond that which they expect to teach, as well as of the mathematics in earlier grades” (Conference Board of the Mathematical Sciences, 2001, ch.2). • Carnoy& Chisholm’s (2008: p. 22) conceptual model distinguishes between basic content knowledge and higher level content knowledge.

21. What do South African teachers know relative to other teachers in Africa?

22. SA Grade 6 Mathematics teacher performance on SACMEQ mathematics-teacher test

23. SACMEQ III (2007) Mathematics-teacher mathematics test-scores for SACMEQ countries and South African quintiles of school wealth (95% confidence interval incl.)

24. Which content areas do South African teachers struggle with?

25. Figure 2: Mathematics teacher performance by content area (SACMEQ III - 2007)

26. Rate of change example (Q17)SACMEQ III (2007)  401/498 Gr6 Mathematics teachers Correct answer (7km): 38%of Gr 6 Maths teachers 7 2 education systems

27. Percentage of Grade 6 mathematics teachers with correct answer on Q17 of the SACMEQ III (2007) mathematics teacher test

28. What do South African teachers know relative to international Gr8students?

29. SACMEQ Grade 6 teachers’ average correct response (dark red) and TIMSS Grade 8 average correct response (light red) on 16 items common to Gr 8 TIMSS Mathematics test 1995 and SACMEQ Grade 6 mathematics teachers test 2007

30. Conclusions Ball et al (2008, p. 409): “Teachers who do not themselves know the subject well are not likely to have the knowledge they need to help students learn this content. At the same time just knowing a subject may well not be sufficient for teaching.” • What can Siyavula do about low teacher CK? • NDP suggests that interventions should not expect a high degree of capacity/competence – i.e. they should be tailored to work in low capacity contexts (i.e. majority of SA)

31. 3) In South Africa we have TWO public schooling systems not one

32. School Monitoring Survey (2011)2000 schools

33. SMS 2011

34. SMS2011 this this

36. Bimodality – indisputable fact PIRLS/ TIMSS/ SACMEQ/ NSES/ ANA/ Matric… by Wealth/ Language/ Location/ Dept…

37. Education and inequality? • IQ • Motivation • Social networks • Discrimination

38. Labour Market • University/FET • Type of institution (FET or University) • Quality of institution • Type of qualification(diploma, degree etc.) • Field of study (Engineering, Arts etc.) • High productivity jobs and incomes (17%) • Mainly professional, managerial & skilled jobs • Requires graduates, good quality matric or good vocational skills • Historically mainly white High quality secondaryschool Unequal society High SES background +ECD High quality primary school Minority (20%) Some motivated, lucky or talented students make the transition • Vocational training • Affirmative action • Big demand for good schools despite fees • Some scholarships/bursaries Majority (80%) Quality Type Attainment Low quality secondary school • Low productivity jobs & incomes • Often manual or low skill jobs • Limited or low quality education • Minimum wage can exceed productivity Low SES background Low quality primary school cf. Servaas van der Berg – QLFS 2011

39. SOLUTION? Accountability AND Capacity

46. “Only when schools have both the incentive to respond to an accountability system as well as the capacity to do so will there be an improvement in student outcomes.” (p22)

47. Binding constraints approach