1 / 52

International comparisons of science and mathematics education : PISA and TIMSS

International comparisons of science and mathematics education : PISA and TIMSS. Harrie Eijkelhof Freudenthal Institute for Science and Mathematics Education. Outline of this workshop. Why comparing countries ? PISA Age 15 Reading, Mathematics, Science and Financial Literacy

ehoyt
Download Presentation

International comparisons of science and mathematics education : PISA and TIMSS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. International comparisons of science andmathematicseducation: PISA and TIMSS Harrie Eijkelhof Freudenthal Institutefor Science andMathematicsEducation

  2. Outline of this workshop • Whycomparingcountries? • PISA • Age 15 • Reading, Mathematics, Science and Financial Literacy • TIMSS • Grades 4 & 8 • Mathematics and Science • Implications of comparing countries • Learning from other countries summerschool 2017

  3. Why comparing countries in science and mathematics education? • Economic importance of science and mathematics education • Internationalisation: mobility of students • Tool for educational policy: monitoring, reform • Learning from other systems: relative strengths and weaknesses summerschool 2017

  4. Programme for International Student Assessment (PISA) • Created in 1997 by OECD • Aim: to monitor outcomes of educational systems in terms of student achievement • Age: 15 years • Surveysevery 3 yearssince 2000 in reading, mathematicalandscientificliteracy • 2000 reading, math, science [43] • 2003 reading, math, science [41] • 2006 reading, math, science [58] • 2009 reading, math, science [74] • 2012 reading, math, science [65] • 2015 reading, math, science [71] • 2018 reading, math, science [80] https://www.youtube.com/watch?feature=player_embedded&v=i4RGqzaNEtg summerschool 2017

  5. Countriesparticipating in PISA 2015grey: OECD countriesblue: othercountries summerschool 2017

  6. Focus of PISA • Collaborative effort: OECD + non-member partner economies • To measure how well students at age 15 are prepared to meet challenges in future life • Based on model of lifelong learning • Beyond school-based approach: use of knowledge in everyday tasks and challenges • Not only assessing knowledge: also how to apply knowledge in real-life issues • Items based on frameworks, created by expert groups summerschool 2017

  7. PISA-definition of Mathematical literacy(2013) Mathematical literacy is an individual’s capacity to formulate, employ, and interpret mathematics in a variety of contexts. It includes reasoning mathematically and using mathematical concepts, procedures, facts, and tools to describe, explain, and predict phenomena. It assists individuals to recognise the role that mathematics plays in the world and to make the well-founded judgments and decisions needed by constructive, engaged and reflective citizens. summerschool 2017

  8. PISA 2012 Mathematics Framework summerschool 2017

  9. Five problems of Pythagoras’stheorem 1. State Pythagoras’s theorem. 2. ABC is a triangle right-angled at C (fig. a). AC has length 7 cm. BC has length 12 cm. Calculate the length of side AB. 3. In triangle DEF, angle F is 90° (fig. b), angle D is 45° and side EF is 150 m. Calculate the length of side DE. 4. A large kite is flying at an angle of 45° to the ground at height of 150 m. How long is the rope tethering it? 5. KLM is a triangle right-angled at M (fig. c). P is a point on KM and Q is a point on LM. Prove that KQ²+LP² = KL²+PQ². summerschool 2017

  10. PISA 2015 Science Framework • 3 competencies: • explain, evaluate, interpret • Competenciesrequire: • 3 types of Knowledge: • content, procedural, epistemic • Attitudes: • interest, valuing, environmentalawarenes • Contexts: • personal, local/national, global summerschool 2017

  11. Contexts for the PISA 2015 science assessment summerschool 2017

  12. Scientific knowledge Of science: • Physical systems • Living systems • Earth andspace systems About science: • Procedural knowledge: variables, measurement, replicability, representing data, control of variables • Epistemic knowledge: purposes, nature, values, justification, errors, collaboration and critique summerschool 2017

  13. Attitudes in science (PISA 2015) • Interest in science: e.g. curiosity, willingness to acquire knowledge, career aspirations • Valuing scientific approaches to enquiry: e.g. commitment to evidence, criticism • Environmental awareness: e.g. concern, disposition to sustainable behaviour summerschool 2017

  14. Sample PISA-items (released) • Study sample questions • 3 mathematics • 3 science • Look at • the question type • level of difficulty • Giveyour opinion on the natureand level of the questions: feasible in your country? summerschool 2017

  15. PISA-questions MATHEMATICS EXAMPLES Question 1: SAVINGS ACCOUNT 1 000 zed is put into a savings account at a bank. There are two choices: one can get an annual rate of 4% OR one can get an immediate 10 zed bonus from the bank, and a 3% annual rate. • Which option is better after one year? • After two years? summerschool 2017

  16. Question 2: SCIENCE TESTS In Mei Lin’s school, her science teacher gives tests that are marked out of 100. Mei Lin has an average of 60 marks on her first four Science tests. On the fifth test she got 80 marks. What is the average of Mei Lin’s marks in Science after all five tests? Average: ............................................... summerschool 2017

  17. Question 3: BOOKSHELVES To complete one set of bookshelves a carpenter needs the following components: 4 long wooden panels, 6 short wooden panels, 12 small clips, 2 large clips and 14 screws. The carpenter has in stock 26 long wooden panels, 33 short wooden panels, 200 small clips, 20 large clips and 510 screws. How many sets of bookshelves can the carpenter make? Answer: ................................................. summerschool 2017

  18. PISA-questions: Science example TOBACCO SMOKING Some people use nicotine patches to help them to give up smoking. The patches are put on skin and release nicotine into the blood. This helps to relieve cravings and withdrawal symptoms when people have stopped smoking. To study the effectiveness of nicotine patches, a group of 100 smokers who want to give up smoking is chosen randomly. The group is to be studied for six months. The effectiveness of the nicotine patches is to be measured by finding out how many people in the group have not resumed smoking by the end of the study. Which one of the following is the best experimental design? A All the people in the group wear the patches. B All wear patches except one person who tries to give up smoking without them. C People choose whether or not they will use patches to help give up smoking. D Half are randomly chosen to use patches and the other half do not use them. summerschool 2017

  19. Pisa tests in schools • Random selection of schools • Schoolcoordinatorappointed • Random selection of 35 students age15 per school (not classes) • Permissionfromparents • Tests sessionorganizedby test administrator • 13 different bookletswith sets of questions • 2 hoursforknowledgetesting of students • 30 minutes for student questionnaire: personal background, learninghabits, attitudes, motivation • School questionnaire (headmaster): demographiccharacteristics, quality of the learning environment summerschool 2017

  20. Proficiency levels mathematics PISA 2012(500 = average) OECD % Level 6 > 669 3.3 Level 5 607 - 669 9.3 Level 4 545 – 607 18.2 Level 3 482 – 545 23.7 Level 2 420 – 482 22.5 Level 1 358 – 420 15.0 Below 1 < 358 8.0 summerschool 2017

  21. PISA 2015 – cognitive performance summerschool 2017

  22. Intrinsicmotivationtolearnmathematics(PISA 2012) (in %) summerschool 2017

  23. PISA- 2015: Knowledge of science versus Enjoyment of science (Volume I, p. 337) summerschool 2017

  24. How toexplain PISA-results? • Whichresults are striking toyou? • Givereasonswhichmightexplaindifferencesbetweencountries in results: summerschool 2017

  25. How toexplain PISA-results? • Cultural factors • Value of knowledgeandeducation in society • Value of arguing • Science in the media (TV, journals, newspapers) • Educational factors • Organization of education • Nature of the school curricula • Quality of teaching • Quality of assessment • Investments in education • PISA-factors • Attitude towardscompleting the PISA-test by 15-year oldsand society • Nature of the PISA-questions summerschool 2017

  26. Financial literacy test The PISA financial literacy test is designed to measure whether students have • the knowledge and understanding of financial concepts and risks, • as well as the skills, motivation and confidence to apply such knowledge and understanding • in order to make effective decisions across a range of financial contexts, • to improve the financial well-being of individuals and society, and • to enable participation in economic life. summerschool 2017

  27. Participation in the financial literacy test OECD: • Australia • Belgium (Flemish) • Canada (7 prov.) • Chile • Italy • Netherlands • Poland • Slovak Republic • Spain • United States Partner countries: • Brazil • China (4 prov.) • Lithuania • Peru • Russia summerschool 2017

  28. Financial question categories • Financial content • Money and transactions • Planning and managing financies • Risk andreward • Financial landscape • Financial contexts • Educationandwork • Home andfamiliy • Individual • Societal • Financial literacyprocesses • Identify, analyse, evaluate, apply summerschool 2017

  29. Examplequestions financial literacy • Invoice: why sent? • Invoice: deliveringcosts? • Shares: whentobuyandannual share priceincrease? • Pay slip: howmuchpaid? • Bank error? summerschool 2017

  30. PISA 2015 Results Financial LiteracyVolume IV summerschool 2017

  31. summerschool 2017

  32. Objectionsraisedagainst PISA • Unlike United Nations organizations OECD has no mandatetoimproveeducation • ‘Educationalcolonialism’ fromcomparingdevelopingcountrieswith OECD countries • Bias to economic role of schooling • Alliance with for-profit companies • Narrowing to measurable educational objectives • Leads to short-term policies • Escalation of standardizedtesting • Decreasesautonomy of teachers summerschool 2017

  33. Discussobjections • Whichobjections do youagreewith? Why? • How mightonedefend PISA against these objections? summerschool 2017

  34. PISA-sources • Interview with Andreas Schleicher (PISA, OECD https://www.northcountrypublicradio.org/news/npr/541644277/andreas-schleicher-what-are-the-keys-to-a-successful-education-system • Further information about PISA http://www.pisa.oecd.org/ http://www.oecd.org/pisa/pisaproducts/ • New initiatives: 1. PISA-based Test for Schools http://www.oecd.org/pisa/aboutpisa/pisa-based-test-for-schools.htm 2. PISA for Development http://www.oecd.org/pisa/aboutpisa/pisafordevelopment.htm summerschool 2017

  35. Trends in International Mathematics and Science Study (TIMSS) • Started in 1995 by IEA (International Associationfor the Evaluation of EducationalAchievement) • Aim: tomeasuremathandscienceknowledgeand skills alignedwith curricula in participatingcountries • Age: grades 4, 8, 12 • Surveysevery 4 years in manycountries: Grade 4 Grade 8 Grade 12 • 1995 26 41 5 • 1999 -- 38 -- • 2003 25 46 -- • 2007 36 48 10 (2008) • 2011 50 42 -- • 2015 47 41 9 summerschool 2017

  36. TIMSS Frameworks Grades 4 and 8 • Mathematics • Grade 4 • Content domains: number, geometricshapesandmeasures, data display • Grade 8 • Content domains: number, algebra, geometry, data and chance • Science • Grade 4 • Content domains: life science, physicalscience, earthscience • Grade 8 • Content domains: biology, chemistry, physics, earthscience • Mathematics + Science • Cognitive domains: knowing, applying, reasoning summerschool 2017

  37. Target Percentages of the TIMSS 2015 Mathematics Assessment Devoted to Content and Cognitive Domains at the Fourth and Eighth Grades summerschool 2017

  38. Sample of released math items TIMSS grade 4 1. Three thousand twenty three can be written as: a. 323 b. 3,023 c. 30,023 d. 300,023 2. Jeb had 16 peaches. He gave away 4 peaches. Then Jeb divided the remaining peaches equally between 2 baskets. How many peaches did Jeb put in each basket? a. 6 b. 8 c. 10 d. 12 3. A bottle of apple juice costs 1.87 zeds. A bottle of orange juice costs 3.29 zeds. Gavin has 4 zeds. How much more does Gavin need to buy both bottles of juice? a. 1.06 zedsb. 1.16 zeds c. 5.06 zeds d. 5.16 zeds 4. The perimeter of a 5-sided figure is 30 centimeters. Three of the sides are each 4 cm long. The other two sides, A en B, are the same length. What is the length of side A? a. 6 cm b. 9 cm c. 12 cm d. 18 cm summerschool 2017

  39. Sample of released math items TIMSS grade 8 summerschool 2017

  40. TIMSS Results2015 Grade 4 (N=47)Math Science Singapore 618 590 Korea 608 589 Ireland 547 529 Belgium (Fl.) 546 512 USA 539 546 Denmark 539 527 Netherlands530 517 Spain 505 518 Slovakia 498 520 Turkey 483 483 Iran 431 421 Indonesia 397 397 Saudi Arabia 383 390 South Africa 376 -- Grade 8 (N=39) Math Science Singapore 621 597 Korea 606 556 Ireland 523 530 USA 518 530 Israel 511 507 Turkey 458 493 Iran 436 456 South Africa 372 358 Saudi Arabia 368 396 summerschool 2017

  41. Sources TIMSS 2015 • Highlights http://www.iea.nl/timss-2015-results • Frameworks https://timssandpirls.bc.edu/timss2015/frameworks.html • Detailedresults (incl. released items) http://timssandpirls.bc.edu/timss2015/international-results/download-center/ summerschool 2017

  42. TIMSS South Africa 2015http://www.timss-sa.org.za/download/Presentation-results-release.pdf Grade 5 Grade 9 Science andMathematics Tested at Grade 8 level in 1995, 1999, 2003 and at Grade 9 level in 2003, 2011 and 2015. South African sample 292 schools 12 500 learners 330 mathematicsand science teachers • Mathematics • First time South Africa participated in TIMSS at the Grade 5 • South African Sample • 297 schools • 11 000 learners • 297 mathematicseducators • 10 500 parents/ care givers summerschool 2017

  43. Characteristics of SA TIMSS resultsin grade 5 mathematics • 61% score below 400 score • Differencesbetweenprovinces: • Western Cape (441) versus Eastern Cape (343) • Differencesbetween school types: • No-fee (344) versus fee (445) and independent (506) • Girls (384) significantlybetterthan boys (368) • Differences in home environment • Education of parents • Access tofacilities (running tap water, flush toilet) • Use of test language at home • Emphasis on academicsuccess summerschool 2017

  44. Characteristics of SA TIMSS resultsin grade 9 mathematics • 66% score below 400 score • Differencesbetweenprovinces: • Gauteng (408) versus Eastern Cape (346) • Differencesbetween school types: • No-fee (341) versus fee (423) and independent (477) • Girls (376) notsignif. betterthan boys (369) • Differences in home environment • Education of parents • Access to facilities (running tap water, flush toilet) • Use of test language at home • Emphasis on academic success summerschool 2017

  45. Policy Implications of TIMSS & PISA • Monitoring problems/successes • Lookingabroadforsolutions • Focus on assessment • Developing new curricula • Policy shifts, e.g.: • focus on excellence • investing in backward regions or populations • Acting on comparisons at system level summerschool 2017

  46. The Learning CurveLessons in country performance in educationPearson,2012 http://thelearningcurve.pearson.com/videos http://thelearningcurve.pearson.com • 40 countries compared • Index cognitive skills & educational attainment • Top-countries Finland and South Korea • NL in subtop (7) • www.thelearningcurve.pearson.com summerschool 2017

  47. School responsibility & autonomy compared summerschool 2017

  48. Country profiles • http://thelearningcurve.pearson.com/country-profiles : education input & output andsocio-economic indicators http://thelearningcurve.pearson.com/country-profiles/south-africa http://thelearningcurve.pearson.com/country-profiles/spain http://thelearningcurve.pearson.com/country-profiles/brazil http://thelearningcurve.pearson.com/country-profiles/denmark summerschool 2017

  49. Global index of cognitive skills and educational attainment summerschool 2017

  50. Comparing educational systems South Korea Finland late start in schooling less lessons no homework only some frontal teaching focus on applying knowledge small classes rel. low salaries teachers importance of teacher training education seen as act of social justice • exam driven • rigid curriculum • reproduction oriented • frontal teaching • private crammer schools (hagwans) • large classes • rel. high salaries teachers • importance of teacher training • learning seen as moral duty to family and society summerschool 2017

More Related