1 / 23

Gianluca Argentin Alberto Martini Barbara Romano romanob@gse.upenn

Standing on the Shoulders of Chess Masters: Using RCTs to Produce Evidence about Teaching Chess in Italian Elementary Schools. Gianluca Argentin Alberto Martini Barbara Romano romanob@gse.upenn.edu. Why should chess be taught in school?. According to the

serena
Download Presentation

Gianluca Argentin Alberto Martini Barbara Romano romanob@gse.upenn

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Standing on the Shoulders of Chess Masters: Using RCTs to Produce Evidence aboutTeaching Chess in Italian Elementary Schools Gianluca Argentin Alberto Martini Barbara Romano romanob@gse.upenn.edu

  2. Why should chess be taught in school? According to the European Parliament for several reasons

  3. The EU Parliament claims that “Chess can improve children’s concentration, patience and persistence and can develop sense of creativity, intuition, memory, analytic and decision-making skills. Chess also teaches determination, motivation and sportsmanship”

  4. The evidence on the effects of learning chess on cognitive outcomes is literally scattered all over the world: from chess association websites to academic journals in a variety of disciplines. However Rarely this evidence is based on rigorous evaluation designsuch as randomized controlled trials

  5. Wewillpresent: • the results of a simple RCT to measure the effects of learning chess on mathachievement (SAM) • the design of a more complex RCT to answerseveralquestionsthatarisewhenincorporating chess in the regular curriculum (SC3) Our true long run objective is promoting the use of random assignment in evaluation and education research in Italy.

  6. PROGETTO SAM Scacchi e Apprendimento della Matematica

  7. We recruited 33 schools that had been involved in chess teaching before (a non probabilistic sample, yet nicely spread all over Italy)

  8. Each school agreed to exclude at least one 3° grade class, chosen randomly All the other 3° grade classes were taught 30 hours of chess by professional instructors during 2009-10 school year

  9. A total of 113 classes - about 2000 pupils - participated either as treatment or control All pupils were pre-tested and post-tested using modified versions of INVALSI tests High level of compliance to the design

  10. Impact Pre-test Score distribution Post-test Score distribution Clearly something is happening to the experimentals

  11. Estimated effect on math scores (in standard deviations) A third of a standard deviation is an exceptionally good result This makes people (including us) doubt it

  12. Is it because you included questions too favorable for chess players? a. Draw the snail path b. Which shape corresponds to the snail path?

  13. We found an effect on almost each item on the test Differential probability of correct response for each item

  14. IT MUST BE THE EFFECT OF CHEATING!

  15. CHEATING SHOULD SHOW UP HERE, BUT IT’S EMPTY

  16. Chess does work! We need to prove it with an RCT based on a probabilistic sample of schools

  17. Sc3 sperimentazioneControllata di scacchi a scuola (Springer = Knight in German)

  18. Does learning chess at school (at some point between 3rd and4th grade) affects achievement in mathematics and reading measured in 5th grade? Does chess taught by professional instructors obtain better or similar results than when based on web teaching tools with the support of regular teachers? Which solution is more cost-effective and sustainable at scale? How persistent are the effects of learning chess? Does any beneficial effect remain one or two years after training? Which fraction of pupils continue to play chess and possibly benefit from it, after it is no longer taught in class?

  19. First question: does learning chess improve achievement in math and reading, as measured by INVALSI standardized tests 240 schools selected with probability prop. to size out of 18,000 primary schools in Italy Second grade INVALSI National test FifthgradeINVALSI National test 160 treated schools RA 80 control schools

  20. The second question: External instructor or regular teacher+web? Second grade INVALSI National test Fifth gradeINVALSI National test 80 schools “teaching by external instructor” RA 80 schools “web-based with support by regular teachers”

  21. The third question: Do school-based activities increase persistency of the effect of learning chess? Test of knowledge of chess and frequency of use (early in third grade) Test of knowledge of chess and frequency of use (late In fifth grade) 80 schools promote chess in 5° grade RA 80 schools do not promote chess in 5° grade

  22. The two dimensions crossed represent a factorial design

  23. We are looking for sponsor/supporter And for other countries willing to “play (it again) SAM” Anyone interested?

More Related