1 / 46

Using Corpora in Language Research -also Introduction to the Sketch Engine (WS15) part 1

Adam Kilgarriff Lexical Computing Ltd Universities of Leeds. Using Corpora in Language Research -also Introduction to the Sketch Engine (WS15) part 1. What is language?. What is language? In our heads. What is language? In our heads In texts and sound signals. What is language?

chester
Download Presentation

Using Corpora in Language Research -also Introduction to the Sketch Engine (WS15) part 1

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Adam Kilgarriff Lexical Computing Ltd Universities of Leeds Using Corpora in Language Research-alsoIntroduction to the Sketch Engine (WS15) part 1

  2. Adam Kilgarriff What is language?

  3. Adam Kilgarriff What is language? In our heads

  4. Adam Kilgarriff What is language? In our heads In texts and sound signals

  5. Adam Kilgarriff What is language? In our heads In texts and sound signals Both

  6. Adam Kilgarriff Methodology Study language in our heads Competence Chomsky “rationalist” (Descartes, Leibniz)‏

  7. Adam Kilgarriff Methodology Study language in our heads Competence Chomsky “rationalist” (Descartes, Leibniz)‏ Odd method for objective science Practical problems: coverage, arbitrariness

  8. Adam Kilgarriff Methodology Study text “empiricist” (Locke, Hume)‏ Physics: forces, matter Chemistry: chemicals, bonds Language: text, speech signals

  9. Adam Kilgarriff It goes against the grain What is important about a sentence? its meaning Corpus methodology: Throw away individual sentence meaning Find patterns

  10. Adam Kilgarriff Computer power Corpora bigger and bigger data sets Language technology tools lemmatizers, POS-taggers, parsers Machine learning, pattern-finding 20 years of rapid ascent

  11. Adam Kilgarriff All the linguisticses Theoretical Socio Psycho Developmental Law and Computational Contrastive Applied ... linguistics

  12. Adam Kilgarriff Developmental CHILDES, TalkBank How children learn language Parents record all interactions Since 1980s Prof. Brian MacWhinney, Carnegie-Mellon Many languages Largest chunk: English, 23m words

  13. Adam Kilgarriff

  14. Adam Kilgarriff

  15. Adam Kilgarriff

  16. Adam Kilgarriff

  17. Adam Kilgarriff

  18. Adam Kilgarriff

  19. Adam Kilgarriff

  20. Adam Kilgarriff Language change Brown family Small but perfectly formed I m words 500 x 2000-word samples the same 15 text types Supports comparison American and British English 1931, 1961, 1991, 2006

  21. Adam Kilgarriff

  22. Adam Kilgarriff

  23. Adam Kilgarriff

  24. Adam Kilgarriff

  25. Adam Kilgarriff

  26. Adam Kilgarriff Language and gender When you see a dentist <he/she/they> ... What is now normal? Recent study they now the norm themself now needed despite what spellcheck says BNC (most text from 1989) 0.2/million EnTenTen (mostly 2009) 0.4/million

  27. Adam Kilgarriff Language and law Trade marks Hoover and similar trademark or generic Cases sabatier, botox, kettle chips Key evidence Do people tend to capitalize?

  28. Adam Kilgarriff English nouns: % capitalized

  29. Adam Kilgarriff Syntax and semantics

  30. Adam Kilgarriff

  31. Adam Kilgarriff

  32. Adam Kilgarriff DANTE Detailed account of English lexis Corpus-driven From word sketches Lexicographers assign to senses High precision Available at http://webdante.com Brochures

  33. Adam Kilgarriff What data shall I use?

  34. Adam Kilgarriff Think hard

  35. Adam Kilgarriff Sometimes ... Just-in-time corpus from the web Use case: Translator, French-to-English Translation task volcanoes In French I understand it OK, but I'm no vulcanologist, I don't know the English terminology BootCaT, Baroni and Bernardini

  36. Adam Kilgarriff

  37. Adam Kilgarriff

  38. Adam Kilgarriff

  39. Adam Kilgarriff

  40. Adam Kilgarriff

  41. Adam Kilgarriff

  42. Adam Kilgarriff

  43. Adam Kilgarriff

  44. Adam Kilgarriff Corpora in Sketch Engine Access-to-all 42 languages All major world languages Mostly large, web-crawled Various other CHILDES, Brown, ... “My corpora” BootCat and other

  45. Adam Kilgarriff LCL sponsorship of LSA One year free accounts for participants http://www.sketchengine.co.uk “Register” “Site licence member” Your details and Organisation: select LSA2011 Site licence key: Boulder Password by email change it (under Settings)‏

  46. Adam Kilgarriff Today Motivations, taster Sunday 9-12 practical

More Related