Hindi Syntax Annotating Dependency, Lexical Predicate-Argument Structure, and Phrase Structure

1. Hindi SyntaxAnnotating Dependency, Lexical Predicate-Argument Structure, and Phrase Structure Martha Palmer (University of Colorado, USA) Rajesh Bhatt (U of Massachusetts, Amherst, USA) Bhuvana Narasimhan (University of Colorado, USA) Owen Rambow (Columbia University, New York, USA) Dipti Misra Sharma (IIIT Hyderabad, India) Fei Xia (U Washington, USA) bhatt@linguist.umass.edu

2. Outline • A Multi-Representational Treebank for Hindi/Urdu • Three Representations • Dependency • Proposition Bank • Phrase Structure • Constructions • Basic Clause Structure • Unaccusative • Support Verbs

3. Dependency and Phrase Structure: Types of Trees (Reminder) • Dependency: all nodes are labeled with words or empty strings • Phrase structure: leaf nodes are labeled with words or empty strings, internal nodes are labeled with nonterminal symbols (special alphabet)

4. Motivation 1: Two Representations • Both phrase-structure treebanks and dependency treebanks are used in NLP • Collins/Charniak/Bikel parser for PS • CoNLL task on dependency parsing • Problem: currently few treebanks (no?) with PS and DS which are independently motivated • Our project: build treebank for Hindi/Urdu for which PS and DS are linguistically motivated from the outset • Dependency: Paninian grammar (Panini 400 BC) • Phrase structure: variant of Minimalism (Chomsky 1995)

5. Motivation 2: Two Content Levels • Everyone (?) wants syntax • Recent popularity of PropBank (Palmer et al 2002): lexical predicate-argument structure; “semantics as surfacy as it gets” • Recent experience: PropBank may inform some treebanking decisions • Our project: build treebank with all levels from the outset

6. The Multi-Representational Hindi/Urdu Treebanking Project Representation (How) manual manual automatic automatic Devise all levels of representations simultaneously!

7. Outline • A Multi-Representational Treebank for Hindi/Urdu • Three Representations • Dependency • Proposition Bank • Phrase Structure • Constructions • Basic Clause Structure • Unaccusative • Support Verbs

8. Hindi Paninian Framework(Dipti Sharma, Hyderabad) • There are 6 main karakas (karaka relations): • karata(k1):Activity of the verb resides in karta. • karma(k2):Result of the verb resides in karma. • karana(k3):Instrument helping in achieving the activity of the verb is karana • sampradaan(k4):Receiver of the action is sampradaan • apaadan(k5):Point of separation from which an entity has moved away in an action is apaadan • adhikaran (k7):Place (k7p) or time (k7t) where the action is located

9. Full Set of Relations

10. Sample Paninian Analysis

11. Basic Clause Structure

12. Basic Clause Structure: Dependency Structure पढ़ा k1 k2 किताब-को अतिफ़-ने

13. Outline • A Multi-Representational Treebank for Hindi/Urdu • Three Representations • Dependency • Proposition Bank • Phrase Structure • Constructions • Basic Clause Structure • Unaccusative • Support Verbs

14. PropBank:Lexical Semantic Annotation • Dependency annotation on top of DS - PropBank is a dependency representation, but the arc labels are different from DS • Captures diathesis alternations: • John loaded the cart with hay. • John loaded hay on the cart. hay has same relation to predicate load in all these sentences • PropBank annotates verb-meaning specific verbal roles • Palmer et al 2004

15. Basic Clause Structure: PropBank पढ़ा Roleset: पढ़ना.01 Arg0 Arg1 अतिफ़-ने किताब-को

16. Phrase Structure • Inspired by Chomskyan Principles-and-Parameters approach • Binary branching • Small number of nonterminals • Key structural assumptions: • Only two marked argument positions for verbs, all other NPs are adjuncts and can appear anywhere • Use of traces for displacement from normal position • Case assigned under c-command

17. Basic Clause Structure:Phrase Structure

18. Outline • A Multi-Representational Treebank for Hindi/Urdu • Three Representations • Dependency • Proposition Bank • Phrase Structure • Constructions • Unaccusative • Support Verb Constructions

19. Unaccusatives

20. Unaccusative: Dependency Structure खुल गया K1 दरवाज़ा

21. Unaccusative: PropBank खुल गया arg1 दरवाज़ा

22. Unaccusative: Phrase Structure

23. Outline • A Multi-Representational Treebank for Hindi/Urdu • Three Representations • Dependency • Proposition Bank • Phrase Structure • Constructions • Unaccusative • Support Verb Constructions

24. Support Verb Constructions

25. Support Verb Constructions: Dependency Structure हो गये k2 pof गहनें चोरी

26. Support Verb Constructions: PropBank

27. Support Verb Constructions: Phrase Structure

28. Where we are now • DS and PS guidelines nearly complete • PropBank guidelines under development • Automatic conversion from DS + PropBank in progress. We have initial experimental results • Close co-operation in development of the three components essential