1 / 35

LING 388: Language and Computers

LING 388: Language and Computers. Sandiway Fong Lecture 26: 11/28. Administrivia. Last Homework out today due next Tuesday extra credit question No Computer Lab Class on Thursday Lab is not available Homework help is available bring in your laptop. Last Time. Reached a course landmark

holleb
Download Presentation

LING 388: Language and Computers

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. LING 388: Language and Computers Sandiway Fong Lecture 26: 11/28

  2. Administrivia • Last Homework out today • due next Tuesday • extra credit question • No Computer Lab Class on Thursday • Lab is not available • Homework help is available • bring in your laptop

  3. Last Time • Reached a course landmark • we built a simple working translator out of • a Japanese DCG and • an English DCG • possible because • both DCGs were bidirectional – we didn’t have to write both a generator and a parser for each language • let’s review what we did...

  4. Last Time • Tree-to-Tree Mapping • Object wh-Question: • What did John buy sbar(np(what),aux(did),s(np(john),vp(v(buy)))) • taroo-ga nani-o katta ka s(np(taroo),vp(np(nani),v(katta))) • Added a rule for maptree/2 • maptree(sbar(O,_,s(S,vp(V))),s(SJ,vp(OJ,VJ))) :- • je(SJ,S), • je(VJ,V), • je(OJ,O).

  5. English parse tree Japanese parse tree Japanese Grammar English Grammar Japanese sentence English sentence Translator Architecture • tree-to-tree mapping construction-based

  6. Last Time • Predicate-argument • much more simple mapping • also the correspondence dictionary will be more simple too • Example 1 (Declarative case): • John bought a book bought(john,book) • Taroo-ga hon-o katta katta(taroo,hon) • Example 2 (Subject wh-Question): • Who bought a book bought(who,book) • dare-ga hon-o katta ka katta(dare,hon) • Example 3 (Object wh-Question): • What did John buy bought(john,what) • taroo-ga nani-o katta ka katta(taroo,nani)

  7. Translator Architecture • predicate-argument mapping p(A1,A2) construction independent particular-language parse tree independent English predicate-argument structure Japanese predicate-argument structure more advanced: language-independent interlingua Japanese Grammar English Grammar Japanese sentence English sentence

  8. Last Time • Predicate-Argument Structure Mapping • Modified DCG rules (Japanese Grammar): • s(PA) --> np(Y,Q1), nomcase, vp(Z,Q2), sf(Q1,Q2), { predarg(Y,Z,2,PA)}. • vp(vp(Z,Y),Q) --> np(Z,Q), acccase, transitive(Y). • transitive(v(katta)) --> [katta]. • nomcase --> [ga]. • acccase --> [o]. • np(np(taroo),notwh) --> [taroo]. • np(np(hon),notwh) --> [hon]. • np(np(dare),wh) --> [dare]. • np(np(nani),wh) --> [nani]. • sf(wh,notwh) --> [ka]. • sf(notwh,wh) --> [ka]. • sf(notwh,notwh) --> []. • sf(wh,wh) --> [ka]. predarg(X,Y,Order,PA) :- headof(X,S), headof(Y,P), order(Order,Y,NP), headof(NP,O), PA =.. [P,S,O]. order(1,vp(_,NP),NP). order(2,vp(NP,_),NP). headof(np(_,n(N)),N). headof(vp(v(V),_),V). headof(vp(_,v(V)),V). headof(vp(v(V)),V). headof(np(N),N).

  9. DCG rules: sbar(sbar(X,A,Y)) --> np(X,wh), do(A), s_objectwh(Y). sbar(S) --> s(S). s_objectwh(s(Y,Z)) --> np(Y,_), vp_objectwh(Z). s(PA) --> np(Y,_),vp(Z),{predarg(Y,Z,1,PA). np(np(Y),Q) --> pronoun(Y,Q). np(np(Y),notwh) --> proper_noun(Y). np(np(D,N),Q) --> det(D,Number), common_noun(N,Number,Q). det(det(the),_) --> [the]. det(det(a),sg) --> [a]. common_noun(n(ball),sg,notwh) --> [ball]. common_noun(n(man),sg,notwh) --> [man]. common_noun(n(men),pl,notwh) --> [men]. common_noun(n(book),sg,notwh) --> [book]. pronoun(who,wh) --> [who]. pronoun(what,wh) --> [what]. pronoun(i,notwh) --> [i]. pronoun(we,notwh) --> [we]. pronoun(me,notwh) --> [me]. proper_noun(john) --> [john]. vp(vp(Y)) --> unergative(Y). vp(vp(Y,Z)) --> transitive(Y,_), np(Z,_). vp(vp(A,V)) --> aux(A), transitive(V,en). vp_objectwh(vp(Y)) --> transitive(Y,root). unergative(v(ran)) --> [ran]. transitive(v(hit),_) --> [hit]. transitive(v(eat),root) --> [eat]. transitive(v(eats),s) --> [eats]. transitive(v(ate),ed) --> [ate]. transitive(v(eaten),en) --> [eaten]. transitive(v(buy),root) --> [buy]. transitive(v(bought),ed) --> [bought]. aux(aux(was)) --> [was]. do(aux(did)) --> [did]. do(aux(does)) --> [does]. do(aux(do)) --> [do]. English Grammar: Modified

  10. Mapping: Predicate-Argument Structure • Task 2: • Modify the English grammar to also generate predicate argument structure • Modified English DCG Rule: • s(PA) --> np(X), vp(Y), { predarg(X,Y,1,PA)}. • Applies to: • John bought a book bought(john,book) • Who bought a book bought(who,book)

  11. Mapping: Predicate-Argument Structure • Task 2: • Modify the English grammar to also generate predicate argument structure • Example 3 (Object wh-Question): • What did John buy buy(john,what) • Modified SBar rules: • sbar(PA) --> np(X,wh), do(A), s_objectwh(Y,S,P), {headof(X,O),PA =.. [P,S,O]}. • s_objectwh(s(Y,Z),S,P) --> np(Y,_), vp_objectwh(Z), {headof(Y,S),headof(Z,P)}. • vp_objectwh(vp(Y)) --> transitive(Y,root). sbar np s aux what np vp did v john buy • sbar(np(what),aux(did),s(np(john),vp(v(buy))))

  12. DCG rules: sbar(PA) --> np(X,wh), do(A), s_objectwh(_,S,P), {headof(X,O), PA =.. [P,S,O]}. sbar(S) --> s(S). s_objectwh(s(Y,Z),S,P) --> np(Y,_), vp_objectwh(Z), {headof(Y,S),headof(Z,P)}. s(PA) --> np(Y,_),vp(Z),{predarg(Y,Z,1,P)}. np(np(Y),Q) --> pronoun(Y,Q). np(np(Y),notwh) --> proper_noun(Y). np(np(D,N),Q) --> det(D,Number), common_noun(N,Number,Q). det(det(the),_) --> [the]. det(det(a),sg) --> [a]. common_noun(n(ball),sg,notwh) --> [ball]. common_noun(n(man),sg,notwh) --> [man]. common_noun(n(men),pl,notwh) --> [men]. common_noun(n(book),sg,notwh) --> [book]. pronoun(who,wh) --> [who]. pronoun(what,wh) --> [what]. pronoun(i,notwh) --> [i]. pronoun(we,notwh) --> [we]. pronoun(me,notwh) --> [me]. proper_noun(john) --> [john]. vp(vp(Y)) --> unergative(Y). vp(vp(Y,Z)) --> transitive(Y,_), np(Z,_). vp(vp(A,V)) --> aux(A), transitive(V,en). vp_objectwh(vp(Y)) --> transitive(Y,root). unergative(v(ran)) --> [ran]. transitive(v(hit),_) --> [hit]. transitive(v(eat),root) --> [eat]. transitive(v(eats),s) --> [eats]. transitive(v(ate),ed) --> [ate]. transitive(v(eaten),en) --> [eaten]. transitive(v(buy),root) --> [buy]. transitive(v(bought),ed) --> [bought]. aux(aux(was)) --> [was]. do(aux(did)) --> [did]. do(aux(does)) --> [does]. do(aux(do)) --> [do]. English Grammar: Modified

  13. Mapping: Predicate-Argument Structure • queries • ?- sbar(X,[what,did,john,buy],[]). • X = buy(john,what) • ?- sbar(X,[who,bought,a,book],[]). • X = bought(who,book) • ?- sbar(X,[who,bought,what],[]). • X = bought(who,what) • uniform structures

  14. Translator Architecture • predicate-argument mapping p(A1,A2) construction independent particular-language parse tree independent English predicate-argument structure Japanese predicate-argument structure Japanese Grammar English Grammar Japanese sentence English sentence

  15. Translation • Translation code: • translate(E,J) :- • sbar(X,E,[]), % English grammar • mapPA(X,Xp), % Map predicate-argument • js(Xp,J,[]). % Japanese grammar • mapPA/2 replaces maptree/2 • easier to write • general form: p(A1,A2) • just have to translate terms p, A1 and A2 into the other language • Example: • John bought a book bought(john,book) • Taroo-ga hon-o katta katta(taroo,hon)

  16. Translation • example • John bought a book bought(john,book) • Taroo-ga hon-o katta katta(taroo,hon) • mapPA/2 • mapPA(E,J) :- • E =.. [P,S,O], • je(PJ,P), • je(SJ,S), • je(OJ,O), • J =.. [PJ,SJ,OJ]. • Bilingual Dictionary (Word Correspondences) • je(katta,bought). • je(hon,book). • je(taroo,john). • je(dare,who). • je(nani,what). • je(katta,buy).

  17. Translation • example • John bought a book bought(john,book) • Taroo-ga hon-o katta katta(taroo,hon) • mapPA/2 • mapPA(E,J) :- E = bought(john,book) • E =.. [P,S,O], P = bought, S = john, O = book • je(PJ,P), PJ = katta • je(SJ,S), SJ = taroo • je(OJ,O), OJ = hon • J =.. [PJ,SJ,OJ]. J = katta(taroo,hon) • Bilingual Dictionary (Word Correspondences) • je(katta,bought). • je(hon,book). • je(taroo,john). • je(dare,who). • je(nani,what). • je(katta,buy). • Tree-to-tree mapping dictionary • je(v(katta), v(bought)). • je(np(hon), np(_,n(book))). • je(np(taroo),np(john)). • je(np(dare), np(who)). • je(np(nani), np(what)).

  18. Translation • translation code • translate(E,J) :- • sbar(X,E,[]), % English grammar • mapPA(X,Xp), % Map predicate-argument • js(Xp,J,[]). % Japanese grammar • example • John bought a book bought(john,book) • Taroo-ga hon-o katta katta(taroo,hon) • computation • ?- translate([john,bought,a,book],J). • ?- sbar(X,[john,bought,a,book],[]). % English grammar • ?- sbar(bought(john,book),[john,bought,a,book],[]). • ?-mapPA(bought(john,book),Xp). % Map predicate-argument • ?-mapPA(bought(john,book),katta(taroo,hon)). • ?- js(katta(taroo,hon),J,[]). % Japanese grammar • ?- js(katta(taroo,hon),[taroo,ga,hon,o,katta],[]). • ?- translate([john,bought,a,book], [taroo,ga,hon,o,katta]).

  19. Homework 7

  20. Files

  21. DCG rules sbar(PA) --> np(X,wh), do(_,_), s_objectwh(_,S,P), {headof(X,O), PA =..[P,S,O]}. sbar(S) --> s(S). s_objectwh(s(Y,Z),S,P) --> np(Y,_), vp_objectwh(Z), {headof(Y,S),headof(Z,P)}. s(PA) --> np(Y,_), vp(Z,_), {predarg(Y,Z,1,PA)}. np(np(Y),Q) --> pronoun(Y,Q). np(np(Y),notwh) --> proper_noun(Y). np(np(D,N),Q) --> det(D,Number), common_noun(N,Number,Q). vp(vp(v(died)),ed) --> [kicked,the,bucket]. vp(vp(Y,Z),F) --> transitive(Y,F), np(Z,_). vp(vp(A,V),F) --> aux(A,F), transitive(V,en). vp_objectwh(vp(Y)) --> transitive(Y,root). det(det(the),_) --> [the]. det(det(a),sg) --> [a]. common_noun(n(bucket),sg,notwh) --> [bucket]. common_noun(n(buckets),pl,notwh) --> [buckets]. common_noun(n(apple),sg,notwh) --> [apple]. common_noun(n(apples),pl,notwh) --> [apples]. common_noun(n(man),sg,notwh) --> [man]. common_noun(n(book),sg,notwh) --> [book]. common_noun(n(books),pl,notwh) --> [books]. English Grammar: e.pl

  22. pronoun(who,wh) --> [who]. pronoun(what,wh) --> [what]. proper_noun(john) --> [john]. transitive(v(eats),s) --> [eats]. transitive(v(ate),ed) --> [ate]. transitive(v(eaten),en) --> [eaten]. transitive(v(buy),root) --> [buy]. transitive(v(buys),s) --> [buys]. transitive(v(bought),ed) --> [bought]. transitive(v(bought),en) --> [bought]. transitive(v(kicks),s) --> [kicks]. transitive(v(kicked),ed) --> [kicked]. transitive(v(kicked),en) --> [kicked]. aux(aux(was),ed) --> [was]. aux(aux(is),s) --> [is]. do(aux(does),s) --> [does]. do(aux(did),ed) --> [did]. English Grammar: e.pl

  23. Japanese Grammar: j.pl • DCG Rules • s(PA) --> np(Y,Q1), nomcase, vp(Z,Q2), sf(Q1,Q2), {predarg(Y,Z,2,PA)}. • vp(vp(Z,Y),Q) --> np(Z,Q), acccase, transitive(Y). • transitive(v(katta)) --> [katta]. • nomcase --> [ga]. • acccase --> [o]. • np(np(taroo),notwh) --> [taroo]. • np(np(hon),notwh) --> [hon]. • np(np(dare),wh) --> [dare]. • np(np(nani),wh) --> [nani]. • sf(wh,notwh) --> [ka]. • sf(notwh,wh) --> [ka]. • sf(notwh,notwh) --> []. • sf(wh,wh) --> [ka]. • predarg(X,Y,Order,PA) :- • headof(X,S), • headof(Y,P), • order(Order,Y,NP), • headof(NP,O), • PA =.. [P,S,O]. • predarg(X,Y,_,PA) :- • headof(X,S), • headof(Y,P), • Y = vp(_), • PA =.. [P,S]. • order(1,vp(_,NP),NP). • order(2,vp(NP,_),NP). • headof(np(_,n(N)),N). • headof(vp(v(V),_),V). • headof(vp(_,v(V)),V). • headof(vp(v(V)),V). • headof(np(N),N). bilingual predicate-argument structure code stored in j21.pl but used by both grammars

  24. Translator: t.pl • Prolog translation code • translate(E,J) :- % Translator • sbar(X,E,[]), % English grammar • mapPA(X,Xp), • js(Xp,J,[]). % Japanese grammar • mapPA(E,J) :- % Map predicate-argument • E =.. [P,S,O], • je(PJ,P), • je(SJ,S), • je(OJ,O), • J =.. [PJ,SJ,OJ]. • je(katta,bought). % Bilingual dictionary • je(hon,book). • je(taroo,john). • je(dare,who). • je(nani,what). • je(katta,buy).

  25. Exercise 0: Translation • load all 3 files e.pl, j.pl and t.pl into the Prolog system • preliminary exercise • (don’t submit): • verify both parsers works individually by running the following sentences: • John bought the books • Taroo-ga hon-o katta • verify the translator works by running • Taroo-ga hon-o katta • and see how many English translations are reported • run the translator in reverse

  26. Question 1: Translation • Homework Question • using the debugger (?-spy(sbar).) for the Japanese example: • taroo-ga hon-o katta • (A) (1pt) • How many English sentences are explored by the translator before a compatible sentence is found? • (B) (2pts) • How would you rewrite translate/2 to avoid this inefficiency for the Japanese ➙ English direction • submit your definition of translate/2

  27. Question 2: Tense • Homework Question • Tense and predicate-argument structure • let’s expand the grammar slightly • assume kau (buy(s)) is the present tense form of katta (bought) • (5pts) • Modify the translator to respect tenses when translating between • John buys a book taroo-ga hon-o kau • John bought a book taroo-ga hon-o katta • submit both your code and all relevant translations, e.g. • ?- translate([john,buys,a,book],X). • ?- translate(X,[taroo,ga,hon,o,kau]).

  28. Question 3: Yes-No Questions • example: • Did John buy the books? • auxiliary do preceding subject signals the yes-no question • assume predicate-argument structure: • yesno(buy(john,books)) • example (Japanese): • Taroo-ga hon-o katta ka • ka = question particle • predicate-argument structure: • yesno(katta(taroo,hon))

  29. Question 3: Yes-No Questions • Homework Question • (A) (8pts) • modify the English and Japanese grammars to incorporate yes-no questions • modify the translator to operate on yes-no questions • submit your code and examples using: • Did John buy a book? yesno(buy(john,book)) • Taroo-ga hon-o katta kayesno(katta(taroo,hon))

  30. Idioms • idioms • non-composition meaning • i.e. meaning of idiom cannot be inferred from the meaning of the constitutive words • examples • John kicked the bucket • VP “kicked the bucket” • has a literal interpretation • has an idiomatic interpretation “John died” • Pete gave me the cold shoulder • VP “give X the cold shoulder” • has an (unlikely) literal interpretation • has a (more likely) idiomatic interpretation “be unfriendly towards X” • (French) • cassé sa pipe • (literal) break his pipe • (idiomatic) died

  31. examples John kicked the bucket VP “kicked the bucket” has a literal interpretation has an idiomatic interpretation “John died” John kicked the buckets VP “kicked the buckets” has only a literal interpretation English grammar modifications: verb: kicked transitive(v(kicked),ed) --> [kicked]. transitive(v(kicked),en) --> [kicked]. common noun: bucket(s) common_noun(n(bucket),sg,notwh) --> [bucket]. common_noun(n(buckets),pl,notwh) --> [buckets]. queries ?- sbar(X,[john,kicked,the,bucket],[]). X = kicked(john,bucket) ?- sbar(X,[john,kicked,the,buckets],[]). X = kicked(john,buckets) Literal meanings only Idioms

  32. Idioms • examples • John kicked the bucket • VP “kicked the bucket” • has a literal interpretation • has an idiomatic interpretation “John died” • John kicked the buckets • VP “kicked the buckets” • has only a literal interpretation • idiomatic interpretation • Verb Phrase: kicked the bucket • vp(vp(v(died))) --> [kicked,the,bucket]. • Predicate-Argument structure (intransitive verbs) • predarg(X,Y,_,PA) :- • headof(X,S), • headof(Y,P), • Y = vp(_), • PA =.. [P,S]. predarg(X,Y,Order,PA) :- headof(X,S), headof(Y,P), order(Order,Y,NP), headof(NP,O), PA =.. [P,S,O]. order(1,vp(_,NP),NP). order(2,vp(NP,_),NP). headof(np(_,n(N)),N). headof(vp(v(V),_),V). headof(vp(_,v(V)),V). headof(vp(v(V)),V). headof(np(N),N).

  33. Idioms • example • John kicked the bucket • VP “kicked the bucket” • has a literal interpretation • has an idiomatic interpretation “John died” • John kicked the buckets • VP “kicked the buckets” • has only a literal interpretation • queries • ?- sbar(X,[john,kicked,the,bucket],[]). • X = died(john) ? ; • X = kicked(john,bucket) ? ; • ?- sbar(X,[john,kicked,the,buckets],[]). • X = kicked(john,buckets) ? ; • no

  34. Question 4: English Idiom • example • John kicked the bucket • the VP “kicked the bucket” • has a literal interpretation and an idiomatic interpretation “John died” • vp(vp(v(died))) --> [kicked,the,bucket]. • (6pts) • Complete the translator so that • John kicked the bucket • has both a literal and an idiomatic translation • Taroo-ga buketsu-o ketta • Taroo-ga shinda • buketsu = bucket • shinda = died ketta = kicked • John kicked the buckets • has only a literal translation • Taroo-ga buketsu-o ketta (assuming Japanese does not distinguish number)

  35. extra credit question example taroo-ga saji-o nageta taroo-nom spoon-acc threw “John threw the spoon” (literal) “Johngaveup” (idiomatic) Homework Question: (8pts) Implement the example and the idiomatic and the literal translations submit code and examples Question 5: Japanese Idiom

More Related