Dr. Douglas B. Lenat , 3721 Executive Center Drive, Suite 100, Austin, TX 78731

1. Upper Ontology Symposium Formal Ontologies: Dr. Douglas B. Lenat , 3721 Executive Center Drive, Suite 100, Austin, TX 78731 Email: Lenat@cyc.com Phone: (512) 342-4001 2 July 2005

2. Upper Ontology Symposium Formal Ontologies: Can Anything With That Title be Understandable or Interesting? Dr. Douglas B. Lenat , 3721 Executive Center Drive, Suite 100, Austin, TX 78731 Email: Lenat@cyc.com Phone: (512) 342-4001 2 July 2005

3. Upper Ontology Symposium Formal Ontologies: Can Anything With That Title be Understandable or Interesting? The basic idea: Get the computer to understand, not just store, information. Then it can reason to answer queries, search, translate, transcribe speech, etc. 2 July 2005

4. Contrast: With NO Formal Ontology… … programs are lucky to even have the appearance of understanding, a thin veneer of intelligence. E.g., ELIZA. The basic idea: Get the computer to understand, not just store, information. Then it can reason to answer queries, search, translate, transcribe speech, etc. 2 July 2005

5. ELIZA (DOCTOR) 1965 Joe Weizenbaum, MIT Simulation/Parody of reflection psychotherapy Patient: “I swear a lot.” “How do you feel about the fact that you swear a lot?” Carl Rogers Patient: “My dog’s mother died recently.” “Tell me more about your mother.”

6. ELIZA (DOCTOR) “blah blah blah mother blah blah blah” Patient: “My dog’s mother died recently.” “Tell me more about your mother.”

7. ELIZA (DOCTOR) “blah blah blah mother blah blah blah” Patient: “My dog’s mother died recently.” “Tell me more about your mother.”

8. ELIZA (DOCTOR) “blah blah blah mother blah blah blah” Patient: “My dog’s mother died recently.” “Tell me more about your mother.”

9. ELIZA (DOCTOR) “blah blah blah mother blah blah blah” Patient: “My dog’s mother died recently.” “Tell me more about your mother.”

10. ELIZA (DOCTOR) “blah blah blah mother blah blah blah” Patient: “My dog’s mother died recently.” “Tell me more about your mother.”

11. ELIZA (DOCTOR) “blah blah blah mother blah blah blah” Patient: “My dog’s mother died recently.” “Tell me more about your mother.”

12. ELIZA (DOCTOR) “blah blah blah mother blah blah blah” Patient: “My dog’s mother died recently.” “Tell me more about your mother.”

13. ALICE (today!!) • JUDGE11[9:26:0]I WILL ASK YOU SOME SIMPLE QUESTIONS AND GIVE SIMPLE COMMANDS • PROGRAM[9:26:0]Do you think your plan will succeed? • JUDGE11[9:26:16]WHAT IS THE COLOR OF A BLUE CAR • PROGRAM[9:26:16]WHAT COLOR IS a blue car • JUDGE11[9:26:35]WHERE IS SUE’S NOSE WHEN SUE IS IN HER HOUSE • PROGRAM[9:26:35]Where it belongs. • Try searching the Web.

16. From the User’s POV • The user has a question they want answered • The data needed to answer it is available to them, but not in one single, obvious, reliable place • The answers follow logically (and/or arithmetically) from m elements in n sources • Don’t want to have to know, ahead of time, what sources to go to, how to access them, how to combine the intermediate results. • Do want to be able to limit, ahead of time, the uncertainty, recency, granularity, ideology… (and/or see such meta-level info for each answer) “Which first-run movies star a teenager born in Texas and are showing today at a theater < 10 minutes’ drive from this building?”

17. MicrowaveOven is a type of Kitchen-Appliance Dishwasher is a type of Kitchen-Appliance The basic idea: Get the computer to understand, not just store, information. Then it can reason to answer your queries. 2 July 2005

18. Rthagide-disjaks is a type of Kitchen-Appliance Gracinimumples is a type of Kitchen-Appliance The basic idea: Get the computer to understand, not just store, information. Then it can reason to answer your queries. 2 July 2005

19. Rthagide-disjaks is a type of Kitchen-Appliance Gracinimumples is a type of Kitchen-Appliance Rthagide-disjaks requires Electricity. Gracinimumples requires Electricity and Water. The basic idea: Get the computer to understand, not just store, information. Then it can reason to answer your queries. 2 July 2005

20. Rthagide-disjaks is a type of Kitchen-Appliance Gracinimumples is a type of Kitchen-Appliance Rthagide-disjaks requires Vorawnistz. Gracinimumples requires Vorawnistz and Buzqa. The basic idea: Get the computer to understand, not just store, information. Then it can reason to answer your queries. 2 July 2005

21. Rthagide-disjaks is a type of Kitchen-Appliance Gracinimumples is a type of Kitchen-Appliance Rthagide-disjaks requires Vorawnistz. Gracinimumples requires Vorawnistz and Buzqa. Buzqa is a Liquid and supplied through Pipes. The basic idea: Get the computer to understand, not just store, information. Then it can reason to answer your queries. 2 July 2005

22. Rthagide-disjaks is a type of Kitchen-Appliance Gracinimumples is a type of Kitchen-Appliance Rthagide-disjaks requires Vorawnistz. Gracinimumples requires Vorawnistz and Buzqa. Buzqa is a Thwarn and supplied through Epluns. The basic idea: Get the computer to understand, not just store, information. Then it can reason to answer your queries. 2 July 2005

23. Eventually, after writing millions of these rules, the system knows as much about pipes, liquids, water, electricity, microwave ovens, dishwashers, etc. as you and I do. (In Technospeak: eventually there is just one interpretation of that model.) The basic idea: Get the computer to understand, not just store, information. Then it can reason to answer your queries. 2 July 2005

24. Example:Google How could it be more powerful if it were formal (had some understanding)? The basic idea: Get the computer to understand, not just store, information. Then it can reason to answer your queries. 2 July 2005

25. How formalized knowledge helps search Query: “Show me pictures of strong and adventurous people” Caption: “A man climbing a rock face” find information by inference (+KB)

26. How formalized knowledge helps search Query: “Outdoor explosions in terrorist events Lebanon between 1990 and 2001” Document: “1993 pipe bombing on the patio of the Beirut Hilton coffee shop.” Text Document find information by inference (+KB)

27. both general and domain knowledge How formalized knowledge helps search ^ Query: “Threats to low-flying US airliners in Lebanon” Document: “Hizballah buys ten SA-7’s.” Text Document find information by inference (+KB)

28. vets Web Results 1 -25 Revise New Search vets: 25,947 matches 1.Photographs of Cyclo-Vets @ work 2.Veterans National Archives 3.Recommended Vets for Hamster Owners 4.Sponsors on Vets On Line 5.Pops Place BBS Index Page • Do you mean: • vets (military veteran) • vets (veterinary surgeon)

29. Web Results 1 -25 Revise New Search vets: 25,947 matches 1.Photographs of Cyclo-Vets @ work 2.Veterans National Archives 3.Recommended Vets for Hamster Owners 4.Sponsors on Vets On Line 5.Pops Place BBS Index Page (ex-serviceman OR ”mili • Do you mean: • vets (military veteran) • vets (veterinary surgeon) (ex-serviceman OR "military veteran") OR vet OR veteran AND NOT (veterinarian OR "veterinary surgeon" OR “animal doctor”

30. 1. Veterans News and Information Service - Military, Army, Navy, Marine Corps, Air Force, Coast Guard 2.Surf Point - Society & Issues: Military/Armed Forces: War Veterans 3.AVet Remembers 4.Retail and Wholesale Merchants of Military/ Veteran Goods and Services (ex-serviceman OR ”mili • Do you mean: • vets (military veteran) • vets (veterinary surgeon) (ex-serviceman OR "military veteran") OR vet OR veteran AND NOT (veterinarian OR "veterinary surgeon" OR “animal doctor” Web Results 1 -25 Revise New Search vets: 25,947 matches vets: 388,109 matches

31. vets Web Results 1 -25 Revise New Search vets: 25,947 matches 1.Photographs of Cyclo-Vets @ work 2.Veterans National Archives 3.Recommended Vets for Hamster Owners 4.Sponsors on Vets On Line 5.Pops Place BBS Index Page • Do you mean: • vets (military veteran) • vets (veterinary surgeon)

32. Web Results 1 -25 Revise New Search vets: 25,947 matches 1.Photographs of Cyclo-Vets @ work 2.Veterans National Archives 3.Recommended Vets for Hamster Owners 4.Sponsors on Vets On Line 5.Pops Place BBS Index Page veterinarian OR “veteri • Do you mean: • vets (military veteran) • vets (veterinary surgeon) veterinarian OR "veterinary surgeon" OR “animal doctor” AND NOT (ex-serviceman OR "military veteran" OR veteran)

33. 1.Veterinary Book List 2.Advice from The White Cross Veterinary Group 3.Welcome to the World of Eco-Vet 4.Animal Wellness International 5.The economy or management of animals veterinarian OR “veteri • Do you mean: • vets (military veteran) • vets (veterinary surgeon) veterinarian OR "veterinary surgeon" OR “animal doctor” AND NOT (ex-serviceman OR "military veteran" OR veteran) Web Results 1 -25 Revise New Search vets: 25,947 matches vets: 153,060 matches

34. Find and clean (consistency-check) information by inference (+KB)

35. Find and clean (consistency-check) information by inference (+KB)

36. How can our programs be intelligent, not merely have the veneer of it? • ANSWER: By having – and being able to apply, not just store – a large corpus of knowledge, spanning the gamut from specific domain-dependent all the way up to general common sense. • E.g., consider the task of getting a program to understand natural language. How would having lots of machine-usable knowledge help?

37. Natural Language Understanding requires having lots of knowledge 1. The pen is in the box. The box is in the pen. 2. The police watched the demonstrators… …because they feared violence. …because they advocated violence.

38. Natural Language Understanding requires having lots of knowledge 3. Mary and Sue are sisters. Mary and Sue are mothers.

39. Natural Language Understanding requires having lots of knowledge 4. Every American has a mother. Every American has a president. 5. John saw his brother skiing on TV. The fool… ...didn’t have a coat on! …didn’t recognize him!

40. Natural Language Understanding requires having lots of knowledge 6. George Burns: “My aunt is in the hospital. I went to see her today, and took her flowers.” Gracie Allen: “George, that’s terrible! You should have brought her flowers!” Took Table Sanction . . .

41. What is this “knowledge”? Millions of facts, rules of thumb, etc. Represented as sentences in some language If the language is Logic, computers can do the deductive reasoning automatically, themselves The sentences are all composed of words; the full list of words is what we call the ontology The sentences, expressed in logic, are formal That’s why we call the words (terms) and logic sentences (axioms) about them a formal ontology

42. Organize Terms into an Ontology Vehicle Water Vehicle Surface Vehicle Submarine Vehicle Surface Water Vehicle Overland Vehicle Tracked Vehicle Wheeled Vehicle Railed Vehicle Truck INSTANCE Truck#809726543

43. Driven by a trained adult human Can’t control its altitude Leaves tracks Attach Facts/Rules/... to the Nodes (inherit knowledge through class hierarchy) Vehicle Vehicle Water Vehicle Water Vehicle Surface Vehicle Surface Vehicle Submarine Vehicle Submarine Vehicle Surface Water Vehicle Surface Water Vehicle Overland Vehicle Overland Vehicle Tracked Vehicle Tracked Vehicle Wheeled Vehicle Wheeled Vehicle Railed Vehicle Railed Vehicle Truck Truck INSTANCE INSTANCE Truck#809726543 Truck#809726543

44. Slow down in bad weather Move each rule to the best place Vehicle Vehicle Driven by a trained adult human Water Vehicle Water Vehicle Surface Vehicle Surface Vehicle Can’t control its altitude Submarine Vehicle Submarine Vehicle Surface Water Vehicle Surface Water Vehicle Overland Vehicle Overland Vehicle Tracked Vehicle Tracked Vehicle Wheeled Vehicle Wheeled Vehicle Railed Vehicle Railed Vehicle Truck Truck INSTANCE INSTANCE Leaves tracks Truck#809726543 Truck#809726543

45. Move each rule to the best place Vehicle Vehicle Driven by a trained adult human Water Vehicle Water Vehicle Surface Vehicle Surface Vehicle Can’t control its altitude Submarine Vehicle Submarine Vehicle Surface Water Vehicle Surface Water Vehicle Overland Vehicle Overland Vehicle Slow down in bad weather Tracked Vehicle Tracked Vehicle Wheeled Vehicle Wheeled Vehicle Railed Vehicle Railed Vehicle Truck Truck INSTANCE INSTANCE Leaves tracks Truck#809726543 Truck#809726543

46. Move each rule to the best place Vehicle Vehicle Driven by a trained adult human Water Vehicle Water Vehicle Surface Vehicle Surface Vehicle Can’t control its altitude Submarine Vehicle Submarine Vehicle Surface Water Vehicle Surface Water Vehicle Overland Vehicle Overland Vehicle Slow down in bad weather Tracked Vehicle Tracked Vehicle Wheeled Vehicle Wheeled Vehicle Railed Vehicle Railed Vehicle Truck Truck INSTANCE INSTANCE Leaves tracks Truck#809726543 Truck#809726543

47. What do we mean “represent it in logic”? (isa Socrates Man) “Socrates is a man” (genls Man Mortal) “all men are mortal” (ForAll ?x “all men are mortal” (implies (isa ?x Man) (isa ?x Mortal))) (ForAll ?x “each person has a mother who’s a female person” (implies (isa ?x Person) (ThereExists ?y (and (isa ?y FemalePerson) (mother ?x ?y)))))

48. What do we mean “it can reason”? Simple: (isa Socrates Man) (ForAll ?x (implies (isa ?x Man) (isa ?x Mortal))) Harder: Using general and specific knowledge: Can a can can-can? Very complex: An example from our AKB (Analyst’s Knowledge Base)

49. What do we mean “it can reason”? Simple: (isa Socrates Man) (ForAll ?x (implies (isa ?x Man) (isa ?x Mortal))) (isa Socrates Mortal) Harder: Using general and specific knowledge: Can a can can-can? Very complex: An example from our AKB (Analyst’s Knowledge Base)

50. Can a can can-can?