CS 541: Artificial Intelligence

1. CS 541: Artificial Intelligence Lecture IV: Logic Agent and First Order Logic

2. Announcement • CA Office Hour: 3:00pm-4:00pm, Lieb 319. • Homework assignment should be checked at Moodle.

3. Schedule

4. Re-cap Lecture III • Constraint Satisfaction Problem • Constraint satisfaction problem (CSP) examples • Backtracking search for CSPs • Problem structure and problem decomposition • Local search for CSPs • Adversarial Search and Games • Games • Perfect play • Minimax decisions • α - βpruning • Resource limits and approximate evaluation • Games of chance • Games of imperfect information

5. Logic Agent Lecture IV: Part I

6. Outline • Knowledge-based agents • Wumpus world • Logic in general—models and entailment • Propositional (Boolean) logic • Equivalence, validity, satisfiability • Inference rules and theorem proving • Forward chaining • Backward chaining • Resolution

7. Knowledge bases • Knowledge base • Set of sentences in a formal language • Declarative approach to building an agent (or other system) • TELL it what is needs to know • Then it can ASK itself what to do • Answers should follow from the KB • Agents can be viewed at the knowledge level • i.e., what they know, regardless of how implemented • Or at the implementation level • i.e., data structures in KB and algorithms that manipulate them

8. A simple knowledge-based agent • The agent must be able to: • Represent states, actions, etc. • Incorporate new percepts • Update internal representations of the world • Deduce hidden properties of the world • Deduce appropriate actions

9. Wumpus world PEAS description • Performance measure • Gold +1000; Death -1000 • -1 per step; -10 for using the arrow • Environment • Squares adjacent to wumpus are smelly • Squares adjacent to pit are breezy • Glitter iff gold is in the same square • Shooting kills wumpus if you are facing it • Grabbing picks up gold if in same square • Releasing drops the gold in same square • Actuators • Left turn, right turn, forward, grab, release, shoot • Sensors • Breeze, glitter, smell

10. Wumpus world characterization • Observable?? • No, only local perception • Deterministic?? • Yes, outcomes exactly specified • Episodic?? • No, sequential at the level of actions • Static?? • Wumpus and pits do not move • Discrete?? • Yes • Single-agent?? • Yes, Wumpus is essentially a natural feature

11. Exploring a wumpus world

12. Exploring a wumpus world

13. Exploring a wumpus world

14. Exploring a wumpus world

15. Exploring a wumpus world

16. Exploring a wumpus world

17. Exploring a wumpus world

18. Exploring a wumpus world

19. Other tight spots • Breeze in (1,2) and (2, 1) • No safe actions • Smell in (1,1) • Cannot move • Can use a strategy of coercion • Shoot straight ahead • Wumpus was theredeadsafe • Wumpus wasn’t there  safe

20. Logic in general • Logics are formal languages for representing information • Such that conclusions can be drawn • Syntax defines the sentences in the language • Semantics define the “meaning” of sentences • i.e., define truth of a sentence in a world • E.g., the language of arithematics • x+2≥y is a sentence; x2+2> is not a sentence • x+2≥y is true iff the number x+2 is no less than the number y • x+2≥y is true in a world where x=7, y=1 • x+2≥y is false in a world where x=0, y=6

21. Entailment • Entailment means that one thing follows from another • Knowledge base KB entails sentence • If and only if is true in all worlds where KB is true • E.g., the KB containing “the giants won” and “the Reds won” entails “Either the Giants won or the Reds won” • E.g., x+y=4 entails 4=x+y • Entailment is a relationship between sentences (i.e., syntax) that is based on semantics • Note: brains process syntax (of some sort)

22. Models • Logicians typically think in terms of models, which are formally structured worlds with respect to which truth can be evaluated • We say m is a model of a sentence • is the set of all models of • Then if and only if • E.g, KB=Giants won and Reds won, and =Giants won

23. Entailment in the wumpus world • Situation after detecting nothing in [1,1], moving right, breeze in [2,1] • Consider possible models for ?s assuming only pits • 3 Boolean choices  8 possible models

24. Wumpus models

25. Wumpus models • KB=wumpus-world rules+observations

26. Wumpus models • KB=wumpus-world rules+observations • =“[1,2] is safe”, , proved by model checking

27. Wumpus models • KB=wumpus-world rules+observations

28. Wumpus models • KB=wumpus-world rules+observations • =“[2,2] is safe”,

29. Inference • = sentence can be derived from KB by procedure i • Consequences of KB are a haystack; is a needle. • Entailment = needle in haystack; inference=finding it! • Soundness: • i is sound if whenever, it is also true that • Completeness: • i is complete if whenever, it is also true that • Preview: • We will define a logic (first-order logic) which is expressive enough to say almost anything of interest, and for which there exists a sound and complete inference procedure • i.e., the procedure will answer any question whose answer follows from what is known about KB

30. Propositional logic: Syntax • Propositional logic is the simplest logic—illustrates basic ideas • The proposition symbols P1, P2 etc. are sentences • If S is a sentence, is a sentence (negation) • If and are sentences, is a sentence (conjunction) • If and are sentences, is a sentence (disjunction) • If and are sentences, is a sentence (implication) • If and are sentences, is a sentence (bicondition)

31. Propositional logic: Semantics • Each model specifies true/false for each proposition symbol • E.g., true true true • With these symbols, 8 possible models, can be enumerated automatically • Rules for evaluating truth with respect to a model m: • is true iff is false • is true iff is true and is true • is true iff is true or is true • is true iff is false or is true i.e., is false iff is true and is false • is true iff is true or is true • Simple recursive process evaluates an arbitrary sentence, e.g.,

32. Truth tables for connectives

33. Wumpus world sentences • Let be true if there is a pit in [i,j] • Let be true if there is a breeze in [i,j] • “Pits cause breezes in adjacent squares” • “A square is breezy if and only if there is an adjacent pit”

34. Truth tables for inference • Enumerate rows (different assignments to symbols) • If KB is true in row, check that is too

35. Inference by enumeration • Depth-first enumeration of all models in sound and complete • for n symbols; problem is co-NP-complete

36. Logical equivalence • Two sentences are logically equivalent iff true in same models: • if and only if and

37. Validity and satisfiability • A sentence is valid if it is true in all models • E.g., • Validity is connected to inference via the Deduction Theorem • if and only if is valid • A sentence is satisfiable if it is true in some models • E.g., • A sentence is unsatisfiableif it is true in no model • E.g., • Satisfiability is connected to inference via the following: • if and only if is unsatisfiable • i.e., prove by reductio ad absurdum

38. Proof methods • Proof methods divide into (roughly) two kinds: • Application of inference rules • Legitimate (sound) generation of new sentences from old • Proof = a sequence of inference rule applications • Can use inference rules as operators in a standard search algorithm • Typically require translation of sentences into a norm form • Model checking • Truth table enumeration (always exponential in n) • Improved backtracking, e.g., Davis-Putnam-Logemann-Loveland (DPLL) • Heurisitc search in model space (sound but incomplete) • E.g., min-conflicts-like hill-climbing algorithms

39. Forward and backward chaining • Horn From (restricted) • KB=conjunction of Horn clauses • Horn clause = • Proposition symbol • (Conjunction of symbols) symbol • E.g., • Modus Ponens (for Horn Form): complete for Horn KBs • Can be used with forward chaining or backward chaining • These algorithms are very natural and run in linear time

40. Forward chaining • Idea: fire any rule whose premises are satisfied in the KB, add its conclusion to the KB, until query is found

41. Forward chaining algorithm

42. Forward chaining example

43. Forward chaining example

44. Forward chaining example

45. Forward chaining example

46. Forward chaining example

47. Forward chaining example

48. Forward chaining example

49. Forward chaining example

50. Proof of completeness • FC derives every atomic sentence that is entailed by KB • FC reaches a fixed point where no new atomic sentences are derived • Consider the final state as a model m, assigning true/false to symbols • Every clause in the original KB is true in m • Proof: Suppose a clause is false in m Then is true in m and b is false in m Therefore the algorithm has not reached a fixed point • Hence m is a model of KB • If , q is true in every model of KB, including m • General idea: construct any model of KB by sound inference, check