CS6382 Theory of Computation

1. CS6382 Theory of Computation Ding-Zhu Du Office: ECSS 3-611, M 3:15-4:30 Lecture: ECSS 2.311, MW 12:30-1:45

2. Text Books • Ding-Zhu Du and Ker-I Ko, Theory of Computational Complexity, John-Wiley, 2 000. (Main) • Ding-Zhu Du and Ker-I Ko, Problem Solving in Automata, Languages and Complexity, John-Wiley, 2001. (Reference)

3. Part I Theory of Deterministic Computation

4. tape head Finite Control Lecture 1Deterministic Turing Machine (DTM)

5. e p h B a l a The tape has the left end but infinite to the right. It is divided into cells. Each cell contains a symbol in an alphabet Γ. There exists a special symbol B which represents the empty cell.

6. a • The head scans at a cell on the tape and can read, erase, and write a symbol on the cell. In each move, the head can move to the right cell or to the left cell (or stay in the same cell).

7. The finite control has finitely many states which form a set Q. For each move, the state is changed according to the evaluation of a transition function δ : Q x Γ → Q x Γ x {R, L}.

8. b a • δ(q, a) = (p, b, L) means that if the head reads symbol a and the finite control is in the state q, then the next state should be p, the symbol a should be changed to b, and the head moves one cell to the left. q p

9. a b q p • δ(q, a) = (p, b, R) means that if the head reads symbol a and the finite control is in the state q, then the next state should be p, the symbol a should be changed to b, and the head moves one cell to the right.

10. There are some special states: an initial state s and an final states h. • Initially, the DTM is in the initial state and the head scans the leftmost cell. The tape holds an input string. s

11. x h • When the DTM is in the final state, the DTM stops. An input string x is accepted by the DTM if the DTM reaches the final state h. • Otherwise, the input string is rejected.

12. The DTM can be represented by M = (Q, Σ, Γ, δ, s) where Σ is the alphabet of input symbols. • The set of all strings accepted by a DTM M is denoted by L(M). We also say that the language L(M) is accepted by M.

13. The transition diagram of a DTM is an alternative way to represent the DTM. • For M = (Q, Σ, Γ, δ, s), the transition diagram of M is a symbol-labeled digraphG=(V, E) satisfying the following: V = Q (s = , h = ) E = { p q | δ(p, a) = (q, b, D)}. a/b,D

14. 1/1,R 0/0,R; 1/1,R 0/0,R 0/0,R B/B,R s p q h 1/1,R M=(Q, Σ, Γ, δ, s) where Q = {s, p, q, h}, Σ = {0, 1}, Г = {0, 1, B}. δ 0 1 B s (p, 0, R) (s, 1, R) - p (q, 0, R) (s, 1, R) - q (q, 0, R) (q, 1, R) (h, B, R) L(M) = (0+1)*00(0+1)*.

15. Theorem. Every regular set can be accepted by a DTM. Proof. • Every regular set can be accepted a deterministic finite automata (DFA). • Every DFA can be simulated by a DTM.

16. Review on Regular Set • Regular sets on an alphabet Σis defined recursively as follows (1) The empty set Φ is a regular set. (2) For every symbol a in Σ, {a} is a regular set. (3) If A and B are regular sets, then A ∩ B, A U B, and A* are all regular sets.

17. Review on DFA tape a b c d e f head finite control

18. The tape is divided into cells. Each cell contains a symbol in an alphabet Σ. • The head scans at a cell on the tape and can read symbol from the cell. It can also move from left to right, one cell per move.

19. The finite control has finitely many states which form a set Q. For each move, the state is changed according to the evaluation of a function δ: Q x Σ →Q. If the head reads symbol a and the finite control is in the state q, then the next state is p = δ(q, a).

20. There are some special states: an initial state s and some final states which form a set F. • The DFA can be represented by M = (Q, Σ, δ, s, F).

21. Initially, the DFA is in the initial state and the head scans the leftmost cell. The tape holds an input string x. When the head moves off the tape, the DFA stops. An input string is accepted by the DFA if the DFA stops in a final state. Otherwise, the input string is rejected.

22. Simulate DFA by DTM • Given a DFA M = (Q, Σ, δ, s, F), we can construct a DTM M’ = (Q’, Г, Σ, δ’, s) to simulate M as follows: • Q’ = Q U {h}, Γ = Σ U {B}, • If δ(q, a) = p, then δ’(q, a) = (p, a, R). δ’(q, B) = (h, B, R) for q in F.

23. 1/1,R 0/0,R; 1/1,R 0/0,R 0/0,R B/B,R s p q h 1/1,R L(M) = (0+1)*00(0+1)*. 1 0, 1 0 0 s p q 1

24. Turing acceptable languages Regular languages

25. Why DTM can accept more languages than DFA? Because • The head can move in two directions. (No!) • The head can erase. (No!) • The head can write and move in two directions. (Yes!)

26. Examples of DTM

27. ├ ├

29. (s, 0110B) ├ (q0, B110B) ├ (q1, B010B) ├ (q1, B010B) ├ (q0, B011B) ├ (h, B0110B)

30. Remark

31. Turing-acceptable ├

32. R {ww | w ε (0+1)*} is Turing-acceptable. (s, B0110B)├ (q, B0110B)├ (q0, B011BB) ├* (q0, B011B) ├ (p0, B011B)├ (ok, BB11B) ├* (ok, B11B) ├ (q, B11B) ├ (q1, B1BB) ├ (q1, B1B) ├ (p1, B1B) ├ (ok, BBB) ├ (q, BBB) ├ (h, BBB) ?? Could we do (ok, BBB) ├ (h, BBB) ?

33. R L= {ww | w in (0+1)*}

34. Turing-Computable Functions • A total function f: Σ* → Σ* is Turing-computable if there exists a DTM M such that for every x in Σ*, (s, BxB) ├* (h, Bf(x)B). • A partialf: Ω→ Σ* is Turing-computable if there exists a DTM M such that L(M)=Ω and for every x in Ω, (s, BxB) ├* (h, Bf(x)B).

35. R The following function f is Turing-computable: f(x) =w, if x = ww ; ↑, otherwise (s, B0110B)├ (q, B0110B)├ (q0, B011BB) ├* (q0, B011B) ├ (p0, B011B)├ (ok, B0’11B) ├* (ok, B0’11B) ├ (q, B0’11B) ├ (q1, B0’1BB) ├ (q1, B0’1B) ├ (p1, B0’1B) ├ (ok, B0’1’B) ├ (q, B0’1’B) ├ (r, B0’1B) ├* (r, B01B) ├ (o, B01B) ├* (o, B01B)├ (k, B01BB) ├ (h, B01B)

36. R • f(x) = w if x = ww ; ↑, otherwise

37. Turing-decidable • A language A is Turing-decidable if its characteristic function is Turing-computable. Χ (x) = { 1, if x ε A 0, otherwise A

38. R • { ww | w ε (0+1)*} is Turing-decidable. (s, B0110B)├ (q, B0110B)├ (q0, B011BB) ├* (q0, B011B) ├ (p0, B011B)├ (ok, B$11B) ├* (ok, B$11B) ├ (q, B$11B) ├ (q1, B$1BB) ├ (q1, B$1B) ├ (p1, B$1B) ├ (ok, B$$B) ├ (q, B$$B) ├ (r, B$BB) ├* (r, BBB) ├ (o, BBB) ├* (h, B1B)

40. Theorem • A language A is Turing-acceptable iff there exists a total Turing-computable function f such that A = { f(x) | x ε (0+1)*}. • If we look at each natural number as a 0-1 string, then f can be also a total Turing-computable function defined on N, the set of all natural numbers, that is, A = { f(1), f(2), f(3), …} • Therefore, “Turing-acceptable” is also called “recursively enumerable” (r.e.).

41. Theorem • A language A is Turing-decidable iff A and its complement Ā are Turing-acceptable. Proof. Suppose L(M) = A and L(M’) = Ā. Construct M* to simulate M and M’ simultaneously

42. Turing-decidable (recursive) Turing-acceptable (r.e.) regular

43. Various TMs

44. Allow the head not move Theorem. If the head is allowed to stay at the cell in each move, then every function computed by the DTM is still Turing-computable. Proof. Consider DTM M=(Q,Σ,Γ,δ,s) where δ: Q x Γ → Q x Γ x {R, L, H} and H means that the head stays at the current cell. We construct M’=(Q U Q’, Σ, Γ, δ’,s) as follows:

45. Q’ = {q’ | q ε Q} • For q ε Q, δ’(q, a) = (p, b, R) if δ(q, a) = (p, b, R) δ’(q, a) = (p, b, L) if δ(q, a) = (p, b, L) δ’(q, a) = (p’, b, R) if δ(q, a) = (p, b, H) For p’ ε Q’, δ’(p’, a) = (p, a, L). M and M’ compute the same function.

46. Corollary. A language is accepted by a DTM, which allows the head not to move, iff it is Turing-acceptable. Why this is a corollary? Because every language accepted by a DTM is the definition domain of a function computable by a DTM of the same type. Corollary. A language is decided by a DTM, which allows the head not to move, iff it is Turing-decidable.

47. Two-way DTM

48. Theorem.Every function computed by a two-way DTM is Turing-computable. $

49. Consider a two-way DTM M=(Q, Σ,Γ, δ,s). Construct a DTM M’ = (Q U Q’,Σ’,Γ’,δ’,s) to simulate M as follows: • Q’={q’ | q ε Q} • Γ’ ={(a, b) | a, b εΓ } U { (B, $) } • Σ’ ={(a, B) | a εΣ} • For q ε Q, δ’(q, $) = (q’,$,R) δ’(q, (a, c)) = (p,(b,c),D) if δ(q,a)=(p,b,D)

50. For q’ ε Q’, δ’(q’, $) = (q, $, R) δ’(q’,(c,a)) = (p’,(c,b),R) if δ(q,a)=(p,b,L) δ’(q’,(c,a)) = (p’,(c,b),L) if δ(q,a)=(p,b,R) δ’(q’,(c,a)) = (p’,(c,b),H) if δ(q,a)=(p,b,H)