1 / 24

Approximation Algorithms

Approximation Algorithms. Duality My T. Thai @ UF. Duality. Given a primal problem: P: min c T x subject to Ax ≥ b, x ≥ 0 The dual is: D: max b T y subject to A T y ≤ c, y ≥ 0. An Example. Weak Duality Theorem. Weak duality Theorem:

jui
Download Presentation

Approximation Algorithms

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Approximation Algorithms Duality My T. Thai @ UF

  2. Duality • Given a primal problem: P: min cTx subject to Ax ≥ b, x ≥ 0 • The dual is: D: max bTy subject to ATy ≤ c, y ≥ 0 My T. Thai mythai@cise.ufl.edu

  3. An Example My T. Thai mythai@cise.ufl.edu

  4. Weak Duality Theorem • Weak duality Theorem: Let x and y be the feasible solutions for P and D respectively, then: • Proof: Follows immediately from the constraints My T. Thai mythai@cise.ufl.edu

  5. Weak Duality Theorem • This theorem is very useful • Suppose there is a feasible solution y to D. Then any feasible solution of P has value lower bounded by bTy. This means that if P has a feasible solution, then it has an optimal solution • Reversing argument is also true • Therefore, if both P and D have feasible solutions, then both must have an optimal solution. My T. Thai mythai@cise.ufl.edu

  6. Hidden Message ≥ • Strong Duality Theorem: If the primal P has an optimal solution x* then the dual D has an optimal solution y* such that: • cTx* = bTy* My T. Thai mythai@cise.ufl.edu

  7. Complementary Slackness • Theorem: Let x and y be primal and dual feasible solutions respectively. Then x and y are both optimal iff two of the following conditions are satisfied: (ATy – c)j xj = 0 for all j = 1…n (Ax – b)i yi = 0 for all i = 1…m My T. Thai mythai@cise.ufl.edu

  8. Proof of Complementary Slackness Proof: As in the proof of the weak duality theorem, we have: cTx ≥(ATy)Tx = yTAx ≥ yTb (1) From the strong duality theorem, we have: (2) (3) My T. Thai mythai@cise.ufl.edu

  9. Proof (cont) Note that and We have: x and y optimal  (2) and (3) hold  both sums (4) and (5) are zero  all terms in both sums are zero (?)  Complementary slackness holds (4) (5) My T. Thai mythai@cise.ufl.edu

  10. Why do we care? • It’s an easy way to check whether a pair of primal/dual feasible solutions are optimal • Given one optimal solution, complementary slackness makes it easy to find the optimal solution of the dual problem • May provide a simpler way to solve the primal My T. Thai mythai@cise.ufl.edu

  11. Some examples • Solve this system: My T. Thai mythai@cise.ufl.edu

  12. Min-Max Relations • What is a role of LP-duality • Max-flow and Min-Cut My T. Thai mythai@cise.ufl.edu

  13. Max Flow in a Network • Definition: Given a directed graph G=(V,E) with two distinguished nodes, source s and sink t, a positive capacity function c: E → R+, find the maximum amount of flow that can be sent from s to t, subject to: • Capacity constraint: for each arc (i,j), the flow sent through (i,j), fij bounded by its capacity cij • Flow conservation:at each node i, other than s and t, the total flow into i should equal to the total flow out of i My T. Thai mythai@cise.ufl.edu

  14. An Example 3 3 4 4 4 0 3 2 4 3 3 4 2 1 2 1 t s 1 3 1 1 3 2 0 2 3 0 2 1 2 0 5 0 My T. Thai mythai@cise.ufl.edu

  15. Formulate Max Flow as an LP • Capacity constraints: 0 ≤ fij ≤ cij for all (i,j) • Conservation constraints: • We have the following: My T. Thai mythai@cise.ufl.edu

  16. LP Formulation (cont) 3 3 4 4 4 0 3 2 4 3 4 3 2 1 3 2 1 t 1 s 1 1 2 3 2 0 3 1 0 2 2 0 5 0 ∞ My T. Thai mythai@cise.ufl.edu

  17. LP Formulation (cont) My T. Thai mythai@cise.ufl.edu

  18. Min Cut • Capacity of any s-t cut is an upper bound on any feasible flow • If the capacity of an s-t cut is equal to the value of a maximum flow, then that cut is a minimum cut My T. Thai mythai@cise.ufl.edu

  19. Max Flow and Min Cut My T. Thai mythai@cise.ufl.edu

  20. Solutions of IP Consider: Let (d*,p*) be the optimal solution to this IP. Then: • ps* = 1 and pt* = 0. So define X = {pi | pi = 1} and X = {pi | pi = 0}. Then we can find the s-t cut • dij* =1. So for i in X and j in X, define dij = 1, otherwise dij = 0. • Then the object function is equal to the minimum s-t cut My T. Thai mythai@cise.ufl.edu

  21. LP-relaxation • Relax the integrality constraints of the previous IP, we will obtain the previous dual. My T. Thai mythai@cise.ufl.edu

  22. Design Techniques • Many combinatorial optimization problems can be stated as IP • Using LP-relaxation techniques, we obtain LP • The feasible solutions of the LP-relaxation is a factional solution to the original. However, we are interested in finding a near-optimal integral solution: • Rounding Techniques • Primal-dual Schema My T. Thai mythai@cise.ufl.edu

  23. Rounding Techniques • Solve the LP and convert the obtained fractional solution to an integral solution: • Deterministic • Probabilistic (randomized rounding) My T. Thai mythai@cise.ufl.edu

  24. Primal-Dual Schema • An integral solution of LP-relaxation and a feasible solution to the dual program are constructed iteratively • Any feasible solution of the dual also provides the lower bound of OPT • Comparing the two solutions will establish the approximation guarantee My T. Thai mythai@cise.ufl.edu

More Related