240 likes | 481 Views
Introduction to Linear and Integer Programming. Lecture 7: Feb 1. Overview . Mathematical programming Linear and integer programming Examples Geometric interpretation Agenda. Mathematical Programming . Input: An objective function f: R n -> R
E N D
Introduction to Linear and Integer Programming Lecture 7: Feb 1
Overview • Mathematical programming • Linear and integer programming • Examples • Geometric interpretation • Agenda
Mathematical Programming • Input: • An objective function f: Rn -> R • A set of constraint functions: gi: Rn -> R • A set of constraint values: bi • Goal: • Find x in Rn which: • maximizes f(x) • satisfies gi(x) <= bi
Linear Programming • Input: • A linear objective function f: Rn -> R • A set of linear constraint functions: gi: Rn -> R • A set of constraint values: bi • Goal: • Find x in Rn which: • maximizes f(x) • satisfies gi(x) <= bi
Integer Linear Programming • Input: • A linear objective function f: Zn -> Z • A set of linear constraint functions: gi: Zn -> Z • A set of constraint values: bi • Goal: • Find x in Zn which: • maximizes f(x) • satisfies gi(x) <= bi
Maximum Matchings (degree constraints) Every solution is a matching!
Maximum Satisfiability Goal: Find a truth assignment to satisfy all clauses NP-complete!
Integer Linear Programming • Input: • A linear objective function f: Zn -> Z • A set of linear constraint functions: gi: Zn -> Z • A set of constraint values: bi • Goal: • Find x in Zn which: • maximizes f(x) • satisfies gi(x) <= bi NP-complete!
Mathematical Programming • Input: • An objective function f: Rn -> R • A set of constraint functions: gi: Rn -> R • A set of constraint values: bi • Goal: • Find x in Rn which: • maximizes f(x) • satisfies gi(x) <= bi NP-complete!
Algorithms for Linear Programming • (Dantzig 1951)Simplex method • Very efficient in practice • Exponential time in worst case • (Khachiyan 1979)Ellipsoid method • Not efficient in practice • Polynomial time in worst case
Linear Programming Relaxation Replace By Surprisingly, this works for many problems!
Linear Programming Relaxation Stable matchings Bipartite matchings Minimum spanning trees General matchings Maximum flows Shortest paths Minimum Cost Flows Submodular Flows Linear programming
Maximum Matchings But not every solution is a matching!! Every matching is a solution.
Geometric Interpretation Goal: Optimize over integers! Linear inequalities as hyperplanes Objective function is also a hyperplane Not a good relaxation!
Good Relaxation Every vertex could be the unique optimal solution for some objective function. So, we need every vertex to beintegral!
Matching Polytope x1 Goal: define a polytope which is the convex hull of matchings. x1 (0.5,0.5,0.5) x2 x3 x3 x2
x1 Matching Polytope x1 x2 x3 x1 x3 x2 x3 x2
Valid Inequalities Inequalities which are satisfied by integer solutions but kill unwanted fractional solution. Enough?
Valid Inequalities Odd set inequalities Enough? Yes, that’s enough. [Edmonds 1965]
Exponentially Many Inequalities Can take care by the ellipsoid method. Just need a separation oracle, which determines whether a solution is feasible. If not, find a violating inequality. How to construct a separation oracle for matchings?
Questions Prove that bipartite matching polytope is defined by the degree constraints. Try to confirm what Edmonds said. Write a linear program for the stable matching problem.
Plan How to prove integrality? • Convex combination • Totally unimodular matrix • Iterative rounding • Randomized rounding • Totally dual integrality Uncrossing technique
Plan How to prove min-max theorems? Duality theorem How to solve linear programs? • Simplex method • Ellipsoid method • Primal-dual method Can see combinatorial algorithms!