810 likes | 988 Views
A Postmortem of the Last Decade and Some Directions for the Future. Vijay V. Vazirani Georgia Tech. Although this may seem a paradox, all exact science is dominated by the idea of approximation. Bertrand Russell (1872-1970). Exact algorithms have been studied
E N D
A Postmortem of the Last Decade and Some Directions for the Future Vijay V. Vazirani Georgia Tech
Although this may seem a paradox, all exact science is dominated by the idea of approximation. Bertrand Russell (1872-1970)
Exact algorithms have been studied intensively for over four decades, and yet basic insights are still being obtained. Since polynomial time solvability is the exception rather than the rule, it is only reasonable to expect the theory of approximation algorithms to grow considerably over the years.
Beyond the list … Unique Games Conjecture Simpler proof of PCP Theorem Online algorithms for AdWords problem
Beyond the list … Unique Games Conjecture Simpler proof of PCP Theorem Online algorithms for AdWords problem Integrality gaps vs approximability
Raghevendra, 2008: Assuming UGC, for every constrained satisfaction problem: • Can achieve approximation factor = integrality gap of “standard SDP” • NP-hard to approximate better.
Future Directions Status of UGC Raghavendra-type results for LP-relaxations Randomized dual growth in primal-dual algorithms
Approximability: sharp thresholds For a natural problem: Can achieve approximation factor in P. If we can achieve in P => complexity-theoretic disaster
Conjecture • There is a natural problem having sharp thresholds w.r.t. time classes
Group Steiner Tree Problem Chekuri & Pal, 2005: Halperin & Krauthgamer, 2003:
What lies at the core of approximation algorithms?
What lies at the core of approximation algorithms? Combinatorial optimization!
Combinatorial optimization Central problems have LP-relaxations that always have integer optimal solutions! ILP: Integral LP
Combinatorial optimization Central problems have LP-relaxations that always have integer optimal solutions! ILP: Integral LP i.e., it “behaves” like an IP!
Cornerstone problems in P • Matching (general graph) • Network flow • Shortest paths • Minimum spanning tree • Minimum branching
Is combinatorial optimizationrelevant today? Why design combinatorial algorithms, especially today that LP-solvers are so fast?
Combinatorial algorithms • Very rich theory • Gave field of algorithms some of its formative and fundamental notions, e.g.P • Preferable in applications, since efficient and malleable.
Helped spawn off algorithmic areas, e.g., approximation algorithms and parallel algorithms.
Combinatorial optimization studied: Problems admitting ILPs
Approximation algorithms studied: Problems admitting LP-relaxations with bounded integrality gaps
Problems admitting LP-relaxations with bounded integrality gaps Problems admitting ILPs
Rational convex program • A nonlinear convex program that always has a rational solution (if feasible), using polynomially many bits, if all parameters are rational.
Rational convex program • Always has a rational solution (if feasible) using polynomially many bits, if all parameters are rational. • i.e., it “behaves” like an LP!
Rational convex program • Always has a rational solution (if feasible) using polynomially many bits, if all parameters are rational. • i.e., it “behaves” like an LP! • Do they exist??
Two opportunities for RCPs: Program A: Combinatorial, polynomial time (strongly poly.) algorithm Program B: Polynomial time (strongly poly.) algorithm, given LP-oracle.
Combinatorial Algorithms • Helgason, Kennington & Lall, 1980 • Single constraint • Minoux, 1984 • Minimum quadratic cost flow • Frank & Karzanov, 1992 • Closest point from origin to bipartite perfect matching polytope. • Karzanov & McCormick, 1997 • Any totally unimodular matrix.
Ben-Tal & Nemirovski, 1999 Polyhedral approximation of second-order cone Main technique: Solves any quadratic RCP in polynomial time, given an LP-oracle.
Ben-Tal & Nemirovski, 1999 Polyhedral approximation of second-order cone Main technique: Solves any quadratic RCP in polynomial time, given an LP-oracle. Strongly polynomial algorithm?
Logarithmic RCPs Rationality is the exception to the rule, and needs to be established piece-meal.
Logarithmic RCPs Optimal solutions to such RCPs capture equilibria for various market models!
Arrow-Debreu Theorem, 1954 • Celebrated theorem in Mathematical Economics • Established existence of market equilibrium under very general conditions using a deep theorem from topology - Kakutani fixed point theorem.