Computational Methods for Management and Economics Carla Gomes

Computational Methods forManagement and EconomicsCarla Gomes Module 6c Initialization in Simplex (Textbook – Hillier and Lieberman)

Initialization Adapting to other forms

Equality constraints • Negative Right-hand sides • Constraints ≥ • Minimization

Artificial Variable Approach • What if our problem is not in standard form – i.e., it may include functional constraints of type = and ≥ and also negative RHS? • How can we identify an initial BFS? • Approach – artificial variable technique: • Construct an artificial problem: • introduce a dummy variable – an artificial variable, s.t., the usual non-negativity constraints, just for the purpose of being initial basic variable -- into each of the constraints that are non standard; • Objective function – modify it to impose an exorbitant penalty on the artificial variables • Simplex method – forces the artificial variables to become 0, one at a time, until they are all gone, providing an initial basic solution for the original problem.

Handling Equality Constraints • ai1 x1 + ai2 x2 + … + ain xn = bi • Can be transformed into: ai1 x1 + ai2 x2 + … + ain xn≥ bi ai1 x1 + ai2 x2 + … + ain xn≤ bi But we still would have to deal with one constraint in non-standard form.

Wyndor Glass • Requirement: plant 3must be uses at full capacity  3 x1 + 2 x2 = 18; • Algebraic form: Z - 3 x1 - 2 x2 = 0; x1 + x3 = 4; 2 x2 + x3 = 12; 3 x1 + 2 x2 = 18; What’s the problem with this initial system from the simplex’s point of view?

What is the basic variable in the 3rd equation? No obvious BFS

Z = 3 x1 + 2 x2 - M 3 x1 + 2 x2 + = 18; Procedure Construct an artificial problem that has the same optimal solution as the real problem by making two modifications to the real problem: • Apply the artificial variable technique by introducing a non-negative artificial variable into the equality constraint as if it were a slack variable. • Assign an overwhelming penalty to having by changing the objective function to: = 18 - 3 x1 + 2 x2 M is a huge positive number (Big M Method).

Note: because plays the role of the slack variable in the 3rd constraint, this constraint becomes equivalent to 3 x1 + 2 x2 <=18; therefore the feasible region is identical to the feasible region of the original Wyndor Glass problem.

3. Converting Z equation into proper form x1 + x3 = 4; 2 x2 + x4 = 12; 3 x1 + 2 x2 + = 18; Is this form the right form for the simplex? Why? Z - 3 x1 - 2 x2 + M = 0 • convert Z equation into the proper form by subtracting from Eq(0), Eq(3) times M

Converting Z equation into proper form Now we are ready to use the Simplex method. Note: Think of M as a huge number. M only appears in Eq 0 in Expressions of the form aM + b; because M is huge it is enough to Compare the multiplicative factor a. What variable will enter the basis? What variable will leave the basis?

What operations do we need to perform to this tableau? Answer: Multiply pivot row by (-3) and add it to eq (3); Multiply pivot row by (3M+3) and add it to eq (0); Is this a feasible solution for the original problem? Optimal?Why? What variable will enter the basis? What variable will leave the basis?

What operations do we need to perform to this tableau? Answer: Divide pivot row by 2 Multiply new pivot row by (-2) and add it to eq (2); Multiply new pivot row by (2M+5) and add it to eq (0); Is this a feasible solution for the original problem? Optimal?Why? What variable will enter the basis? What variable will leave the basis?

Is this a feasible solution for the original problem? Optimal?Why?

Graphical Visualization of Wyndor Glass Problem x1=2,x2=5,x3=2,x4=0,x5=0 x1=4,x2=3,x3=0,x4=6,x5=0 x1=4,x2=0,x3=0,x4=12,x5=18 x1=0,x2=0,x3=4,x4=12,x5=18

Handling Negative Right Hand Sides x1 + x3 <=-1; -x1 - x3 ≥ 1;

Handling ≥ constraints • x1 + x2 >= 6 start by introducing a surplus variable • x1 + x2 - x3 = 6 now we know how to deal with equality constraints by adding an artificial variable, x3≥ 0; • x1 + x2 - x3 + x4= 6 x4≥ 0 is an artificial variable Note: x1 + x2 - x3 + x4= 6  x1 + x2 = 6 + x3 - x4 Since x3 >=0 andx4>=0 that means that x1 + x2can now take any value (below or above the constraint) so this procedure in fact eliminates the constraint from the artificial problem.

Minimization • Minimize Z = c1 x1 + c2 x2 + … + cn xn  • Maximize - Z = - c1 x1 - c2 x2 - … - cn xn

The Big M Method • Modify the constraints so that the RHS of each constraint is nonnegative. Identify each constraint that is now an = or ≥ constraint. • Convert each inequality constraint to augmented form (add a slack variable for ≤ constraints, add an surplus (excess) variable for ≥ constraints). • For each ≥ or = constraint, add artificial variables. Add sign restriction ai ≥ 0. • Let M denote a very large positive number. Add (for each artificial variable) Mai to min problem objective functions or -Mai to max problem objective functions. • Since each artificial variable will be in the starting basis, all artificial variables must be eliminated from row 0 before beginning the simplex. Remembering M represents a very large number, solve the transformed problem by the simplex. Description of the Big M Method

Math Programming and Radiation Therapy

Radiation Therapy Overview • High doses of radiation (energy/unit mass) can kill cells and/or prevent them from growing and dividing • True for cancer cells and normal cells • Radiation is attractive because the repair mechanisms for cancer cells is less efficient than for normal cells (slides adapted from James Orlin’s)

Radiation Therapy Overview • Recent advances in radiation therapy now make it possible to • map the cancerous region in greater detail • aim a larger number of different beamlets with greater specificity • This has spawned the new field of tomotherapy • “Optimizing the Delivery of Radiation Therapy to Cancer patients,” by Shepard, Ferris, Olivera, and Mackie, SIAM Review, Vol 41, pp 721-744, 1999. • Also see http://www.tomotherapy.com/

Conventional Radiotherapy Relative Intensity of Dose Delivered

Conventional Radiotherapy • In conventional radiotherapy • 3 to 7 beams of radiation • radiation oncologist and physicist work together to determine a set of beam angles and beam intensities • determined by manual “trial-and-error” process

Critical Area Tumor area Goal: maximize the dose to the tumor while minimizing dose to the critical area With a small number of beams, it is difficult to achieve these goals.

Recent Advances • More accurate map of tumor area • CT -- Computed Tomography • MRI -- Magnetic Resonance Imaging • More accurate delivery of radiation • IMRT: Intensity Modulated Radiation Therapy • Tomotherapy

Tomotherapy: a diagram

Radiation Therapy: Problem Statement • For a given tumor and given critical areas • For a given set of possible beamlet origins and angles • Determine the weight of each beamlet such that: • dosage over the tumor area will be at least a target level gL . • dosage over the critical area will be at most a target level gU.

Display of radiation levels

Linear Programming Model • First, discretize the space • Divide up region into a 2D (or 3D) grid of pixels

= unit dose delivered to pixel (i,j) by beamlet p More on the LP • Create the beamlet data for each of p = 1, ..., n possible beamlets. • Dp is the matrix of unit doses delivered by beam p.

Linear Program • Decision variables w = (w1, ..., wp) • wp= intensity weight assigned to beamlet p for p = 1 to n; • Dij= dosage delivered to pixel (i,j)

An LP model took 4 minutes to solve. minimize In an example reported in the paper, there were more than 63,000 variables, and more than 94,000 constraints (excluding upper/lower bounds)

What to do if there is no feasible solution • Use penalties: e.g., Dij gL – yijand then penalize y in the objective. • Consider non-linear penalties (e.g., quadratic) • Consider costs that depend on damage rather than on radiation • Develop target doses and penalize deviation from the target

Optimal Solution for the LP

An Optimal Solution to an NLP

Further considerations • Minimize damage to critical tissue • Maximize damage to tumor cells • Minimize time to carry out the dosage • LP depends on the technology

Mary’s radiation therapy: simplified version • Goal – design and select the combination of beamlets to be used and the intensity of each one, to generate the best possible dose distribution (units: kilorads) • Decision variables: • x1 - dose at the entry point for beamlet 1 • x2 - dose at the entry point for beamlet 1 • Objective function: • Z – total dosage reaching healthy anatomy min z = 0.4 x1 + 0.5 x2 st 0.3x1 + 0.1x2 ≤ 2.7 critical tissues 0.6x1 + 0.4x2 = 6 tumor region 0.5x1 + 0.5x2 ≥ 6 center of tumor x1, x2, > 0

min z = 0.4 x1 + 0.5 x2 st 0.3x1 + 0.1x2 ≤ 2.7 0.6x1 + 0.4x2 = 6 0.5x1 + 0.5x2 ≥ 5 x1, x2, > 0

Getting the problem into augmented form (canonical form) for simplex

1st Simplex Tableaux Optimal? Entering Variable? x1 enters the base and x3 leaves the base

When do we get a feasible solution for the original problem? What the optimal solution? x1 = ? x2 = ? Z = ? x4 = ? x5 = ? x6 = ?

From Big M Method to the Two-Phase Method • The Big-M Method can be thought of as having two phases: • Phase 1 – all the artificial variables are driven to 0 (because of the penalty M) in order to reach an initial BF solution to the real problem; • Phase 2 – all the artificial variables are kept to 0 (because of the penalty M) while the simplex method generates a sequence of BF solutions for the real problem that leads to an optimal solution. Two phase method – streamlined procedure for performing the two-phases directly, without introducing M explicitly;

Two Phase Method: Mary’s radiation therapy • Real problem’s objective function: min z = 0.4 x1 + 0.5 x2 • Big M method’s objective function: min z = 0.4 x1 + 0.5 x2 + M x4 + M x6 • Since the two first coefficients are negligible compared to M, the two phase method drops M by using the following objective functions: • Phase 1: minimize z = x4 + x6 (until x4 = , x6 =0) • Phase 2: min z = 0.4 x1 + 0.5 x2 (with x4 = , x6 =0)

Phase 1: Mary’s radiation therapy min z = x4 + x6 st 0.3x1 + 0.1x2 + x3 = 2.7 0.6x1 + 0.4x2 + x4 = 6 0.5x1 + 0.5x2 - x5 + x6 = 6 x1, x2, x3, x4 , x5, x6 >= 0 The solution of phase 1 is the initial solution for phase 2, assuming That the optimal solution of phase 1 is z=0 and x4 , x6 = 0;

Phase 2: Mary’s radiation therapy min z = 0.4x1 + 0.5x2 st 0.3x1 + 0.1x2 + x3 = 2.7 0.6x1 + 0.4x2 = 6 0.5x1 + 0.5x2 - x5 = 6 x1, x2, x3, x5 >= 0 Note: the solution from phase 1 is the initial BFS for phase 2.

Tableau for Phase 1: Mary’s radiation therapy min z = x4 + x6 st 0.3x1 + 0.1x2 + x3 = 2.7 0.6x1 + 0.4x2 + x4 = 6 0.5x1 + 0.5x2 - x5 + x6 = 6 x1, x2, x3, x4 , x5, x6 >= 0 What is the basic variable in equation 1? Equation 2? Equation 3? What operations do we need to perform in order to get the canonical form for the simplex? (multiply row 2 by –1 and row 3 by –1; add new row 2 and new row 3 to row 0)

Computational Methods for Management and Economics Carla Gomes