Experimental Analysis of Choice

Experimental Analysis of Choice • Methods: concurrent schedules, concurrent chains, delay discounting, foraging contingencies, behavioral economic contingencies. • Models and Issues: matching/melioration, maximizing/optimality, hyperbolic discounting, behavioral economic/ecological models, behavior momentum, molar versus molecular issue, concepts of response strength. • Applications: self-control, drug abuse, gambling, risk, economics, behavioral ecology, social/political decision making.

Operant Conditioning

HERRNSTEIN’S HYPERBOLA:ASSUMPTIONS • 1. The matching law holds. • 2. Every contingency involves choice (e.g., one can respond to a given alternative or not). • 3. Not responding to one alternative means all others supply reinforcers too. • 4. The total behavior in a situation is constant.

HERRNSTEIN’S HYPERBOLA

Modern Version

MULTIVARIATE RATE EQUATION Rout = { ln [a1 exp (1/Rin) + a0]}

MATCHING LAW Herrnstein R1 / R1 = r1 / r2 Baum R1 / R2 = b (r1 / r2)a

MATCHING LAW • R1 / R2 = r1 / r2 Herrnstein • R1 / R2 = b (r1 / r2)a Baum • V1 / V2 = b (r1 / r2)a1 (M1 / M2)a2 (D2 / D1)a3 • Rachlin’s “Value”

Melioration: A Theory of Matching “To make better”: Behavior shifts to the higher return (lower cost) or equal local rates of reinforcement. (R1 / R2) = (r1 / r2), or (r1 / R1) = (r2 / R2) (reinforcers per response, i.e., return). (T1 / T2) = (r1 / r2), or (r1 / T1) = (r2 / T2) (local rate of reinforcement).

Example: Conc VI 30”VI 120” Suppose in the first hour of exposure 1000 responses were emitted to each alternative: (VI 30”) r1 / R1 = (120 rfs / 1000 resps). Return = 0.120 (VI 120”) r2 / R2 = (30 rfs / 1000 resps). Return = 0.03 Ultimately behavior will shift toward the higher return. What will be the result? 120 / (1000 + x) = 30 / (1000 – x); x = 600. 120 / 1600 = 30 / 400 i.e., matching (80% responses on VI 30” alternative). Return = 0.075 rfs/resp on each alternative.

Problem: Conc VR 30 VR 120 ALL responses will ultimately be made to the VR 30 alternative. This is consistent with matching, but same would be said if all the responses were made to the VR 120 alternative. But melioration can predict which alternative should receive all the responses: VR 30: r1/ R1 = 1/30; VR 120: r2/ R2 = 1/120. These cannot change, so shifting to the higher return means all the responses will go to VR 30 alternative.

FUNCTIONAL PROPERTIES AND CURVE FITTING • What is the “real” delay function? Vt = V0 / (1 + Kt) Vt = V0/(1 + Kt)s Vt = V0/(M + Kts) Vt = V0/(M + ts) Vt = V0 exp(-Mt)

Experimental Analysis of Choice