PSY402 Theories of Learning

1. PSY402Theories of Learning Chapter 7 – Theories and Applications of Appetitive Conditioning

2. Operant Conditioning • The nature of reinforcement: • Premack’s probability differential theory • Response deprivation theory • Behavioral economics: • Behavioral allocation – blisspoint • Choice behavior – Herrnstein’s matching law. • Momentary maximization theory • Delay-reduction theory

3. Probability-Differential Theory • Premack – a reinforcer can be any activity that is more likely to occur than the reinforced behavior. • Manipulators vs eaters • High probability behaviors can be used as reinforcers of low probability behaviors. • Frequency of the reinforcer decreases when it is made contingent on another response.

4. Response Deprivation Theory • Timberlake & Allison – deprivation occurs when an activity is used as a reinforcer and is not freely emitted. • The activity is reinforcing because it satisfies the deprivation created. • The animal tries to return to its pre-deprivation level of responding. • Activities can be reinforcing even if their baselines were not higher.

5. Behavioral Allocation • Blisspoint (paired basepoint) – the free operant level of two responses. • Unrestricted responding with two choices of behaviors. • Blisspoint is used to figure out how much behavior an animal will engage in to obtain a reward. • Animals try to get as close to the blisspoint as possible.

6. Problems with Contingencies • Blisspoint is established by looking at behavior before a contingency is established. • The established contingency must take blisspoint into account or it may not increase desired behavior.

7. Choice Behavior • Herrnstein’s matching law – describes how animals act when they have two or more choices. • Different responses have different schedules of reinforcement. • Responding to each choice is proportionate to the reinforcement for each choice – after learning. • This can be expressed mathematically.

8. Mathematical Expression • The formula for the matching law is: where R1 and R2 are the rates of response for two alternative responses And r1 and r2 are rates of reinforcement for those responses

9. Delayed Gratification • Why does anyone choose a smaller reward part of the time? • Animals and people typically choose a small immediate reward over a larger delayed reward. • Large rewards are selected when: • The choice is made in advance of reward. • Reinforcers are not visible or reward is already present (pleasurable activity).

10. Complexities of the Matching Law • Maximizing law – sometimes the aim is to obtain as many rewards as possible. • Explains FR-10 vs FR-40 schedules. • Doesn’t work for VI vs VR schedules. • Momentary maximization theory – choose best alternative at the time. • Delay reduction theory – choose what will get the reward the fastest.

11. Contingency Management • Assessment phase – determine the frequency of behavior and the situations in which it occurs. • Contracting phase – specifies the relationship between responding and reinforcement. • Management phase – implement the contract and evaluate results.