Learning 7-9% of AP Exam

1. Learning7-9% of AP Exam Classical Conditioning Operant Conditioning Observational Learning

2. Defining “Learning” • Learning: a relatively permanent change in an organism’s behavior due to experience. • Contingency: an event that may but is not certain to occur • The study of how organisms learn is based on a series of contingencies (classical, operant and observational).

3. Classical Conditioning

4. Classical conditioning • Classical conditioning – forms associations between stimuli. • Involves actions that are automatic responses to a stimulus.

5. Classical conditioning • Ivan Pavlov’s research using dogs is one of psychology’s most famous experiments. • Set the stage for the development of behaviorism.

6. Pavlov’s Experiments • Before conditioning, food (Unconditioned Stimulus, UCS) produces salivation (Unconditioned Response, UCR). However, the tone (neutral stimulus) does not.

7. Pavlov’s Experiments • During conditioning, the neutral stimulus (tone) and the UCS (food) are paired, resulting in salivation (UCR). After conditioning, the neutral stimulus (now Conditioned Stimulus, CS) elicits salivation (now Conditioned Response, CR)

9. UCS= Unconditioned Stimulus Something that automatically, unconditionally triggers us to do something… any behavior

10. UCR= Unconditioned Response • It is the NATURAL response. The response is unlearned… we just do it.

11. NS= Neutral Stimulus • Stimulus that means nothing to the person or animal. • …at first. MEANING

12. CS= Conditioned Stimulus • Neutral Stimulus that once meant nothing, now means something.

13. CR= Conditioned Response • Unlike the unconditioned response, this behavior does NOT occur naturally. The response must be learned.

14. Classical Conditioning Terminology

15. Acquisition • Acquisition -the initial stage in classical conditioning in which an association between a neutral stimulus and an unconditioned stimulus takes place. • In most cases, for conditioning to occur, the neutral stimulus needs to come before the unconditioned stimulus. • The time in between the two stimuli should be about half a second. Pavlov theorized that the acquisition of a CR depends on stimulus contiguity, or the occurrence of stimuli together in time and space.

16. Higher-Order Conditioning • When a new neutral stimulus becomes a new conditioned stimulus, higher-order conditioning has occurred. • Higher-order conditioning shows that classical conditioning does not depend on the presence of a genuine, natural UCS. • An already established CS will do just fine.

17. Higher-Order Conditioning • Ex. My dog hates taking a bath. He knows that when I carry him to the bathroom, he will be getting a bath and begins to shake. • What’s the CS? • What’s the CR? • For this situation, the sound of running water (NS) could become a new CS signaling to my dog that he is about to get a bath, therefore causing the dog to shake. (CR) • Higher-order conditioning had occurred.

18. Extinction • Extinction - When the UCS (food) does not follow the CS (tone), CR (salivation) begins to decrease and eventually causes extinction.

19. Spontaneous recovery • Spontaneous Recovery– the reappearance of an extinguished response after a period of non-exposure to the conditioned stimulus

20. generalization • Generalization – tendency, once a response is conditioned, for stimuli similar to the conditioned stimulus to elicit similar responses.

21. Watson and “Little Albert” • John Watson (founder of behaviorism) and Rosalie Rayner’s 1913 study on classical conditioning. • “Little Albert” Experiment – Watson paired the presence of a white rat with a loud noise to elicit fear from a young boy. • Albert learned to associate the white rat with loud noises even after the noises had stopped. • Albert even generalized his CR by reacting with fear to other white animals and objects.

23. discrimination • Discrimination – learned ability to distinguish between a conditioned stimulus and stimuli that do not signal an unconditioned stimulus

24. Biological constraints in classical conditioning

25. John Garcia • Showed that classical conditioning was influenced by biological predispositions. • Study using rats led to the phenomena known as taste aversion. • Rats learned to avoid drinking from certain water sources that contained water tainted with radiation that made them sick. • Also showed that the CS and the UCS could be paired hours apart and still result in CR.

26. Even humans can develop classically to conditioned nausea.

27. Theories on Taste Aversion • Garcia argues that taste aversion is a byproduct of the evolutionary history of mammals. • Animals that consumed poisonous foods and survive must learn not to repeat their mistakes. • Natural selection will favor organisms that quickly learn what NOT to eat. • Thus, evolution may have biologically programmed (or predisposed) some organisms to learn certain types of associations more easily than others.

28. Cognition in Classical Conditioning

29. Cognition in Classical Conditioning • Robert Rescorla – determined through experiments that classical conditioning is not simply “reaction” but requires some form of thought • He concluded that for a NS to become a CS, the organism had to be able to predict the CR • The more predictable the association, the stronger the CR • Also determined that two CS presented at same time fight for stronger association within the mind of the organism

30. Cognition in Classical Conditioning • Martin Seligman – developed the idea of learned helplessness • Learned helplessness – passive resignation an organism learns when unable to avoid repeated aversive events • Seligman’s studies with dogs and shocks showed further evidence of thought processes involved with classical conditioning

31. Operant Conditioning

32. Operant Conditioning • In operant conditioning organisms learn to associate their own actions with consequences.

33. Thorndike and the “Law of Effect” • Edward Thorndike (1874-1949) • Psychologist whose famous studies on animals led to understanding of how humans learn. • Famous “Law of Effect” stated that rewarded behavior is likely to recur and punished behavior is likely to cease.

34. B.F. Skinner (1904-1990) • Psychologist and leading figure in behaviorist movement. • Developed an operant chamber; what came to be known as a “Skinner Box”. • Used the concept of shaping to reinforce a desired behavior. • Shaping involves rewarding responses that are ever-closer to final desired behavior while ignoring all other responses.

35. Skinner box

36. Operant Conditioning Terminology

37. Types of stimuli • Appetitive (pleasant) stimulus • Organism wants to achieve or receive • Aversive (unpleasant) stimulus • Organism wants to avoid or escape from

38. Types of reinforcers • REINFORCERS ARE ANY EVENT THAT STRENGTHENS A PRECEDINING RESPONSE. • A “reward”, so to speak. • Positive reinforcement – presenting a pleasant (appetitive) stimulus after response • Negative reinforcement – reducing or removing an unpleasant (aversive) stimulus after response

39. NEGATIVE REINFORCEMENT IS NOT PUNISHMENT

40. Primary vs. Secondary reinforcers • Primary reinforcers – stimuli that satisfy a biological need • Food, sleep, sex, thirst, homeostasis, etc. • Secondary reinforcers – stimuli that gain power through the association with primary reinforcer • Money, good grades, attention, applause, etc.

41. Money is a secondary reinforcer!!!

42. Immediate vs. delayed reinforcers • In animals, immediate reinforcement is usually required for operant conditioning to occur. • However in humans, delayed reinforcement is possible. • Paycheck at weeks’ end • Good grade at end of semester

43. Schedules of reinforcement • Continuous reinforcement: reinforcing desired response every time • Partial reinforcement: reinforcing desired response only part of the time • 4 schedules of partial reinforcement: • Fixed-ratio • Variable-ratio • Fixed-interval • Variable-interval

44. Schedules of reinforcement • Fixed-ratio - reinforces a response only a specified number of responses • You buy 10 smoothies, you get a free one. (10:1) • For every pair of jeans you sell you get $5. (1:5) • Variable-ratio – reinforces a response after an unpredictable number of responses • Slot machines – you pull 10 times, get money; then you pull 15 times, get money, then you pull 7 times, get money • (10:1), (15:1), (7:1)

45. Schedules of reinforcement • Fixed-interval schedules – reinforces a response only a specified time has elapsed • An administrator observes a teacher every other Friday. • Variable-interval schedules – reinforces a response at unpredictable time intervals • An administrator observes a teacher on random occasions

46. A Few Notes on Schedules of Reinforcement More than 50 years of research has yielded an enormous volume of data on how these schedules of reinforcement are related to patterns of responding: 1. Fixed schedules typically cause extinction of behavior more quickly after the reinforcement ceases. 2. Variable schedules have a higher resistance to extinction than fixed schedules. 3. Higher ratios generate higher response rates. (1:1 is better than 10:1) 4. Shorter intervals (time between reinforcement) generate higher rates overall.

47. punishment • Punishment – any consequence that reduces the frequency of a behavior • Reinforcers increase; punishers decrease • Punishment IS NOT negative reinforcement

48. Two types of punishment • Positive punishment: when an aversive stimulus is given to decrease the likelihood that behavior will continue. • Negative punishment: when an appetitive stimulus is taken away to decrease the likelihood that behavior will continue.