100 likes | 297 Views
Reliability of Behavioral Observations. Introduction to Clinical Psychology Discussion Section # 10. Psychological Assessment. Data Collection Methods : Clinical interview Tests Observations Informal assessment Examination of life records. Behavioral Observations.
E N D
Reliability of Behavioral Observations Introduction to Clinical Psychology Discussion Section # 10
Psychological Assessment Data Collection Methods: • Clinical interview • Tests • Observations • Informal assessment • Examination of life records
Behavioral Observations • Often used in school settings • Useful in inpatient observation settings
Behavioral Observations and Reliability • How accurate are observers in recording the data? • Do the observers record the same behavior? • Do the observers interpret the operational definitions in the same way? To measure reliability (not so much in your projects), you can calculate inter-observer agreement
Reliability of Behavioral Observations Inter-rater Reliability: • Consistency of observers in recording the behavior When the behavior is explicitly defined, the inter-rater reliability tends to be high, vague definitions tend to be associated with low inter-rater reliability
Behavioral or Operational Definitions Vague: “I want to lose weight” Clear: “At the end of every week I want to have lost one pound”. Key points of a good operational definition: • Refer to observable characteristics-not inner states • Note how the behavior will be assessed
Operational Definition: Exercise • Let’s say your problem behavior is that you have a longstanding problem with not having enough money at the end of the month to pay your bills. You want to start saving more money. What would be a precise operational definition for your goal behavior of saving money?
Operational Definition: An Exercise You are asked to design a behavioral program for a nail biter. Two observers will be available to record nail biting behavior. Develop a precise definition of nail biting behavior for these observers to use.
Interobserver Agreement Calculating interobserver agreement for the number of times a behavior occured: % Agreement= Smaller # / Larger # X 100
Calculating Inter-observer Agreement: An Exercise • Select a partner you don’t know • Decide on behavior to record • Operationally define • Move to seat where you can’t see your partner • Watch “Friends” episode and record behavior • Calculate Agreement • Discuss source of error and improving definition