PQA Assessing Program Quality

1. PQA Assessing Program Quality

2. Workshop Objectives Participants will be able to: Identify the format and scoring criteria of the Preschool PQA. Write and use evidence/anecdotes and descriptors to accurately score PQA Items. 2

3. Program Quality Assessment (PQA) • What is the PQA? • An instrument that evaluates the quality of early childhood programs. • It is research-based, field-tested, and based on the “best practices.”

4. What Does the PQA Assess? • The PQA measures seven areas of program quality: • Learning Environment • Daily Routine • Adult-Child Interaction • Curriculum Planning and Assessment • Parent Involvement and Family Services • Staff Qualifications and Development • Program Management

5. Form A assesses quality in the classroom. A separate Form A assessment should be completed for each classroom in a program or agency. Form B assesses quality in the agency or program. One Form B should be completed for the entire agency or program. The PQA is Divided into Two Parts 5

6. Form A Form A looks at: • Learning Environment • Daily Routine • Adult-Child Interaction • Curriculum Planning and Assessment

7. Form B Form B looks at: • Parent Involvement and Family Services • Staff Qualifications and Development • Program Management

8. 2009 High/Scope Educational Research Foundation Section At the top of each page, you’ll find the section number and title. This helps you know where you are in the instrument. 8 2008 High/Scope Educational Research Foundation

9. 2009 High/Scope Educational Research Foundation Items are identified by their section number (in this example, Section III) and by a letter. There is also a statement that describes what the item is about (in this example adult support during group times). Sections I – IV of the PQA contain between 5 and 13 items. Item 9 2008 High/Scope Educational Research Foundation

10. 2009 High/Scope Educational Research Foundation Rows Each item has several rows. Each row addresses specific indicators of quality for that item. Rows Each item has several rows. Each row addresses specific Descriptors These describe the kinds things you might observe for three levels of quality. 10 2008 High/Scope Educational Research Foundation

11. 2009 High/Scope Educational Research Foundation Each row also has space to record supporting evidence and/or anecdotes. Each row also has space to record supporting evidence and/or anecdotes 11 2008 High/Scope Educational Research Foundation

12. Steps for Completing the PQA Step 1:Observe in the classroom. Record supporting evidence. Step 2:Read each row of descriptors and check () one box per row. Step 3: Score the items.

13. Step 1: Observe. Record evidence. Anecdotes:a briefer version of what children and/or staff do or say. Quotes:What children and/or staff say. Materials lists 13

14. Step 1 (cont.) Diagrams of the space---indoors and outdoors Sequence of the daily routinethat occurred the day you were there. Answersto questions. NOTE:You must have evidence for each row in order to correctly score the PQA. 14

15. Completing the Interview Items • The evidence for Section IV has to be gathered by interviewing the teachers. • You may find other “standard questions” for other items in Form A. Teacher writing an anecdote. 15

16. 2009 High/Scope Educational Research Foundation ck Standard Questions 16 2008 High/Scope Educational Research Foundation 16

17. Completing “Standard Questions” • Read the standard questions above the indicators on each item. • Just as you do with the observation items, record the supporting evidence and anecdotes in the space provided for each row. 17

18. Helpful Hints: Cross Referencing • If you are having trouble finding evidence for a particular row, look at the evidence you already have. • Evidence used for a row in one item may be useful for an entirely different item! • Be alert for such possibilities! This can save time!

19. To cross reference to a row within the same item: Simply write down the row number or draw an arrow to the evidence you are cross-referencing. To cross reference to a row in a different item: Write the row and page number of the cross reference as your new evidence. Cross Referencing How-Tos

20. High quality evidence is: • Complete • Will your evidence help you decide between the three indicators in a row? • If you see a range of quality (i.e., sometimes the interactions are at a level 5 and sometimes the interactions are at a level 1), be sure to document both! This is how you determine the row is a level 3 because “sometimes” they are high quality and other times they are low quality. • Do you have enough examples to build a solid case for your score?

21. Objective Evidence • Be factual • Be specific • Be brief • Document what children and adults do and say. • Leave out statements that show judgments or personal preferences.

22. Is this Objective or Subjective? Work time: Adult let child choose book. Listen while they describe what they saw on the cover. Restated, “You like it when your grandpa hugs you tight, too.”

23. Remember to Record What You See, NOT What You Expect to See! • Sometimes new, custom-designed buildings, past awards, etc. can make positive first impressions while older buildings and furnishings can give a negative feeling. • Remember, the strength of the PQA is that it will help determine if the criteria for quality is currently being met, regardless of resources or past accolades.

24. Step 2: Read all descriptors and check one row per box. For each row, read through the descriptors and select the one that most closely matches your evidence. Pay close attention to words likesome,most,andalways. If you need evidence, cross-reference or gather more evidence. 24

25. As to X X Step 2: Check the descriptor box that matches the evidence for each row. 25 2008 High/Scope Educational Research Foundation 2009 High/Scope Educational Research Foundation 25

26. A Closer Look at Descriptors Level 5 describes high quality practice. Level 5 descriptors may include bulleted lists of specific strategies. In order to score a row a 5, everythingin the bulleted list must be present and observed. Level 5 descriptors may also include examples, these are only suggestions of the type of evidence to look for. 26

27. Level 5 Descriptors Words to look for in Level 5: Many Most Always Regularly Often If your evidence doesn’t show this level of consistency (sometimes they do it, but sometimes they don’t), you should NOT check the level 5 box. 27

28. A Closer Look at Level 1 Descriptors Level 1 represents low quality. Words to look for in Level 1: Not. No. None. 28

29. A Closer Look at Level 3 Descriptors Level 3 describes medium quality. Words to look for in Level 3: • Sometimes. • Some. • A few. 29 29

30. H Lvl 1 - Lvl 3 1 3 Lvl 5 4 ? A I - - 3 3 - 1 3 3 J B - 3 - 2 2 1 1 3 C K - 1 - 2 3 3 2 4 L 2 1 - 3 2 2 1 2 D E M 1 - - 2 2 4 2 5 F N - - 2 1 1 1 4 3 G O 3 1 - - - 1 1 2 P 1 1 - 2 Answers to Scoring Exercise

31. Step 3: Score the Items The method for scoring PQA items depends upon the number of rows. First, determine if the item has: 2 rows; or 3 or more rows. Then, follow the corresponding guidelines. 31

32. Scoring Guidelines for Items With 3 or More Rows of Boxes Level 1: Half or moreof level 1 boxes (even if level 3 or 5 boxes are checked). Level 2: Fewer than half level 1 boxes are checked, and some of level 3 and/or 5 are checked. Level 3: Half or morelevel 3 boxes, no level 1 boxes. Level 4:Fewer than halflevel 3 boxes, the rest are level 5 boxes. Level 5:All level 5 boxes checked. 32

33. Score this item 33

34. Score this item Score = 1 Half or more of level 1 boxes (even if level 3 or 5 boxes are checked). 34

35. Score this item

36. Score this item Score = 3 Half or more level 3 boxes, no level 1 boxes.

37. Score this item

38. Score this item Score = 5 All level 5 boxes checked. 38

39. Score this item

40. Score this item Score = 4 Fewer than half of the level 3 boxes are checked and the rest are level 5. 40

41. Score this item

42. Score this item Score = 2 Fewer than half level 1 boxes are checked, and some of level 3 and/or 5 are checked.

43. Score this item

44. Score this item Score = 1 Half or more of level 1 boxes (even if level 3 or 5 boxes are checked).

45. Scoring Guidelines forItems with 2 Rows of Boxes Level 1:Both level 1 boxes are checked. Level 2:One level 1 and one level of the 3 or 5 boxes are checked. Level 3:Both level 3 boxes are checked. Level 4:One level 3 box and one level 5 box are checked. Level 5:Both level 5 boxes checked. 45

46. Score this item 46

47. Score this item Score = 3 Both level 3 boxes are checked. 47

48. Score this item 48

49. Score this item Score = 5 Both level 5 boxes are checked. 49

50. Score this item 50