Annual BEAP Report March 20, 2010

1. Annual BEAP ReportMarch 20, 2010 27th Annual BPD Conference Atlanta, GA

2. Introduction

3. Foundation Curriculum Assessment Instrument

4. Purpose of the FCAI Provides Pre/Post test in seven major curricular areas of a BSW program Seeks to help the program assess “value added” from entry to exit Assists with identification of curricular areas that may need attention Provides national comparative data

5. Curricular components

6. Sample HBSE Question • The concept “person-in-environment” includes which of the following: • Clients are influenced by their environment • Clients influence their environment • Behavior is understood in the context of one’s environment • All of the above

7. Sample Practice Question • Determining progress toward goal achievement is one facet of the _____ stage. • a. Engagement • b. Evaluation • c. Assessment • d. Planning

8. Testing History – 2006-2010 • Version 3 1 Test 65 ?s n= 305 • Version 4 1 test 55 ?s n= 381 • Version 5 1 test 82 ?s n= 286 • Version 6 1 test 74 ?s n= 36 • Version 7 1 test 72 ?s n= 318 • Version 8 1 test 64 ?s n=1576 TOTAL =2902

9. Reliability Testing – Version 8 • Tested in two junior practice classes • Students tested twice, 2 weeks apart • Pearson’s correlation coefficient: r = .86 • a

10. Item difficulty index • Overall difficulty or average should be around .5 (Cohen & Swerdlik, 2005) • FCAI = .523 (n=415) • “This is a very good difficulty level for the test. Not likely to misrepresent the knowledge level of test takers”.

11. Expansion beyond BSW • Based upon CSWE assertions related to educational levels in social work education, we expanded testing to three additional groups: • MSW foundation students: • entering • exiting • Advanced standing students: • entering

12. Mean scores by Educational level – Version 8

13. Instrument Discriminant Analysis

14. Pre/post test for differenceBSW & MSW Foundation

15. Tests of Difference by Educational Level

16. Tests of Difference by Educational level

17. Domain Comparisons- Version 8 Overall

18. Domain Comparisons- Version 8 Overall

19. Domain Comparisons-Version 8 Overall

20. Domain Comparisons- Version 8 Overall

21. Field Practicum/Placement Assessment Instrument (FPPAI)

22. Need for Field Evaluation In response to evaluate social work program outcomes related to the 2008 EPAS competencies and practice behaviors The need for a field/practicum assessment that measures competencies related to practice behaviors

23. FPPAI Piloting Phases • Initial Piloting was conducted May 2008 • Second Piloting was conducted in Fall 2008/Spring 2009 • Third Piloting phase was conducted Fall 2009 • Full implementation: Fall 2010

24. Assessment Methodology 55 Likert Scale questions measuring practice behaviors linked to the EPAS 2008 competencies. Qualitative feedback form for each domain available for program use. Will be available online and in print format. Individual program outcomes report with national comparisons. Individual program outcomes report with national comparisons for EPAS 2008 Competencies & Practice Behaviors Can be used as a final field assessment and mid-test/post test design. MSW pilot in the planning stages.

25. FPPAI Scale

26. FPPAI: Instrument Sample (Quantitative)

27. FPPAI Sample: Qualitative Feedback Form

28. BEAP & EPAS 2008

29. FPPAI: Overview & Key Findings 204 participants from 18 schools and 18 states participated in the FPPAI pilot project. Overwhelming positive feedback from participating schools. Incorporated pilot feedback survey results into final pilot revisions. Cronbach’s Alpha reliability test of internal consistency was completed, (n=204, .962) reporting excellent internal consistency. Fall online MSW foundation pilot

30. Call for Foundation Year MSW Participation If your program is interested in being a part of the national ”MSW Foundation Online” pilot, please access the FPPAI website: http://www.lcsc/bchristenson/fpai.htm Dr. Brian Christenson: • blchristenson@lcsc.edu Dr. Ruth Gerritsen-McKane: • Ruth.Gerritsen-McKane@socwk.utah.edu

31. http://beap.socwk.utah.edu/

32. http://www.lcsc.edu/bchristenson/fpai.htm

33. 2009 Report on the Revised BEAP Instruments

34. Sample Profile Overview of all Respondents

35. Sample vs. Population Program Type

36. Sample Profile Response Rates

37. Auspices of College or University(Overall-Entrance)

38. Ethnicity at Entrance Note: Percentages equal more than 100% due to multiple self-reported ethnicities.

39. Financial Aid at Entrance *Includes Federal and State only.

40. Plan to be Employed During BSW Education (Reported at Entrance)

41. Future Educational Plans-Exit Note: Percentages equal more than 100% due to multiple self-reported future educational plans.

42. KSV- Exit (Scale of 0-10)

43. Exit Advising Scores (Scale of 0-10)

44. Overall Advising Scores by Auspice- Exit (Scale of 0-10)

45. Overall Advising Scores by Program Type-Exit N= 20,833 t- test *p= .000 (Scale of 0-10)

46. Current Employment Information Primary Function - Exit n= number reporting

47. Current Employment Information Primary Role - Exit n= number reporting

48. Client Systems - Alumni/ae

49. Income Level Most Represented by Clients - Alumni/ae

50. Professional Development During the Last Year(Reported at Alumni/ae)