Annual BEAP Report February 24, 2011

1. Annual BEAP ReportFebruary 24, 2011 28th Annual BPD Conference Cincinnati, Ohio

2. BEAP Team Vicky BuchanColorado State UniversityBuchan@cahs.Colostate.eduBrian ChristensonLewis-Clark State Collegeblchristenson@lcsc.eduhttp://www.lcsc.edu/bchristensonRuth Gerritsen-McKaneUniversity of Utahruth.gerritsen-mckane@socwk.utah.edu Tobi DeLong HamiltonUniversity of Nebraska at Kearneyhamiltont2@unk.eduRoy (Butch) RodenhiserBoise State UniversityRoyRodenhiser@boisestate.eduMarshall Smithdocsmith@umich.edu Erin Gerdes Graduate Student: Colorado State University

3. To Access BEAP • http://beap.utah.edu/ Or • http://www.bpdonline.org • “Resource Center” • BEAP • Resource Center • Accreditation Resources

4. Foundation Curriculum Assessment Instrument

5. Purpose of the FCAI • Provides Pre/Post test in seven major curricular areas of a BSW program • Provides a direct measure to assist programs with evaluation of their curriculum • Assists with identification of curricular areas that may need attention • Provides national comparative data

6. Curricular Components

7. Sample HBSE Question • The concept “person-in-environment” includes which of the following: • Clients are influenced by their environment • Clients influence their environment • Behavior is understood in the context of one’s environment • All of the above

8. Sample Practice Question • Determining progress toward goal achievement is one facet of the _____ stage. • a. Engagement • b. Evaluation • c. Assessment • d. Planning

9. Testing History – 2006-2010 • Version 3 1 Test 65 ?s n= 305 • Version 4 1 test 55 ?s n= 381 • Version 5 1 test 82 ?s n= 286 • Version 6 1 test 74 ?s n= 36 • Version 7 1 test 72 ?s n= 318 • Version 8 1 test 64 ?s n=2231 TOTAL =3557

10. Reliability Testing • Version 8 • Tested in two junior practice classes • Students tested twice, 2 weeks apart • Pearson’s correlation coefficient • r = .86 • a

11. Item difficulty index • Overall difficulty or average should be around .5 (Cohen & Swerdlik, 2005) • FCAI = .523 (n=415) • “This is a very good difficulty level for the test. Not likely to misrepresent the knowledge level of test takers”.

12. Expansion beyond BSW • Based upon CSWE assertions related to educational levels in social work education, we expanded testing to three additional groups: • MSW foundation students: • entering • exiting • Advanced standing students: • entering

13. Mean Scores by Educational Level – Version 8

14. Pre/post test for differenceBSW & MSW Foundation

15. Tests of Difference by Educational Level

16. Tests of Difference by Educational Level

17. Domain Comparisons- Version 8 Overall

18. Domain Comparisons- Version 8 Overall

19. Domain Comparisons-Version 8 Overall

20. Domain Comparisons- Version 8 Overall

21. Foundation Curriculum Assessment Instrument (FCAI)Program Name: Students are: Entering BSW Program ______ Exiting BSW Program _______ Month ____, Year ____, Semester ____ • Program Cumulative Scores Compared with all Student Scores

22. II. Program: Section Scores Compared with all FCAI Section

23. III. Program: BSW Student Scores by Individual Curricular Area

24. Field Practicum/Placement Assessment Instrument (FPPAI)

25. Need for Field Evaluation In response to evaluate social work program outcomes related to the 2008 EPAS competencies and practice behaviors The need for a field/practicum assessment that measures competencies related to practice behaviors

26. FPPAI Piloting Phases • Initial Piloting was conducted May 2008 • Second Piloting was conducted in Fall 2008/Spring 2009 • Third Piloting phase was conducted Fall 2009 • Full implementation: Fall 2010

27. Assessment Methodology 55 Likert Scale questions measuring practice behaviors linked to the EPAS 2008 competencies. Qualitative feedback form for each domain available for program use. Will be available online and in print format. Individual program outcomes report with national comparisons. Individual program outcomes report with national comparisons for EPAS 2008 Competencies & Practice Behaviors Can be used as a final field assessment and mid-test/post test design. MSW pilot in the planning stages.

28. FPPAI Scale

29. BEAP & EPAS 2008

30. FPPAI Reporting and EPAS 2008 Overview: Click on the screen to see the video.

31. Call for Foundation Year MSW Participation If your program is interested in being a part of the national ”MSW Foundation Online” pilot, please access the FPPAI website: http://www.lcsc/bchristenson/fpai.htm Dr. Brian Christenson: • blchristenson@lcsc.edu Dr. Ruth Gerritsen-McKane: • Ruth.Gerritsen-McKane@socwk.utah.edu

32. http://beap.socwk.utah.edu/

33. Student demographics Assessment on Knowledge, Skills, & Values Employment information Advising feedback Professional development of students & alumni/ae Peer comparison by region, program type, auspice & nationally …and more What BEAP can do for your program

34. BEAP Instruments & EPAS Competencies/Practice Behaviors The Matrix

35. BEAP & EPAS 2008

36. BEAP InstrumentsNational Overview of Data 2010

37. Sample vs. Population Program Type

38. Sample Profile Overview of all Respondents* *Note: SWVI no longer reported

39. Sample Profile Response Rates

40. Auspices of College or University(2010 Entrance)

41. Ethnicity at Entrance Note: Percentages equal more than 100% due to multiple self-reported ethnicities.

42. Financial Aid at Entrance- 2000-2009 *Includes Federal and State only.

43. 2010 Financial Aid at Entrance *Includes Federal and State only.

44. Plan to be Employed During BSW Education (Reported at Entrance)

45. Future Educational Plans-Exit Note: Percentages equal more than 100% due to multiple self-reported future educational plans.

46. KSV- Exit *2010 Likert scale changed from 0-10 to 1-9 (Scale of 0-10)

47. Exit Advising Scores *2010 Likert scale changed from 0-10 to 1-9 (Scale of 0-10)

48. 2010 Advising Scored by Auspice- Exit (Scale of 1-9)

49. 2010 Advising Scores by Program Type-Exit N= 568 t- test *p= .000 (Scale of 1-9)

50. Current Employment Information Primary Function- Exit n= number reporting