1 / 54

Annual BEAP Presentation

Annual BEAP Presentation. BPD Annual Conference Portland, OR March 2012. The BEAP Team. Vicky Buchan Colorado State University victoria.buchan@colostate.edu

petula
Download Presentation

Annual BEAP Presentation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Annual BEAP Presentation BPD Annual Conference Portland, OR March 2012

  2. The BEAP Team Vicky BuchanColorado State Universityvictoria.buchan@colostate.edu Brian ChristensonLewis-Clark State Collegeblchristenson@lcsc.eduhttp://www.lcsc.edu/bchristensonRuth Gerritsen-McKaneUniversity of Utahruth.gerritsen-mckane@socwk.utah.edu Tobi DeLong HamiltonLewis-Clark State College, CDA tadelong-hamilton@lcsc.eduRoy (Butch) RodenhiserBoise State UniversityRoyRodenhiser@boisestate.eduMarshall Smith (Retired)docsmith@umich.edu Phil Ng BEAP@PHILNG.NET

  3. What BEAP Can Do For Your Program: • Student demographics • Assessment on Knowledge, Skills, & Values • Employment information • Advising feedback • Professional development of students & alumni/ae • Peer comparison by region, program type, auspice & nationally • …and more

  4. Matrix Example

  5. The BEAP Matrix Can Be Found in: DeLong-Hamilton, T., Buchan, V. V., Hull, G. H., Christenson, B., Gerritsen-McKane, R., Rodenhiser, R. W., & Smith, M. L. (2011). Responding to the 2008 EPAS: Baccalaureate education assessment direct and indirect measurement. Journal of Baccalaureate Social Work, 16(1), 17-31.

  6. Sample ProfileOverview of all Respondents

  7. Frequencies for Auspices of College or University, 2011

  8. Frequencies for Program Type, 2011

  9. Entrance Survey – Student Ethnicity

  10. Exit SurveyKnowledge, Values, Skills*2010 Likert Scale changed from 0-10 to 1-9

  11. Exit SurveyAdvising Scores*2010 Likert Scale changed from 0-10 to 1-9

  12. Foundation Curriculum Assessment Instrument

  13. Purpose of the FCAI • Provides Pre/Post test in seven major curricular areas of a BSW program • Provides a direct measure to assist programs with evaluation of their curriculum • Assists with identification of curricular areas that may need attention • Provides national comparative data

  14. Curricular Components

  15. Sample HBSE Question • The concept “person-in-environment” includes which of the following: • Clients are influenced by their environment • Clients influence their environment • Behavior is understood in the context of one’s environment • All of the above

  16. Sample Practice Question • Determining progress toward goal achievement is one facet of the _____ stage. • a. Engagement • b. Evaluation • c. Assessment • d. Planning

  17. Testing History – 2006-2011 TEST #questions N • Version 3 65 n= 305 • Version 4 55 n= 381 • Version 5 82 n= 286 • Version 6 74 n= 36 • Version 7 72 n= 318 • Version 8 64 n=2231 • Version 9 64 n=5839

  18. Reliability Testing • Version 8 • Tested in two junior practice classes • Students tested twice, 2 weeks apart • Pearson’s correlation coefficient • r = .86 • a

  19. Item difficulty index • Overall difficulty or average should be around .5 (Cohen & Swerdlik, 2005) • FCAI = .523 (n=415) • “This is a very good difficulty level for the test. Not likely to misrepresent the knowledge level of test takers”.

  20. Reliability & Effect Size • Cronbach’s alpha = .784 • Effect Size d = 6.87

  21. Current Data • Number of Schools: 41 from 28 States • Number of Respondents: • Pre-test: 3721 • Post-test: 2118

  22. Schools By Type • BSW Only: 22 • BSW/MSW Combination: 8 • Not Reported: 1

  23. Schools By Auspice • Public: 32 • Private Denomination: 13 • Private Non-Denomination: 6

  24. Foundation Curriculum Assessment Instrument (FCAI)Program Name: Students are: Entering BSW Program ______ Exiting BSW Program _______ Month ____, Year ____, Semester ____ • Program Cumulative Scores Compared with all Student Scores

  25. School X / National Comparison

  26. Overall Scores Pre-Post

  27. Scores By Curricular Area:Practice and HBSE

  28. Scores by Curricular Area:Ethics, Diversity, and Soc/Eco Justice

  29. Scores by Curricular Area:Policy and Research

  30. III. Program: BSW Student Scores by Curricular Area 1 Program : Entrance & Exit

  31. Expansion beyond BSW • Based upon CSWE assertions related to educational levels in social work education, we expanded testing to three additional groups: • MSW foundation students: • entering • exiting • Advanced standing students: • entering

  32. Points to keep in Mind 1. Purpose of this instrument: to review and improve curriculum 2. Program will want to “monitor” scores over several years (or several cohorts) for trends. 3. The FCAI can be considered a measure of “value added” from program entry to exit.

  33. Field Practicum/Placement Assessment Instrument (FPPAI)

  34. Assessment Methodology 55 Likert Scale questions measuring practice behaviors linked to the EPAS 2008 competencies. Qualitative feedback form for each domain available for program use. Available online and in print format. Individual program outcomes report with national comparisons for EPAS 2008 Competencies & Practice Behaviors (coming next year) Can be used as a final field assessment and mid-test/post test design.

  35. FPPAI Scale

  36. FPPAI Reporting and EPAS 2008 Overview • FPPAI Administration Overview (Online & Paper versions) • FPPAI Individual Reporting • FPPAI Aggregate Reporting • Resources available on BEAP website

  37. Field/Practicum Placement Instrument Reporting • More than 50 Schools utilizing the FPPAI instrument currently • More than 1,100 administrations to date • National data comparisons available next year • Cronbach’s Alpha reliability test of internal consistency was completed (mid-point), (n=340, .969) • Cronbach’s Alpha reliability test of internal consistency was completed (final), (n=778, .975)

  38. Field/Practicum Placement Instrument Reporting

  39. How to Access BEAP http://beap.utah.edu/ Or http://www.bpdonline.org • “Resource Center” • BEAP • Resource Center • Accreditation Resources

More Related