460 likes | 470 Views
A summary of two Culture of Assessment Surveys from spring 2003 and 2004 assessing progress towards a more effective assessment culture at PCCUA. The survey covered faculty, administration, and staff perceptions and identified areas for improvement. The data highlighted a need for more student involvement in the assessment process and revealed varying levels of progress within different divisions. The survey results emphasized shared responsibilities, mission commitment, and the importance of student engagement to enhance the assessment culture. Strategies were suggested to continue enhancing the assessment process and improving student learning outcomes at the college.
E N D
Assessment Surveys July 22, 2004 Chancellor’s Meeting
Surveys 2003 • Culture of Assessment Survey - Spring • Professional staff and administration • Divisional • ACT Faces of the Future Survey -Spring • PCCUA college students • PCCUA Graduate Survey – Spring • Graduating students • High School Survey – Fall • High school students in Phillips and Arkansas County’s
Surveys 2004 • Community Survey – Spring • Phillips and Arkansas County’s • Advising Survey – Spring • PCCUA Advisors • ACT Survey of Academic Advising - Spring • PCCUA College Students • PCCUA Graduate Survey (revised) - Spring • Graduating Students • Culture of Assessment Survey – Spring • Professional Staff and Administration
Survey to determine perceptions regarding progress by College toward Assessment Faculty, administrators, and professional staff completed survey Institutional survey –spring 2003 & 2004 Divisional survey – spring 2003 Culture of Assessment Survey Spring 2003 & Spring 2004
Culture of Assessment Survey Spring 2003 & Spring 2004 • Used Dr. Cecelia Lopez’s characteristics of assessment as model • Collective Values • Mission • Shared Faculty Responsibility • Shared Administrative Responsibility • Shared Student Responsibility • Institutional Support Resources • Efficacy • Model included: planning, emerging and maturing levels
Culture of Assessment Survey Spring 2003 & Spring 2004 • Established a point of reference to measure progress of assessment implementation at PCCUA • Long range goal is to improve culture of assessment at the College • Survey confirmed that students have not been involved with the assessment process • Division survey demonstrated more progress initially within academic divisions than at institutional level
Culture of Assessment Survey Spring 2003 & Spring 2004 • Collective Values & Mission • Commitment to students • Commitment to excellence in education • Contribution to community • Commitment to Access • Commitment to faculty and staff • Quality campus life • Shared Faculty Responsibility • Assessment has been faculty led • Shared Administrative Responsibility • Deans and administrators have contributed to assessment efforts
Culture of Assessment Survey Spring 2003 & Spring 2004 • Shared Student Responsibility • Underutilize students in divisional and institutional assessment • Institutional Support Resources • Webpage • Plan of assessment • Efficacy • Assess student learning evidenced by course design and improvements in teaching
How to use this data • Continue assessment activities, professional development, and divisional and institutional planning • Increased mean score for each characteristic on survey indicates a measure of improvement of the culture of assessment • Assessment will continue to expand as it becomes an effective and integrated process used to improve student learning • Based on outcome of survey it was decided to add students to the Assessment Committee
ACT Faces of the Future • Annual, nationwide survey of community colleges (ACT/AACC) • Identifies characteristics of students • Assesses student’s attitudes of school programs, services, and environment • Identifies educational and career intentions of students • Compares PCCUA students to national user group
ACT Faces of the Future • Survey categories included questions related to: • General background of student • Employment background of student • Educational background of student • Current college experience of student
ACT Faces of the Future • Deans selected classes to survey • Administered to 244 students across all campuses • Mean scores based on 5-1 Likert scale • ACT compiled data reports • Reports will be linked to Assessment web page with Survey
ACT Faces of the Future • Student perceptions demonstrate PCCUA is committed and respect them • Students feel PCCUA provides quality service • Students believe that PCCUA has commitment to access and availability • Students believe PCCUA reflects commitment to positive campus life
How to use this data • Provided student input for College’s self-study • Opportunity to participate in this national survey annually each fall to assess student perceptions of College
Graduate Survey • 2003 • Administered each spring at graduation • 2004 • Assessment Committee revised • Revisions correlate with college core competencies • Results are now maintained in Assessment Office
How to use this data • Graduate data will be documented in the Assessment of Student Learning report annually • Graduate Follow-Up • Graduates perception of education received • Alumni Surveys created
High School Survey • Determine students plans for enrollment in higher education • Gain enrollment information for PCCUA • 10th and 11th grades target group • Administered to 1,078 students • Five Schools- Phillips County (443) • Seven Schools – Arkansas County (635)
High School Survey Survey questions related to: • Enrollment • Technology • Availability of services offered • Areas of study • Future plans of students
High School Survey • Availability of services was most significant area of response • Students interested in enrolling at PCCUA if classes offered at their school during the day • Would enroll in ACT/SAT test preparation if offered • Areas of Study indicated by student based on interest (students chose more than one area) • Overall area of study responses = 2,062
Top Five Areas of Interest • Nursing • Business Management • Medical Technology • Cosmetology • Welding
High School Survey Students indicated they were interested in AA Transfer degree programs by taking courses at PCCUA through another college or university • Teachers, lawyers, pharmacy, business-any professional study requiring a baccalaureate degree
How to use this data • Recruitment • College preparation • Secondary Center (to be created) • Course paths for new Charter School
How to use this data Information shared with marketing department • Packets of material have been prepared for each student who completed survey • Packets include: fall schedule, brochures for area of interest, academic advisor list, application for enrollment, letter from college relations office, cost comparison list and college catalog (catalog-if requested). Information shared with each division Example: Graphic Communications – across both counties 68 students expressed an interest in this program.
Future Use of High School Survey • Survey will continue to be utilized because of the wealth of information it provides • Survey will rotate on a two-year cycle and will be administered again in Fall 2006 • Survey tool has now been developed into a web-based format and students will be able to access on-line (Anthony Cunningham developed web access)
Community Survey Survey to determine Arkansas and Phillips County communities’ perception of PCCUA Survey categories included: • Marketing • College Mission • Community Perceptions • Institutional Services
Community Survey • Type of Survey • Conducted convenience sample at various locations in Phillips and Arkansas County’s • Used frequencies and percentages for reporting data – easier for people to understand • Surveyed 327 individuals • Overall report, the community has a positive perception of the college
How to use this data • Needed feedback from constituents in the communities about perception of the college and last community survey was 15 years ago which only included Phillips County • Contributes to future institutional planning • Survey provided data for the College’s self-study
Advising Survey • Survey completed by PCCUA advisors to evaluate current advising process • Initiative that began with Carl Perkins Project • Surveyed advisors perceptions of current academic advising process and the effectiveness of the procedures • Survey emailed to all 35 advisors –all campuses
Advising Survey • Anonymous response from advisors • Advisor response rate 57% • 100% of advisors who responded stated willing to participate in advisor training • 80% are willing to serve on an advisor task force to evaluate current advising system
Advising Survey • Advisors also responded to open-ended questions and provided suggestions • Consensus of group seems to indicate need for more effective training, more information, and better communication • Need effective training for new advisors • Advising system is effective to a degree but improvements can be made
How to use this data • Develop advisor training beginning in the fall –conduct annually and as needed to update with new information/technology • Create a task force – advisors indicated they want to participate • Develop annual evaluation process for advisors • Advising and Retention Resources purchased and placed in Library and Professional Advisor’s offices at all campuses
How to use this data • Utilize advising resources which include useful tips and training sessions that can be adapted • Survey comments indicated Advisor Training in spring 2004 at NACADA Advising Conference was useful and informative (15 individuals attended) • Continue to provide opportunities for advisors to attend Advising Conferences
ACT Survey of Academic Advising • Surveyed upper level students • Deans selected classes to administer survey • Survey provides information of students’ impressions of institution’s academic advising services
ACT Survey of Academic Advising • Survey questions related to: • Advising information • Academic advising needs • Impression of advisor • Time spend with advisor
ACT Survey of Academic Advising • Provided students opportunity to evaluate current advisor at PCCUA • ACT scores and returns report to PCCUA • 172 students responded to survey
How to use this data • Feedback from students regarding academic advising • Indicates student perceptions of strengths and weaknesses in advising • Evaluation tool to assess academic advising • Individual advisor reports provided to advisors • Plan to continue the process of students evaluating advisors
Assessment of Student Learning • AKA - “The Assessment Plan” • Evolved into Assessment of Student Learning Process • Goals and Expected Outcomes of Student Learning
Assessment Web Page www.pccua.edu/assessment