Assessing First-Year Student Expectations and Experiences at Two-Year and Four-Year Institutions: The CSXQ, CSEQ, and CC

1. Assessing First-Year Student Expectations and Experiences atTwo-Year and Four-Year Institutions: The CSXQ, CSEQ, and CCSEQ Michael J. Siegel, Ph.D. Research Associate Policy Center on the First Year of College  2003 Summer Assessment Institute July 22, 2003

2. Goals for Session • Examine background / structure / content of the “C/Q” Instruments: • College Student Experiences Questionnaire (CSEQ) • College Student Expectations Questionnaire (CSXQ) • Community College Experiences Questionnaire (CCSEQ) • Discuss relevant ways in which instruments can be used on your campus, and for what purposes • Share national data comparing expectations and experience as framework for discussion

3. The CSXQ, CSEQ, and CCSEQ are organized around the following principle: Students do better academically and socially when they apportion time to activities that lead to desirable learning outcomes: studying, interacting regularly with faculty and staff, engaging with students who might have different opinions and views than they do, getting involved in service-learning or community service, and participating in educationally purposeful co-curricular activities

4. Seven Principles for Good Practice in Undergraduate Education(Chickering and Gamson, 1987) • encourages student-faculty contact; • encourages cooperation among students; • encourages active learning; • gives prompt feedback; • emphasizes time on task; • communicates high expectations; and • respects diverse talents and ways of learning. Good practice in undergraduate education…

5. What is the CSEQ? The College Student Experiences Questionnaire (CSEQ) assesses the quality of effort college students expend in using the resources and opportunities provided by the institution for their learning and development.

6. CSEQ Fast Facts • Developed in 1979 by Dr. Robert Pace at UCLA • Since the first edition in 1979, more than 400,000 students have completed the instrument • Over 500 institutions, representing all institutional types, have used the CSEQ • Now in its 4th edition (2nd edition developed in 1983; 3rd edition in 1990)

7. Common Uses of the CSEQ Assessment emphasizes outcomes, or what students have learned Accountability emphasizes efficiency, or how resources are used Accreditation emphasizes institutional quality and improvement

8. Content of the CSEQ • Background Characteristics • Activities Scales • Environment Scales • Estimate of Gains Scales

9. CSEQ Activities Scales Eleven scales reflect the quality of effort students expend in activities related to: • Library • Computer and Information Technology • Course Learning • Writing Experiences • Experiences with Faculty • Art, Music, Theater • Campus Facilities • Clubs and Organizations • Personal Experiences • Student Acquaintances • Scientific and Quantitative Experiences • Topics of Conversation • Information in Conversations

10. CSEQ Measures of the College Environment Ten scales measuring perceptions of the campus environment with regard to • the extent to which the campus emphasizes diverse aspects of student learning and personal development • relationships with faculty members, administrators, and other students

11. CSEQ Measures of the Estimate of Gains Student ratings of progress toward important educational goals Goals are presented in five major clusters: • General Education, Literature, Arts, and Social Sciences • Personal Development and Social Competence • Science and Technology • Intellectual Skills • Vocational Competence

12. What is theCSXQ? The (CSXQ) provides information about new student expectations of: • The nature and frequency of interaction with faculty members • Expected use of campus facilities, learning centers, and other resources provided for their learning • Satisfaction with college • The nature of college learning environments • Involvement with peers from diverse backgrounds (e.g., ethnic, racial, social, religious)

13. CSXQ Fast Facts The CSXQ asks students what they expect from the first year in terms involvement in educational activities, experiences with the campus environment, and anticipated learning outcomes. • Pace and Kuh developed from CSEQ • FIPSE Influence • 2nd Edition (1999) • Norms • More than 33,000 students at over 50

14. CSXQ Activities Scales Eleven scales reflect the quality of effort students expect to expend in activities related to: • Library and Information Technology • Experiences with Faculty • Course Learning • Writing • Campus Facilities • Clubs, Organizations, Service projects • Student Acquaintances • Scientific and Quantitative Experiences • Topics of Conversation • Information in Conversations • Reading and Writing

15. CSXQ Measures of the College Environment Ten college environment questions that question the extent to which students believe certain variables will be emphasized at the institution during the upcoming year • Environmental Emphasis: • Seven scales refer to the extent to which environment emphasizes scholarly, intellectual, and practical activities. • Quality of Relationships: • Three scales refer to relationships with students, faculty members, and administrative offices and personnel.

16. Results from the CSXQ can be used to inform: • Institutional research, evaluation, and assessment of the student experience • Enrollment management, student recruitment and retention initiatives • Faculty development, advising and academic support services • First year experience programs • Orientation, residence life, and student activities

17. What is the CCSEQ? • Institutions use the CCSEQ to: • Prepare for self-study and accreditation review Assess Institutional Effectiveness • Evaluate general education, transfer, and vocational programs • Measure student interest, impressions and satisfaction • Discuss ways to improve student involvement • Encourage dialogue between academic affairs and student affairs

18. The CCSEQ Focuses on Four Distinct Elements of the Community College Experience • Who are the community college students and what are their reasons for attending community college? • To what extent do students at the college utilize campus facilities and resources, and of what opportunities for learning do students take advantage? • What are student impressions and perceptions of the community college experience? • What programs have students made toward important learning goals?

19. CCSEQ Activities Scales Twelve scales reflect the quality of effort students expend in activities related to: • Course Activities • Library Activities • Faculty • Student Acquaintances • Art, Music Theater Activities • Writing Activities • Science Activities • Athletic Activities • Career/Occupational Skills • Computer Technology • Clubs and Organizations • Counseling and Career Planning

20. CCSEQ Measures of the Estimate of Gains Student ratings of progress toward, and gains in, important educational goals Goals are presented in five major clusters: • General Education, Literature, Arts, and Social Sciences • Personal Development and Social Competence • Science and Technology • Intellectual Skills • Vocational Competence

21. CCSEQ Measures of the College Environment Eight scales measuring perceptions of the campus environment with regard to • the extent to which the campus emphasizes diverse aspects of student learning and personal development • relationships with faculty members, administrators, and other students

22. CSXQ, CSEQ, and CCSEQ Administration • Mail, Internet (CSXQ and CSEQ only), classroom, residence halls • For CSEQ and CCSEQ—with first-year students, typically administered during the second semester; CSXQ administered before classes begin, primarily during orientation • Undergraduate population or unique environment; given the scope of off-campus responsibilities at two-year school, sampling must be more strategic • Consortia of colleges and universities

23. Strategies for bridging student expectations and reality • “Expectations Audit”: Whose promising what? “Contract” between student and institution. • Student academic job descriptions • Comparative analysis of student expectations and institutional expectations for students (e.g., “environmental scan”) • Investigate expectations of first-year students (e.g., quant surveys, qual focus groups) • Develop common language and standards for delivery of first year of college

24. Further ideas for narrowing the gap(s) between expectations and reality • Focus efforts on student expectations while student expectations are still forming (Timing) • Try to discover, understand, and close the gap(s) that exists between what students expect and what they actually experience during the first year of college • Coordination between academic and student affairs is critical in setting expectations for student performance and engagement • Communication of institutional expectations to incoming students is imperative. Messages need to systemic and conveyed in a systematic manner

25. What do national data tell us student expectations and experiences? • CSXQ = 32,000 beginning frosh at 36 four-year colleges and universities (1998-2001) • CSEQ = 35,500 end-of-year frosh at 121 four-year colleges and universities (1998-2001)

26. Expected & Reported Grades

27. Hours Per Week Studying

28. Use Study or Academic Skills Center

29. Use Library as a Quiet Place to Read or Study

30. Ask Instructor for Comments/Criticisms About Your Academic Performance

31. Discuss Term Paper or Class Project with a Faculty Member

32. Socialize with a Faculty Member Outside of Class

33. Work on a Campus Committee

34. Have Serious Discussions with Students Whose Philosophy or Personal Values Very Different From Yours

35. Have Serious Discussions with Students Whose Racial and Ethnic Backgrounds Different Than Yours

36. Course-Related Learning Activities

37. Out-of-Class Learning Activities

38. Contact Information CSXQ and CSEQIndiana University Center for Postsecondary Research and Planning1913 East 7th StreetBloomington, Indiana 47405Phone: 812.856.5138E-mail: cseq@indiana.edu CSSEQUniversity of MemphisCenter for the Study of Higher Education308 Browning HallMemphis, TN 38148Phone: 901.678.2775E-mail: ccseqlib@cc.memphis.edu Michael J. Siegel, Ph.D. Research Associate Policy Center on the First Year of CollegeBrevard College400 North Broad Street Duplex #2Brevard, North Carolina 28712 828.877.6009-Phone 828.883.4093-Fax siegelmj@brevard.edu www.brevard.edu/fyc/