Surveying Postsecondary ESL Programs Statewide

1. Surveying Postsecondary ESL Programs Statewide TESOL 2007 Colloquium March 22, 2007 Seattle, Washington 2-3:45 p.m. Grand Hyatt Seattle/Leonese III Room

2. Presenters Virginia Berger, Grossmont College Janet Eyring, CSU Fullerton Jan Frodesen, UC Santa Barbara Janet Lane, UC Davis Ellen Lipp, CSU Fresno

3. Background Information and Need for the Survey (Lane)

4. Demographic Data Language minority students comprise 40% of all K-12 students and an increasing population of postsecondary students. (CDE, 2005) Between 1994 and 2004, the total K-12 enrollment growth rate in California was 7.8%, but the Limited English Proficient enrollment growth rate was 30%. (CDE, 2005) Between 2001 and 2005, more than 1 in 5 foreign immigrants to the U.S. settled in California. (Kelley, 2005, LA Times)

5. Changes in the Population of English Learners Large increase in number of students who have received most of their education in the U.S. but speak a language other than English at home. Many lack competency in college-level academic English and have instructional needs differing from those of native English speakers. Many have been considered English proficient on basis of oral skills from an early age.

6. Changes in the Population of English Learners (continued) Colleges must address needs of these students along with needs of two other sub-groups of ESL learners, recently-arrived immigrants and international students. Have different needs but are often grouped together in college classes. Often enroll in classes designed for native English speakers; challenge for instructors who don�t have training/materials to work with them. Large and diverse multilingual population with multifaceted educational needs.

7. The Three California Postsecondary Systems California Community Colleges (109 colleges) Any student can enroll; wide range of backgrounds and linguistic proficiencies ESL has central role in mission (providing ESL instruction considered essential and important function) California State University (23 campuses) Main mission to prepare students for workforce and especially teachers for CA schools Instruction for ESL/multilingual students vary by campus, with some no ESL instruction or services University of California (10 campuses) Mission includes research and providing undergrad, grad, and professional education First developed ESL programs for international grad students (before children of immigrants and refugees reached college age in 1980s)

8. ICAS (Intersegmental Committee of Academic Senates) Established in 1980 Made up of representatives of the Academic Senates of each segment Designed to deal with issues of mutual interest, including Transfer Articulation General education Educational quality and standards

9. Transfer and Articulation Issues What are the experiences, needs, and challenges of ESL students as they transition between the three segments? Is there appropriate articulation of courses with CCC and transfer partners, CSU and UC? Are English learners progressing successfully within and across the segments? Do significant differences exist in procedures and offerings across the three segments?

10. Other Questions Raised by Educators, Administrators, and Legislators Are colleges effectively distinguishing nonnative English speakers who need specialized instruction from those who do not? Are assessment and placement procedures for ESL learners adequate? What programs, courses, and support services are currently offered for ESL learners? Could they be more effective? How are courses staffed? Are instructors adequately trained to teach them? What attention is being given to the education of English learners in courses across the disciplines?

11. Formation of ESL Task Force and Obtaining of Grant

12. Formation of the ESL Task Force Initially formed to address the particular concerns of the CCC Board of Governors�concerns shared by a great many others beyond the CCC system. In December 2003, ICAS (Intersegmental Committee of Academic Senates) appointed four members from each segment (N=12) with the following goals: To review academic offerings and support services for ESL learners at the California community colleges and four-year institutions To identify critical issues affecting student success To make recommendations for improving ESL students� academic achievement across the segments

13. Members of the ESL Task Force California Community Colleges Virginia Berger, Grossmont College Kathleen Flynn, Glendale College John Gamber, American River College Mark Lieu, Ohlone College California State University Jan Eyring, CSU Fullerton Ellen Lipp, CSU Fresno Karen Russikoff, CSU Pomona (Robby Ching, CSU Sacramento) University of California Jan Frodesen, UC Santa Barbara (Chair) Janet Lane, UC Davis Robin Scarcella, UC Irvine Jane Stevens, UC San Diego** **Representative from outside the fields of ESL and Applied Linguistics

14. Obtaining of Grant Applied for and received a grant, approximately $40,000, from the CCCs To perform an online survey and produce a subsequent report ICAS would be a partner, receiving regular reports as well as evaluating the final report. The Task Force met regularly and communicated frequently online while working on the project.

15. Other Related ICAS (Intersegmental Committee of Academic Senates) Projects California Pathways: The Second Language Student in Public High Schools, Colleges and Universities (1996; revised 2001) Defines ESL proficiency levels that can be used across secondary and postsecondary segments for curriculum development Describes ways second language learners acquire English, the challenges they face, and the very different ESL populations that exist Obtain from CATESOL website: http://www.catesol.org/pathways.pdf

16. Other Related ICAS (Intersegmental Committee of Academic Senates) Projects (continued) Academic Literacy: A Statement of Competencies Expected of Students Entering California�s Public Colleges and Universities (Spring 2002) Responses to questions about the academic preparation of entering freshmen provided by CCC, CSU, and UC faculty through a web-based survey. Report emphasizes need to recognize different subgroups of second language learners and to provide appropriate instruction based on these differences. Obtain from Academic Senate for CCCs website: http://www.asccc.org/Publications/Papers/AcademicLiteracy/main.htm

17. Designing, Piloting, and Revising the Survey (Frodesen) Initial Stages of Survey Design Research Objectives Writing Survey Questions Piloting the Survey Final Revision

18. Initial Stages of Survey Design Responding to ICAS concerns as amended by the ESL Scoping Committee (2002) ICAS Scoping Committee had defined charge of Task Force Included future Task Force members Lieu, Frodesen, Lane and Lipp

19. Initial Stages of Survey Design Deciding what is �doable� and �not doable,� given time/funding constraints �Doable�: Determining whether or not students are identified as ESL learners; how they are identified; describing types and levels of programs and courses, among others �Not doable�: Evaluating programs and courses, examining relationships between non-credit/extension programs and a college/ university�s ESL program; examining ESL instruction for Teaching Assistants in 4-year colleges and universities, among others

20. Research Objectives To determine if and how students are identified as ESL learners for tracking progress and/or for gathering longitudinal data. To determine how students are identified as ESL learners for the purposes of initial assessment selection and/or for the purposes of appropriate placement. To identify the range of courses and program designs available to address the academic and vocational preparation of ESL learners across the segments, and the processes by which these programs are evaluated.

21. Research Objectives To identify how the placement of ESL learners into courses specifically designed for ESL learners across the segments is affected by matriculation practices (enforcement of prerequisites, waiver policies, timeline for completion, course repetition). To determine the kinds of student support services that are specifically targeted to ESL learners, whether prior to their enrollment or while they are enrolled in ESL courses, and after they have completed ESL coursework. To determine the types of data on ESL learners that are collected and reported, and the ways in which they are gathered, both while the students are enrolled in ESL courses and after they complete ESL coursework.

22. Writing Survey Questions Starting with objectives: What we needed to know about ESL learners, programs, services Deciding format of questions (Yes/no, multiple choice, open-ended comments) Committee meetings to draft revise, discuss E-mail listserv: commenting and revision Checking of all questions by members of each segment for missing or incorrect information (e.g., ways of assessing or placing students

23. Writing Survey Questions Consulting with Director of Social Science Survey Center at UCSB Applied for and received Human Subjects exemption from UCSB Office of Research Creating separate sections for different segments Examples: Two different sets of questions for Identification of ESL learners (CCC, CSU/UC); three different sets for Assessment and Placement Multiple drafts produced prior to piloting

24. Piloting the Survey ESL, English, Writing Program faculty contacted from each of the three segments (N=7) Selected based on several variables: college size; type of program (or lack of any ESL program); willingness to assist the Task Force Completed a paper version of the survey (sent and returned by e-mail attachment) Respondents wrote comments, length of time it took to complete, noted any problems

25. Revising the Survey ESLTF responded to pilot survey data (phone, e-mail contacts) Revised for clarity, category confusion (e.g., writing vs. reading/writing classes) SSSC developed internet version, which ESLTF further revised Resulting survey: 87 questions (Not all questions answered by all respondents)

26. QUESTION BREAK

27. Conducting the Survey and Analyzing Results (Lipp) 

28. While the Task Force was writing the survey, the group selected Paolo Gardinali of the Social Science Survey Center (UCSB) to provide the following support: putting the survey on line making the survey password protected developing crosstabulation displays of the quantitative data compiling responses to the open-ended questions

29. Trial Run of the On-Line Questionnaire