180 likes | 273 Views
Office of Postsecondary Education International and Foreign Language Education. FLAS Program New Challenges: Pre/Post Language Evaluations and Biennial Tracking. Cheryl Gibbs Beth MacRae July 27, 2011. Topics . Fellow Pre and Post Language Evaluation
E N D
Office of Postsecondary Education International and Foreign Language Education FLAS Program New Challenges: Pre/Post Language Evaluations and Biennial Tracking Cheryl Gibbs Beth MacRae July 27, 2011
Topics • Fellow Pre and Post Language Evaluation • The importance of the language evaluation • Results of feedback from Centers • Challenges and solutions • IRIS Enhancements • FLAS Tracking Survey • Why now? • What will the survey cover? • Challenges and concerns • FLAS tracking survey – tentative plan • Carry-Over Funds
Fellow Pre & Post Language Evaluation • Results of the language evaluations will show: • Effectiveness of the FLAS program • Future budget justifications • First year and still a learning process…. • FLAS Language Advisory Group • Ray Clifford, Meg Malone & Scott McGinnis
Feedback from Centers • Most Centers currently: • Use instructors familiar with administering OPI or ACTFL tests and/or trained as evaluators • Use instructors of the target language • Administer the tests through the Center • Hold the student responsible for identifying the evaluator
Challenges and Solutions • Same vs. different instructors? • Same instructor = standardization of testing • Students and language evaluators forget about the post evaluation during the academic year • FLAS Coordinators send reminder one month prior to final report due date • The test does not fit the clientele • Potential future revisions
More Challenges and Solutions • FLAS fellows tend to be less motivated to participate in the evaluation process after completing the study program • Centers can require students sign an agreement • Limited English language skills of the instructor overseas • Available domestic backup • Not all summer programs are completed by September 1 when reports are due • IFLE will change the date to October 1
Other Challenges • Format is challenging because it only tests oral proficiency. • IFLE will consider other evaluations in the future • Can IFLE provide the instructors with a standard rubric for determining the language markers? • No, it would allow potential predetermination of the student’s ability. • Can IFLE consider the option of offering a small stipend or compensation to the evaluators? • Unfortunately, this is not an option at this time.
IRIS Enhancements and More • FLAS competition import • Guides and FLAS instructor business process document • Language evaluation results • FLAS instructors now have one account
FLAS Tracking SurveyWhy Now? • The Congress believed – • That a mechanism for determining program IMPACT was long overdue. • All grantees shall administer a survey to determine— • Post graduate employment • Education • Training
Why Now? • That the federal INVESTMENT has been substantial. FY 2000 – 2002: $56,669,000 FY 2003 – 2005: $84,193,000 FY 2006 – 2009: $117,903,000 • That thousands of fellows have been trained. FY 2000 – 2002: 4,696 FY 2003 – 2005: 6,037 FY 2006 – 2009: 8,210
Why Now? • And that the INTEGRITY and VALUE of the program could best be validated after students had graduated from their area studies and language training programs.
What Will the Survey Cover? The FLAS tracking survey will solicit the following: 1. FLAS Recipient (Alum) Information • Gender • Age • Race/ethnicity • Citizenship • Location (state, country) 2. Postgraduate employment, education, & training • Employment status • Sector • Year (first) degree with FLAS support is obtained • Additional degree(s) or training obtained & when
What Will the Survey Cover? 3. Foreign language and area studies training • Relevance of area studies training to job requirements and responsibilities • Frequency for using/applying language skills and area studies expertise • Usefulness of language and area studies training
Challenges and Concerns • Updated email addresses • Centers’ access to data • Privacy issues • Center specific questions • Security concerns, Survey Monkey vs. Qualtrix • Alternate format besides email • ED vs. Center administered survey and effect on response rate • IRIS capabilities for administering the survey
FLAS Tracking Survey – Tentative Plan • Select FLAS Tracking Advisory Committee • Convene FLAS Tracking Advisory Committee • Send survey to Centers for final comment • Submit survey for approval • Request updated email addresses • Survey first cohort: AY 2010 and Summer 2011 • Publish data on program outcomes • Provide data to Centers
Carry-Over Funds • Academic Year to Summer • Summer to next Academic Year with approval from program officer • Only after attempting to use and share summer funds • Email request must be approved by program officer
Questions & Concerns Thank You!