470 likes | 666 Views
New CTE Follow-up Survey. Training Topics. Discuss Purpose Explain Need for Good Response Rate Explain Interviewer Responsibilities Introduce the Survey Mock Interview Practice (2 w & w/o stumbling blocks) Discuss Problems Consistency & Confidentiality Lessons on making calculations
E N D
Training Topics • Discuss Purpose • Explain Need for Good Response Rate • Explain Interviewer Responsibilities • Introduce the Survey • Mock Interview • Practice (2 w & w/o stumbling blocks) • Discuss Problems • Consistency & Confidentiality • Lessons on making calculations • Closely Monitor
p1 Purpose & Use • Provide data to meet reporting needs. • Used for • Perkins III Core Performance Indicators. • Ranking programs for State Added Cost funding • LEAs to use for program improvement & aiding students not placed • Program reviews • Reporting CTE program impact to public
p6-8 The Interview Process Qualities of Good Implementation • Consistency • Response Rate • Interviewer Responsibilities
p6 Consistency • Goal = to collect data from all students statewide • in exactly the same way • at exactly the same time • Timing = 9 mo after June of senior year
P6-8 Response Rate • Acceptable Rate • 90% - 100% • Unacceptable Rate • < 50% • Relationship to Placement Rate
A-C Tips for Improving RR • Use a phone survey method • Call from the school phone • Leave messages on answering machines • Call in evenings & on weekends • Make at least 6 attempts • Other suggestions in Attachment C
P9-10 Interviewer Responsibilities • Be consistent • Follow question wording exactly • Be objective • Follow the script • Check your work BEFORE Hanging Up • Enjoy your work
p9 Follow Wording Exactly • Would you climb a tree? • Should you climb a tree? • Could you climb a tree?
p10 Be Objective • WHY do you say that? • Why do YOU say that? • Why do you say THAT?
P11-22 New CTE Follow-up Phone Survey • Upfront • Opening • Student contact • Proxy contact • Part A: Current Status • Part B: School/Training • Part C: Employment • Part D: Only if Not Working • Closing
p11 Opening – Student Contact Hello, this is _____ from _____. Is ____ there?
p11 Student contact
p11 Proxy contact
p12 Part A Current Status 1. Lets start what you’re doing now. Are you going to school? Working? Verify applicable part of answer with statement before coding. YesNo a. in a training program or attending school or college? b. working as an apprentice? (If Yes: Q1c = Yes*) c. working? d. on full-time, active duty in the military? (If Yes: Q1c = Yes & Q7 = 40 hrs/wk) e. on part-time duty in the military? (If Yes: Q1c = Yes & Q7 = 40 hrs/wk) f. Other: (specify code from list below) ____ 1. unpaid leave of absence (disability, Family leave) 2. on seasonal layoff
p13 Q1 - Skip Options • If working, but not in school or training, Skip to Part C. • If ‘Other’ only, Skip to Part D.
p14 Part B: School/Training • I have some questions about your schooling or training.
p15 3. Where are you going to school? (Note: If enrolled in more than one, identify the primary one.) business or trade school, or career center community college college/university military (National Guard, West Point, Annapolis, DLI, Merchant Marines, etc.) other ___________________________
p16 4. What type of program are you in? [Read list] certificate associate degree bachelor’s degree other (specify) ___________________
p16 Part B – Skip Options • If No Current job, Skip to Part D.
p17 Part C: Employment • Now, I’d like to talk about your job as it relates to your (selected) program. 5. On your job, how much would you say you’re using the skills you were taught? Would you say you use them . . . ? A lot Some Hardly ever Not at all
p18 6. How strongly do you agree with the statement, I am satisfied with my present job? Do you . . . ? Strongly agree Agree Disagree Strongly disagree
p18 7. How many hours a week do you work? ______________ hrs/week 7a. If not specific: Would you say it’s 35 hrs a week or more? Yes No
p19 8. Including tips and commissions, how much do you make an hour? $ _________ / hr Skip to Comments
p22 Part D: Only if Not Working 9. Are you currently looking for a job? Yes No
p22 Comments • Thank you. That’s all I needed. Now, are there any comments you’d like to make to help us improve our programs.
Break Back in 10 min
p Proxy Survey • Part A: Current Status 1. Let’s start with what (she/he) is doing now. • Part B: School/Training 3. Where is (he/she) going to school? 4. What type of program is (he/she) in?
p • Part C: Employment 7. How many hours a week does (he/she) work? 7a. If not specific: Would you say it’s 35 hours a week or more? 8. Including tips and commissions, how much does (he/she) make an hour? Skip to Comments. • Part D: Only if Not Working 9. Is (he/she) currently looking for a job?
p6 Consistency • Goal = to collect data from all students statewide • in exactly the same way, • at exactly the same time.
p20 Prefaces to Avoid Using • Apologetic – If you don’t mind my asking… • Blameless – This is confidential, but the state needs it. • Estimates – Approximately how much … • On guard! – I have to ask this question. • Proxy – You may not be able to answer… • Opt out – You don’t have to answer …
p Role Play #1 • Practice Conducting the Survey • Choose a partner. • Go to a room • Practice both roles – the interviewer and the student. • Practice at least three times. • Switch roles with your partner. • Be KIND. Do not throw in stumbling blocks. Back in 15 min
Potential Problem & Solution #1 • Where are you going to school? I take a class at the career center. ? Are you registered at the career center? I’m registered at the community college, but they hold the class at the career center.
Potential Problem & Solution #2 • On your job, how much would you say you’re using the skills you were taught? Student from automechanics program working at a dealership says “not at all.” ? What should the interviewer do? a. Mark the answer and go on. b. Review skills they learned & ask again. c. Explain why that’s not possible & ask again.
Potential Problem & Solution #3 • How strongly do you agree with the statement, “I am satisfied with my present job”? Student working at McDonald’s “Strongly Agrees”. ? What should the interviewer do? a. Review potential for the program they took. b. Talk about benefits & ask again. c. Mark the answer and go on.
Potential Problem & Solution #4 • Including tips and commissions, how much do you make an hour? The completer has more than 1 job. ? What should the interviewer do? Combine and estimate the overall hourly wage.
Potential Problem & Solution #5 • Including tips and commissions, how much do you make an hour? The interviewer is uncomfortable about asking the question. ? What should the interviewer do? a. Apologize, say “I know this is sensitive, but b. Ask for an estimate, “About how much … c. Explain it’s optional. Just ask the question.
Role Play #2 • Practice Conducting the Survey • Choose a partner/new partner • Go to a room • Practice both roles (interviewer & responder) • Practice both surveys (phone & proxy) • Do the survey twice (2 each) • Go ahead -- throw in stumbling blocks Back in 15 min
A-C Handling Difficult Calls • Talkative • Grouchy • Irate
p Confidentiality • Part of the 2 Big Cs What was the first C? • Meaning • A promise by interviewers who know the response of specific completers not to reveal those responses to anyone. • Keeping responses a secret Consistency
p19 Calculations • Weekly rate based on 40 hr/wk • $400/wk ÷ 40hr/wk = $10.00/hr • Monthly rate based on 2080 hr/yr • $1200/mo x 12mo = $14,400/yr $14,000/yr ÷ 2080 hr/yr = $6.92/hr • Annual rate based on 2080 hr/yr • $18,000/yr ÷ 2080 hr/yr = $8.65/hr
p8 Strategies for Making ContactChallenges • Updated records • Mobility of students • When to call • The Telephone Consumer Protection Act states that telephone solicitation cannot occur before 8:00 a.m. or after 9:00 p.m • Schools technically are not solicitors • State still recommends keeping within the 8 a.m. - 9 p.m. time frame
p9 Challenges (cont’d) • Answering Machines • Caller ID • Reaching Students • Disconnects • Callbacks Can’t Get Through
Solving Problems • No finite list of problems • Some may be area specific • SSC will help with solutions • Careful about making snap decisions • All solutions are not easy • Record enough info – no need to recall • Keep own list • Experience in handling
Process Problems • Contact Dr. Jill Kroll Office of Career and Technical Preparation (517) 241- 4354
Lunch Start at 1:00 pm