The Joint Program in Survey Methodology and its Impact on the Federal Statistical Agency Workforce

1. The Joint Program in Survey Methodology and its Impact on the Federal Statistical Agency Workforce Cynthia Z.F. Clark and Gia. F. Donnalley U.S. Census Bureau Roger Tourangeau Joint Program in Survey Methodology, University of Maryland

2. Joint Program in Survey Methodology:Background • Funded by NSF; supported by 15 federal statistical agencies • Joint Program in Survey Methodology (JPSM) • University of Maryland • University of Michigan • Westat • Began in Fall of 1993

3. Joint Program in Survey Methodology:Academic Program • Citation in Introductory Survey Methodology • Citation in Economic Measurement • Graduate Certificate in Intermediate Survey Methodology • Graduate Certificate in Survey Statistics • Masters of Science in Survey Methodology • Ph.D. in Survey Methodology

4. JPSM Short Courses • 10-12 short courses (1-2 days) offered each year • Examples: • Telephone Survey Methodology • Computer Assisted Methods in Surveys • Small Area Estimation • Self Administered/Mail Surveys • Statistical Disclosure and Disclosure Limitation • An Intro to Pre-testing Techniques

5. JPSM: Citation in Introductory Survey Methodology • One semester length academic course • Fundamentals of Survey Methodology • Four core short courses: • Questionnaire Design • Survey Management • An Introduction to Survey Sampling • Introduction to Survey Estimation • Four elective short courses

6. JPSM: Citation in Economic Measurement • One semester length academic course • Introduction to Economic Measurement • Four core short courses: • An Introduction to Survey Sampling • Introduction to Survey Estimation • Introduction to Survey Methods for Businesses and Organizations • Analysis and Presentation of Economic Data • Four elective short courses

7. JPSM: Graduate Certificate in Intermediate Survey Methodology • Six semester length academic courses • Five required courses • One JPSM elective course • Required Courses: • Fundamentals of Survey Methodology • Intro to Statistical Methods using Computers • Data Collection Methods • Applied Sampling • Questionnaire Design

8. JPSM: Graduate Certificate in Survey Statistics • Six semester length academic courses • Four required courses • Two JPSM elective courses • Required Courses: • Sampling Theory • Applied Sampling • Inference from Complex Surveys • Topics in Sampling

9. JPSM: Masters Degree Program

10. JPSM: Ph.D. Program in Survey Methodology • Qualifying exam before matriculation • Advisory committee • A set of doctoral courses and two required • core Ph.D. seminars • Comprehensive Exam • Dissertation

11. Interagency Collaboration with JPSM • JPSM now contractually funded by 12 agencies • Facilitated by the U.S. Census Bureau • Established protocol for agency sharing of benefits

12. Shared Agency Benefits from JPSM • Practicum Survey • Survey Design Seminar • Summer Intern Program • Recruiting of Graduates • Customizing of the Program • Annual Sponsor Meeting

13. JPSM: Master’s Degree Graduates

14. JPSM Junior Fellows Program

15. Survey of Master’s Graduates • March 2002 • Email survey • 55 of 70 alumni responded (80%)

16. Survey of Master’s GraduatesQuality of JPSM Academic Experience

17. Development of new programs to meet Census Bureau Needs • Fundamentals of Survey Methodology • Introduction to Economic Measurement

18. U.S. Census Bureau: Participation in JPSM • Competitive participation in master’s degree program since 1993 providing financial support and half-time work • Financial support for academic semester length courses • Financial support and work-time for short courses

19. JPSM: Impact on Census Bureau Workforce (1996-2004) • Masters Degree • 40 Census Bureau graduates(23 statistics, 17 social) • 14 employees enrolled • Citation in Introductory Survey Methodology • 5 Census Bureau graduates • 5 employees enrolled

20. JPSM: Impact on Census Bureau Workforce (1996-2004) • Certificate in Intermediate Survey Methodology • 5 Census Bureau graduates • 7 employees enrolled • Certificate in Survey Statistics • 2 Census Bureau graduates • 6 employees enrolled

21. JPSM Graduate Assistantships at the Census Bureau • Contract with University of Maryland • Work half-time while in classes

22. Impact of the Census Bureau’s Participation in the JPSM • Three focus groups- May 2004 • - Two of master’s degree graduates • - One of supervisors of graduates

23. Composition of Focus Groups with Graduates

24. Composition of Focus Groups with Supervisors of Graduates

25. Focus Group Findings • Positive effects of the JPSM program on careers at Census Bureau • Promotions • Networking • Increased confidence in skills • More knowledgeable about survey methodology • Motivated to question methods and techniques used for years • Improved writing and documentation skills • Gained better understanding of research process and survey design

26. Focus Group Findings • Positive effects of the JPSM program on careers at Census Bureau • Knowledgeable about literature and survey methodology tools • JPSM credentials backed up work experience • JPSM background enabled total career change • Gained familiarity with survey terminology • Gained confidence to start projects on their own • Understood implications of methodological changes on the data

27. Future Direction for Use of the JPSM by the Census Bureau • Identify other employees in office participating • in JPSM • Continue efforts to incorporate economic survey methods into the JPSM • Incorporate more examples from establishment surveys • New JPSM Citation in Economic Measurement

28. Future Direction for Use of the JPSM by the Census Bureau • Participate in Development of courses in: • Small Area Estimation • Statistical Editing and Imputation • Statistical Disclosure Techniques • Record Linkage