GEM 2010 Planning Meeting New Teams Training Adult Population Survey (APS) Yana Litovsky

1. GEM 2010 Planning MeetingNew Teams Training Adult Population Survey (APS) Yana Litovsky Jeff Seaman Chile January 2010

2. Agenda • Introduction of the members of the GEM APS team • APS objective • Sample design • Review of the steps in the 2010 GEM APS cycle • Review of the components of the Request for Proposal

3. Most Important aps@gemconsortium.org

4. Mick Hancock • GEM Project & National Teams Manager • Based in Denmark, Mick Hancock joined GEM in January 2000 as the leader of the Danish Team. As GEM expanded, he went on to serve as Chairman of the Transitional Executive Committee and as President of the Association of GEM National Teams, in which capacity he helped transform GEM into a stand-alone legal entity (GERA). Now, as Operations Manager, Mick manages the project’s annual cycle, GEM staff and the 50+ national teams. • Before GEM, Mick held the post of Senior Researcher at the University of Southern Denmark.

5. Chris Aylett • GEM Project Administrator • Based in the UK, Chris Aylett has been with GEM for over 3 years. He manages the paperwork from the National Teams, issues invoices, liaises with the accounts department and maintains and develops the GEM website. He is also the secretary to the Board, organising their meetings and preparing agendas, papers and minutes. • Prior to working for GEM, he studied French at University College London, and is a qualified translator. Chris is also the bass guitarist for the up-and-coming rock band 'Scholars'.

6. Marcia Cole • GEM Global Project Manager • Based in the US, Marcia joined GEM in 2000, and is the longest serving employee of the GEM Coordination Team.  Her role covers a wide range of projects form website management to report production to convening the Indices Panel at the 2009 Annual Meeting. • Marcia holds undergraduate and graduate degrees in the literary field and, before GEM, she worked for 10 years in college textbook publishing.

7. Niels Bosma • GEM Research Director • Based in the Netherlands, Niels Bosma has been a member of the GEM Netherlands Team since 2001 and has been engaged in the GEM coordination team since 2004. • Niels Bosma holds an MSc degree in econometrics as well as a PhD on entrepreneurship dynamics and regional economic development at Utrecht University, Department of Economic Geography. He completed a research trainee program at Erasmus University Rotterdam in a joint program with EIM Business and Policy Research and Tinbergen Institute. He has published a number of articles in academic journals and he has contributed to several books and research reports on entrepreneurship

8. Jackline Gloria Odoch • GEM Research Assistant • Based in the UK, Jackie Odoch joined GEM in 2007. Her role as Research Assistant includes coding, managing the newsletter, proof reading and general administrative tasks. • Jackie is in the final year of her medical studies at King's College London with a Bachelors degree in Craniofacial Sciences and she hopes to become a surgeon. Jackie’s varied career includes posts as student ambassador, histology demonstrator, Kaplan teacher, healthcare assistant, diary secretary to the Minister of State for Health and editorial assistant for a biomedical publishing house. Currently she is involved in a project to send hospital equipment to Ghana

9. Alicia Coduras Martinez • GEM NES Coordinator • Based in Spain, Alicia Coduras heads the GEM Team in Spain since 2000 and manages the NES as a member of the GEM Coordination Team. She is also a member of the Research Committee. • Alicia is also an Associate Research Professor in the Department of Entrepreneurship and Family Business. She holds a doctorate in political sciences from the University Pompeu Fabra and a degree in economics and business sciences from the University of Barcelona. She publishes regularly in academic reviews and develops entrepreneurship reports for Spanish governmental institutions.

10. Jeff Seaman • GEM Data Consultant • Based in the US, Jeff joined GEM in 2007 to work on data quality issues. • Jeff holds an undergraduate and multiple graduate degrees from Cornell University and has worked extensively in the areas of technology, survey design, and sampling. He currently serves as the Survey Director for The Sloan Consortium and Co-Director of the Babson Survey Research Group. He has served as the Director of the Computing Resource Center and as Associate Vice Provost for Computing for the University of Pennsylvania and as Chief Information Officer for Lesley University.

11. Yana Litovsky • GEM Data Manager • Based in the US, Yana Litovsky joined GEM in March, 2009. Her role as Data Manager involves communicating with National Teams about data related issues as well as collecting and processing the submitted APS data. • Before GEM, she spent 4 years at the Harvard Business School as a Research Associate working in the field of Industrial Psychology. She holds an Undergraduate degree from Brandeis University in Psychology and Philosophy.

12. The project • Begun in 1998: 10 countries • In 2009: 55 countries, over 183,000 respondents • Objectives • To measure differences in the level of entrepreneurial activity between countries • To uncover factors determining the levels of entrepreneurial activity • To identify policies that may enhance the level of entrepreneurial activity

13. Introduction • The Global Entrepreneurship Monitor estimates the participation in business start-ups and new firms in different countries. It is therefore important that all national teams use the same procedure and provide data to the same standards worldwide so results from different countries can be compared.

14. Phases in Entrepreneurship identified in GEM

15. The Sample

16. Adult Population Survey • Representative national sample of the adult population of at least 2000 • Aged 18 to 99 years preferred (aged 18 to 64 accepted) • All individuals should be included • Those considered in and OUT of the labor force (homemakers, retirees, students) • Urban and rural areas • All geographic regions • Only exclusions are those visiting the country, in institutions (prisons, mental institutions), group quarters or the military

17. Administration • Telephone • Fixed-line (landline): Most common approach, but portion of the population reachable by fixed-line phones is decreasing. • Mobile: Typically used in conjunction with a fixed-line sample to improve coverage. • Face-to-face interviews • Required where telephone coverage is insufficient. • Web-based • Several trials to date – none meet GEM requirements. Not yet approved for GEM APS use.

18. Sampling Frame • Goal is to achieve a representative sample of the adult population. • Coverage – should allow sample selection from all the adult population and not exclude any particular group (the youngest, the poorest, etc.) • Possible Sampling Frames: • Telephone directories • Voter lists • Census data • National registry • Telephone Random Digit Dialing

19. Total Population Adult Population Sampling Frame

20. Total Population Adult Population Mobile Telephone Selecting a Sampling Frame Need a rule to prevent those with both fixed-line and mobile telephones from being counted twice. Fixed-line Telephone

21. Choice of Survey Vendor • The survey firm employed to carry out the interviews should have expertise in conducting scientific or academic surveys. • GEM is not a market research project, and so a market research survey company may not be the best choice in an environment with growing scientific demands. • Inappropriate selection of vendors used in the past has caused much time wasting, additional work and confusion.

22. Sample Selection • The GEM APS is a sample of individuals, therefore: • Any sampling technique that reaches a household (for example a face-to-face interview or calling on a fixed-line phone) must randomly select the respondent from within all members of that household. • Interviewing only the first person contacted is NOT allowed. • Two common techniques used to select the individual for interviewing: • Next Birthday method • Kish Grid

23. Call Backs • Multiple attempts (call backs) must be made to reach the designated respondent. • Interviewing only those present at the time of first contact can introduce considerable bias. • GEM typically requires 5 call back attempts for each potential respondent. • Call backs must be scheduled at different times of day and on different days of the week to avoid bias.

24. 2010 GEM APS Cycle

25. 1. Cycle Preparation • The GEM APS survey instrument is finalized for 2009. • New special topic questions reviewed and revised. This year there will not be a special topic section. • Questionnaire pre-tested to check question wording, skip patterns, and estimate timing. • Request for Proposals (RFP) revised for 2009. • Final calendar for 2009 cycle determined.

26. 2. RFP available • Final RFP is posted to the GEM consortium web site: • Instructions for submitting a proposal (referred to as RFP) • Final version of questionnaire • Description of questionnaire • Methodology template • Sample strata template • Fieldwork template • SPSS data template • Email announcement made to all teams.

27. 3. Download RFP and work with vendor • Each national team downloads the RFP package and begins working with their vendor on completing the requirements. • The coordination team remains available for questions during this process. • Vendors must use the GEM APS forms, they cannot submit their own forms. • Vendors must also submit a Survey Vendor Proposal, which they create themselves (no template). This contains any additional information about their company and methodology.

28. 4. Submit Completed RFP • Email the completed forms to aps@gemconsortium.org • The GEM APS coordination team will confirm receipt of the forms. • The national team MAY NOT BEGIN its survey until after the RFP has been approved by GEM APS coordination team.

29. 5. RFP Review • Process review – has all the required material been submitted? • Methodology review – does the sample and survey design meet GEM APS standards?. • Teams receive a review of their proposal including: • Our understanding of their methods • Questions, comments or requests for revisions

30. 6. Communication and Revisions • If necessary, the national team will be requested to submit any missing information. • If necessary, the national team will be asked to clarify specifics of the sample design or surveying process. • If necessary, the national team will be requested to revise the sampling and survey plan to meet GEM APS standards.

31. 7. RFP Approved • Begin the survey process • Suggestion: find a mentor GEM country. Contact other GEM teams with same cultural background, especially if they have the same language! • Work with vendor on translations • National team has more knowledge on the purpose of the questions • Vendors have more knowledge on how translated questions will be received by the respondents • Use back-translations to check if the questions have been translated well • For any (!!!) unclear issues: contact aps@gemconsortium.org

32. 7a. Pilot Survey • Strongly recommended for new teams or teams working with a new vendor. • Conduct a pilot survey of about 100 respondents. • Submit the pilot results (using the GEM data templates) to the GEM APS coordination team. • These results will be reviewed and tested: • Proper skip pattern • Correct variable coding • Proper use of data templates • Any problems will be quickly communicated back to the national team, so corrective action can be taken early.

33. 8. Submit Completed Survey Results • Send all completed templates to aps@gemconsortium.org • The GEM APS coordination team will conduct an initial review that all required material has been submitted. • Checks will include: • All templates are present • Data files are not corrupted and can be read • Data templates appear correct • This is not a detailed check on the quality of the data; that comes later.

34. 9. Harmonization and TEA Calculation • All data has extensive checks for quality: • Proper skip patterns used. • Proper variable coding used. • No excessive missing data. • Open-ended responses coded. • OE responses provided to us in English • Survey Vendor should try to obtain responses that are as thorough and specific as possible. • All national data converted to a standard coding scheme. • Indicators added to be used in calculating various GEM indices (such as TEA).

35. 10. Harmonized Data to National Teams • The complete harmonized data set, with all GEM indicators added, is loaded to the GEM Consortium web site. • National teams are notified when their data is available, which they can download from the web site. • Data is available only to those teams that have submitted all required documentation and paid their dues.

36. The RFP

37. RFP Instructions • Contains full description of entire RFP process

38. Questionnaire • Full questionnaire, with codes and skip patterns.

39. Questionnaire Description • Detailed description of each question

40. Methodology Overview • Vendor uses to provide full details of sample design

41. Sample Strata • How is the sample designed? • What strata are going to be used?

42. Population Statistics • The most recent population statistics for your country

43. SPSS Data Template • Used to submit final survey data

44. Remember aps@gemconsortium.org