1 / 22

Question-led mixed methods research synthesis

Question-led mixed methods research synthesis. Centre launch 21 June 2005 David Gough and Sandy Oliver Institute of Education, University of London. David Gough Sandy Oliver Angela Harden James Thomas Rebecca Rees Adam Fletcher Lisa Underwood Ann Oakley.

sona
Download Presentation

Question-led mixed methods research synthesis

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Question-led mixed methods research synthesis Centre launch 21 June 2005 David Gough and Sandy Oliver Institute of Education, University of London

  2. David Gough Sandy Oliver Angela Harden James Thomas Rebecca Rees Adam Fletcher Lisa Underwood Ann Oakley Building on more than ten years’ experience of synthesising policy relevant research in health, education and social welfare Methods for Research Synthesis Programme

  3. Professional Experience & Expertise Pragmatics & Contingencies Political Judgement Research Evidence Lobbyists & Pressure Groups Resources Habits & Tradition Values DIFFERENT TYPES OF EVIDENCE Adapted from Philip Davies, 2005

  4. Research production and evidence Evidence influenced by the context of its production • All the activities of a research commissioning or granting agency (including training) • All the activities of a research production facility (e.g. institute, department, university) • The activities of a potential research user organization and its staff • The entire ‘research regime’ in a country Adapted from Jonathan Lomas, 2005

  5. Research methodology In question-led synthesis, methodology is • A system of principles, practices, and procedures applied to a specific branch of knowledge. • A set of procedures or methods used to conduct research. • For asking the questions as well as findings the answers

  6. Choosing questions Gathering questions Policy makers Practitioners Service users Members of society Academics Setting priorities Consensus development methods Framing questions (un)answerable research questions Finding answers Choosing appropriate research designs Choosing methods for finding, appraising and synthesising the findings of research reports Questions and methods

  7. Policy makers Practitioners Service users Members of society Academics Collective questions Population wide? Costs? Practical, delivery issues? Personally relevant? Ethical? ConceptualPhilosophical? Answerable? ??? How questions vary

  8. My question is, are we having an impact?

  9. User question led synthesis • What do we want to know (and who wants to know and why)? • What do we know already (and how do we know it)? • What more do we need to know (and how can we know it)? • Can not be value free • Involves intellectual work

  10. Population People over 55 Older patients Older people at less risk Interventions to prevent injury to reduce falls & frailty to prevent falls & injury to prevent accidents Exercise/ balance training Medical interventions Outcomes Knowledge Falls or fall related injury Strength, balance, gait, sway Design Controlled trials RCTs Quality assessed RCTs Older people, accidents and injuries

  11. Questions do make a difference 6 reviews of older people and accident prevention Total studies included 137 Common to at least two reviews 33 Common to all six reviews 2 Treated consistently in all reviews 1 Oliver et al. 1999

  12. PERSPECTIVES AND PARTICIPATION WHAT DO YOU WANT TO KNOW? TYPES OF KNOWLEDGE INTERPRETATION AND APPLICATION RESEARCH QUESTIONS COMMUNICATION OF KNOWLEDGE RESEARCH STUDIES AND METHODS WHAT HAS BEEN DONE? What more needs to be known? TYPES OF RESEARCH EVIDENCE WHAT IS KNOWN? (WITHIN THOSE PERSPECTIVES AND THAT FORM OF KNOWLEDGE)

  13. Perspectives and participation (i) Research What do we want to know? PERSPECTIVES AND PARTICIPATION (ii) User of service/ public (i) Research (iii) Practitioner (ii) User of service/ public (iv) Policy community (iii) Practitioner (v) Organisational (iv) Policy community Interpretation and application What do you want to know? TYPES OF KNOWLEDGE Effects? TYPES OF KNOWLEDGE (v) Organisational How/processes? Interpretation and application Nature,/extent/frequency? Effects? Perspectives/insights/concepts? RESEARCH QUESTIONS How/processes? RESEARCHQUESTIONS Nature/extent/frequency? Perspectives/ concepts? Communication Communication Action research What has been done? Action research Survey What has been done? RESEARCH STUDIES AND METHODS Survey Case study RESEARCH STUDIES AND METHODS Case study Experimental Experimental Multimethod Multi method Effects? What do we know? How do we know it? RESEARCH EVIDENCE What do we know? How do we know it? What don’t we know? How could we know it? How/processes? RESEARCH EVIDENCE Perspectives/insights/concepts? Nature/extent/frequency? Nature,/extent/frequency Perspectives/ concepts? How/processes? Effects

  14. Need for synthesis • Brings together what we know – whatever we are studying • Contextualizes information from new studies • Involves explicit systematic methods and thus transparency • These may be lacking in non systematic reviews and expert opinion however excellent

  15. Systematic review: key features • Synthesises the results of primary research • Uses explicit and transparent method • A piece of research, following standard set of stages • Accountable, replicable, updateable • Need for user involvement

  16. Question led synthesis • Questions looking for answers • Make implicit assumptions explicit • All types of question so all types of research design • Statistical, narrative empirical and conceptual synthesis • Mixed methods synthesis

  17. Dimensions of difference in synthesis models • Review/research questions (impact, process, need, explanatory concepts) • Research designs considered relevant • Types of data - numerical or textual • Quality assessment of different designs • Breadth of question and research design • Quantitative/narrative empirical/conceptual synthesis • Variation in contribution of each study to the systematic synthesis

  18. Mixed methods synthesis Review question e.g. What is known about the barriers to, and facilitators of, fruit and vegetable intake amongst children aged 4 to 10 years? ‘Qualitative’ studies 1. Application of inclusion criteria 2. Quality assessment 3. Data extraction 4. Qualitative synthesis Trials 1. Application of inclusion criteria 2. Quality assessment 3. Data extraction 4. Statistical meta-analysis Trials and ‘views’ Mixed methods synthesis

  19. Findings for synthesis 1: ‘Quantitative’ (Trials)

  20. Findings of synthesis 2: Descriptive themes Food preferences Perceptions of health benefits Knowledge-behaviour gap Roles and responsibilities Non-influencing factors Chosen foods Influences on foods eaten Parental influence and food rules Breaking rules Foods in the home Provided foods Limited choice Social occasion Contradictions Foods in the school Concepts of healthy eating Healthy eating concepts Good and bad foods Health consequences

  21. Developing a framework • Typology of research questions in the social science literature • Methods of synthesis for answering such questions • Matrix of synthesis methods and methodological development and challenges • Creating solutions with others • An emerging framework

  22. Contacts and information NRCM MRS web http://www.ncrm.ac.uk/nodes/mrs/people.php SSRU web: http://www.ioe.ac.uk/ssru/ SSRU's EPPI web: http://eppi.ioe.ac.uk Email: d.gough@ioe.ac.uk s.oliver@ioe.ac.uk

More Related