MIXED-METHODS DATA ANALYSIS Graduate Seminar in English Language Studies Suranaree , March 2011

1. MIXED-METHODS DATA ANALYSISGraduate Seminar in English Language StudiesSuranaree, March 2011 Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

2. POKOK BAHASAN • RisetKuantitatifmurni • RisetKualitatifMurni • MMR = Mixed-methods research • Collecting both QUANT and QUAL data using different instruments • MMDA = Mixed-methods data analysis • Usually only QUAL data collected • Data is treated both quantitatively and qualitatively • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

3. KuantitatifatauKualitatif? • QUANT – QUAL distinction in applied linguistics research • QUANT: data numerik; menggunakanstatistik • Penelitian Experimental; Survei • QUAL: data verbal; menggunakaninterpretasithematikataunaratif • Analisis Conversation; Ethnography • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

4. MMR = Mixed-methods research • “MMR melibatkanpengumpulanatauanalisis data kuantitatifdankualitatifdalamsuatustudidenganupayamengintegrasikankeduapendekatanpadasatufaseataulebihdalamprosespenelitiannya” (Dörnyei, 2007) • Tujuan: • Mencapaipemahaman yang tuntas • Triangulasitemuan-temuan. • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

5. Contoh-contoh MMR • Contoh yang jelek • Research into attitudes: survey a large number and interview a predetermined small number of subjects • Tujuan : Tidakjelas • Contoh yang agaklebihbaik • Research into attitudes: survey a large number of subjects, then, selecting based on questionnaire responses, interview a small number • Tujuan : menindak-lanjutihasil-hasilygpenting • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

6. Contoh-contoh MMR • An example of the opposite • Interview a small number to gain insights to design a questionnaire, then survey a large number • Purpose: informing instrument design • Another similar example • Research into beliefs: interview 4 teachers but survey 80 students • Purpose: accounting for practicality in using instruments • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

7. Contoh-contoh MMR • Contoh yang fokuspadatriangulasi • Research into strategies: comparing results from different instruments • Much strategy research involves the use of SILL • SILL asks respondents to identify how often they use a particular strategy • Strategy use is context-dependent • Research question: Will recent context of learning change responses to SILL? • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

8. Contoh-contoh MMR • Metode • Subyektunggal • Time 1: read academic articles • Time 2: read short stories for pleasure • Responded to SILL twice • Interviewed 4 times (background interview, after SILL responses, summary interview) • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

9. Contoh-contoh MMR • SILL responses • Showed major differences between 2 times e.g. “If I guess the meaning of a word, later I will check whether my guess is correct by using a dictionary.” rated Always at Time 1; Never at Time 2 • Interview responses • Showed that recent learning contexts influenced different ratings • Triangulation to confirm results or triangulation to provide different perspectives • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

10. MMDA = Mixed-methods data analysis “The most common perception of mixed methods research is that it is a modular process in which qualitative and quantitative components are carried out either concurrently or sequentially. Although this perception is by and large true, it also suggests that the analysis of the data should proceed independently for the QUANT and QUAL phases and mixing should occur only at the final interpretation stage. This conclusion is only partially true … we can also start integrating the data at the analysis stage, resulting in what can be called mixed methods data analysis” Dörnyei (2007) • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

11. MMDA = Mixed-methods data analysis • Monodata-multianalysis—this is the analysis of one type of data using both qualitative and quantitative anslysis. • The logic of this approach is to: • First, analyze your data with the standard approach (e.g., qualitative analysis for your qualitative data or quantitative analysis for your quantitative data). • Second, either qualitative or quantitize one set of data for additional analysis. • Qualitize—transforming quantitative data into qualitative data (e.g., provide names or labels to quantitative characteristics). • Quantitize—transforming qualitative data into quantitative data (e.g., do numerical counts of qualitative categories and themes). • MMDA berarti: • Quantitising qualitative data • Qualitising quantitative data • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

12. Mengkuantitatifkan Data Kualitatif • Kuantifikasiseringkalidilakukansecaratidaksadar • Melakukananalisis “keyword” • Menggunakanskor IELTS dalamriset • Quantitising helps a qualitative analysis by allowing a reliability check • Quantitising can be used to count and compare frequency of themes • Quantitising allows further statistical analysis of data, but information is always lost when converting QUAL to QUANT • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

13. Mengkualitatifkan Data Kuantitatif Websites for Qualitative Data Analysis Programs Program name and Website address AnSWR (freeware) http://www.cdc.gov/hiv/software/answr.htm ATLAS http://atlasti.de/ Ethnographhttp://qualisresearch.com HyperResearchhttp://researchware.com Nvivohttp://www.qsrinternational.com NUD*IST http://www.qsrinternational.com/products_previous-products_n6.aspx (Note: NUD*IST is being replaced by NVivo). • Tidaklazim, jarangdilakukan • Penyusunanprofilnaratif • Using quantitatively obtained questionnaire data in a qualitative description of a subject • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

14. MMDA yang lebihKompleks • Sifat Data of QUANT • Ringkas • Memnungkinkananalisislanjut (Statistikainferensial) • Menyediakaninformasiringkas (ikhtisar) • Sifat Data QUAL • Detail daninformatif • Memungkinkanpemahamankasus-kasus • Menyediakaninformasi yang mendalam • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

15. MMDA yang lebihKompleks • What purposes can mixing QUANT and QUAL data analysis serve? • Illustration for insight • Concise summary to give overview • Preliminary overview to inform analysis • Providing a more well-rounded and more persuasive analysis • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

16. MMDA: IlustrasiuntukPemahaman • In many QUANT studies, it is easy to get lost in the numbers and forget what they mean • If the numbers are derived from QUAL data, it is useful to give a QUAL example to concretise the QUANT findings • In Case 1, the original data is QUAL; this is quantitised for analysis; a QUAL example is given to concretise the data and to show how the quantitative analyses was applied • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

17. MMDA: Ikhtisar • In some QUAL research (primarily involving categorisation or thematisation), the lengthy, detailed data make it difficult to see the overall pattern • It can be useful to provide a QUANT summary as an overview • In Case 2, the data is QUAL and analysed in a QUAL way, but the overall pattern of results is presented as QUANT • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

18. MMDA: TelaahawaluntukAnalisis • In QUAL studies with large amounts of data, it is difficult for the researcher to ensure that all relevant issues have been identified • It is also difficult to see underlying patterns that can be drowned in the sheer quantity of data • It is useful to conduct a preliminary QUANT analysis to ensure all issues and underlying patterns are identified • In Case 3, QUAL data is treated qualitatively to find keywords which then inform a QUAL thematic analysis • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

19. MMDA: Analisis yang lebihpersuasif • In QUAL studies with large amounts of data, restricting analysis to either QUANT or QUAL cannot provide a full picture of the data • QUAL provides detailed description of the data • QUANT provides generalisations of patterns to the whole data set • In Case 4, QUAL and QUANT analyses are used together to produce a fuller description of the data • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)

20. Penggunaan Illustration for insight Summarise for overview Inform analysis Provide full picture Pola-pola QUANT → QUAL QUAL → QUANT QUANT → QUAL Mix of QUANT and QUAL Penggunaan MMDA • Sumber: Richard Watson Todd (http://arts.kmutt.ac.th/crs/research/mmda.ppt)