UCD Methods & Research:

1. UCD Methods & Research: Are UCD methods research? And just what is research anyway? Dr. Jennifer L. Bowie UCD Fall 2006

2. What is Research? Some definitions outside TC • According to the KanCRN project: “True research is a quest driven by a specific question which needs an answer.” • From KanCRN discussing Paul Leedy’s (Practical Research: Planning and Design) lists of eight characteristics of research: • Research originates with a question or a problem. • Research requires a clear articulation of a goal. • Research follows a specific plan of procedure. • Research usually divides the principal problem into more manageable sub-problems. • Research is guided by the specific research problem, question, or hypothesis. • Research accepts certain critical assumptions. These assumptions are underlying theories or ideas about how the world works. • Research requires the collection and interpretation of data in attempting to resolve the problem that initiated the research. • Research is, by its nature, cyclical; or more exactly, spiral or helical. In the KanCRN project the helical nature of research is represented by connecting Vee diagrams. (http://kancrn.kckps.k12.ks.us/guide/research.html)

3. What is Research? Some definitions outside TC From the JCU Research Services site, research is: • “creative work undertaken on a systematic basis in order to increase the stock of knowledge, including knowledge of humanity, culture and society, and the use of this stock of knowledge to devise new applications; [OECD Definition]” • “Characterised [sic] by originality; it should have investigation as a primary objective and should have the potential to produce results that are sufficiently general for humanity's stock of knowledge (theoretical and/or practical) to be recognisably [sic] increased. Most higher education research work would qualify as research and experimental development. [DEST 2002, HERDC Specifications for the collection of 2002 data]” • “leads to publicly verifiable outcomes which are open to peer appraisal.” http://www.jcu.edu.au/office/research_office/researchdef.htm

4. What is Research? Some definitions outside TC Types of Research Activity (directly quoted from JCU Research Services): • Pure basic research is experimental and theoretical work undertaken to acquire new knowledge without looking for long-term benefits other than the advancement of knowledge. • Strategic basic research is experimental and theoretical work undertaken to acquire new knowledge directed into specified broad areas in the expectation of useful discoveries. It provides the broad base of knowledge necessary for the solution of recognised [sic] practical problems. • Applied research is original work undertaken primarily to acquire new knowledge with a specific application in view. It is undertaken either to determine possible uses for the findings of basic research or to determine new ways of achieving some specific and predetermined objectives. • Experimental development is systematic work, using existing knowledge gained from research or practical experience, that is directed to producing new materials, products or devices, to installing new processes, systems and services, or to improving substantially those already produced or installed. http://www.jcu.edu.au/office/research_office/researchdef.html

5. What is Research? Some definitions inside TC & related disciplines • The goal of research is to “investigate the existence of some phenomenon” (Dumas and Redish 22) • Research is composed of “activities where data is collected and analyzed for the purpose of making generalizations beyond the immediate participants of the study” (Hughes 488) • Research, according to MacNealy's criteria, must: • Be planned in advance • Be collected systematically • Produce a body of evidence that can be examined by others

6. What is Research? • In summary, research: • Begins with and is guided by a question or goal • Is planned in advance & is systematic • Involves the collection & analysis of data • Adds to the "knowledge of humanity" • Produces results that can be generalized • Is verifiable and can be examined by others • Applied research is undertaken with a specific application in mind

7. How does UCD fit this definition of Research? • Research: • Begins with and is guided by a question or goal • Is planned in advance & is systematic • Involves the collection & analysis of data • Adds to the "knowledge of humanity" • Produces results that can be generalized • Is verifiable and can be examined by others Applied research is undertaken with a specific application in mind

8. Are UCD methods research? • Not according to Dumas and Redish: • they argue that a usability test and a research study have fundamentally different goals (22 and 35-8) • “primary goal of a usability test is to improve the usability of the product being tested… [and] improve the process by which products are designed”

9. What do you think? Why/Why not?

10. Questions? Works Cited: Anderson, Gary. “What is Research?” KanCRN: Collaborative Research Network. http://kancrn.kckps.k12.ks.us/guide/research.html Accessed: 11/28/06. Burnell, Jenna. “What is Research?” Research Services website at James Cook University. http://www.jcu.edu.au/office/research_office/researchdef.htm Accessed: 11/28/06. Dumas, Joseph S. and Janice C. Redish. A Practical Guide to Usability Testing Norwood: Ablex, 1994. Hughes, Michael. “Rigor in Usability Testing.” Technical Communication 46.4 (1999): 488-94. MacNealy, Mary Sue. Strategies for Empirical Research in Writing. Boston: Allyn and Bacon, 1999. Dr. Jennifer L. Bowie jbowie@gsu.edu