480 likes | 735 Views
Research Methods for Computer Science, HILCO. By Temtim Assefa Revised September, 2013. Learning Objectives. Explain the purpose of research Understand basic concepts in research (constructs, relationship, indicators, research model, theory, etc)
E N D
Research Methods for Computer Science, HILCO By TemtimAssefa Revised September, 2013
Learning Objectives • Explain the purpose of research • Understand basic concepts in research (constructs, relationship, indicators, research model, theory, etc) • Understand research as a scientific method to acquire knowledge • Acquire skill to formulate researchable research problems • Identify major research problems in computer engineering • Explain the different research approaches and methods (Quantitative, qualitative and design science)
Objective … • Justify the rational for selecting a particular research method to solve computer Science problems • Able to design research projects or research proposal • Able to collect data relevant to the research problem • Undertake validity and reliability tests of research instruments
Objective … • Able to interpret data into meaningful information • Acquire skill to plan, execute, and implement research projects in computer science • Able to review research articles • Able to produce publishable research articles (conference or journals, etc) • Contribute new knowledge to your discipline
What Research Is Not • Gathering information from resources such books or magazines isn’t a research. • It has no contribution to new knowledge. • Merely transporting facts from one resource to another doesn’t constitute research. • It has no contribution to new knowledge, although this might make existing knowledge more accessible.
Research is not • Research is not simply learning about something • Gathering information to know more about a certain area is different from looking at a body of data and deciding how it contributes to the solution of a problem • Research problems do not simply result in a “yes” or a “no” answer • Should able to explain why something is happened - e.g computer increases organizational efficiency but add how ?
Research: A Definition • “…the systematic process of collecting and analyzing information (data) in order to increase our understanding of the phenomenon about which we are concerned or interested.” • an activity that contributes to the understanding of a phenomenon [Kuhn, 1962; Lakatos, 1978]
Research ... • Research: • phenomenon: a set of behaviors of some entity(ies) that is found interesting by a research community • understanding: knowledge that allows prediction of the behavior of some aspect of the phenomenon • activities considered appropriate to the production of understanding (knowledge) are the research methods and techniques of a research community
Research Characteristics • Originates with a question or problem. • Requires clear articulation of a goal or objective. • Follows a specific plan or procedure. • Often divides main problem into sub-problems. • Guided by specific problem, question, proposition or hypothesis. • Accepts certain critical assumptions. • Requires collection and interpretation of data. • Cyclical (helical) in nature.
Types of Research • Basic Research • its main purpose is the disclosure of fundamental truths or principles • Focuses the testing and development of theory • To extend existing human understanding • Has no immediate application to real world problems • Example - • Physists are interested in understanding basic elements that make up matter • Computer scientist are interested to create an efficient algorithm to process data, retrieve information, etc
Cont’d • Applied research • To solve existing societal problems • Example - software automation like • Developing a SW that convert word files into database format • Doing payroll processing by a computer • Developing a program that copys files from a computer to a mobile phone
Epistemology of Knowledge • is the branch of philosophy concerned with the nature and scope (limitations) of knowledge • It answers the following questions • What is knowledge? • How is knowledge acquired? • To what extent is it possible for a given subject or entity to be known?
Continued … • There is a debate between • Knowledge as objective Truth • Knowledge as subjective truth
Objective Truth • Knowledge exists independent of the knower • Knowledge can be measured by measuring instruments • Observed independent of the researcher • Can be quantified using different statistical methods • It is constructed by deductive methods • Research is targeted to falsify an existing truth or theory
Knowledge is constructed mainly through observation and experience. • Aristotle is the main supporter of this view
Subjective truth • Knowledge is a human construct • People born with some thought constructs that are used to interprate and give meaning what we experience • It is the human that gives meaning to real world objects • It is a social construct and exits in the language, text, etc by the human being
Cont’d • Knowledge is constructed by reflection, interpretation what respondent says • The researcher is part of the knowledge construction process • It is constructed by inductive method • From observations, general truths are drawn • There are as many truth as the there are a number of human beings
Theory • An abstraction of realities that serve as a guide for future practice • You may think theory as an absolute truth, such as the theory of gravity or the theory of relativity • Actually a changing phenomenon, especially in the soft or social sciences. • Theories are developed based on what is observed or experienced, often times in the real world. • Changed as we gather new facts and observe new relationship
Theory -- Cont’d • Dubin (1978) notes theory contains three main elements: • A set of well-defined concepts (or units); • Laws of interaction (or interrelationships between the units); • A boundary within which the theory holds. • Example • Theory of planned behavior • Design theory • Communication theory • Human Computer Interaction theory (HCI), etc
Theory of Planned Behavior Attitude Intention Behavior Subjective Norms Controlling Variables Source – Ajzen, 1991
Conceptual Framework • It is the researchers understanding of the Research Problem • It contains variables and their relationship to be investigated in the research • It serve as a guide for the research process • It is build from existing theory or prior experience of the researcher • It is accepted or modified after the collected empirical data is analyzed and interpreted
Conceptual Framework – uses … • are analytical schemes; • simplify reality to make it easer to discuss, analyze or research; • simplify reality by selecting certain phenomena/variables and suggesting certain • relationships between them; • are judged in terms or utility, not correctness.
Cause and Effect – explanation … • seeing other people being rewarded for acting well (vicarious reward) • and punished for acting badly (vicarious punishment); • whether people believe they control their own destinies or are at the mercy of forces beyond their control (locus of control) • and their level of moral development • increases the likelihood that people will make decisions that are ethical rather than pragmatic.
Type of CF … Stages in a Process • the concepts are related because they are stages in a process. • Example Project Management Problem • It starts with planning and • then proceeds through the stages of doing, • monitoring and • Revising the plan. Here the theory is represented as a circle that flows in a cycle. What about software development theory?
Type of CF … Hierarchical relationships • In many conceptual frameworks, concepts are related because they occupy higher or lower positions on a scale or in a hierarchy. • Example Maslow’s (1954) Need Hierarchy • physiological needs • safety needs • belongingness needs • esteem needs • self-actualisation.
Type of CF … Map and coordinates • You can define the relationships between concepts by plotting • them against a series of coordinates. High SW success SW Testing Low SW success User requirement Elicitation Low High
Theory visa-vis Conceptual Framework • Conceptual frameworks provide generalisations about processes, about the interaction of the concepts, • whereas theories provide hypotheses about the outcomes of these processes. • A conceptual framework might identify persistence, graphical buttons, user experience, etc linked with good user interface design • Theory would show how these factors can increase use of the software by different groups of users
Proposition • Predictions about the world are made using propositions, that is, conclusions that may be deduced logically from the theory. • It establishes one construct with another construct • It guides the research process in data collection and data analysis • Used in qualitative research methods especially in case study research
Proposition … Example • Proposition #1 --- ERP implementation can be successful only if there is a strong and committed leadership guiding the initiative” (Sarker and Lee 2000, p416) • “Proposition #2 ----ERP implementation can be successful only if there is open and honest communication among the stakeholders” (Sarker and Lee 2000, p416) • “Proposition #3 --- ERP implementation can be successful only if the implementation team is empowered and balanced” (Sarker and Lee 2000
Hypothesis • A hypothesis is an empirically testable statement that is generated from a proposition • Hypothesis is a tentative solution forwarded by the researcher based on previous theory or experience • It is expressed in terms that support collection and analysis of empirical data • Terms used in the hypothesis are “things observable” (Dubin 1978) • One proposition may generate many hypotheses
Cont’d • Begins with theory to identify variables • Both hypothesis and research questions are used to guide the researcher • To collect what type of data • How to analyze the collected evidences
Hypothesis … • Example • Graphical software interface increases SW learnability. • Cloud service reduces IT operation costs • Component based SW development increases SW project success • The deductive testing of hypotheses involves looking for disconfirming evidence to falsify hypotheses (Lee 1989). • Falsified hypotheses are then refined based on the reasons for falsification and subjected to further empirical testing.
Methodology • A methodology is “a system of principles, practices, and procedures applied to a specific branch of knowledge • A methodology might help researchers to produce and present high quality research results that is accepted as valuable, rigorous, and publishable in Computer Science research outlets. • Method is one component in the Methodology • Data collection method like interview • Data analysis method like open coding, correlation, regression, etc • Method of prototype system evaluation – how do you evaluate it
Definitions of Terms • Define each technical term as it is used in relation to your research project. • Resource – how is defined in the context of library and computer system • This helps remove significant ambiguity from the research itself by ensuring that reviewers, while they may not agree with your definitions, at least know what you’re talking about. .
Metrics in Research • Metrics are measures used to represent the variable • For example: • a sex variable is measured by Male or Female • Attitude is measured by likearte scale (Very strongly disagree <->Strongly Agree) • How do you measure CPU performance? • Clearly state how you measure your research variable
Scales of variable measurement • There are four measurement scales • Nominal – which does not show magnitude like male or famale • Ordinal – which measure magnitude but cannot quantify difference e.g poor and rich • Interval - measures magnitude and the difference between the two values • e.g age -- 10 years and 20 years • Scale – measures which has vales below zero e.g temperature
Know your Research Contributions • In what way(s) does your study add significant contribution(s) to: • Extant Theory? • Relevant Practice?
Free Access Journals • http://www.springer.com/computer/hci?SGWID=0-154-12-116377-0 • http://ocw.mit.edu/courses/mathematics/18-996-topics-in-theoretical-computer-science-internet-research-problems-spring-2002/lecture-notes/