190 likes | 221 Views
New Approaches to Software for Statistical Processing Joint seminar of the RSS-SCS and the ASC Issues in metadata standards aiming at the re-use of questionnaires; e xperiences from IQML, IT et al. Hans Rutjes & Jannes Hartkamp DESAN Research Solutions. DESAN. activities
E N D
New Approaches to Software for Statistical ProcessingJoint seminar of the RSS-SCS and the ASCIssues in metadata standards aiming at the re-use of questionnaires;experiences from IQML, IT et al.Hans Rutjes & Jannes HartkampDESAN Research Solutions RSS-SCS / ASC Seminar
DESAN • activities • data collection & processing (quantitative) • analysis & reporting • R&D • methods • telephone • paper • Internet • face-to-face • mixed mode RSS-SCS / ASC Seminar
Data exchange history • not so long ago data could not move (punch cards could) • now data exchange is hardly a problem • metadata exchange is an issue • CAI metadata exchange is a problem RSS-SCS / ASC Seminar
‘CAI metadata’ currently • many different CAI-packages in use • re-use / sharing of questionnaire ‘scripts’ and data collection metadata problematic -> • collective benefits of standards for questionnaire definitions and data collection metadata acknowledged RSS-SCS / ASC Seminar
On standard spread • Standards can emerge in two ways: A. authoritative body (e.g. €) B. self-strengthening process (e.g. English) • Spread ->attractiveness -> spread ->... • Standards as hyper-collective goods ? • collective action • collective benefits RSS-SCS / ASC Seminar
‘CAI md’ standards currently • no authoritative body • no dominant player • no shared belief in emerging standard • collective benefits of common standard • DDI, Dublin Core not rich enough • several standardising initiatives RSS-SCS / ASC Seminar
Standardising strategies A. Existing software -> standard advantages: (e.g. SPSS) • software available • some market share B. Multiple packages -> standard (e.g, Triple-S) C. New standard -> software advantages: (e.g. IQML idea) • collective product • easier to optimise as a standard RSS-SCS / ASC Seminar
Standard requirements • standard should be • rich enough to be useful • simple enough to be ‘implementable’ • standard needs belief to spread • adoption must be cost-effective RSS-SCS / ASC Seminar
Some technical issues • routing (if ?2>?1 goto ?5) • separate items or sub-items of questions ? • dynamic questions and answer cat (How long has #?3# lived in #?7# ?) • missing values • data collection metadata (types of non-response, interview date&time etc) • flat or hierarchical data? RSS-SCS / ASC Seminar
IQML experience (1) • EU IST FP5 2000-2003 • 5 modules (QDT, MR, SAT, QPT, DIT) • 4 main developers (Dimension, UEdin, DESAN, Comfact) • 2 strategies • standard -> software (questionnaires) • software -> standard (forms) • 3 resulting DTDs RSS-SCS / ASC Seminar
IQML experience (2) IQML XML model • theory: • practice: QDT QPT/DIT MR SAT IQML XML XML4DR model RDRMES QDT QPT/DIT MR SAT RSS-SCS / ASC Seminar
IQML experience (3) • main CAI innovations • XML based • distributed • re-use of questionnaire items, e.g. <TextRef>IQML6481</TextRef> <Text textId="IQML6481" textType="instruction"> <TextString>What is your sex?</TextString> </Text> • concept seems sound, functionality limited RSS-SCS / ASC Seminar
IT experience (1) • IT • full-fledged generic CAI software developed by DESANs sister company Interview Technology • paper, telephone, web, face-to-face, self, mixed • used by >100 data collectors world wide • data export to e.g. SPSS, dBase, Lotus, Quantime, SAS, Triple-S (see Feb 2004 issue of Research) RSS-SCS / ASC Seminar
IT experience (2) • IT -> TripleS export • relatively easy to implement, but • no user/system missing distinction in Triple-S • 0 not allowed as category in Triple-S (negative nr is) • sequential category numbering in Triple-S • no MR for numeric variables in Triple-S • TripleS only variables and data (no routing etc.), so IT -> TripleS -> IT would mean huge loss • low costs, low benefits ? RSS-SCS / ASC Seminar
IT experience (3) • IT -> SPSS MR Data Model retrieval • implementation just started • on-line data retrieval • model seems complex, but well-documented • questionnaire dynamics (skips, loops, random...)?? RSS-SCS / ASC Seminar
Way forward • standards can start with basic elements and be extended and diversified later: • 10% of standard may suffice for 90% of use RSS-SCS / ASC Seminar
Ideal? • consortium of multiple key CAI-players • index and analysis of functionality/issues • questionnaire dynamics • validation • mixed mode • collection metadata • model development • interface development RSS-SCS / ASC Seminar
CODACMOS • EU IST FP5 Cluster 2002-2004 • focus on data collection • partners • NSI’s of Italy, Finland, Norway, Greece • universities of Edinburgh, Patras, Athens • others (DESAN et al.) • issues for future research • attention for non-technical issues RSS-SCS / ASC Seminar
Info • www.desan.nl • www.epros.ed.ac.uk/iqml • www.InterviewTechnology.com • www.triple-s.org • www.codacmos.eu.org • www.research-live.com (IT review Feb ‘04) • rutjes@desan.nl / hartkamp@desan.nl RSS-SCS / ASC Seminar