780 likes | 1.31k Views
Define.XML. A CASE study describing how to produce Define.XML from within SAS. Dianne Weatherall Sep 2012. Topics for Discussion. Note. Examples and code are based on the Draft Define V2 Slides are based on SDTM Define, but similar principles can be applied to the ADaM Define
E N D
Define.XML A CASE study describing how to produce Define.XML from within SAS Dianne Weatherall Sep 2012
Note • Examples and code are based on the Draft Define V2 • Slides are based on SDTM Define, but similar principles can be applied to the ADaMDefine • Key differences are explained in the Define Draft V2
Requirements? • What? • How? • Summary • Why? Why?
Requirements? • What? • How? • Summary • Why? Why? • To describe what is included in the electronic data transfer (datasets, variables, codelists, etc) -> METADATA-> an elaborate “PROC CONTENTS” and more • To provide a user-friendly document with links to navigate easily, and to access information easily • To easily access the annotated CRF and datasets • To have a standard format to describe the electronic data transfer • Why XML? • Machine readable format for use by software applications • Browser-based report (through the use of an XSL stylesheet) • Vendor neutral, platform independent
Requirements? • What? • How? • Summary • Why? Requirements? • Metadata in a usable format, easy to capture and ability to import into SAS (recommended format = Excel) • Dataset metadata: list of domains -> name, description, class, structure, purpose, keys, location • Variable metadata:list of variables: -> name, label, type, controlled terms / format, origin, role, comment • Controlled terms:coded value, decode • Value-level metadata:variable, where, type, controlled terms or format, origin, computation method • Computational algorithms:reference name, name, computation method • Data in XPT format • Annotated CRF in PDF format • Supporting documentation: • Reviewers guide / complex algorithms in PDF format
Requirements? • What? • How? • Summary • Why? Requirements? • Example: dataset metadata
Requirements? • What? • How? • Summary • Why? Requirements? • Example: variable metadata
Requirements? • What? • How? • Summary • Why? Requirements? • Example: controlled terms • Usually includes all possibilities on the CRF, not only those in the data • Needs to be set up from the CRF, not the data
Requirements? • What? • How? • Summary • Why? Requirements? • Example: value-level metadata • 2 types: SUPPQUAL (QVAL) and FINDINGS (ORRES) • Can be generated from the data, especially electronic labs
Requirements? • What? • How? • Summary • Why? Requirements? • Example: computational algorithms • Used for standard algorithms that can be applied across variables • Very long derivations should rather be specified in a PDF file, and linked from the variable comment
Requirements? • What? • How? • Summary • Why? Requirements? • Specification vs Metadata • Specification • Instructions to a programmer to get to the final SDTM / ADaM dataset • Contains derivations that often refer to raw variable names (for programming) • May contain SAS code in some cases • May refer to other documents (e.g. SAP etc) • Metadata • Describes the contents of the final SDTM/ADaM dataset • Contains derivations that describe in words how the data was derived (for traceability and reviewer information) • Does not contain SAS code and does not refer to raw variables • Contains links to other documents
Requirements? • What? • How? • Summary • Why? Requirements? • Specification vs Metadata • To combine or not to combine? • It makes sense to create one document that serves both purposes • Prevents rework • Consistency • Less work • BUT… make sure you separate programmer notes from reviewer comments • Example:
What? • Define.XML with and without stylesheet
Requirements? • What? • How? • Summary • Why? What?
Requirements? • What? • How? • Summary • Why? What?
Requirements? • What? • How? • Summary • Why? What?
Requirements? • What? • How? • Summary • Why? What?
Requirements? • What? • How? • Summary • Why? What?
Requirements? • What? • How? • Summary • Why? What? • Define-XML Version 2.0.0 can be used for SDTM and ADaM • Terminology: • Def: declaration of an object • Ref: reference to an object • OID: identify a metadata object • Validation of the Define.XML: • It must properly reference versions of the CDISC standards • Conform to schemas • Meet all requirements of the Define-XML Specification • Can be checked using OpenCDISC according to defined rules
Requirements? • What? • How? • Summary • Why? What? • Structure of the XML file • XML header, the ODM root element, Study and MetaDataVersion • Linked supporting PDF documents (e.g. aCRF) • Value List definitions (e.g. for Supplemental Qualifiers / Findings Tests) • Where Clause definitions (referenced in Value List definitions) • Dataset definitions (ItemGroup) • Variable definitions (ItemDef) • Code List definitions (Codelist) • Methods definitions (MethodDef) • Comments definitions (CommentDef) • Leafs definitions
Requirements? • What? • How? • Summary • Why? PREPARATION BEFORE WRITING TO XML FILE • Create XPT files of the SDTM datasets • Import the specifications into SAS and create a dataset containing the Dataset and Variable metadata • Import the methods into SAS and merge onto the metadata by the method name • XML does not like special characters – convert characters to text • Create a value-level metadata dataset by choosing “TESTCD”, “PARMCD” and “QNAM” variables and obtaining the values in those variables from the data • Create a codelist dataset by running through variables and value-level variables with codelists attached to them and obtaining the values for those variables • Codelists -> set up in specs vs create from data
Requirements? • What? • How? • Summary • Why? How? • Create XML file within SAS using: • DATA steps • FILE and PUT statements
Requirements? • What? • How? • Summary • Why? XML Header + ODM root element • Example code:
Requirements? • What? • How? • Summary • Why? XML Header + ODM root element • Example code: Study-specific derivations: - Creation date/time
Requirements? • What? • How? • Summary • Why? XML Header + ODM root element • Example code: Simple FILE and PUT statements Study-specific parameters can be read in using macro parameters or derived - e.g. creation date/time
Requirements? • What? • How? • Summary • Why? Study + MetaDataVersion • Example code:
Requirements? • What? • How? • Summary • Why? Study + MetaDataVersion
Requirements? • What? • How? • Summary • Why? Study + MetaDataVersion • Example code: Simple FILE and PUT statements – use the MOD option on the FILE statement to append to the text file Study-specific parameters can be read in using macro parameters or derived - e.g. study name and description
Requirements? • What? • How? • Summary • Why? Linked supporting PDF documents (e.g. aCRF) + Leafs definition • Example code:
Requirements? • What? • How? • Summary • Why? Linked supporting PDF documents (e.g. aCRF) + Leafs definition
Requirements? • What? • How? • Summary • Why? Linked supporting PDF documents (e.g. aCRF) + Leafs definition • Example code: Simple FILE and PUT statements with a MOD option
Requirements? • What? • How? • Summary • Why? Linked supporting PDF documents (e.g. aCRF) + Leafs definition • Example code: Simple FILE and PUT statements with a MOD option
Requirements? • What? • How? • Summary • Why? Value List definitions (e.g. Findings Tests) and Where Clause definitions • Example code:
Requirements? • What? • How? • Summary • Why? Value List definitions (e.g. Findings Tests) and Where Clause definitions • Example code:
Requirements? • What? • How? • Summary • Why? Value List definitions (e.g. Findings Tests) and Where Clause definitions
Requirements? • What? • How? • Summary • Why? Value List definitions (e.g. Findings Tests) and Where Clause definitions • Example code: Example: VSORRES Create a dataset in SAS of value-level variables and their values. Output an ITEMREF statement for each value of VSORRES (e.g. DIABP) and reference a WHERECLAUSE.
Requirements? • What? • How? • Summary • Why? Value List definitions (e.g. Findings Tests) and Where Clause definitions • Example code: Example: VSORRES Output a WHERECLAUSEDEF statement for each value of VSORRES (e.g. DIABP) and use the same WHERECLAUSE name referenced in the ITEMREF.
Requirements? • What? • How? • Summary • Why? Value List definitions (e.g. for Supplemental Qualifiers) and Where Clause definitions • Example code:
Requirements? • What? • How? • Summary • Why? Value List definitions (e.g. for Supplemental Qualifiers) and Where Clause definitions • Example code:
Requirements? • What? • How? • Summary • Why? Value List definitions (e.g. for Supplemental Qualifiers) and Where Clause definitions
Requirements? • What? • How? • Summary • Why? Value List definitions (e.g. for Supplemental Qualifiers) and Where Clause definitions • Example code: Example: SUPPDM.QVAL Output an ITEMREF statement for each value of SUPPDM.QNAM (e.g. RACE1) and reference a WHERECLAUSE.
Requirements? • What? • How? • Summary • Why? Value List definitions (e.g. for Supplemental Qualifiers) and Where Clause definitions • Example code: Example: SUPPDM.QVAL Output a WHERECLAUSEDEF statement for each value of SUPPDM.QVAL (e.g. RACE1) and use the same WHERECLAUSE name referenced in the ITEMREF.
Requirements? • What? • How? • Summary • Why? Dataset definitions (ItemGroup) • Dataset Definitions: • Dataset definitions: • ItemGroupDef element • Include references to variable definitions • Include references to actual data file • Variable references: • ItemDef element • Dataset definition: • def:leaf element
Requirements? • What? • How? • Summary • Why? Dataset definitions (ItemGroup) • Attributes: • Repeating: • No for datasets with one record per subject • Yes for datasets with more than one record per subject • Mandatory: • Yes for required variables • No for Expected or Permissible variables • Domain: • Name of the domain • IsReferenceData: • Yes for reference datasets (no subjects) • No for subject-level datasets
Requirements? • What? • How? • Summary • Why? Dataset definitions (ItemGroup) • Example code: