330 likes | 418 Views
Digital Research Records at Center for Environmental Studies. Peter McCartney. Distributed Resources 5 institutions, 8 departments Biodiversity Taxonomic information Browsing Collections query Species checklists Identification Keys Research metadata
E N D
Digital Research Records at Center for Environmental Studies Peter McCartney Center for Environmental Studies Arizona State University
Distributed Resources • 5 institutions, 8 departments • Biodiversity Taxonomic information Browsing Collections query Species checklists Identification Keys • Research metadata • Datasets, Literature,Images, Protocols, Models • Data access • Download, Visualization, EDA Center for Environmental Studies Arizona State University
History • LTER Mandate to provide long-term management of Ecological Data • Expand ASU Capacity for large environmental initiatives through integration • Develop more effective data sharing with central Arizona partner (Federal, State, Municipal, NGO) Center for Environmental Studies Arizona State University
Model for EcoInformatics Knowledge Information Data Outreach Broad Spatial and Temporal Research Knowledge-based Query Systems Framework Data Semantic Metadata Indexing Catalogs Access Technology Syntactic Metadata Primary Data Storage Center for Environmental Studies Arizona State University
ADEQ ADWR CES Informatics Lab MAG ASU Geo Sciences GIS Lab Remote Sensing Lab Landscape Metadata Service Office of Ecology Climatology Modeling Lab Data Service ASU MesoNet Model Service Lab Message Pathway Distributed computing Center for Environmental Studies Arizona State University
Ecological Data Archives • Diversity in formats, schema, size, organization. • Tabular – SQL, ASCII, App formats • GIS – shapefiles, SDE, coverages • Raster – raw, SDE, Remote sensing, Erdas, ESRI Grid • Standards and procedures may exist within individual archives • Few standards at network level Center for Environmental Studies Arizona State University
Ecological Metadata Language • Serve to integrate, rather than dictate, site solutions for data management • ASU, Central Arizona, Naitonal LTER network, OBFS • Machine parsable • Based on XML • Build on existing standards • FLED, Dublin core, ISO 19115, FGDC Center for Environmental Studies Arizona State University
EML 2.0 Design • Modular, with classes relating to specific functional roles • Uses XML Schema complex types to define extensible base classes of information resources • Extensible via the linking of new modules within the schema • Organized to abstract the logical description of data from the physical Center for Environmental Studies Arizona State University
EML Related Projects at CES • Xylographa – Metadata Creation • Xanthoria – Metadata Query • Xylopia- Metadata mediated Access Center for Environmental Studies Arizona State University
Xylographa: Metadata Cretation Center for Environmental Studies Arizona State University
Xanthoria: Metadata Query User Xanthoria Client Application Metadata archives XML Schema Database Target Xanthoria SOAP Server Relational Database HTTP Request/ Response WebApplication HTTP Browser XML File Target Xanthoria SOAP Server XML Files SOAP Messages SOAP Messages Query Manager Xanthoria SOAP Client Xindice Target Xanthoria SOAP Server XML Database SOAP Messages SOAP Messages Metacat Target Xanthoria SOAP Server Metacat Center for Environmental Studies Arizona State University
RDBMS Connector Xylographa ConfigurationWizard EML Config.XML XSL RDBMSCatalog XanthoriaConnector Native XML Standard XML Center for Environmental Studies Arizona State University
CES Center for Environmental Studies Xanthoria Methods • ping(src): boolean • query(returnfields, querygroup, query statement, src): Element • getFullRecordElement(id, src): Element • getFullRecordPath(id, src): String • load(file, src): String src = target name Center for Environmental Studies Arizona State University
CES Center for Environmental Studies Xanthoria Query Reply Center for Environmental Studies Arizona State University
CES Center for Environmental Studies Xanthoria Request Center for Environmental Studies Arizona State University
CES Center for Environmental Studies Xylopia: Metadata Mediate Access A web-service (Apache SOAP) based data analysis application for EML • Uses EML Metadata to resolve message content • Modules for: • Data Query • Processing • Visualization • Analysis Center for Environmental Studies Arizona State University
CES Center for Environmental Studies Xylopia Components Web-based Application (SEINet, Ecology Explorers, ClimDB, etc.) Xylopia Client-side Xylopia Server-side SOAP Data Collector Input: EML Query Output: Clipped EML & Raw Data or Processed Data (ASCII) Graph Generator Input: Clipped EML & GG Message Output: PNG graph Map Generator* Input: EML Query & MG Message Output: JPG, zip, map service configuration *This module is not a web-service Statistics Calculator Input: Clipped EML & SC Message Output: Clipped EML & Stats (ASCII) Center for Environmental Studies Arizona State University
CES Center for Environmental Studies Typical Xylopia Workflow • EML Query message built by the app/user • App sends the message to the Data Collector • Data Collector finds the data, puts it into an ascii file and places the data and a new ‘clipped eml’ into a designated drop box • App gets these data and displays it to the user • If the user requests a graph or statistics on these data, the ‘clipped eml’ and ascii file is usually used by these web services • If the user requests mapping data, the Data Collector’s output varies depending on the requested file’s format Center for Environmental Studies Arizona State University