140 likes | 253 Views
Technological Aspects April 27-28, 2011 Fairbanks, Alaska. Design Strategy Top Down Approach. Identify requirements Develop specific science questions to be answered and analyses to be conducted based on requirements Determine data required for analyses
E N D
Design StrategyTop Down Approach • Identify requirements • Develop specific science questions to be answered and analyses to be conducted based on requirements • Determine data required for analyses • Approach ensures that focus is on realizing tools for ice road planning • Requirements and science questions drove development of NSDSS architectural design: • Cyber infrastructure (CI) • NSDSS.net
North Slope DSS Web Portal GIS-based Information Solution Cyber Infrastructure Data, Tools, Reports Catalog Service Metadata for all Databases Model Data: Publish Field Data: WERC, Publish (ODM-based) GIS Data (WMS, WFS) Climate Forecasts ReAnalysis (NetCDF) Local Cache Combination of new and Existing Databases, owned by data partners
1 Intent is to Evaluate Potential Ice Road Route(s) 2 NorthSlopeDSS Workbench GIS-based Desktop Tool Decide to do Ice Road Planning Study; select start and end point 4 Catalog Service provides names and call methods and parameters for Nodes 5 Workbench Requests Data 7 User Conducts Analysis and documents findings 6 Node Serves Data 8 User Completes Evaluation Report 9 User saves findings and brings into decision process. An example of how it will Work? Ask Catalog Service for Data Nodes that contain suitable data (Terrain, GIS – Lakes, Sensitive Areas) CyberInfrastructure Data, Tools, Reports 3 Catalog Service Metadata for all information Field Data GINA GIS Node Local Cache Climate Data
NorthSlopeDSS Workbench GIS-based Desktop Tool NSDSS Data Sources CyberInfrastructure Catalog Service Metadata for all Databases WERC Field Data (ODM-based) NSDSS NetCDF -GCM Climate Scenarios -Re-Analysis Local Cache Data Models NSDSS ArcGIS -Lakes DB -Transportation -Hydrography -DEM NSF Data Conservancy/ EOL Endangered Species Service NSDSS Model Database (xml-based model descriptions) ESRI World Map (ODM-based) NSDSS Publish Database (ODM-based) External Read-Only Publishable
Federated Databases • WERC (UAF) ODM: • Environmental, meteorological, and hydrologic data • MS SQL-Server database using the CUASHI standard for storage of field observations, ODM • NSDSSNetCDF Database: • Standard data file format for storing geospatial time series information in the atmospheric science world • Forecasting water availability - General Circulation Models (GCMs) data: scenarios for how green house gases may be controlled in the coming century. • NSDSSODM Publish Database: • Publishing new field observations or through re-analysis of existing field observations • Web methods added for publishing the data to the ODM database
A NetCDF Data Service • In Atmospheric Research Field, data is stored in binary files (netCDF), not relational databases (ODM). • Historical data is Re-Analyzed into gridded formats too. • Net CDF Data Service • Stores gridded data files, • Ask for GeoWindow and Variable, • Catalog Service Mediates, • Provides back stream of data in XML, or spawns mini netcdf file. CyberInfrastructure Data, Tools, Reports Catalog Service Metadata for all information Historical Field Measurements GIS Data NetCDF Data Service
Federated Databases • NSDSS Model Publish Database: • Facilitate sharing of ice road plans, water budget models, and water quality models for the review process • MS SQL Server Database for storing models. • Web service created for searching, serving, and publishing the models • NSDSSArcGIS Server: • Geographic data which serves road networks, watersheds, and a North Slope-wide digital elevation model • Primarily products of the North Slope Science Initiative • North Slope lakes database created as part of a joint NSDSS-Alaska DOT project. • ArcGIS Server is an ArcGIS Server 10.0 installation
Federated Databases - Existing • ESRI Base Map • Usedin the NSDSS.net web portal • GINA Map Services • Geographic Information Network of Alaska, provides multiple OGC-standard map services for remotely sensed data across the North Slope. • Includes digital elevation models (Satellite and LIDAR based), aerial imagery, MODIS-based infrared imagery, among others. • NSDSS is working with GINA to create web feature services for hydrographic elements and sufficiently detailed DEM data.
Tying It All Together • Metadata Catalog Service • Created to facilitate searching for data within NSDSS’s multiple databases • Stores information on each time series in the various ODM databases, the NetCDF Database, and each publish database • Consumer asks for data, the catalog leads the consumer to the various databases that contain the data. • Semantic Mediation • Process used by the metadata catalog service to equate data of different variable names • Example: • IPCC-standard for temperature is termed “tas” • WERCODM database observations of temperature “WERC_tmp” • Time series named differently, but contain data of the same variable • Semantic mediation maps one name to the other to ensure that a search for temperature results in finding both sets of data
Tying It All Together • Unit Mediation • Web service allows data consumers to request data with their desired unit • Service automatically converts the data in the database from its raw unit to the requested unit before providing it back to the consumer • Accomplished by providing a central conversion coefficient service • Keeping the conversion service central ensure that the conversion coefficients only have to be stored in one place • Automated Time Series Processing • Each database’s web service allows the data consumer to request data with a desired interval (annual, monthly, daily, hourly, raw) and statistic (min, max, average, sum, count, raw) • Web service converts the time series to the desired interval and statistic prior to providing it to the data consumer.
Workbench GIS-based Desktop Tool Authentication • Big Question relates to who can see the data, • Added Authentication, so consumers of web services must have valid username and password before data is provided back. • User Base Maintained in Catalog Service. CyberInfrastructure Data, Tools, Reports Catalog Service Metadata for all information Historical Data GIS Data Local Cache Climate Projections
NSDSS Web Portalnsdss.net • MS Silverlight-based web application • Enables exploration of data, analysis, and publication of findings • Data stored in statewide cyber infrastructure, and is accessed directly through the web portal through web services • Map-based application containing four modules that interact with map: • Data Exploration • Data Publishing • Environmental Analysis • Ice Road Planning
NSDSS Software Layout Search for all data within the NSDSS Cyberinfrastructure Uses Semantic Mediation