220 likes | 321 Views
Delivering Digital Services. US Weather Standards and Codes. Presented By: Matt Peroutka Aaron Braeckel Steve Olson Date: August 28, 2014. Concise History. July 2011: WMO’s Commission for Basic Systems authorized a task team to create “XML representation of weather data”
E N D
Delivering Digital Services US Weather Standards and Codes Presented By: Matt Peroutka Aaron Braeckel Steve Olson Date: August 28, 2014
Concise History • July 2011: WMO’s Commission for Basic Systems authorized a task team to create “XML representation of weather data” • November 2013: AvXML version 1.0 posted to http://schemas.wmo.int • January 2014: IWXXM-US version 1.0 posted to http://nws.weather.gov/schemas/ 2
Motivation • Unique regional requirements in US • Requirements fulfilled and documented in Traditional Alphanumeric Codes (TAC) via filed differences 3
Guiding Principles for IWXXM-US • Support all filed differences maintained by the US for METAR, SPECI, TAF, and SIGMET • Enable the development of straightforward techniques that convert products from US-specific formats to formats that comply with international standards 4
Implementation of IWXXM-US • Extensions to IWXXM • Regional namespace http://nws.weather.gov/schemas/IWXXM-US/1.0/Release • Three data models/schemas • usMetarSpeci.xsd • usSigmet.xsd • usTaf.xsd 5
IWXXM-US Schemas and Code Tables http://nws.weather.gov/schemas/IWXXM-US/1.0/Release/ http://nws.weather.gov/codes/ 6
IWXXM-US • Re-use of IWXXM constructs and style, where possible • Use of appinfo and quantity attribute, as in IWXXM • Use of code lists and vocabulary attribute, as in IWXXM 7
Sea Level Pressure in usMetar.xsd <element maxOccurs="1" minOccurs="0" name="seaLevelPressure" type="gml:MeasureType"> <annotation> <appinfo> <quantity> http://codes.wmo.int/common/c-15/me/pressureReducedToMeanSeaLevel </quantity> </appinfo> </annotation> </element> 8
Pressure Tendency Characteristic in usMetar.xsd <complexType name="PressureTendencyCharacteristicType"> <annotation> <appinfo> <vocabulary> http://codes.wmo.int/bufr4/codeflag/0-10-063 </vocabulary> <extensibility>none</extensibility> </appinfo> </annotation> </complexType> 9
Sea Level Pressure in Example US METAR <iwxxm-us:seaLevelPressureuom="hPa">1008.3</iwxxm-us:seaLevelPressure> <iwxxm-us:pressureChangeIndicatorxlink:href="http://nws.weather.gov/codes/FMH-1/2005/PressureChangingRapidly/ PRESSURE_FALLING_RAPIDLY"/> <iwxxm-us:pressureTendency3hr uom="hPa">6.2</iwxxm-us:pressureTendency3hr> <iwxxm-us:pressureTendencyCharacteristic3hr xlink:href=" http://codes.wmo.int/bufr4/codeflag/0-10-063/8 "/> 10
US Codes US Codes needed for IWXXM-US and other US products (MDCRS, PIREP, etc.) Codes so far taken from: Federal Meteorological Handbook National Weather Service Instruction (NWSI) publications 11
WMO Codes Registry Authoritative, publicly-accessible definitions Relationships between concepts (links, sub-types, etc.) Semantics (Skos - TTL, RDF) Code management policies (defined lifecycle, deprecated concepts, etc.) Allows for distributed management and/or authorities 12
Status Textual codes available at http://nws.weather.gov/codes/ • Registry prototyping also underway 13
Codes Encoding US Codes populated on an as-needed basis so far A single sustained effort to fully encode each document would probably save effort 14
Guiding Principles for creating Metadata records for NOAA wx Data • Strong Governance • NAO 212-15 and procedural directives • Adherence to ISO and OGC standards • Best way to ensure compatibility between difference types of web services supporting metadata records • Enables flexibility in data discovery methodologies (CSW, Reg/Rep, CKAN, etc.) • Providing the proper set of tools and training resources • Enable creation, maintenance, conformance, and transformation of records.
Strong Governance The role of NOAA Administrative Order (NAO) 212-15 • NOAA Administrative Order (NAO) 212-15, Management of Environment Data and Information, states environmental data be managed based upon a lifecycle that includes a data management plan. It also helped establish the Department of Commerce (DOC) National Oceanic and Atmospheric Administration (NOAA) Environmental Data Management Policy. • NOAA has approved procedural directives for: • Data Documentation (https://www.nosc.noaa.gov/EDMC/PD.DD.php) • Data Management (https://www.nosc.noaa.gov/EDMC/PD.DMP.php) • Data Sharing for NOAA Grants (https://www.nosc.noaa.gov/EDMC/PD.DSP.php) • Data Archival (https://www.nosc.noaa.gov/EDMC/documents/NOAA_Procedure_document_final_12-16-1.pdf) • Data Access and Data Citation are in development
Strong Governance (Cont’d) • NOAA Data Documentation Procedural Directive established the ISO 19115 parts 1 and 2 and 19139 as the recommended standards for data and information • Approved by NOAA’s Environmental Data Management Committee in Oct 2011 • Recommends development of common metadata management tools including mechanisms for evaluating the completeness and quality of data documentation • Weekly and monthly collaboration activities across the various NOAA line offices
Adherence to standards • ISO Technical Committee 211 Geographic information/Geomatics (TC211) is responsible for the ISO geographic information series of standards.
Upcoming changes to standards ISO 19115-* XML Schema/Transform Status 19115-3 • XML schemas implementation of 19115 -1, 19115-2 and related standards. • ISO 19115-1 and 19115-2 will be the conceptual models • Transform – 19115/19115-2 / 19139 to 19115-3 is done and validates against schema. It’s available on public github. • Future revised version of ISO 19139 will contain only encoding rules, no UML • Expected to be a International Standard by May 2015 19157-2 • Data Quality XML encoding • Transform done – included in 19115/19115-2 / 19139 to 19115-3 One Key to transition is XSLT stylesheet transforms
NOAA Metadata Training and Tool Resources • Training • NCDDC Metadata Training Webinars – (http://www.ncddc.noaa.gov/metadata-standards/metadata-training/) • Tools • EMMA webpage – (http://www.ngdc.noaa.gov/metadata/emma/index.html) • Has links to all metadata tools (guidance, authorship, component management, translation, validation, and metrics and reporting) • EDM Dashboard -- (https://sites.google.com/a/noaa.gov/edm-dashboard/home) • Show the status and progress of activities guided by the National Oceanic and Atmospheric Administration (NOAA) Environmental Data Management Committee (EDMC). • NGDC Metadata Wiki webpage • Goto guide for metadata management • ISO Explorer • Goto guide for ISO Metadata • Rubric Scoring for metadata completeness and compliance
Questions 21