1 / 48

An Overview of Geospatial Standards Support within the ArcGIS Platform

An overview of the geospatial standards supported within the ArcGIS Platform, including data formats, API, metadata, web services, and interoperability challenges.

jswenson
Download Presentation

An Overview of Geospatial Standards Support within the ArcGIS Platform

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. An Overview of Geospatial Standards Support within the ArcGIS Platform Satish Sankaran Marten Hogeweg

  2. Agenda • Interoperability Challenges • Standards Organizations and Standards • Standards – Data formats and API, Metadata and Web Services • ArcGIS – Standards Support • Pragmatic Interoperability (de-facto vs de-jure standards) • Demonstrations

  3. Interoperability Challenges • Multiple Platforms ( Operating Systems, Databases, …) • Multiple Architecture ( Local, Enterprise, Web, Cloud,…) • Multiple Clients ( Desktop, Web, Mobile, …) • Multiple Developer Environments (.NET, Java,…) • Multiple Protocols (SOAP, REST, OGC,….) • Multiple Encodings ( XML, Raster Formats, GML, JSON, ….) Cloud • Create • Manage • Visualize • Analyze • Collaborate • Discover Web Enterprise Mobile Local Desktop

  4. The ArcGIS Platform • An Open & Interoperable Platform • Supporting a thriving ecosystem of focused apps and applications. • A Standards Compliant Platform • Supporting many relevant standards including those from ISO TC 211 and OGC. http://www.esri.com/software/open

  5. Procurement personnel System Integrator Developer User Standards Open ETL Interoperability

  6. Many Standards Organizations ……. ANSI/INCITS ISO IHO OMA OGC FGDC OASIS CEN WS-I GSDI DGIWG ACSM ASPRS EPSG

  7. Many Standards …… SOS WFS WPS WCS Simple Features WMS Open LS GML ISO 19115 ISO 19139 OWS Context GeoXACML CityGML FGDC - CSDGM Geopackage

  8. GIS Standardization – functional areas Basic Geographic Structures (semantic interoperability) Geometry, topology, coordinate reference systems Content Description (semantic interoperability) Standardized Data Models, Feature Catalog Modeling languages, Application schemas Metadata Data Management (semantic and technical) Database management Data Formats (technical interoperability) Structure, Syntax, language, API Visualization (semantic and technical) Symbology, cartography, display GeoWeb Services (technical interoperability) Web Catalog, Web Services, SOA

  9. Basic Geographic Structures ISO 19107 – Spatial Schema, ISO 19111 – Coordinate Reference Systems Content Description FACC, SDSFIE, Standardized Data Models ISO 19110 – Feature Catalog Methodology , UML, FGDC Metadata, ISO 19115 – Metadata Data Management OGC Simple Features Data Formats VPF, OGC GML, ISO 19139, 80+ industry and national formats Visualization SLD, MIL-STD 2525 Web Services OGC WMS, WFS, WCS, OpenLS Registry and catalog services CAT 1.0, OAI-PMH, CS-W (ebRIM) GIS Standardization – functional areas

  10. Standards Data Formats Metadata Web Services

  11. Data Formats • Simple Features • GML • KML • Geopackage • Gml JPEG 2000 • OWS Context • WaterML, AiXM, … • CAD formats • IFC • NIEM • …..

  12. Simple Feature specification defines: Data access model Database schema 2D Geometry model for points, lines, polygons “Well-Known” data formats for geometry and spatial reference ISO and OGC specifications for simple feature access 10 area1 yellow Feature Table 11 area2 green Feature 12 area3 Blue 13 area4 red Geometry Feature Attribute What are simple features? Feature Tables contain rows (features) sharing common properties (Feature Attributes). Geometry is a Feature Attribute.

  13. Geography Markup Language (GML) • GML or Geography Markup Language is an XML based encoding standard for geographic information developed by the Open Geospatial Consortium (OGC). • Defines an XML schema for representing geographic features (attributes, geometries, relationships, Topologies, Observations, etc). • GML Simple Features • Initially motivated to help WFS use of GML 3 • GML 3 has many optional elements of schema, which complicates GML parsers • GMLSF Profile “fixes” application schemas to only allow the elements prescribed in the profile • This allows WFS servers and clients to be simpler and more efficient; the types of data which they need to anticipate are finite and reasonably structured for faster parsing

  14. GML Support in ArcGIS Desktop Simple Feature GML support is available to all ArcGIS users Import/export data Use directly as a map layer Use in a geoprocessing model Consume GML served by any Web feature Service (WFS) GML Support in ArcGIS Desktop (ArcMap) using the Data Interoperability Extension Support for specific Application schemas available using the Data Interoperability Extension. Several application schemas supported Custom schemas defined using transformation tools Consume GML served by any Web feature Service (WFS) GML Support in ArcGIS Server – Web Feature Service (WFS) implementation GML is streamed using the Web Feature Service Protocol GML Support in ArcGIS

  15. Kml Support in ArcGIS KML is an XML grammar used to visualize geographic data in an earth browser. KML uses a tag-based structure with nested elements and attributes and is based on the XML standard. • Serve • Using ArcGIS Server • Consume • ArcGIS Desktop (ArcMap, PRO) • Runtime • ArcGIS Earth • ArcGIS Online / Portal • Geoprocessing Tools • Layer To KML Tool • The Layer To KMLgeoprocessing tool allows individual • layers to be exported directly from ArcMap, ArcGlobe or ArcScene. • Map To KML Tool • The Map To KMLgeoprocessing tool allows multiple layers to be • exported into a single KML source.

  16. ArcGIS Data Interoperability Extension • Format Support • Adds support for 200+ data formats • Custom Formats • Direct use in ArcGIS Desktop • Quick Data Translation • Data Interoperability Tools Toolbox • Convert between data formats • Spatial ETL (Extract, Transform, Load) • Semantic Data Translation • Data Restructuring

  17. Standards Data Formats Metadata Web Services

  18. International Metadata Standards • FGDC CSDGM • ISO 19115, 19119 Metadata • ISO 19139 Metadata XML Schema Implementation • … Metadata Leading the way to semantic interoperability • Data about data • Geographic area covered • Currency • Rules of use • Positional accuracy • Data dictionary • Means of encoding • Datum • Map projection • A Key interoperability technology: • Producers explain their product • Users learn about products • Non standard products can be understood

  19. ISO Metadata ( Today  Future ) Ted Haberman : hdfcgroup.org

  20. Metadata standards today Extensions Profiles Content Standard for Digital Geospatial Metadata Aka “FGDC Metadata” ISO 19115 Geospatial Information - Metadata Aka “ISO Metadata” <xsd:element name="bounding" type="boundingType"/> <xsd:complexType name="boundingType"> <xsd:sequence> <xsd:element ref="westbc"/> <xsd:element ref="eastbc"/> <xsd:element ref="northbc"/> <xsd:element ref="southbc"/> </xsd:sequence> </xsd:complexType>

  21. Overview of Metadata Standards

  22. ISO 19115 (-1) Profiles • A metadata profile for precision agriculture based on ISO 19115 standard. • WMO Core Profile of the ISO 19115 Metadata Standard • Transformation of HDF-EOS metadata from the ECS model to ISO 19115-based XML • Draft African metadata profile of ISO19115 • Samoan profile • NOKIS – an ISO 19115 Based Metadata System • The UDK and ISO 19115 Standard • Latin American Profile • NúcleoEspañol de Metadatos (NEM) • UK GEMINI • Biological profile • Coastal zone profile • S100 Metadata profile (IHO) • Australia-New Zealand Profile • North American Profile of ISO 19115:2003 (NAP) • CAN/CGSB-171.100-2009 • INCITS 453-2009 • INSPIRE Metadata Directive • ISO19115/ISO19119 Application Profile for CSW 2.0 • C3Grid ISO 19115 Metadata Profile • Marine Community Metadata Profile of ISO 19115 • Energy Industry Profile of ISO 19115-1 • USGIN ISO 19139 Profile • DISDI Geospatial Metadata Profile (DGMP) • National System for Geospatial Intelligence MetadataFoundation (NMF)

  23. ArcGIS Metadata Standards Support ArcGIS Metadata ISO 19139 (NAP) XML ISO 19139 (INSPIRE) XML ISO 19139 XML FGDC CSDGM XML

  24. ArcCatalog

  25. ArcGIS Is a Platform Metadata Available in the Cloud . . . . . . and On-Premises Enabling GIS Everywhere Desktop Web Device Author / Create Simple Integrated Open Use Web GIS Portal Catalog / Discover / search Serve / Publish Server Online Content and Services

  26. ArcGIS Platform and Metadata Items Carrying Metadata • Portal and Online Items • Mxd’s, Datasets, Services • Folders • … Indexing / Access / Discovery • GeoServices REST Spec • OpenSearch • OGC CS-W Products ArcGIS Desktop – ArcMap, PRO ArcGIS for Server ArcGIS Online / Portal for ArcGIS ArcGIS OpenData App Geoportal Server App Widgets Metadata Formats • Item Information • ArcGIS Metadata • Formal Metadata – FGDC, ISO, … • DCAT • Encodings – esri JSON, XML, atom,

  27. Esri support for metadata Item Info Geoportal ArcMap ArcGIS Online Mxd properties ArcGIS PRO ArcGIS service meatadata Service Metadata ArcGIS OpenData WMS metadata

  28. What’s Next for ArcGIS? • Investigating how to incorporate support for ISO 19115-1/19115-3 into the ArcGIS platform • 19115-3 incorporates existing ISO 19115-2 and 19110 XML schemas • Evaluating XML schemas available in new ISO repositories • Continue to Improve metadata support in ArcGIS Pro and throughout the platform • Desktop -> Server -> Online/Portal • Planning next steps

  29. Standards Data Formats Metadata Web Services

  30. OGC Web Services • Web Map Service • Web Map Tiling Specification • Web Feature Service • Web Coverage Service • OGC KML • Sensor observation Service • Web Processing Service • 3D Portrayal service • ….

  31. DGIWG and OGC Service Types and Profiles Geospaial Interoperability Reference Architecture doc Report – Spring 2015 https://www.ise.gov /sites/default/files/GIRA.pdf http://ise.gov from … Geospatial Interoperability Reference Architecture (GIRA)

  32. Core Standards ArcGIS Platform Components Metadata (ISO, FGDC, …) Portals (AGOL, Portal) Providing & Consuming Developer Solutions (runtime, JavascriptApi) Consuming Data (Geopackage, geoJSON, gml-JPEG 2000…) Server Providing Desktop (ArcMap & PRO) Consuming Portrayal Standards Services (wms,wfs,wcs, wps,sos,cs-w, …) Apps Consuming

  33. JSON clients (HTTP REST) OGC clients (HTTP SOAP) Inspire clients (HTTP SOAP) Inspire CSW GeoJSON Esri REST API WMS WMTS WFS Inspire ATOM KML WCS Inspire WMS Inspire WFS WPS ArcGIS for Server ArcGIS for Inspire Geoportal http://www.esri.com/library/whitepapers/pdfs/supported-ogc-iso-standards.pdf

  34. Standards Requirements – Across the platform ….. What we are hearing! • Online / Portal • Register OGC services • Consume OGC services • Create hosted OGC services • Geopackage support • Allow analyses on OGC services • Support Discovery Standards – OGC CS-W, OpenSearch, DCAT • Managing Secured OGC Services • Metadata Support across the platform • Federated searches across portals • Server • Improve existing OGC support ( compliancy, update to new version, new profiles) • Desktop (ArcMap / Pro) • Consume OGC services • Geopackage support • Runtime and Apps • Consume OGC services • Geopackage support • Javascript API • Consume OGC services

  35. Standards Support • ArcGIS PRO • Improvements to wms wmts and metadata support in PRO (PRO 1.2) • Improvements to KML support ( Pro 1.3) • ArcGIS Earth 1.1 • Supports kml, wms and wmts • ArcGIS Online • Support for formal Metadata (Version 3.8, July 2015) • Support for secured OGC services (Version 3.10, Nov 2015) • Major improvements in Online (version 4.2, June 2016 ) – wms, wfs • ArcGIS for Server • Improvements to wfs 2.0 support • Achieved KML Compliancy (Server 10.4)

  36. Standards Support - Roadmap WCS support in Javascript API (prototype) Web App Builder widget to consume OGC OWS context document with embedded ogc services (prototype) Native netCDF Support in ArcMap (10.5) and PRO (10.4) Better metadata support across the stack Improvements to geopackage support Support for Hosted wms, wmts and wfs support in Online (Q4 2016) and Portal ( Version 10.5) Native wfs client support in PRO (Version 1.4) WCS 2.0.1 support in ArcMap and PRO Support for wms, wmts( Q4 2016 Quartz runtime) Support for geopackage, wfs , s57 in (Q1 2017 Quartz runtime)

  37. Procurement personnel http://www.opengeospatial.org/resource/products/compliant#ESRI @ 10.4 : 16 certificates

  38. SOA Vs REST Use the Web Luke ! http://geekandpoke.typepad.com/.a/ 6a00d8341d3df553ef012875f312f9970c-pi http://www.programmableweb.com/news/api-anti-patterns-how-to-avoid-common-rest-mistakes/2010/08/13 Pragmatic Interoperability …. Some GIS Standards are still playing catchup with the Web

  39. Standards, Specifications, …. • geoJSON • geoRSS • Atom • Sqlite • Vector tiles • DCAT / geoDCAT -AP • CSS – Styling • RDF • No SQL • xlsform • Opensearch + geoExtension Pragmatic Interoperability

  40. Open API’s and Specifications • Shapefile (July 1998) • Geodatabase XML (June 2008) • GeoServices REST API (Sept 2010) • FGDB API (Jan 2011) • i3S (May 2015) • LERC (Dec 2015) Open Data Download Stats for April 2016 Shapefile: 3,714,978 CSV: 413,037 GeoJSON: 318,052 KML: 43,689 GeoHash: 22,033 Pragmatic Interoperability

  41. The Proof of the Pudding… @martenhogeweg

  42. Group on Earth Observations SAEOS INPE PANGAEA GCMD ArcGIS Online GEO SeaDataNet EEA-SDI EuroGEOSS WMO WIS IOOS GSFC-DAAC EnviroGRIDS GBIF

  43. Connecting GIS and Earth Observations

  44. Geospatial Platform and Data.gov … NASA GSA Census Geoplatform.gov Data.gov DOI FCC DOT NOAA DOJ EPA DHHS DHS

  45. Access Geoplatform Content in ArcGIS • Connect tohttp://geoplatform.maps.arcgis.com • Find National Geospatial Data Assets • Use in Your GIS Projects

  46. OGC Testbed 12 • Viewer • ArcGIS, WMS, WCS, KML • WMTS, Koop FeatureServer • Discovery • OpenSearch • OGC CSW 2.0.2, 3.0.0 • OGC Context Document • GeoJSON encoding

  47. Please take our Survey Your feedback allows us to help maintain high standards and to help presenters Find your event in the Esri Events App Find the session you want to review Scroll down to the bottom of the session Answer survey questions and submit

More Related