260 likes | 473 Views
Publishing Clearinghouse resources to geodata.gov. Doug Nebert FGDC Secretariat Geospatial One-Stop Team September 17, 2004. NSDI: a Foundation for GOS. Geospatial One-Stop (GOS) implements the principles of the NSDI spelled out in Executive Order 12906 (recently revised)
E N D
Publishing Clearinghouse resources to geodata.gov Doug Nebert FGDC Secretariat Geospatial One-Stop Team September 17, 2004
NSDI: a Foundation for GOS • Geospatial One-Stop (GOS) implements the principles of the NSDI spelled out in Executive Order 12906 (recently revised) • GOS builds on the resources already available in the NSDI – FGDC and endorsed external Framework Standards, NSDI Clearinghouse Network • Operated as project coordinated through FGDC Secretariat with many agency partners
Geodata.gov and the NSDI Clearinghouse • Over 150 collections of metadata exist within searchable NSDI Clearinghouse Nodes in the US • All FGDC metadata records are searchable by fields and full-text through six replicated search gateways • Additional non-Z39.50 metadata collections exist that should be part of the NSDI via geodata.gov
Some operational features • geodata.gov will speed and simplify search and browse of metadata as a replacement for the domestic NSDI Gateways • Metadata are harvested from remote collections into a single metadata ‘cache’ to speed search and ranking • Browsing for geospatial data is made possible through common ISO Categories
Portal at geodata.gov • OGC Web Map Services (WMS) and ArcIMS ‘image’ services supported in viewer where links provided in metadata (Online_Linkage) • Data, map services, static maps, and applications are among the resource types indexed • Channels (thematic communities) post selected browseable content
How do I publish? • Before you can publish metadata in geodata.gov, you need to register as a publisher • After your registration is completed, you will have username and password to access the portal as a publisher
1. Start registration: Login 2. Register online
4. Receive e-mail and confirm registration 3. Complete user account information 5. Read and accept publisher agreement
6. Complete publisher registration Publisher main menu
Current Publication Options • Users may contribute metadata one of three ways: • Enter FGDC metadata into a form at geodata.gov and they are stored and indexed there • Upload metadata as FGDC XML to the geodata.gov site • Register their existing metadata collection to be harvested into the GOS metadata repository
metadata metadata metadata metadata form entry XML upload search map services data data metadata cache geodata.gov map viewer data data
Data Entry Form If you do not have any FGDC metadata and anticipate only a few records to be published to geodata.gov you can use an online entry form to collect abbreviated FGDC metadata that will be hosted at geodata.gov
Upload XML Metadata If you have access to a metadata editor such as ArcCatalog but do not have a Z39.50 server or ArcIMS Metadata Server you can upload a small set of FGDC metadata to geodata.gov
Register metadata site(s) to be harvested (must use Internet Explorer 6+)
Metadata Validation Derived values, for example resource type (Live Map, Downloadable Data…) Valid values for minimum FGDC: <onlink>http://mywebsite.org/index.html</onlink> In your FGDC Online_Linkage field: For a OGC Web Map Server, enter: http://myserver/ms?VERSION=1.1.0&REQUEST=getmap&LAYERS=roads For an OGC Web Feature Service, enter: http://myserver/fserv?VERSION=1.0.0&SERVICE=WFS&REQUEST=getCapabilities For an ArcIMS image service, enter: http://myserver/image/mymap For an ArcIMS feature service, enter: https://myserver/feature/myfeaturemap
Harvesting Option • If you have or would like to maintain a collection of metadata at your site and can let geodata.gov know its location, geodata.gov can ‘harvest’ or fetch new and updated metadata to make it searchable • You can describe any type of resource (planned data activity, existing data, a map service, an application, etc.) using your published set of metadata
Harvesting options • A provider wanting to have content harvested into in geodata.gov can register: • Z39.50 “GEO” Metadata server (NSDI Clearinghouse Node) • ArcIMS Metadata Server • OAI-PMH (Open Archives Initiative, Protocol for Metadata Harvest) • Web Accessible Folder
Harvesting capabilities • Harvesting is a scheduled retrieval of metadata from a remote collection, such as an existing Clearinghouse Node • The harvester detects new content and brings it into a metadata ‘cache’ at geodata.gov for inclusion in search • Scheduling can be established in the registration profile of each provider
If you have a Z39.50 Clearinghouse Node • If your metadata collection is served on Z39.50 (such as Isite), you need to implement the newest version of Isite (2.10) • Update version for Isite is available at: • ftp://ftp.awcubed.com/pub/Software/Isite2/ • Other brands of Z39.50 software (Compusult, Intergraph, ESRI, Blue Angel) will be implementing the new features for harvest in coming months
Web Accessible Folder • Simplest option for publishing moderate numbers of metadata records (<1000) from an organization • Create browse-enabled web directory (directory listing view, no default.htm or index.html file present) with FGDC XML and optionally HTML records present • Register organization and WAF location with geodata.gov • Initial harvest pulls all content, subsequent harvests pull only changed content based on file time-stamps
Inclusion Strategy • FGDC Staff has been working on an outreach and ‘inclusion’ schedule to get all domestic Clearinghouses (Z39.50 and otherwise) from State/Local, Federal, and Commercial sources • Encourage partnerships and community networking to include as many resources as possible
Summary Steps • If you have FGDC metadata, get it in XML form and register as a publisher • Evaluate a crosswalk of your theme keyword values with ISO Categories • Insert map service and/or download URLs in your Online_Linkage fields – you may have multiple onlinks! • Consider an upgrade of software or change of protocol to be more efficient in your services • Depending on your site: register to be harvested, use form to enter individual records, or upload multiple XML files • View and test your resources once the registration and publishing is processed using the geodata.gov viewer
Metadata harvest counselors • Federal Providers • Sharon Shin, sharon_shin@usgs.gov • Sharon Maccini, smaccini@usgs.gov • Western States • Doug Nebert, ddnebert@fgdc.gov • Intermountain/Great Plains, Northeast States • Matt Orstad, morstad@usgs.gov • Gulf/Southern States • Lynda Wayne, lwayne@fgdc.gov • Midwest, Carolinas, Mid-Atlantic States • Melissa Wegner, wegner@usgs.gov