480 likes | 1.33k Views
Challenges Solutions. Metadata in ArcGIS 10. John Bocchino: NJ Department of Environmental Protection John.Bocchino@dep.state.nj.us Edith Konopka, NJ Office of Information Technology, Office of GIS edith.konopka@oit.state.nj.us. Outline. Part 1: Challenges and Solutions
E N D
Challenges Solutions Metadata in ArcGIS 10 John Bocchino: NJ Department of Environmental Protection John.Bocchino@dep.state.nj.us Edith Konopka, NJ Office of Information Technology, Office of GIS edith.konopka@oit.state.nj.us
Outline Part 1: Challenges and Solutions What Changed What’s New Solutions (What To Do) Part 2: An Optional Editor with EPA EME What is EME? Features Usage Basics Part 3: EME: A Closer Look 2 April 2014 2
Part 1: Challenges and Solutions What Changed with ArcGIS 10 New metadata storage New metadata editor Must set metadata style Old FGDC editor is an add-in 2 April 2014 3
Why Change? • ISO is coming, ISO is coming • Only virtue of old FGDC CSDGM editor: familiarity • Take advantage of • xml tools • More modern programming platform • Allow users to customize • Accommodate multiple standards
Geospatial Metadata Standards • FGDC CSDGM = “old” standard • ESRI profile and additions (extensions) • ISO 19115 = “new” standard • ISO 19115 NAP = “North American Profile” • ISO 19115-1 = revision, currently in-work • ISO 19119 = Service metadata • ISO 19110 = Feature catalog aka Attribute Table • ISO 19115 Inspire = European Union • More… profiles, etc • ISO 19139 = XML Schema for expressing ISO 19115 and related in XML
Who • collected the data? • processed the data? • wrote the metadata? • to contact for questions? • to contact to order? • owns the data? ISO Content: it’s metadata! • When • were the data collected? • were the data processed? • were the data published • Why • were the data collected? • Where • were the data collected? • were the data processed? • are the data located? • What • are the data about? • project were they collected under? • are the constraints on their use? • is the quality? • are appropriate uses? • parameters were measured? • format are the data in? • How • were the data collected? • were the data processed? • do I access the data? • do I order the data? • much do the data cost? • was the quality assessed? Slide content courtesy of Jacqueline Mize, NOAA National Coastal Data Development Center
Talking About Metadata • Section = Big logical chunk • Element/Attribute = a single structured piece of information, e.g. • <title>Ice Cream Store Point Locations in Westfield, NJ</title> • XML = Extensible Markup Language (illus. here) • ISO (UML) attribute vs XML attribute • <step number="3">Connect A to B.</step> • <gmd:date gco:nilReason="unknown"/>
But it’s a little differentFGDC CSDGM vs ISO • Slide content courtesy of Jacqueline Mize, NOAA National Coastal Data Development Center
New ArcCatalog Editor and Viewer The Good The Bad and Ugly Lots of bugs thru sp2 Still some bugs at sp3 Hard to produce/reproduce FGDC CSDGM Upgrade scrambles process steps ISO metadata not supported by most US catalogs yet • Better user interface • Pick lists and calendars; automatic formatting • Editor stores xml in geodatabase in native (non proprietary) xml format • Collects info needed for ISO • Geoprocessing tools for many metadata functions
Workflow Decisions • Keep using old FGDC editor if • Need FGDC metadata for catalogs • Don’t want to learn new editor until it really works • Have a collection of FGDC metadata that must be maintained • Switch to new ArcGIS editor if • Like the latest and greatest • Are willing to do xml editing of “almost ok” FGDC metadata • Have NO FGDC metadata to start with (maybe)
Which Service Pack? • ArcCatalog 10.0 and sp1: DON’T USE THIS • ArcCatalog 10.0 sp2: Use if synchronizing data and FGDC metadata is required • ArcCatalog 10.0 sp3: Use if switching to new Editor
Using the FGDC Editor at ArcGIS 10 Think, then act Practical tips follow
Using the FGDC Editor DON’T DO THIS • Don’t use the “import” button • Don’t “upgrade” your existing metadata before thinking about it carefully • Don’t use the “export metadata” button
Using the FGDC Editor Do this first • Install service pack 2, includes FGDC style • WARNING: may also need one or more patches • Set metadata style to FGDC • Download and install FGDC editor • Optional: Download and install NPS synchronizer (sp2 only)
Using the FGDC Editor: Downloads • Service pack 2 http://resources.arcgis.com/content/patches-and-service-packs?fa=listPatches&PID=160&FilterPV_1=654&maxVersion=1&maxCategory=2&FilterVersion=+go+ • Old FGDC editor http://blogs.esri.com/Dev/blogs/arcgisdesktop/archive/2010/06/25/FGDC-Metadata-Editor-for-ArcGIS-10.aspx Note: destination may depend on OS. Editor Addin should be downloaded DIRECTLY to destination. • NPS Synchronizer http://resources.arcgis.com/gallery/file/geoprocessing/details?entryID=8DA58FD4-1422-2418-8836-2FE83C67EF7D
Using the FGDC Editor After installing service pack, setting style
Using the FGDC Editor 1 After downloading FGDC editor, installation 2 Drag button to toolbar
Viewing FGDC metadata FGDC style – base elements only
Moving FGDC metadata • DON’T USE Import, Export buttons • DON’T USE Import, Export metadata models • DO use ArcToolbox Metadata Importer tool for Import AND Export • Do use ArcToolbox USGS MP Metadata Translator tool
Final comments • Instructions for NJGIN contributors https://njgin.state.nj.us/oit/gis/NJ_NJGINExplorer/docs/Tips_MD_Arc10.pdf • See Reference handout (will be posted) Another option for limited editing of FGDC metadata (JB, you’re on!) • EPA Metadata Editor for ArcGIS 10 https://edg.epa.gov/EME/
A Simple 3-Tab editor for creating, editing and validating metadata -ArcGIS 10 Compatible -Standalone Part 2: The EPA Metadata EditorCurrent EME v 3.1.2 2 April 2014 27
What is EME?The TurboTax of Metadata Editors User-Friendly 3 Tab Editor Drop- Downs Works in ArcGIS10 Stand- alone Color- Coded DB Defaults Help System Custom Synchronizer Internal Validatation
EMEWhy not endorse as an option before? Customized for mainly EPA (especially early versions) • EPA/NJDEP Differences (missing fields) • No ability to easily modify fields/dropdowns (no source code) • No detailed Entity & Attribute Section (just overview) • Multiple Entry Problems (online linkages, process steps) • Additional System Requirements (now in ArcGIS 10) • XML header problems • Other bugs • Major software/hardware changes! • ArcGIS 10 • ISO influence
Using the EME • Earlier Versions in ArcGIS (9.x) • EME 3.0 must be uninstalled prior to uninstalling ArcGIS 9.X. • EPA has developed a patch to help address this issue (Included in EME v3.1.1 download package) Uninstall EME 3.0 Uninstall ArcGIS 9.x
Using the EME EME v 3.1.2 Requirements Microsoft .NET Framework 3.5 ArcGIS 10 (for ArcGIS extension) FGDC Style Patch (for ArcGIS extension) *sp2 (allows viewing of FGDC metadata) *Microsoft Access: Enter “Defaults” into select databases One user with Access can share master database (mdb) in a multi-user environment
EME Join NJDEP Email Notification List if not released by Dec. 6th • Version 3.1.2 available now • What’s Planned for Next Update (3.2 Jan 2012) • Include additional fields • Source citation information • Spatial data organization • Standard order process Will match NJDEP Metadata Profile
EME Key Features • Custom Synchronization • Keyboard shortcuts for Copy ,Cut and Paste • Metadata Export & Import tools from the EME Toolbar, • Provides direct access to EME Help from the EME Toolbar • Provides EME source code from EME website. • Spellcheck • Find and replace • Validate from within the tool • Microsoft Access database to supply default information within the user interface!
EME EME database moved to new location • Install directory: inherent metadata.mdb has EPA information C:\Program Files\Innovate! Inc\EPA Metadata Editor\template\metadata.mdb *Copy/paste NJDEP metadata.mdb for clean version and to easily configure • Makes an operational copy of EME database in user directory, e.g., (e.g., C:\Document and Settings\username\Application Data\Innovate! Inc\(EPA ver) *Copy/paste NJDEP metadata.mdb for clean version and to easily configure Coordinate metadata with multiple users in your office! Have each modify the operational/user config.xml to point to alternative db location, e.g., <EMEConfig> <MdbFilepathname>H:\EME\metadata.mdb</MdbFilepathname> </EMEConfig> *NJDEP metadata.mdb: http://www.nj.gov/dep/gis/metahelp.htm If changes made to directly to metadata.mdb and config.xml, best to close and open ArcCatalog
Using the EME Access EME as an Extension from ArcCatalog Access EME as a standalone application • Start EPA Metadata Editor
Using the EME • The EME Database • EME uses a Microsoft Access (2000) database to supply default information within the user interface • Database is structured to align closely with the flow of the user interface • Modify the database from the EME user interface • Change the location of the database as needed
Using the EME Non-compliant Synchronization • Automatically insert data properties into metadata • Save time and ensures consistency with data • Particularly useful for coordinate system and spatial extent
Using the EME • The EPA Synchronizer • Lets users control which data properties are synchronized • Retain information for important elements • Avoid inserting unnecessary information • Access from EME Toolbar
Using the EME Set EPA Synchronizer as default Select which attributes to synchronize Apply synchronization
Using the EME • The EME Validator • Tests metadata records for compliancy with both FGDC and EPA requirements. • Validate records one at a time or with batch processing • Results of validation available in: • EME user interface • Web browser
Awards & Publications 2007: EPA Metadata Editor wins first place for Best Embedded GIS Application at the ESRI Software Applications Fair 2007: FGDC Newsletter "Spatially Speaking" features EME 2007: ArcUser Magazine features EME 2008: Government Computer News (GCN) 2008 Agency Award 2011: EME wins 2nd Place Award for Desktop GIS Application at the ESRI User Software Applications Fair 6 December 2011 42
ArcUser July-Sept 2007 6 December 2011 43
Ready…Set…Go! Next steps…. 1. Verify Spec’s and Requirements to load EME 2. Download/Install EME from EPA’s EME Website https://edg.epa.gov/EME/ *additional training resources also available here 3. Download NJDEP metadata.mdb version (cleaned up): http://www.nj.gov/dep/gis/metahelp.htm 4. Place NJDEP mdb in the following directories: -Install directory: inherent metadata.mdb has EPA information C:\Program Files\Innovate! Inc\EPA Metadata Editor\template\metadata.mdb -Operational copy of EME database in “user” directory, e.g., (e.g., C:\Document and Settings\username\Application Data\Innovate\(EPA ver.) 5. Turn it on! (Customize-Toolbars-EPA Metadata Toolbar) 6 December 2011 44
Additional Resources EME Website • https://edg.epa.gov/EME/ ArcGIS 10 Desktop Metadata Help • http://help.arcgis.com/en/arcgisdesktop/10.0/help/index.html#//00qp0000001p000000.htm ArcGIS Metadata Blog Posts • http://blogs.esri.com/Dev/blogs/arcgisdesktop/archive/2011/01/03/A-new-approach-for-Metadata-with-ArcGIS-10.aspx FGDC Metadata Website • http://www.fgdc.gov/metadata DEP Metadata Website • http://www.nj.gov/dep/gis/metahelp.htm NJGIN • https://njgin.state.nj.us/NJ_NJGINExplorer/index.jsp 6 December 2011 45
Part 3 EME: A Closer Look Synchro Find & Replace Validate Import Set Synchro Edit Export Help Clear • Existing Metadata vs from Scratch • Using & Importing Templates • Synchronization • Database Usage • Database Entry • Field Entry • Tool Functions • Validating • Exporting • Archiving *Hint: First create a test file gdb with some layers EME Tool Demo 2 April 2014 6 December 2011 47 47