1 / 51

Documenting OEI’s Geospatial Resources

EDG Stewardship and the EPA GeoPlatform. Documenting OEI’s Geospatial Resources. October 28, 2011 EPA East Training Room 2369B https://epa.connectsolutions.com/edgtraining/. Welcome. Reuse. Why are we here today?. Information. Organization. Keywords. My Data. Your Data. GeoPlatform.

buckminster-church
Download Presentation

Documenting OEI’s Geospatial Resources

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EDG Stewardship and the EPA GeoPlatform Documenting OEI’s Geospatial Resources October 28, 2011 EPA East Training Room 2369B https://epa.connectsolutions.com/edgtraining/

  2. Welcome Reuse • Why are we here today? Information Organization Keywords My Data Your Data GeoPlatform Search Authoritative Sensitive Metadata Web Pages EME EDG http://www.youtube.com/watch?v=-4CV05HyAbM

  3. Training Goals • Understand Metadata Workflow • Steps for creating & publishing metadata, publishing your data, updating data/metadata, reusing content in other parts of your life • Understand OEI data/metadata components • OEI servers and services • EPA/OEI web pages • Deploying services , describing them, & linking to metadata • Understand the relationship to the big picture • EPA GeoPlatform • Data Download and Services Hosting • What do we want this to look like?

  4. What Are We NOT Covering? • Detailed information about metadata standards • Detailed instruction on using and configuring EME • Detailed instruction on EDG Administration processes • Detailed instruction on how to optimize and create high-performance services

  5. Agenda • Introduction : basics of current EPA geospatial infrastructure • What , Who, Why, How? • The Role of Metadata and the EDG Break • Hands-on Exercises and Discussion • Part I: Creating & Publishing Metadata Break • Part II: Reusing Content Lunch • Discussion: What shouldEPA’s geo envt look like? To Do Spend some quality time with the EDG Contribute your content Reuse your information Show ROI on your investments

  6. Logistics • Training Machines - Logging In • User Name • Password • Login to EPA GeoPlatform • student • student • Training Materials • Breaks • Questions?

  7. Introduction • What are the technology pieces of EPA’s geospatial framework? Local Data & Metadata NCC Platform (Services) EDG Servers EPA GeoPlatform EPA Websites & Apps A B C D E

  8. Introduction • What is the role of Metadata and the EDG? • Metadata helps people understand your data • Limitations, Contact Information, Processing Steps, Attributes, and more….. • Metadata helps people find your data • Metadata can be used as a link between systems • Primary linkage (service) • Secondary linkage (downloadable data set) • More links if desired

  9. Introduction • What is the role of Metadata and the EDG? • EDG used as a conduit for metadata reuse • Links to metadata records (stylesheets, different views) • REST outputs (for lists, etc) • Sharing with external resources (data.gov) • EDG provides you with the power • You (or your organization) decide how to share your data and with whom to share it • You (and other stewards for your organization) administer content and oversee access rights

  10. Introduction • Who are the people involved? • Data Owner: packages and documents data locally • EDG Steward: works with data owners and publishes to EDG • EDG Administrator: oversees metadata contributed to EDG; assists stewards as needed • EPA’s NCC GIS Team: deploys services to NCC GeoPlatform Environment • SDAP Team: Reports to OMB & external parties

  11. Introduction • Why should we care? • The Present: My Apps work just fine without all this! • The Future: The role of metadata in an increasingly SOA-centric world • EPA GeoPlatform and OEI’s data sets and services • Reusing your own data • Organizing the framework so others can use it • Making life easier on yourself – and others……. Package & document Deploy & Publish Ingest & Reuse Relax

  12. Introduction • Common Pitfalls in Getting from A to B-E • People, Components, & Process • Who’s in charge of overseeing the whole process? • Who has access to which components and who is in charge of each piece? • Simple errors can seem daunting • Priorities, demands, timing

  13. Introduction • How do I get started? • Establish roles, even if informally • Create an inventory • Develop data and metadata • Decide how to share data • Create data services? • Create data packages? • Update linkage • Contribute to EDG • Load to EPA Platform • Reuse Elsewhere Integrated Data Local Data Local Data Local Data

  14. Let’s Get Started Then… • I’m Ready!!!!

  15. Break

  16. Exercises & Discussion • Part I: The Heavy Lifting – preparing and documenting data • Creating Metadata for a Local Data Set • Packaging & Distributing Data • Publishing Metadata to EDG • Part II: Making your data (and metadata!) work for you • EPA GeoPlatform – Publishing Maps • Reusing Content – EGO, REST, Others

  17. Part I: Creating Metadata – The Basics • I have a great dataset! • I need to share it! • How do I document it for distribution? • Metadata Basics: • Know your standard(s) • Know your tools • Know how to start • Know how to finish

  18. Part I: Creating Metadata – The Basics • Standards • FGDC CSDGM, version 2 (1998) • http://www.fgdc.gov/metadata/geospatial-metadata-standards#csdgm • FGDC CSDGM Graphical Image Map • http://www.fgdc.gov/csdgmgraphical/index.html • EPA Technical Specification • http://www.epa.gov/geospatial/docs/EPA_Geospatial_Metadata_Technical_Specification_v1_11_2_2007.pdf • North American Profile (NAP) of the ISO Standard - In progress?

  19. Part I: Creating Metadata – The Basics • Where is my local metadata stored? • How is my metadata stored? • How does that relate to what’s at the EDG? • How does it get there? • How does this relate to “services” metadata? igeo.epa.gov/arcgis/rest/services/FRS/MapServer

  20. Part I: Creating Metadata – The Basics • Know your tools • EPA Metadata Editor with Synchronizer • https://edg.epa.gov/EME/ • ArcCatalog & FGDC Editor • More links at end of presentation • ArcToolbox Metadata Tools • Importer • Validator • Publisher

  21. Part I: Creating Metadata – The Basics • How to Start • Make some decisions • Who, where, what? • Set up database defaults in EME and/or create a template • Why use templates? • Why use caution with templates? • Set up your synchronizers • Why use synchronizers? • Why use caution with synchronizers? • How to Finish • Review (beyond validation) • Confirm online linkages • Proceed to step 2, package and deploy

  22. Part I: Creating Metadata – The Basics • Creating and/or Using a Metadata Template • If you have a good record to start with, start there! • Export metadata record to xml • If not, create one from scratch • Download and install EME (https://edg.epa.gov/EME/) • Customize your defaults • Create a blank record • Apply Defaults (global or single) • Use “Save As” to save record as XML file (“OIAA_template.xml”) Defaults can be shared!

  23. Part I: Creating Metadata – The Basics Each database table represents a field in your metadata template Example: Publisher field Select your organization from the list (or enter a new organization), and check the Default box

  24. Part I: Creating Metadata – The Basics 2. Import 3. Synchronize 4. Open & Edit Metadata 1. Access dataset in ArcCatalog TOC Save

  25. Part I: Creating Metadata – The Basics • Exercise: Creating Metadata for Local Datasets • Create/Use Metadata Template (if desired) • Access Data set in ArcCatalog • Import Template • Configure and Run Synchronizer • Open Metadata Record • Save and Close • Export to XML format (maybe)

  26. Part I: Creating Metadata – The Basics • Things to consider • Top 5 fields to think about • Title • Abstract • Online Linkage • Resource Description • Contacts • Think about Keywords, Acronyms and Titles • Validation Stagnation: Not every error is created equal

  27. Part I: Package & Distribute Data • Considerations for publishing data • What becomes a service? • What becomes a downloadable package? • What’s included in Clip N Ship? • How often will data change? • How will changes be handled? • How should data be referenced?

  28. Part I: Package & Distribute Data • Processes for providing access to data • Data Services • Package Data • Create services in NCC Sandbox Environment • Deploy to NCC GeoPlatform Servers • Downloadable Data Sets • Make available via EDG Download Locations • https://edg.epa.gov/metadata/webhelp/en/gptlv10/inno/EDG_Download_Locations.pdf • Make available through the EPA Clip N Ship Application • All of the above?

  29. Part I: Package & Distribute Data • Exercise: Deploy Data as Services • Open ArcMap, load data; create mxd for publication • Provide descriptions • Dataset • Service • Deploy to NCC Servers • Use Geo Sandbox (development) • Copy files to server • Administer service • http://134.67.224.155/ArcGIS/Manager • http://134.67.224.155/ArcGIS/rest/admin/ • Move to Official Platform Environment http://intranet.epa.gov/rtpgis/ncc_vgis.html • Package Content and Send to NCC • Review on Staging • Review on Production • Update metadata with links Description Mania

  30. Part I: Package & Distribute Data 1. Create MXD in ArcMap 2. Load data (relative path to FGDB) 3. Write basic documentation (link to metadata - soon) This dataset…. <br> <A HREF="http://www.epa.gov/superfund/sites/npl/" target="_blank"><IMG SRC="http://www.fishcda.com/outgoing/r9/program_website.png" BORDER=0></A> <A HREF="https://edg.epa.gov/metadata/catalog/search/resource/details.page?uuid={786F4CC0-4DA1-4F07-B2EC-9AC458D65677}&xsl=metadata_to_html_full" target="_blank"><IMG SRC="http://www.fishcda.com/outgoing/r9/metadata.png" BORDER=0></A> 4. Copy to NCC Sandbox and Test 5. Ask NCC to move files to staging & production. Samples: http://www.fishcda.com/ArcGIS/rest/services/EPAR9Home/MapServer/0

  31. Part I: Package & Distribute Data • Things to Consider (at a later date….) • Service options and optimization • Caching/Tiling • Other Optimizations • Clearing Rest Cache • Service Options • Service organization • Who are the guardians? • Folders/files/services • Service maintenance • Updates to data and metadata

  32. Part I: Package & Distribute Data • Exercise: Deploy Downloadable Data Packages • Example using EDG Download Locations • Why use EDG Download Locations? • Easy ftp process for both internal and public access • User-managed content • WAFs easy to use from EDG • SSO with EDG • Restricted folder: users may not access unless logged in • Publicfolder: users may access anonymously http://edg.epa.gov/data https://edg.epa.gov/metadata/webhelp/en/gptlv10/inno/EDG_Download_Locations.pdf

  33. Part I: Package & Distribute Data • Exercise: Deploy Downloadable Data Packages • Process Steps • Zip data set(s) (if desired) • Login to EDG Data Download Locations • FTP to edg-intranet.epa.gov • Copy content to server and choose access level • Restricted • Public • Check locations at EDG server • Harvest from download location (if desired) • Update metadata links https://edg.epa.gov/metadata/webhelp/en/gptlv10/inno/EDG_Download_Locations.pdf

  34. Part I: Publish Metadata to EDG • Obtain Stewardship Rights • Determine Contribution Method(s) • Harvest • Upload • Both • Contribute • Administer • Decide Access Policy at EDG • Review Resources & Update if Necessary • Review Metrics and Generate Reports EPA Regions, Programs, Labs EDG unrestricted

  35. Part I: Publish Metadata to EDG • Exercise: Publishing to EDG • Harvest Option • Put metadata record into WAF • Login to EDG • Go to Administration Tab • Create new harvest site run harvest • Upload Option • Choose Upload and upload local record to EDG • Review at EDG • Set access level • EDG Administrator reviews & approves • Review at EDG to view links for service description https://edg.epa.gov

  36. Part I: Publish Metadata to EDG Log in to EDG, navigate to Administration tab, and click on “Add” Select your publish method Upload metadata record on behalf of your office. EDG Administrator will approve your record. Review your record at EDG.

  37. Part I: Publish Metadata to EDG • Linking to EDG from Services and Vice-Versa • Problem 1: User must have direct link to EDG metadata record to update service description. As such user must publish record to EDG before documenting link in service. • Problem 2: User must have service link to update metadata record so that online linkage works. • Which step should come first?

  38. Part I: Publish Metadata to EDG • Wrap up the service deployment by updating the service to point to the EDG for the full metadata • This will also come in handy for the EPA GeoPlatform https://edg.epa.gov/metadata/rest/document?id={D29159A0-281A-4C34-9601-CDB95E272A61}&xsl=fgdc_plus

  39. Part I: Publish Metadata to EDG • Evaluate & Report • Come back in a week to see how your data performs…..

  40. Break

  41. Part II: Reuse - The EPA GeoPlatform • Creating a Map • Describing the Map • Loading Content • Linking to Metadata

  42. Part II: Reuse - The EPA GeoPlatform • Exercise • Login to the GeoPlatform • Create a Map • Add your great new service! • Describe the map and link to full metadata! http://epageoplatform.esri.com/home/

  43. Part II: Reuse – EDG Outputs • Putting it All Together • REST Links & Templates • Using within Web Sites • Configuring Parameters

  44. Samples of Reuse

  45. Exercise – Reusing Outputs • Login to EDG • Browse to OIAA • Add a few filters • Click on Intranet REST results • http://edg-intranet.epa.gov/metadata/rest/find/document?owner=106&xsl=metadata_to_html_full&searchText=TIGER&f=html&start=1&max=50 • http://edg-intranet.epa.gov/metadata/rest/find/document?owner=106&xsl=metadata_to_html_full&searchText=Census&f=html&start=1&max=50

  46. Params You May Care About • REST params • xsl (for metadata) • style (for rest HTML output) • owner • Max • Widget params • css

  47. Part II: Reuse – EDG Outputs • Use short HTML code snippets to embed EDG content in your websites • Detailed instructions: https://edg.epa.gov/metadata/webhelp/en/gptlv10/inno/EDG_Reuse.pdf

  48. Summary and Recap • Data Publishing Workflow • Inventory • Metadata Templates • Package Data • Deploy Services • Decide Publish Method • Publish • Set Access Policy • Maintain • Publish at GeoPlatform • Create REST Links

  49. More Information • Resources • EDG About Page • https://edg.epa.gov/metadata/catalog/content/about.page • EME • https://edg.epa.gov/EME/ • https://edg.epa.gov/EME/Resources.htm • FGDC Metadata Editor • http://blogs.esri.com/Dev/blogs/arcgisdesktop/archive/2010/06/25/FGDC-Metadata-Editor-for-ArcGIS-10.aspx • Contacts • David Parrish, EDG and EME Project Manager • parrish.david@epa.gov • Jessica Zichichi, Just Another Contractor • jzichichi@innovateteam.com

  50. Lunch Break 12:00-1:00

More Related