170 likes | 324 Views
Harmonisation of Grid and Geospatial Services Standards in the Earth and Environmental Sciences. Simon Cox 1 , Lesley Wyborn 2 , Andrew Woolf 3 , Robert Woodcock 1 , Rob Atkinson 4 , Joan Esterle 1
E N D
Harmonisation of Grid and Geospatial Services Standards in the Earth and Environmental Sciences Simon Cox1, Lesley Wyborn2, Andrew Woolf3, Robert Woodcock1, Rob Atkinson4, Joan Esterle1 1CSIRO Exploration and Mining2Geoscience Australia3e-Science Centre Rutherford Appleton Lab4Social Change Online 24 May 2005
Overview • e-Science / NERC Datagrid • Oceans & Atmospheres data • Solid Earth and Environment community • HPC services for simulation & inversion • Standards-based loosely-coupled data services • SEE Grid Cox/2005 AGU Spring
GridFeature ProfileSeriesFeature ProfileFeature BADC NERC DataGrid - data transfer • Focus on large datasets, simple structures • Time-series, profiles, gridded datasets • Series and collections • e.g. Climate Science Modelling Language (CSML) Cox/2005 AGU Spring
Some solid-earth e-Science/Grid projects • GEON • NSF “Cyberinfrastructure” • EarthByte • Sydney University/Caltech/CSIRO • APAC Geosciences • Australian Partnership for Advanced Computing • pmd*CRC • Cooperative Research Centre for Predictive Mineral Exploration Cox/2005 AGU Spring
pmd*CRC - geologic process simulations Archives Data Service Cox/2005 AGU Spring
Status quo: Different formats and standards Proprietary Software Versions of Software User Data Structures Cox/2005 AGU Spring
private public boundary WFS Server WFS Client HTML GML • Data-source organised for custodian’s requirements • Community-specific GML application language • TigerGML, LandGML, O&M, XMML, CGI-GML, ADX, GPML, CSML, MarineXML etc Open Geospatial Consortium - Web Feature Service Cox/2005 AGU Spring
WFS Server B WFS Server WFS Client WFS Server C Standard transfer format allows multiple data sources Cox/2005 AGU Spring
Same format and standards XMML User XMML GML for geochemistry: XMML and OGC O&M XMML Cox/2005 AGU Spring
XMML data packet • <GeochemMeasurement gml:id="WA_1_139459_Ag"> • <om:eventTime xsi:nil="true"/> • <om:eventLocation xlink:href="urn:x-seegrid:feature:xmml:GeochemSpecimen:WA_1_139459/location"/> • <om:responsible xlink:href="urn:x-seegrid:person:wyb123"/> • <om:procedureUsed> • <AssayProcedure gml:id="ICPMS_1_139459_Ag"> • <gml:name>Inductively coupled mass spectrometry</gml:name> • <om:method>ICPMS</om:method> • <analyteDetails> • <AnalyteSensitivity> • <analyte>Ag</analyte> • <lowerDetectionLimit uom="ppm">0.01</lowerDetectionLimit> • </AnalyteSensitivity> • </analyteDetails> • </AssayProcedure> • </om:procedureUsed> • <om:target xlink:href="urn:x-seegrid:feature:xmml:GeochemSpecimen:WA_1_139459"/> • <om:result relativeMeasure="lessThan" uom="1">1.e-8</om:result> • <analyte>Ag</analyte> • </GeochemMeasurement> All this (and more) required to properly transmit one number! Cox/2005 AGU Spring
Mapping client http://cgsrv3.arrc.csiro.au/seegrid/savedapps/filter Three servers, one map GA DOIR PIRSA Cox/2005 AGU Spring
Report client http://www.ga.gov.au/wfs/reader/wfsGeochemReaderHome.jsp Three servers, one report Cox/2005 AGU Spring
One service – many uses GML-based data can be …. Rendered into a queryable map … … formatted into a report or …. Condition: community-standard data model/encoding … read and used by any WFS/GML enabled application Cox/2005 AGU Spring
APAC Trial Application… Interactions between discrete http-hosted services User Workflow... Login Edit Problem Description Run Simulation Job Monitor Archive Search Local Repository WS-Security, SAML, Shibboleth… Gridsphere, JSR 168 Portlets… Authorization, Authentication & Audit Globus, WS-RF… Job Management Portal Data Management Portal Results Archive ebRIM, WSDL, UDDI… ebRIM, OGC Catalog Service… SRB, ebRIM… Resource Registry Job Management Service OGC WFS, XMML, Service Profiles… Service Registry Snark Profile, GPML, XMML… Observational Databases EarthByte Profile, GPML, XMML… Geology W.A Rock Prop. W.A EarthByte Service HPC Repository Snark Service Geology S.A Rock Prop. N.S.W Cox/2005 AGU Spring
classic geophysics “Coverage” viewpoint classic geology “Feature” viewpoint Fields vs. objects • simple data structures • collated/gridded ready for analysis • netCDF, HDF-EOS • complex data • database insertion • complete feature interpretations • XML documents Cox/2005 AGU Spring
Key Points • e-Science depends on • Informational Services – to supply modelling constraints • Computational Services – to supply simulators and solvers • e-Science community focus on “Grid” services • high-performance computing, PDE solvers – remote but tight connections • large datasets, data warehouses – simple data structures • Geospatial community working on REST web-services • loosely-coupled, decision-support– on-demand discovery, binding and chaining, • detailed semantics – complex data-structures, community schemas Cox/2005 AGU Spring
Thank You Contact CSIRO Phone 1300 363 400 +61 3 9545 2176 Email enquiries@csiro.au Web www.csiro.au CSIRO Exploration and Mining Name Simon Cox Title Research Scientist Phone +61 8 6436 8639 Email Simon.Cox@csiro.au Web www.seegrid.csiro.au