80 likes | 218 Views
Development of OGC WPS services on Gordon I/O node for Data-Intensive Applications. Choonhan Youn Viswanath Nandigam , Nancy Wilkins- Diehr , Chaitan Baru San Diego Supercomputer Center, University of California, San Diego. Outline. Introduction OpenTopography Project
E N D
Development of OGC WPS services on Gordon I/O node for Data-Intensive Applications Choonhan Youn ViswanathNandigam, Nancy Wilkins-Diehr, Chaitan Baru San Diego Supercomputer Center, University of California, San Diego
Outline • Introduction • OpenTopography Project • Service Registry • OGC WPS service • Gordon: Computing Facility • System Architecture 2
OpenTopography • As an NSF data facility, OpenTopography (OT, http://www.opentopography.org) provides community access to high-resolution Earth science-oriented, topography data, and related tools and resources. • OT provides several spatial data access functions and geoprocessing applications packaged as Web services across multiple backend servers. • OPAL toolkit (http://opal.nbcr.net) • OPAL is an open-source toolkit developed by the National Biomedical Computation Resource (NBCR) and the SDSC that enables users to wrap scientific applications running on cluster and Grid resources as Web services. • All Web services are built and deployed by leveraging OPAL toolkit. 3
Service Registry • An SOA based pluggable service infrastructure has been prototyped to enable scientists to contribute processing tools and algorithms for operating on OT LIDAR datasets, for use by the larger community. • Service registry is a key piece for enhancing and achieving reuse of services that allows service providers/consumers to organize information about services and allow facilities to publish their services. 4
OGC WPS (Web Process Service) Services • It defines a standardized interface that facilitates the publishing of geospatial processes, and the discovery of and binding to those processes by clients. • TauDEM (Terrain Analysis Using Digital Elevation Models) services for the hydrology science • Adapted as science driver and community service to connect OT and CyberGIS projects. • TauDEM functions are wrapped as OGC WPS Web services. • A single data access service which invokes a set of OT data and application services. • WPS repository can be suitable for the service registry potentially and these service registry can be used for the service integration and composition. 5
Gordon: Computing Facility • Data-intensive applications that involve “very large data-sets or very large input-output requirements”. • A“data-intensive” supercomputer based on SSD flash memory • Asystem designed to accelerate access to massive data bases being generated in all fields of science, engineering, medicine, and social science. • TauDEMservices, including full OT software stack, has been deployed to a dedicated Gordon’s I/O node. 6
System Architecture Service Consumers, Science Gateways ( Web Apps, Model Builders, etc. ) SOAP/HTTP SOAP/HTTP External Authenticated OPAL Web Services OGC WPS Web Services Science Applications Future Work: Local SSD Cache Local SSD (4.8TB) Compute Servers Gordon I/O Node Science Applications LIDAR Data Management System (Data Oasis) Gordon Compute Nodes Gordon Computing Cluster 7