1 / 20

UCoMS: Grid Computing Framework for Petroleum Engineering

UCoMS: Grid Computing Framework for Petroleum Engineering. UCoMS. Ubiquitous Computing and Monitoring System for Discovery and Management of Energy Resources.

maxim
Download Presentation

UCoMS: Grid Computing Framework for Petroleum Engineering

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. UCoMS: Grid Computing Framework for Petroleum Engineering

  2. UCoMS • Ubiquitous Computing and Monitoring System for Discovery and Management of Energy Resources. • UCoMS, sponsored by Department of Energy and the Louisiana Board of Regents, is a project to research and develop new Grid computing and sensor network technologies for the management of energy resources. • Three Louisiana Universities are involved in this project: Louisiana State University (LSU), University of Louisiana at Lafayette (ULL) and Southern University at Baton Rouge (SUBR).

  3. UCoMS Application Areas • Reservoir simulation on computing grids. • Real-time well surveillance. • Drilling performance analysis with high-rate data coming from real time drilling.

  4. ResGrid • Massive reservoir simulation tool for uncertainty analysis. • Leveraging data archiving tool, condor-based task farming framework and Information service, and GridSphere. • Basic functions implemented.

  5. Why ResGrid? • Reservoir simulation is one of the largest users of computing power • Large, complex, uncertainty models • High risks and high rewards • Where is the gain? • Moderate-sized jobs can be farmed out onto a heterogeneous grid. • Large jobs can be run in parallel on a grid. • Efficiency gains can help to assess risks, estimate parameters, run larger and more complex models.

  6. Computational Details • Two Parts of the Problem: • constructing grid blocks as input for reservoir simulation. • The Reservoir simulation itself. • Geostatic Modeling is used to generate input data. • UTChem is the reservoir simulation app. • Computational complexity can be increased by increasing the granularity of the grid, increasing number of simulations for better estimates and increasing the complexity of the algorithm itself. • Currently a typical problem requires 55 days on a single 3GHz P4 system. • UTChem’s memory requirement is small. • GSLIB is memory intensive. Typical run needs 8GB of RAM. Trying to move to algorithms using sparse matrices to reduce the memory requirement.

  7. Typical Reservoir Simulation Workflow

  8. ResGrid Workflow

  9. UCoMS Grid Enabled WorkFlow

  10. Grid Computing in UCOMS • Grid Application Toolkit/Simple API for Grid Applications (GAT/SAGA) • Many new adaptors/examples • Grid portals using GridSphere • Data Archiving Toolkit based on GAT • Task Farming Framework using Condor. • Information service based on MDS/GPIR • Mobile Grid Computing (Migration) • ResGrid: a tool for reservoir uncertainty analysis. • General Components: • APIs • Replica location • Job submission • Data transfer • Metadata • Workflow • Task-farming • Visualization

  11. Grid Application Toolkit (GAT) • Abstract programming interface between applications and Grid services • Designed for applications (move file, run remote task, migrate, write to remote file) • Led to GGF Simple API for Grid Applications www.gridlab.org/GAT

  12. Grid Portals • GridSphere Portal used to provide portal interfaces • HPC Portal to monitor and submit to HPC resources at CCT and other national and international Grids.

  13. Data Archiving • Grid-enabled data archiving tool (server and clients) for large scale data management. • Based on GAT. • Essential for large-scale reservoir simulations and drilling applications.

  14. Replica Catalog “The Grid” Task farming infrastructure implemented in Cactus TFM SMS Server GridSphere Portal GAT used for starting remote TFMs TFM TFM Designed for the Grid TFM TFM Tasks can be Anything (MPI, Single proc) Mail Server Task Farming Need flexible mechanisms for scheduling and deploying our applications • Fault tolerance, scheduling, data integration, … Two approaches • Cactus-based task farming framework. • Condor-based task farming framework.

  15. Current Status • ResGrid running locally. • Using Two Grids: CCT Grid and ULL Grid. • Also Running on KISTI machines in Korea. • Interested in Connections to other external Grids.

  16. Grid Infrastructure: CCT Grid

  17. CCT Certificate Authority GSI Open SSH access to all machines GridSphere portals PBSPro, Maui Condor, GAT, Globus GridHub Grid Services Server hosting various Grid Services GridLab Resource Management System (GRMS) iGrid MDS RLS GPIR Grid Infrastructure: Services

  18. Requirements from Sites • Users in GridMap files. • C and Fortran compilers. • Globus 3.x/4.x • GridFTP Server • GRAM

  19. Other Applications/Services from CCT • SCOOP WW3 – Wave Watch 3 • SURA Archive – Can provide the archiving service and getdata clients based on GAT for facilitating storage and retrieval of data for various applications. Also provides metadata and logical file services. ADCIRC can already use the SCOOP Archive we have.

  20. Credits • Investigators • Edward Seidel (CCT) • Gabrielle Allen (CCT) • Christopher D. White (PE) • John R. Smith (PE) • Zhou Lei (CCT) • Hartmut Kaiser (CCT) • Archit Kulshrestha (CCT) • Ph. D. Candidates • Richard Duff (PE) • Xin Li (PE) • Dayong Huang (CS) • Santiago Pena (CS) • Promita Chakraborty (CS) • M. S. Students • Chongjie Zhang (CS) • Undergraduate Students • John Lewis (CS) • Yunan Yuan (EE)

More Related