1 / 7

HDF5 Work

HDF5 Work. Environmental Hydrology Team Workshop Nov 2, 2000 HDF Team http://hdf.ncsa.uiuc.edu/HDF5. What is HDF5. HDF5 is a scientific file format Self-described Platform-independent http://hdf.ncsa.uiuc.edu/HDF5 HDF5’s Virtual File Layer(VFL) supports various file I/O methods

lani-norton
Download Presentation

HDF5 Work

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. HDF5 Work Environmental Hydrology Team Workshop Nov 2, 2000 HDF Team http://hdf.ncsa.uiuc.edu/HDF5

  2. What is HDF5 • HDF5 is a scientific file format • Self-described • Platform-independent • http://hdf.ncsa.uiuc.edu/HDF5 • HDF5’s Virtual File Layer(VFL) supports various file I/O methods • stdio, mpio, Globus-GASS, Data Grid, SRB, ...

  3. Virtual files: files needn’t be files • HDF5 incorporates a virtual file layer (VFL) • Allows HDF5 to interface to disk, the network, memory, or a user-defined device HDF5 VFL I/O drivers Std I/O MPI I/O Memory Network “Storage” Memory Network Files

  4. Types of Parallel HDF5 • MPI parallel • Build on top of MPI-IO • Limit by parallel filesystem and parallel I/O interface • Thread parallel • Beta version of thread-safe HDF5 based on Pthreads • OpenMP parallel • Works if called “correctly”

  5. HDF5 Language API • Sequential • C, F90, Java, C++ • Parallel • MPI: C, F90 • Pthread: C • OpenMP: C

  6. HDF5 Supported Platforms • Sequential • IRIX, Solaris, HPUX, AIX, Linux, DEC, FreeBSD, x86 • Wins98, NT 4.0, Wins2000 • Cray PVP, T3E • Parallel • SGI O2K, IBM SP, Intel Red, T3E, DEC Cluster • MPICH/ROMIO

  7. What about clusters? • NT cluster • mpich has a beta version of MPI-IO but has not been tried yet • Linux cluster • near future target • O2K cluster • no cross box MPI-IO • need to come up with “something”

More Related