1 / 13

Clouds and the Earth’s Radiant Energy System NASA

Clouds and the Earth’s Radiant Energy System NASA. How does one go from binary data to HDF files efficiently?. Betty J. Lock Betty.J.Lock@NASA.Gov (757-951-1903) September 29, 2010. The Performance issue. Processing just 1 zone Using: HDF4.2r4 on: ppc64. The Parameters.

chiko
Download Presentation

Clouds and the Earth’s Radiant Energy System NASA

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Clouds and the Earth’s Radiant Energy System NASA

  2. How does one go from binary data to HDF files efficiently? • Betty J. Lock • Betty.J.Lock@NASA.Gov • (757-951-1903) • September 29, 2010

  3. The Performance issue Processing just 1 zone Using: HDF4.2r4 on: ppc64

  4. The Parameters

  5. The GOALZonal Binary – To Daily HDF ZONE 1 This is done in 2 steps Binary Files HDF Files Day 1 Day n ZONE n Day 31 ZONE 180

  6. Step 1Store in memory Storing Daily information ZONE Binary File STORE in Memory

  7. Step 2Write to Daily HDF Compress sfscompress and write sfwdata Stored in –memory 1 day parameters Day 1 HDF For 31 days: Sfscompress takes .9 s. Sfwdata takes 2630 s.

  8. Backup slides

  9. File Sizes

  10. Performance Details Based on 1 zone (54) processing

  11. Write 31 SYN HDF • Includes • Get dimension info • Get field ind • Get sds id • Sfscompress • sfwdata

  12. From - To • From 180 binary zonal files • 181 Parameters for each region • To HDF Daily Files • 28 to 31 per Month

  13. The Parameters • 3 data structures with an array of 360 regions, 180 zones • 147 data structures with an array of 360 regions, 180 zones, 8 3-hr data • 1 data structure with an array of 360 regions, 180 zones, 8 3-hr data, 20 surface levels • 18 data structures with an array of 360 regions, 180 zones, 8 3-hr-data, 4 cloud layers. • 12 data structures with an array of 360 regions, 180 zones, 8 3-hr-data, 5 layers.

More Related