Contract Year 1 Review Climate-Weather-Ocean Modeling

1. Contract Year 1 ReviewClimate-Weather-Ocean Modeling John R. Boisseau The University of Texas at Austin 16 May 2002

2. FA Technical Overview • MOS CWO efforts are focused in 3 areas: • Improving the performance and scalability of strategic ocean and atmospheric models to enable higher resolution simulations • Improving the HPC user environment & tools to enable rapid developing, porting, and tuning of large CWO codes and visualization/analysis of CWO data • Evaluating and developing new technologies in grids & coordinate systems, coupling techniques, and data assimilation techniques for enhancing CWO simulation capabilities Contract Year 1 Review

3. FA Technical Overview (cont.) • Top specific CWO Strategic Issues • Easier programming tools to enhance porting and optimizing • Common / consistent programming tool suites • More scalable programming algorithms/solvers, tools, and systems • Enhancing visualization capabilities of model output for remote users. • Porting and optimizing CWO codes to/for new HPC systems • Code coupling between ocean, coastal, atmosphere, and/or ice models, and with bio/chem models, aerosols, contaminant/drift transport, etc. • Investigations/evaluations of unstructured grids for estuaries/coastlines • More scalable, better load-balanced variational data assimilation techniques including automatic adjoint compilers • Investigations/evaluations of vertical coordinate systems for accuracy • Accurate, load-balanced representation of atmospheric & ocean physical processes Contract Year 1 Review

4. FA Technical Overview (cont.) • Efforts for Contract Year 1 • On-sites • Developed user contacts • Provided support • Improved CWO codes • Prepared presentations, reports, and publications • Weekly reports • Projects • CWO 007: Coupling of COAMPS and Wavewatch With Improved Wave Physics (Lead: Pat Fitzpatrick, MSU) • CWO 011: Functional Extension and Application of a Model Coupling Executable Library (Lead: Keith Bedford, OSU) Contract Year 1 Review

5. FA Technical Overview (cont.) • Efforts for Contract Year 1 (continued) • FAPOC • Getting contract in place and issues worked out • Staffing Issues • Hiring ERDC on-site • Recruiting Monterey on-site • Development and execution MOS CWO Strategy • UAP • CTA lead, former CTA lead • Visits to major CWO sites, discussions with users • Refined continuously with continuous feedback • Inform on-sites, potential project leaders, potential training class teachers of strategy • Inform users at major users sites of strategy and need for continued input, requests for assistance, etc. • Weekly reports to CPOC Contract Year 1 Review

6. Metrics — Technical • User Codes Impacted by PET • ERDC On-site (since late-February 2002) • Delivered MPI version of Multiblock Grid CH3D-Z to Carl Cerco and Sungchan Kim of Environmental Lab. Assisted on setup Chesapeake Bay & Patuxent River simulation on the O3K at ERDC. • NAVO On-site • Developed OpenMP version of the QUODDY 3-D Finite Element Coastal Circulation Model. • Developed OpenMP version of the SWAN (Simulating WAves Nearshore) wave model. • Incorporated 3D ADCIRC routines into the MPI version of ADCIRC-2DDI to create a single source parallel 2D/3D ADCIRC Contract Year 1 Review

7. Metrics — Technical (cont.) • User Contacts and Assistance • ERDC On-site (since late-Feb ‘02) • Met with Robert McAdory and Joe Letter of Coastal Hydraulic Lab for discussion multiblock grid generation for Biscayne Bay, Pool 18 of Mississippi River, and Port of Los Angeles. • Met and assisted Carl Cerco and Sungchan Kim of Environmental Lab for discussion on setup the Multiblock Grid CH3D-Z model for hydrodynamic simulation of Chesapeake Bay & Patuxent River. • Met with Jane Smith and Ann Sherlock of Coastal & Hydraulic Lab for discussion on CPU usage on the O3K at ERDC MSRC for the HFSoLE CHSSI project. Contract Year 1 Review

8. Metrics — Technical (cont.) • Met with Jane Smith, Dave Mark, and Jarrell Smith of Coastal & Hydraulic Lab for discussion on Mississippi Sound CH3D hydrodynamic simulation. • Contacted DoD CWO users at ERDC for the telecon with CWO FAPOC to discuss on FY03 PET project proposal. • Assisting Prof. Le Ly of Naval Postgraduate School, Monterey in single-block, multiblock mesh generation and setup circulation simulation for the South China Sea. Contract Year 1 Review

9. Metrics — Technical (cont.) • User Contacts and Assistance (continued) • NAVO onsite • Participated in MOS Leadership meeting with NRL-SSC researchers on 12/05/01. • Facilitated and participated in CWO FAPOC meetings on 1/24/02 with researchers at NRL-SSC, NAVO, and local universities. • Provided (on-going) technical support to Tim Keen (NRLSSC) in porting his sediment transport model, LSOM, to MPI. Contract Year 1 Review

10. Metrics — Technical (cont.) • Provided technical support to Rick Allard (CHSSI CWO HFSoLE project lead) on using the new OpenMP version of SWAN • Provided technical support to Cheryl Ann Blain with several FE coastal ocean models: • Contacted Robert Jensen (ERDC) about evaluating the WAM wave model for productivity enhancements Contract Year 1 Review

11. Metrics — Technical (cont.) • Tools introduced to community • In FY02, “tools introduced” consists of new versions of user codes delivered – discussed previous slides Contract Year 1 Review

12. Metrics — Technical (cont.) • Presentations • FAPOC conducted CWO strategy presentation and discussion at ERDC • FAPOC conducted CWO strategy presentation and discussion at NAVO • FAPOC conducted CWO strategy presentation and discussion at Monterey • Conferences & Workshops • NAVO on-site participated in 6th ADCIRC Model Workshop at NRL-SSC, Feb. 27-28, 2002 • NAVO on-site participated in Army/Navy Wave Prediction Group meeting at NRL-SSC, Mar. 21, 2002 • Training • NAVO onsite provided OpenMP example codes to NAVO CE On-Site training. • NAVO onsite developed plan for NAVO PET classroom and work area equipment layout and network policy that would provide efficient systems management. • ERDC onsite attended the parallel programming class for shared, distributed, and clusters memory systems at TACC, UT Austin, April 8-9, 2002. Contract Year 1 Review

13. Metrics—Technical (cont.) • Technical Reports and Articles • “Application of Multiblock Grid and Dual-Level Parallelism in Coastal Ocean Modeling”, Luong, P. V., Breshears, P. C., Ly, L. N., Journal of Scientific Computing. (To appear) • “Multiblock Grid with Variable Horizontal Resolution in Biloxi Bay Circulation Modeling”, Luong, P. V., Breshears, P. C., Boisseau, J. R., Prepare for submission to the Oceans’02 MTS/IEEE Conference, Biloxi, August 2002. (In progress) • Comparison of Multiblock Grid and Domain Decompostition in Ocean Circulation Modeling”, Luong, P. V., Breshears, P. C., Ly, L. N., “Prepare for submission to the International Journal of High Performance Computing Application (HPCA). (In progress) • “Variable Resolution Multiblock Grid and Dual-Level Parallelism in Coastal Ocean Modeling”, Luong, P. V., Ly, L. N., Prepare for High Performance Computing contribution to DoD Mission Success 2002. (In progress) Contract Year 1 Review

14. Metrics—Technical (cont.) • Technical Reports and Articles (cont.) • “Multiblock Grid and Parallelization in Hydrodynamic Modeling”, Luong, P. V., Heath, R. E., Breshears, P. C., PET FY02 Technical Report. (In progress) • “Parallel Implementation of the QUODDY 3-D Finite Element Circulation Model”, Campbell, T. J., Blain, C. A., NRL Report: 7320--02-10,021. • “Parallel Implementation of the SWAN Wave Model”, Campbell, T. J., Cazes, J. E., Rogers, W. E., NRL Report. (In progress). • “Parallel Implementation of SWAN”, Campbell, T. J., Cazes, J. E., Rogers, W. E., Waves in Shallow Water Environments 2002, May 13-16, 2002, Norway. (Presented by Rogers, W. E.) • “Parallel Implementation of an Important Wave Model”, Campbell, T. J., Cazes, J. E., Rogers, W. E., DoD HPCMP UGC 2002, June 10-13, 2002. • “Implementation of an Important Wave Model on Parallel Architectures”, Campbell, T. J., Cazes, J. E., Rogers, W. E., Oceans ’02 MTS/IEEE, October 29-31, 2002. (Submitted) Contract Year 1 Review

15. Metrics—Technical (cont.) • Technical Reports and Articles (cont.) • “Scalable Atomistic Simulation Algorithms for Materials Research”, Nakano, A., Kalia, R. K., Vashishta, P., Campbell, T. J., Ogata, S., Shimojo, F., Saini, S., Supercomputing 2001 Proceedings, November 2001, this paper received the SC2001 “Best Paper Award”. • “Immersive and Interactive Exploration of Billion-Atom Systems”, Sharma, A., Lin, X., Miller, P., Nakano, A., Kalia, R. K., Vashishta, P., Zhao, W., Campbell, T. J., Haas, A., IEEE Virtual Reality 2002 Proceedings, March 2002. • “Wave Modeling in Shallow Water Environments on Parallel Architectures”, Cazes, J. E., Campbell, T. J., Rogers, W. E., Allard, R., High Performance Computing contribution to DoD Mission Success 2002. (In progress) • “An Enhanced Reference Version of the Vector, Signal, Image Processing Library”, Skjellum, T., Boudreaux, G., Linderman, R., High Performance Computing contribution to DoD Mission Success 2002. (In progress) Contract Year 1 Review

16. CWO 007: Coupling of COAMPS and Wavewatch With Improved Wave Physics • Funding Status: Funded at $140,485 on 11/2/01; reduced by $18,643 on 4/2/02 • P.I.: Pat Fitzpatrick (MSU) Objective: Develop the Model Coupling Executable Library (MCEL) which allows for two-way sharing of physically-based forcing parameters between models (Bettencourt 2001), thereby making model coupling portable. The ERC will apply its expertise towards developing a coupled COAMPS-WW systems using MCEL. • Deliverables: • Use of MCEL to couple • COAMPS-WW, improved • wave physics 60% complete. • Technical report reduced • to two page write-up due • to budget cut, parameterization • of other WW terms postponed, • Salary reductions result in postponing • of in-depth coupling testing. • Successful coupled run of COAMPS-WW for Hurricane Gordon. Results show sensitivity to two-way coupling, with larger friction values enhancing latent heat fluxes, and thereby the storm’s intensity. Physically-based and more accurate forcing terms derived for implementation in Wavewatch, to replace the empirical (and inaccurate) parameterized terms. Higher resolution runs, and other weather simulations for more testing underway. Contract Year 1 Review

17. CWO 011: Functional Extension and Application of a Model Coupling Executable Library Objective: This project will extend MCEL validation and functionality. MCEL reliability and ease-of-use will be validated by reformulating the coupling operations in the Coupled Marine Prediction System (COMAPS). A generalized wave-current-sediment marine bottom boundary layer coupling filter will be constructed for MCEL. • Funding Status: Funded at $148, 474 on 11/2/01; reduced by $20,948 on 4/2/02 • P.I.: Keith Bedford (OSU) • MCEL deployment in COMAPS (6/02) • 70% complete (on schedule) • Generalized BBL coupling filter • eliminated due to budget reduction • MCEL support for CHSSI HFSoLE (7/02 - 9/02) • Final Technical Report (9/02) Deliverables: Contract Year 1 Review

18. Core Financial Summary Contract Year 1 Review

19. Staffing • Jay Boisseau is FAPOC • Tim Campbell is on-site at NAVO since 1 Jun 2002 • Phu Luong became on-site at ERDC after 18 Feb 2002 • Recruitment for Monterey on-site yielded offer that was rejected, but a superior candidate has shown interest • CWO UAP includes: • Rich Hodur (NRL-Monterey) • Frank Ruggiero (AFRL) • Jane Smith (ERDC) • Alan Wallcraft (NRL-SSC) • TACC computational staff are coming up to speed on CWO code characteristics Contract Year 1 Review

20. Summary • Successes • Superior on-site support at NAVO, ERDC • Excellent progress on two projects • Development of strategy led to 4 solicited projects, two needed CWO training classes and other CE training classes for FY03 • Projects are proceeding as expected, with reduced efforts due to budget cuts. • Projects and training for next year were successfully developed in line with MOS CWO strategy. • Issues • Much time and effort spent getting contracts in place. • Need to hire on-site for Monterey • Non-funding for Tiger Teams eliminated some opportunities • May benefit from expanding CWO expertise in team, esp. in MSIs Contract Year 1 Review