80 likes | 190 Views
Introduction on WRF-Var Regression Test. Ruifang Li MMM Lir@ucar.edu Phone: 303 4978938. WRF-Var Regression Test. Flow Chart Run Script Script Output Future Work. Flow Chart. Regtest_var.output. Set up Initial variables REG_ROOT = /ptmp/$user CASES = /ptmp/lir/CASE
E N D
Introduction on WRF-Var Regression Test Ruifang Li MMM Lir@ucar.edu Phone: 303 4978938
WRF-Var Regression Test • Flow Chart • Run Script • Script Output • Future Work
Flow Chart Regtest_var.output Set up Initial variables REG_ROOT = /ptmp/$user CASES = /ptmp/lir/CASE FAIL_MAIL = ( ${user}@ucar.edu ) COMPOPTS_VAL = (Serial MPI) Num_Procs = 4 GENERATE_BASELINE = FALSE COMPARE_BASELINE = FALSE . . . Compare case output Compare cost function of Serial and MPI run, Get the first iteration in which cost function is different . WRF-var source code .Trunk .user’s tarfile Wrfvar.tar Test cases .Each case is tested by Serial and MPI executable. (da_wrfvar.exe) Compile .Serial .MPI error error Exit and Send email to user with error message
Run Script • Code comes from trunk • Bsub < regtest_var.csh • Code comes from user • Make a tar file named wrfvar.tar • Put wrfvar.tar in the same directory as regtest_var.csh • Bsub < regtest_var.csh
Regression Test output • WRF-Var source code svn info: • Path: WRFDA • URL: https://svn-wrf-model.cgd.ucar.edu/trunk • Repository Root: https://svn-wrf-model.cgd.ucar.edu • Repository UUID: b0b5d27b-6f0f-0410-a2a3-cb1e977edc3d • Revision: 3590 • Node Kind: directory • Schedule: normal • Last Changed Author: xinzhang • Last Changed Rev: 3589 • Last Changed Date: 2009-02-09 22:09:16 -0700 (Mon, 09 Feb 2009) • WRF-Var source code are located at /ptmp/lir/wrfvar_regression.905395 • WRF-Var test cases are located at /ptmp/lir/wrf_test/data/CASE • Architecture AIX machine: be1104en.ucar.edu • Number of MPI processes to use: 4 • Test conducted by Li Ruifang 8938 MMM • Test run from directory /ptmp/lir/wrf_test/wrf_var/regression/script • This is a bit-wise (traditional) regression test. • Compiler version info: • FORTRAN: xlfrte 11.1.0.5 • OS version info: • AIX: bos.mp 5.3.8.2 • WRF-Var compile successfully for Serial option • WRF-Var compile successfully for MPI option
Regression Test ouput cont’ • ############################################################################### • WRF-Var IS STARTING TO TEST EACH OF CASES IN /ptmp/lir/wrf_test/data/CASE • ############################################################################### • CASE cwb ....................................... • Serial Run ...... PASS • MPI Run ...... PASS • CASE test1 ....................................... • FAIL: either be.dat or ob.ascii or fg or namelist.input not exist for CASE test1 • ############################################################################### • COMPARING SERIAL AND MPI OUTPUT FOR EACH OF CASES IN /ptmp/lir/wrf_test/data/CASE • ############################################################################### • CASE cwb ............................................................................................. • Output starts to differ at iteration Serial vs MPI • 21 3.03954669D+04 2.75530512D+01 2.50729942D-0 | 21 3.03954668D+04 2.75530512D+01 2.50729942D-0
Test New Case • Make a directory for new case • Copy fg, ob.ascii, be.dat, namelist.input to new case directory
Future Work • Archive Serial/MPI run’s output and compare with next run’s output. • Test on Linux and Mac ( now on bluefire). • Put each run’s output on wiki page • Test more cases • Test update_be, wrf, wps