CONUS benchmark problems

Any issues with the actual running of the WRF.

CONUS benchmark problems

Postby steveb » Wed Oct 16, 2019 11:28 am

Hi all,

I'm trying to run the 12km CONUS benchmark.

I'm getting a segfault, but before that a warning that points are exceeding cfl=2. So it looks like it's just unstable, but I'd have assumed the benchmark was set up so that it would work?

This is using WRF 3.9.1.1. To run the benchmark I'm using the files from test/em_real, with data files from http://www2.mmm.ucar.edu/WG2bench/conus12km_data_v3/ over the top (e.g. replacing namelist.input). I had to modify the namelist to add
Code: Select all
use_baseparam_fr_nml = .t.
to the &dynamics section, but it is otherwise unchanged.

I'm then using:
Code: Select all
mpirun ./wrf.exe


This is under slurm so you can't see the process control but its on 8 nodes with 64 tasks per node = 512 cores/processes total. I did try smaller runs first with same result, but I can see there are benchmark results for 512 cores so seemed a reasonable place to start. Nodes have 64 cores with 128GB.

Example of rsl.error.* file with segfault:

Code: Select all
 module_io_quilt_old.F        2931 F
Quilting with   1 groups of   0 I/O tasks.
 Ntasks in X           16 , ntasks in Y           32
--- WARNING: traj_opt is zero, but num_traj is not zero; setting num_traj to zero.
--- NOTE: sst_update is 0, setting io_form_auxinput4 = 0 and auxinput4_interval = 0 for all domains
--- NOTE: grid_fdda is 0 for domain      1, setting gfdda interval and ending time to 0 for that domain.
--- NOTE: both grid_sfdda and pxlsm_soil_nudge are 0 for domain      1, setting sgfdda interval and ending time to 0 for that domain.
--- NOTE: obs_nudge_opt is 0 for domain      1, setting obs nudging interval and ending time to 0 for that domain.
--- NOTE: bl_pbl_physics /= 4, implies mfshconv must be 0, resetting
Need MYNN PBL for icloud_bl = 1, resetting to 0
--- NOTE: RRTMG radiation is not used, setting:  o3input=0 to avoid data pre-processing
*************************************
No physics suite selected.
Physics options will be used directly from the namelist.
*************************************
--- NOTE: num_soil_layers has been set to      5
WRF V3.9.1.1 MODEL
 *************************************
 Parent domain
 ids,ide,jds,jde            1         425           1         300
 ims,ime,jms,jme           48          88         284         305
 ips,ipe,jps,jpe           55          81         291         300
 *************************************
DYNAMICS OPTION: Eulerian Mass Coordinate
   alloc_space_field: domain            1 ,              19342368  bytes allocated
 RESTART run: opening wrfrst_d01_2001-10-25_00_00_00 for reading
Max map factor in domain 1 =  1.05. Scale the dt in the model accordingly.
d01 2001-10-25_00:00:00 WRF restart, LBC starts at 2001-10-24_00:00:00 and restart starts at 2001-10-25_00:00:00
 LBC for restart: Starting valid date = 2001-10-24_00:00:00, Ending valid date = 2001-10-24_06:00:00
 LBC for restart: Restart time            = 2001-10-25_00:00:00
 LBC for restart: Looking for a bounding time
 LBC for restart: Starting valid date = 2001-10-24_06:00:00, Ending valid date = 2001-10-24_12:00:00
 LBC for restart: Starting valid date = 2001-10-24_12:00:00, Ending valid date = 2001-10-24_18:00:00
 LBC for restart: Starting valid date = 2001-10-24_18:00:00, Ending valid date = 2001-10-25_00:00:00
 LBC for restart: Starting valid date = 2001-10-25_00:00:00, Ending valid date = 2001-10-25_06:00:00
 LBC for restart: Found the correct bounding LBC time periods for restart time = 2001-10-25_00:00:00
 Tile Strategy is not specified. Assuming 1D-Y
WRF TILE   1 IS     55 IE     81 JS    291 JE    300
WRF NUMBER OF TILES =   1
d01 2001-10-25_00:00:00         1997  points exceeded cfl=2 in domain d01 at time 2001-10-25_00:00:00 hours
d01 2001-10-25_00:00:00  MAX AT i,j,k:           67         295          34  vert_cfl,w,d(eta)=   2166.30884      -326.380646       1.25799999E-02

Program received signal SIGSEGV: Segmentation fault - invalid memory reference.


Any suggestions please?
steveb
 
Posts: 6
Joined: Mon Jun 17, 2019 4:32 am

Return to Runtime Problems

Who is online

Users browsing this forum: No registered users and 12 guests