gen_be

Issues with running 3DVAR.

gen_be

Postby AParkinson » Thu Jul 10, 2014 1:15 am

I'm having a problem running gen_be in the diagnostics stage. The rest of the stages complete correctly, but then I encounter:

Code: Select all
Thu Jul 10 14:15:53 EST 2014 Start
/home/NWS/WRFV3.5/WRFDA/var/scripts/gen_be/gen_be.ksh[45]: svnversion: not found [No such file or directory]
WRFVAR_DIR is /home/NWS/WRFV3.5/WRFDA
RUN_DIR is /home/NWS/WRFV3.5/WRFDA/gen_be_case1
---------------------------------------------------------------
Run Stage 0: Calculate ensemble perturbations from model forecasts.
---------------------------------------------------------------
Beginning CPU time: Thu Jul 10 14:15:53 EST 2014
gen_be_stage0_wrf: Calculating standard perturbation fields valid at time  2013110918
2013110806 /mnt/genBE/2013110806/wrfout_d01_2013-11-09_18:00:00 /mnt/genBE/2013110906/wrfout_d01_2013-11-09_18:00:00
gen_be_stage0_wrf: Calculating standard perturbation fields valid at time  2013111018
2013110906 /mnt/genBE/2013110906/wrfout_d01_2013-11-10_18:00:00 /mnt/genBE/2013111006/wrfout_d01_2013-11-10_18:00:00
gen_be_stage0_wrf: Calculating standard perturbation fields valid at time  2013111118
2013111006 /mnt/genBE/2013111006/wrfout_d01_2013-11-11_18:00:00 /mnt/genBE/2013111106/wrfout_d01_2013-11-11_18:00:00
Ending CPU time: Thu Jul 10 14:18:21 EST 2014
---------------------------------------------------------------
Run Stage 1: Read standard fields, and remove time/ensemble/area mean.
---------------------------------------------------------------
Beginning CPU time: Thu Jul 10 14:18:21 EST 2014
Ending CPU time: Thu Jul 10 14:18:27 EST 2014
---------------------------------------------------------------
Run Stage 2: Calculate regression coefficients.
---------------------------------------------------------------
Beginning CPU time: Thu Jul 10 14:18:27 EST 2014
Ending CPU time: Thu Jul 10 14:18:30 EST 2014
---------------------------------------------------------------
Run Stage 2a: Calculate control variable fields.
---------------------------------------------------------------
Beginning CPU time: Thu Jul 10 14:18:30 EST 2014
Ending CPU time: Thu Jul 10 14:18:32 EST 2014
---------------------------------------------------------------
Run Stage 3: Read 3D control variable fields, and calculate vertical covariances.
---------------------------------------------------------------
Beginning CPU time: Thu Jul 10 14:18:32 EST 2014
Ending CPU time: Thu Jul 10 14:18:44 EST 2014
---------------------------------------------------------------
Run Stage 4: Calculate horizontal covariances (regional lengthscales).
---------------------------------------------------------------
Beginning CPU time: Thu Jul 10 14:18:44 EST 2014
Ending CPU time: Thu Jul 10 14:25:14 EST 2014
Stage gen_be_diags failed with error 2


Looking at gen_be_diags.log, the error encountered is:

Code: Select all
At line 2930 of file da_gen_be.f (unit = 24, file = 'psi/sl_print.psi')
Fortran runtime error: End of file

 [1] Gather regression coefficients.

 [2] Gather vertical error eigenvectors, eigenvalues.

 [3] Gather horizontal scale length.


That particular line in da_gen_be.f is the read line in:

Code: Select all
open (iunit, file = filename)

      do k=1, nk
         read(iunit,'(a,2e20.8)') ck, ml, scale_length(k)


So obviously 'psi/sl_print.psi' can't be read. I had a look at it an it's 0 bytes, so that's why. The same thing occurs for rh. I'm not sure exactly what's happening, but here are the contents of the psi subfolder (in the working directory):

Code: Select all
-rw-rw-r-- 1 NWS NWS 35479324 Jul 10 14:18 2013110918.psi.e001
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.01
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.02
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.03
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.04
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.05
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.06
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.07
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.08
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.09
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.10
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.11
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.12
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.13
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.14
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.15
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.16
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.17
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.18
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.19
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.20
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.21
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.22
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.23
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.24
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.25
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.26
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013110918.psi.e001.27
-rw-rw-r-- 1 NWS NWS 35479324 Jul 10 14:18 2013111018.psi.e001
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.01
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.02
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.03
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.04
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.05
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.06
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.07
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.08
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.09
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.10
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.11
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.12
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.13
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.14
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.15
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.16
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.17
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.18
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.19
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.20
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.21
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.22
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.23
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.24
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.25
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.26
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111018.psi.e001.27
-rw-rw-r-- 1 NWS NWS 35479324 Jul 10 14:18 2013111118.psi.e001
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.01
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.02
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.03
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.04
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.05
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.06
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.07
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.08
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.09
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.10
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.11
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.12
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.13
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.14
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.15
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.16
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.17
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.18
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.19
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.20
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.21
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.22
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.23
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.24
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.25
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.26
-rw-rw-r-- 1 NWS NWS  1314076 Jul 10 14:18 2013111118.psi.e001.27
-rw-rw-r-- 1 NWS NWS        0 Jul 10 14:20 sl_print.psi


Does anyone have any idea what might be the problem?
AParkinson
 
Posts: 7
Joined: Wed Dec 05, 2012 2:10 am

Re: gen_be

Postby AParkinson » Mon Sep 29, 2014 12:55 am

For anyone having the same problem, it was eventually discovered that the issue was that WRF VAR was compiled in shared memory mode. Recompiling in serial (or distributed, but haven't tested yet) fixed the issue.
AParkinson
 
Posts: 7
Joined: Wed Dec 05, 2012 2:10 am

Re: gen_be

Postby gohomeba » Wed Nov 12, 2014 4:54 am

AParkinson wrote:For anyone having the same problem, it was eventually discovered that the issue was that WRF VAR was compiled in shared memory mode. Recompiling in serial (or distributed, but haven't tested yet) fixed the issue.

thanks for sharing
gohomeba
 
Posts: 3
Joined: Tue Aug 12, 2014 10:06 pm

Re: gen_be

Postby imdnme » Wed Aug 12, 2015 10:18 am

I get a similar error, but recompiling in serial does not solve the problem.

Code: Select all
Wed Aug 12 16:53:21 EEST 2015 Start
/home/angie/WRFDA/var/scripts/gen_be/gen_be.ksh[45]: svnversion: not found [No such file or directory]
WRFVAR_DIR is /home/angie/WRFDA
RUN_DIR is /home/angie/WRFDA/var/scripts/gen_be/gen_be5_cv5
---------------------------------------------------------------
Run Stage 0: Calculate ensemble perturbations from model forecasts.
---------------------------------------------------------------
Beginning CPU time: Wed Aug 12 16:53:21 EEST 2015
gen_be_stage0_wrf: Calculating standard perturbation fields valid at time  2015080712
2015080512 /home/angie/forecast_for_WRFDA//2015080512/wrfout_d01_2015-08-07_12:00:00 /home/angie/forecast_for_WRFDA//2015080612/wrfout_d01_2015-08-07_12:00:00
gen_be_stage0_wrf: Calculating standard perturbation fields valid at time  2015080812
2015080612 /home/angie/forecast_for_WRFDA//2015080612/wrfout_d01_2015-08-08_12:00:00 /home/angie/forecast_for_WRFDA//2015080712/wrfout_d01_2015-08-08_12:00:00
gen_be_stage0_wrf: Calculating standard perturbation fields valid at time  2015080912
2015080712 /home/angie/forecast_for_WRFDA//2015080712/wrfout_d01_2015-08-09_12:00:00 /home/angie/forecast_for_WRFDA//2015080812/wrfout_d01_2015-08-09_12:00:00
gen_be_stage0_wrf: Calculating standard perturbation fields valid at time  2015081012
2015080812 /home/angie/forecast_for_WRFDA//2015080812/wrfout_d01_2015-08-10_12:00:00 /home/angie/forecast_for_WRFDA//2015080912/wrfout_d01_2015-08-10_12:00:00
gen_be_stage0_wrf: Calculating standard perturbation fields valid at time  2015081112
2015080912 /home/angie/forecast_for_WRFDA//2015080912/wrfout_d01_2015-08-11_12:00:00 /home/angie/forecast_for_WRFDA//2015081012/wrfout_d01_2015-08-11_12:00:00
Ending CPU time: Wed Aug 12 16:53:46 EEST 2015
---------------------------------------------------------------
Run Stage 1: Read standard fields, and remove time/ensemble/area mean.
---------------------------------------------------------------
Beginning CPU time: Wed Aug 12 16:53:46 EEST 2015
Ending CPU time: Wed Aug 12 16:53:48 EEST 2015
---------------------------------------------------------------
Run Stage 2: Calculate regression coefficients.
---------------------------------------------------------------
Beginning CPU time: Wed Aug 12 16:53:48 EEST 2015
Ending CPU time: Wed Aug 12 16:53:50 EEST 2015
---------------------------------------------------------------
Run Stage 2a: Calculate control variable fields.
---------------------------------------------------------------
Beginning CPU time: Wed Aug 12 16:53:50 EEST 2015
Ending CPU time: Wed Aug 12 16:53:51 EEST 2015
---------------------------------------------------------------
Run Stage 3: Read 3D control variable fields, and calculate vertical covariances.
---------------------------------------------------------------
Beginning CPU time: Wed Aug 12 16:53:51 EEST 2015
Ending CPU time: Wed Aug 12 16:54:02 EEST 2015
---------------------------------------------------------------
Run Stage 4: Calculate horizontal covariances (regional lengthscales).
---------------------------------------------------------------
Beginning CPU time: Wed Aug 12 16:54:02 EEST 2015
Ending CPU time: Wed Aug 12 16:58:26 EEST 2015
Stage gen_be_diags failed with error 2


WRFDA/var/scripts/gen_be/gen_be5_cv5/working/gen_be_diags.log:
Code: Select all
At line 2555 of file da_gen_be.f (unit = 24, file = 'psi/sl_print.psi')
Fortran runtime error: End of file

 [1] Gather regression coefficients.

 [2] Gather vertical error eigenvectors, eigenvalues.

 [3] Gather horizontal scale length.


ll ./gen_be5_cv5/working/psi/sl_print.psi
Code: Select all
-rw-rw-r--. 1 angie angie 1161 Aug 12 16:55 ./gen_be5_cv5/working/psi/sl_print.psi
imdnme
 
Posts: 11
Joined: Wed Jul 13, 2011 3:39 am
Location: Bulgaria

Re: gen_be

Postby imdnme » Wed Aug 12, 2015 3:05 pm

The number of vertical levels in gen_be_wrapper.ksh was wrong. Fixed it and everything runs OK.
imdnme
 
Posts: 11
Joined: Wed Jul 13, 2011 3:39 am
Location: Bulgaria


Return to Runtime Problems

Who is online

Users browsing this forum: No registered users and 3 guests