Welcome, Guest
Username: Password: Remember me
Forum on HARMONIE Climate Branch

TOPIC: Hindcast simulation using ERA5 and ERA-I

Hindcast simulation using ERA5 and ERA-I 8 months 2 weeks ago #2308

Dear Harmonie climate’s community,

I am trying to realize a simulation of one month-length using ERA-I and ERA5 with AROME at 2.5 km grid-mesh. I am almost positive that I changed the correct keys accordingly to use those two reanalysis dataset. For example, for both simulation I have been inspired by the .../HCLIM38h1/sms/config_exp.h.NORCP_ALADIN that can be found from the NorCP code (svn.hirlam.org/branches/climate/projects/NORCP/HCLIM38h1) and made the changes needed for AROME.
Here the mains changes:
SST_SOURCES=”IFS”
HOST_MODEL=”ifs”
HOST_SURFEX=”no”
BDLIB=ECMWF
BDDIR=$HM_DATA/${BDLIB}/archive/@YYYY@/@MM@/@DD@/@HH@
BDSTRAGEGY=erain or era5
BDINT=6 or 1

The good news is that they crashed at the same, but the bad one is that they crashed when it reaches the Interpol_sst_sic with this error message:

script: /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/lib/scr/Interpol_sst_sic - last modified: Mar 3 17:07
No IFS SST file found /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/ECMWF/archive/2011/07/01/00/fc20110701_00+000
/scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/lib/scr/Interpol_sst_sic failed
total 4
lrwxrwxrwx 1 nh0 dk 68 Mar 23 15:51 climate_aladin -> /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/climate/Const.Clim.sfx
/scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/lib/scr/Interpol_sst_sic: moved working directory to /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/20110701_00/Failed_LBC0_Interpol_sst_sic_Interpol_sst_sic
ERROR:SMSABORT_HM


I also think that the model is able to see the forcing data in general, since I have those in my /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/20110701_00, but I can also see there that the SST_SIC is problematic.

So, my naive conclusion is that the model cannot find the sst and sic...maybe one of my keys is incorrect or I just do not have access to them.

Furthermore, I read on the wiki that the ERA5 has still not been used, only ERA-I was tested...Is that still true?

Any clue?

Hindcast simulation using ERA5 and ERA-I 8 months 2 weeks ago #2309

  • Bert van Ulft
  • Bert van Ulft's Avatar
  • OFFLINE
  • Expert Boarder
  • Posts: 98
  • Thank you received: 22
Hi Dominic,

sorry for the late reply. Did you already get any further with this? ERA-Interim should certainly work out of the box, ERA5 I have mainly used in a NWP setting, but also did some tests with HCLIM38h1.
First thing to check would be if the mentioned file exists and has sst and ci in it, for example with grib_dump.

best wishes,

Bert

PS. I can't access your files due to file permissions.

Hindcast simulation using ERA5 and ERA-I 8 months 1 week ago #2310

Hi Bert,

Thank you for your answer and of course no problem for the late reply, no I didn’t get any information about that issue. I am glad to learn that you tested era5.

So, yes the problems is that the mentioned file does not have sst or sic.
For example:
=========================================================================
grib_dump /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/archive/2011/07/01/00/EXT_SST_SIC012_201107
***** FILE: EXT_SST_SIC012_201107
"ERROR: unreadable message"
"ERROR: unreadable message"
=========================================================================
Furthermore, I can also see in my ecflow that
=========================================================================
script: /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/lib/scr/Interpol_sst_sic - last modified: Mar 3 17:07
No IFS SST file found /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/ECMWF/archive/2011/07/01/00/fc20110701_00+000
/scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/lib/scr/Interpol_sst_sic failed
=========================================================================
where there is no ECMWF repertory in /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011 but archive is there. So, it might be related to one of the key is wrongly set in the config file?

Thank you for your help.

Dom

p.s I give a general reading access to my home on ecgate and my scratch on cca, you should have access, tell me otherwise

Hindcast simulation using ERA5 and ERA-I 8 months 1 week ago #2311

  • Bert van Ulft
  • Bert van Ulft's Avatar
  • OFFLINE
  • Expert Boarder
  • Posts: 98
  • Thank you received: 22
Hi Dominic,

the EXT_SST_SIC012_201107 is a FA file already interpolated to the LCC model domain, so you can't read it with grib_dump. With HARMONIE comes the program gl that can be used to look at its contents and convert it to grib or netcdf. Using the default settings the gl program will be in your directory /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/bin. To look at the contents of your file, and print min/avg/max:
gl -f /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/ECMWF/archive/2011/07/01/00/fc20110701_00+000 -m

It should contain something like:
SURFSEA.ICECONC > 128:031-  000-001@20991201_00:00+000h00m tri:000 000 SIC                       (0-1)
SURFSEA.TEMPERA > 128:034-  000-001@20991201_00:00+000h00m tri:000 000 SST                       (K)

This EXT_SST_SIC file is created from the ERA5/ERA-Interim grib file /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/ECMWF/archive/2011/07/01/00/fc20110701_00+000 . You can check if this file contains SST and SIC with:
grib_dump -w shortName=sst/ci fc20110701_00+000

best wishes,

Bert

PS. I still cannot access your directories

Hindcast simulation using ERA5 and ERA-I 8 months 1 week ago #2312

Hi Bert,

Thank you for your answer and sorry not to react to your comment quicker, I am in full-time formation.

Thank you for the clarification about gl, I did know very little about that program.

So, for both reanalysis I do not have any fc* files, only EXT_SST_SIC*

So in “ll /scratch/ms/dk/nh0/hm_home/DMC_ERA5_July_2011/archive/2011/07/01/00”
-rw-r--r-- 1 nh0 dk 28K Mar 23 00:49 bdstrategy
-rw-r--r-- 1 nh0 dk 984K Mar 23 02:27 EXT_SST_SIC000_201107
-rw-r--r-- 1 nh0 dk 984K Mar 23 02:27 EXT_SST_SIC003_201107
-rw-r--r-- 1 nh0 dk 984K Mar 23 02:27 EXT_SST_SIC006_201107
lrwxrwxrwx 1 nh0 dk 88 Mar 21 18:50 PREP_init.fa -> /scratch/ms/dk/nh0/hm_home/DMC_ERA5_July_2011/archive/2011/07/01/00//ICMSHHARM+00000.sfx
-rw-r--r-- 1 nh0 dk 485M Mar 21 18:50 SURFXINI.fa
-rw-r--r-- 1 nh0 dk 458M Mar 21 18:50 SURFXINI.lfi


and in “ll /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/archive/2011/07/01/00”
-rw-r--r-- 1 nh0 dk 5.7K Mar 23 15:38 bdstrategy
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:16 EXT_SST_SIC000_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:16 EXT_SST_SIC001_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:16 EXT_SST_SIC002_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:16 EXT_SST_SIC003_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:16 EXT_SST_SIC004_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:17 EXT_SST_SIC005_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:16 EXT_SST_SIC006_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:17 EXT_SST_SIC007_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:17 EXT_SST_SIC008_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:56 EXT_SST_SIC009_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:56 EXT_SST_SIC010_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:56 EXT_SST_SIC011_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:56 EXT_SST_SIC012_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:56 EXT_SST_SIC013_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:56 EXT_SST_SIC014_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:56 EXT_SST_SIC015_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 18:56 EXT_SST_SIC016_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 19:56 EXT_SST_SIC017_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 19:56 EXT_SST_SIC018_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 19:56 EXT_SST_SIC019_201107
-rw-r--r-- 1 nh0 dk 3.3M Mar 22 19:56 EXT_SST_SIC020_201107
lrwxrwxrwx 1 nh0 dk 84 Mar 22 20:02 next_first_guess -> /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/archive/2011/07/01/00//ICMSHHARM+05760
lrwxrwxrwx 1 nh0 dk 88 Mar 22 20:02 next_first_guess_sfx -> /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/archive/2011/07/01/00//ICMSHFULL+05760.sfx
lrwxrwxrwx 1 nh0 dk 88 Mar 22 18:43 PREP_init.fa -> /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/archive/2011/07/01/00//ICMSHHARM+00000.sfx
-rw-r--r-- 1 nh0 dk 1.8G Mar 22 18:43 SURFXINI.fa
-rw-r--r-- 1 nh0 dk 1.7G Mar 22 18:43 SURFXINI.lfi

So, there is only EXT_SST_SIC* and a few links that did not work. Furthermore, it might also worth saying that I have /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/archive/ not /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/ECMWF/archive/

Any clues?

Dom
p.s I tried giving you the reading access on cca using the old chmod, but it does not seem to compute...

Hindcast simulation using ERA5 and ERA-I 8 months 1 week ago #2315

  • Bert van Ulft
  • Bert van Ulft's Avatar
  • OFFLINE
  • Expert Boarder
  • Posts: 98
  • Thank you received: 22
Hi Dominic,

the fc files should be in your $BDDIR (probably /scratch/ms/dk/nh0/hm_home/DMC_ERA5_July_2011/ECMWF/archive/2011/07/01/00). Is this the first month that you try to run, or is it a continuation of a previous run? The next_first_guess file points to a strange file: ICMSHHARM+05760. +5760 is 240 days, usually this points to the last file of the previous month, so +744 for a 31-day month.
Could it be that the experiment is polluted by some failed attempts to start it? Perhaps it is a good idea to start with a clean slate and delete everything from the experiment's directory on the cca scratch (/scratch/ms/dk/nh0/hm_home/DMC_ERA5_July_2011). You can keep the bin and lib directories, so you don't have to recompile everything. I still cannot access your files, directories should be executable as well. For example your ~/hm_home on ecgate should become:

drwxr-xr-x. 16 nh0 dk 4096 Mar 22 13:15 hm_home
The last x is missing.

best wishes,

Bert

Hindcast simulation using ERA5 and ERA-I 8 months 1 week ago #2317

Hi Bert,

Good idea, restarting everything. Indeed, I have the two simulations crashing, but for a different reason.

1) For ERA-I, it crash at Data=>Forecasting=>Forecast with (in the ecflow)
==========================================================================
/scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/lib/scr/Forecast: moved working directory to /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/20110701_00/Failed_Forecasting_Forecast_Forecast
ERROR:SMSABORT_HM

==========================================================================
When I look into /scratch/.../Failed_Forecasting_Forecast_Forecast, the links such as:
==========================================================================
PFHARMDENMARK+07200 -> /scratch/ms/dk/nh0/hm_home/DMC_ERAI_July_2011/archive/2011/07/01/00//PFHARMDENMARK+07200
==========================================================================
are not good. Since PFHARMDENMARK+0**** does not exist in the repertory.

2) For the ERA5 one, it is still crashing at the SST and sea ice process as before. However, when I look one of the interpolated fields (fc20110701_**+000) in /scratch/ms/dk/nh0/hm_home/DMC_ERA5_July_2011/ECMWF/archive/ the two variables seem to exist (using grib_dum).

And I still have the same error message in the ecflow.
==========================================================================
No IFS SST file found /scratch/ms/dk/nh0/hm_home/DMC_ERA5_July_2011/ECMWF/archive/2011/07/01/01/fc20110701_01+000
/scratch/ms/dk/nh0/hm_home/DMC_ERA5_July_2011/lib/scr/Interpol_sst_sic failed
total 4
lrwxrwxrwx 1 nh0 dk 68 Apr 3 15:37 climate_aladin -> /scratch/ms/dk/nh0/hm_home/DMC_ERA5_July_2011/climate/Const.Clim.sfx
/scratch/ms/dk/nh0/hm_home/DMC_ERA5_July_2011/lib/scr/Interpol_sst_sic: moved working directory to /scratch/ms/dk/nh0/hm_home/DMC_ERA5_July_2011/20110701_00/Failed_LBC1_Interpol_sst_sic_Interpol_sst_sic
ERROR:SMSABORT_HM

==========================================================================

I also just change the right to my home, sorry for that I thought that the reading access was enough. As you might have realized, I just begin to use Harmonie. Thank you for your help and patience.

Dom

Hindcast simulation using ERA5 and ERA-I 8 months 1 week ago #2318

  • Bert van Ulft
  • Bert van Ulft's Avatar
  • OFFLINE
  • Expert Boarder
  • Posts: 98
  • Thank you received: 22
Hi Dominic,

the PFHARMDENMARK* links you see are OK. All these links are created at the beginning of the forecast, then during the forecast data are actually written. This way these files end up in the archive directory instead of in the working directory. But your Forecast crashes almost immediately with errors like:
***** FACILE - ARTICLE-CHAMP "S024CLOUD_FRACTI" INEXISTANT, UNITE 81     *****

So it looks also in that case that your boundary files are not OK.
For the ERA5 experiment it is strange that for some LBC families Interpol_sst_sic has completed successfully, while for others it has failed.
I forgot to mention that you should also throw away the climate files from the ECFS (ec: or ectmp:) if you have at some point changed the domain. If the climate files don't exist on scratch yet, it is first attempted to copy them from the ECFS. If the domain of climate files conflicts with what you have specified in your experiment's setup it will not run.
HARMONIE isn't the easiest model, but you might learn to appreciate it, in due time.

best wishes,

Bert

Hindcast simulation using ERA5 and ERA-I 7 months 2 weeks ago #2322

Hi Bert,

Thank you very much for your answer and sorry for my late reply. So, I think I found what wrong (but not yet the solution). As you mentioned, the LBC are problematic. I think what going on is that the model is looking for some CLOUD_FRACTI (S*_CLOUD_FRI) in the LBC. Could it be that something should be changed in the namelist (couldn’t the find what changes to do..)? The model is looking for something (tracers needed by some scheme activated in AROME due to a higher resolution) that are not available in ERAI, so I should specify not to look for it? Does it make sense?

Cordially,

Dom

Hindcast simulation using ERA5 and ERA-I 7 months 2 weeks ago #2323

Hi Dom,

Which experiment setup (i.e. namelist) are you using? In NorCP we have a special setup where we use hydrometeors at the boundaries. This works only with ALADIN as the forcing model. For ERAI forcing, you need to use the default namelist.

Cheers,
Danijel

Hindcast simulation using ERA5 and ERA-I 7 months 2 weeks ago #2324

Hi Danijel,
Excellent! This is it..I am using the NorCP one. How do I get the default one?

Cordially,
Dom

Hindcast simulation using ERA5 and ERA-I 7 months 2 weeks ago #2325

It is best to check out the current HCLIM38 branch from svn:
svn.hirlam.org/branches/climate/38h1/HCLIM38h1

Cheers,
Danijel
Time to create page: 0.112 seconds