Simulated vs real obs

!set up the directories (only do this the very first time)
cd /gpfs/hps3/emc/meso/save/Donald.E.Lippi/PhD-globalRadarOSSE
ksh run_realobs.ksh
ksh run_real_vs_sim_obs_perturbed.ksh

!create the initial conditions. the perturbed ICs are only for simulating rws.
cd /gpfs/hps3/emc/meso/save/Donald.E.Lippi/global-workflow-20190306/ush
bsub < fv3gfs_chgres.realobs.sh

cd /gpfs/hps2/ptmp/Donald.E.Lippi/fv3gfs_dl2rw/2019051900/FV3ICS
htar -xvf /NCEPDEV/emc-meso/5year/Donald.E.Lippi/rw_FV3GFS/realobs_vs_simobs/realobs_ICS.tar realobs

bsub < fv3gfs_chgres.perturbed.sh
+ export PSLOT="perturbed"
    htar -xvf  $HPSSPATH/$tarball_high $atm $sfc $nst
+   htar -xvf  $HPSSPATH/gpfs_hps_nco_ops_com_gfs_prod_enkf.20190519_00.anl.tar ./gdas.t${cyc}z.ratmanl.mem080.nemsio
+   mv gdas.t${cyc}z.ratmanl.mem080.nemsio $atm

!move the ICs to the proper locations and save.
mkdir -p /gpfs/hps2/ptmp/Donald.E.Lippi/fv3gfs_dl2rw/2019051900/realobs/
cd /gpfs/hps2/ptmp/Donald.E.Lippi/fv3gfs_dl2rw/2019051900/realobs/
rm -rf enkfgdas.20190519 gdas.20190519
mv /gpfs/hps2/ptmp/Donald.E.Lippi/fv3gfs_dl2rw/2019051900/FV3ICS/realobs/enkfgdas.20190519 .
mv /gpfs/hps2/ptmp/Donald.E.Lippi/fv3gfs_dl2rw/2019051900/FV3ICS/realobs/gdas.20190519 .

mkdir -p /gpfs/hps2/ptmp/Donald.E.Lippi/fv3gfs_dl2rw/2019051900/perturbed/
cd /gpfs/hps2/ptmp/Donald.E.Lippi/fv3gfs_dl2rw/2019051900/perturbed/
rm -rf enkfgdas.20190519 gdas.20190519
mv /gpfs/hps2/ptmp/Donald.E.Lippi/fv3gfs_dl2rw/2019051900/FV3ICS/perturbed/enkfgdas.20190519 .
mv /gpfs/hps2/ptmp/Donald.E.Lippi/fv3gfs_dl2rw/2019051900/FV3ICS/perturbed/gdas.20190519 .

!grab the radial wind observations
cd /gpfs/hps3/emc/meso/save/Donald.E.Lippi/rw_tools
ksh getnexrad.ksh
htar -xvf /NCEPDEV/emc-meso/5year/Donald.E.Lippi/rw_FV3GFS/realobs_vs_simobs/simbufr.tar

!run the realobs experiment
cd /gpfs/hps3/emc/meso/save/Donald.E.Lippi/global-workflow-20190306/sorc/gsi.fd/scripts
vi exglobal_analysis_fv3gfs.sh.ecf.simobs
+nexrad_L2RWBUFR="${PATH1}/simbufr/perturbed_2p00_250/nexrad_2019051906_fv3.t06z_drw.bufr"
ln -sf exglobal_analysis_fv3gfs.sh.ecf.simobs exglobal_analysis_fv3gfs.sh.ecf
cd /gpfs/hps3/emc/meso/noscrub/Donald.E.Lippi/fv3gfs_dl2rw/2019051900/realobs
vi realobs.xml [take out vrfy and arch steps]
ksh run.ksh

!save the results and move to theia
cd /gpfs/hps2/stmp/Donald.E.Lippi/RUNDIRS/realobs/2019051906/gfs/realobs_gfsanal_06
mkdir perturbed_2p00_250
cp fort.209                    perturbed_2p00_250/.
cp diag_conv_ges.2019051906.gz perturbed_2p00_250/.
htar -cvf /NCEPDEV/emc-meso/5year/Donald.E.Lippi/rw_FV3GFS/realobs_vs_simobs/perturbed_2p00_250.tar perturbed_2p00_250
cd /scratch4/NCEPDEV/fv3-cam/save/Donald.E.Lippi/PhD-globalOSSE/rwfits/realobs_vs_simobs
htar -xvf /NCEPDEV/emc-meso/5year/Donald.E.Lippi/rw_FV3GFS/realobs_vs_simobs/perturbed_2p00_250.tar

!run utilities on Theia
cd /scratch4/NCEPDEV/fv3-cam/save/Donald.E.Lippi/PhD-globalOSSE/rwfits/realobs_vs_simobs
cd perturbed_1p00_250/
gunzip diag_conv_ges.2019051906.gz
cd ..
ksh read_diag.ksh
ksh run_plot_rwfits2.ksh

There was something odd between the experiment with 250m gates and 1000m gates. Both experiments used identical super-observation parameters with minnum=2. Both experiments should've had the same number of super-observations; however, 1000m gate experiment had about 25% the super-observations as 250m gate experiment. It turns out that the GSI was reading the 1000m obs as if they were at the 250m spacing. So I modified the GSI to read them at 1000m spcaing and I obtained the results I expected.

cd /scratch4/NCEPDEV/fv3-cam/save/Donald.E.Lippi/PhD-globalOSSE/obssim/fortran/run
htar -cvf /NCEPDEV/emc-meso/5year/Donald.E.Lippi/rw_FV3GFS/realobs_vs_simobs/simbufr.tar simbufr