History - COSMO-ORG/fieldextra-wiki GitHub Wiki

See file admin/HISTORY for a detailed list!

All releases

v11.0.0, released on 21.12.2012

  • Extend support for COSMO-LEPS products
    (e.g. control run)
  • Introduce support for SLEVE 2 vertical coordinates
  • Introduce support for MOS corrections, extend support for Kalman corrections
  • New operator to create a field by cloning the meta-information of a specified field
  • New operator to compute relative humidity over mixed phase (RH_MIX)
  • New operators to compute components, direction, and speed of geostrophic wind on model surfaces (U_G, V_G, FF_G, DD_G)
  • New operators to compute absolute and relative geostrophic vorticity on model surfaces (RELV_G, ABSV_G)
  • New operators to compute absolute and relative geostrophic vorticity advection on model surfaces (RELV_ADV_G, ABSV_ADV_G)
  • New operator to compute geostrophic thickness advection (THICK_ADV_G)
  • New operator to compute 3d wind field divergence on model surfaces (WDIV)
  • New operator to compute horizontal moisture flux convergence on model surfaces (MCONV)
  • New operator 'set_packing' to define field specific packing method
  • New operator 'integ_sfc2h' to integrate from the surface to a specified height above ground
  • New operator 'intpl_k2theta' to interpolate from model to potential temperature surfaces
  • New operator 'intpl_k2pv' to interpolate from model to potential vorticity surfaces
  • New operator 'destagger' to interpolate a staggered field to mass points (the previous method based on the generic interpolation operator was limited in scope)
  • Implement NetCDF output, CF1.6 compliant
  • User interface improvement: re-gridding operator
  • User interface improvement: meta-information in region files
  • Optimization: memory footprint, to support large values of mx_field
    (now set to 15000)
  • Optimization: performance analysis
  • Optimization: critical algorithms, some ASCII output
  • Optimization: shared memory parallelism, implemented with OpenMP
  • Environment: improved library configuration scripts, improved Makefiles
  • Environment: extended and consolidated test environment at CSCS
  • Environment: add support for INTEL compiler
  • Documentation: new FAQ, new cookbook, improved README.install

v11.0.1, released on 15.02.2013

  • More robust parsing of namelist : skip product whose definition is incorrect, instead of exiting at the first exception detected in the namelist
  • Code optimization for cases where a large number of input files are processed
  • Code clean-up and bug corrections
    (in particular to support IBM compiler)

v11.0.2, released on 22.04.2013

  • Support model names with originating center set to Zurich and ARPA-SIMC
  • Support of ECMWF seasonal forecasts, incl. monthly mean
  • Support screening of input file using eps member, lead time, or validation date
  • New switch out_type_novcoord to skip coding vcoord information in GRIB output
  • Replace grins functionality with fieldextra and a wrapper script
  • Environment: version control of full environment (with SVN at CSCS)
  • Environment: clone of master installation at ECMWF
    (rsync script)
  • Environment: add support for IBM compiler
  • Bug corrections

v11.1.0, released on 31.05.2013

  • Complete re-factoring of DWD GRIB API
  • Support model names with originating center set to Moscow
  • More robust support of unregistred COSMO centers
  • Support lagged and other types of composed EPS
  • Support missing EPS members
  • Support selection of EPS members
  • Define and implement default GRIB 1 coding for COSMO EPS
  • New operator to compute EPS perturbation
    (i.e. member - mean)
  • Add preliminary support of GRIB 2 generalized vertical coordinates
  • Tools: implement support of GRIB 2 in grins
  • Tools: new utilities using fieldextra as computation engine
    (fxconvert, fxcrop)
  • Environment: add standard Ubuntu and Redhat platforms in test procedure
  • Environment: add DWD FABEC tests in standard test environment
  • Environment: add support of SUN platform in install scripts and Makefile
  • Environment: link with GRIB API 1.10.4
  • Environment: consolidate dictionaries information
  • Bug corrections
    (in particular quantile computation)

v11.2.0, released on 20.11.2013

  • Consolidate fxconvert
    (NetCDF target and duplicate field names in input file)
  • Simplify usage of dictionaries
    (EPS derived and neighbourhood probability)
  • Finalize support of GRIB 2 generalized vertical coordinates
    (with GRIB API 1.11; see remark about usage in HISTORY)
  • Usage of in_grid to crop fields now also supports staggered fields
  • Product subdomain can now be specified in lat/lon, independently of the grid
  • New operator to compute height of zero degree
    (with option to extrapolate below topo)
  • New operators to transform precipitation amount in fresh snow density and depth
  • Use corrected estimator to compute EPS standard deviation
    (factor 1/(n-1) instead of 1/n)
  • Consolidate code
    (compilation warning, horizontal grid operators)
  • Bug corrections and many other improvements (see HISTORY)

v11.3.0, released on 14.03.2014

  • Remove limitation on domain subset usage for operators requiring a lateral halo
  • Extend support of MOS estimator
    (gridded, logistic regression ...)
  • New operator to compute vertical derivative
  • New operator to define an arbitrary surface, specified by a condition on some field
  • New operator to compute a vertical integral between two arbitrary surfaces
  • Consolidated GRIB 2 support
    (tablesVersion, localTablesVersion ...)
  • Many other operators improvements (see HISTORY)
  • User interface and diagnostic improvements (see HISTORY)
  • Bug corrections, internal code improvements, code optimization (see HISTORY)

v11.3.1, released on 15.04.2014

  • Remove limitation on domain subset usage for operators requiring a lateral halo
  • Extend support of MOS estimator
    (gridded, logistic regression ...)
  • New operator to compute vertical derivative
  • New operator to define an arbitrary surface, specified by a condition on some field
  • New operator to compute a vertical integral between two arbitrary surfaces
  • Consolidated GRIB 2 support
    (tablesVersion, localTablesVersion ...)
  • Many other operators improvements (see HISTORY)
  • User interface and diagnostic improvements (see HISTORY)
  • Bug corrections, internal code improvements, code optimization (see HISTORY)

v11.3.2, released on 25.06.2014

  • Option to specify vertical_coordinate_coef in &ModelSpecificatons
  • Add support of COSMO nudgecast and IFS-ENS mean
  • Add support of compact coding of GRIB constant fields
  • Improve support of multiple grib_definition_path
  • New operator to compute EPS normalized standard deviation
  • Optimization of memory usage and of outer loop parallelism
  • Some diagnostic improvements
  • Bug corrections, miscelleanous (see HISTORY)

v11.3.3, released on 01.09.2014

  • Improve interface for re-gridding input fields
  • Support field specific re-gridding method
  • Support native ICON grid on input - limited implementation
  • New operator set_vcoord in &Process to re-set vertical coordinates info
  • New operator PP to compute pressure deviation, using P as parent field (COSMO model)
  • Support complex logical masks in 'merge_with' and 'compare_with'
  • Consolidate NetCDF output (relax some restrictions on multi-level fields)
  • New fxfilter tool
  • Bug corrections, miscelleanous (see HISTORY)

v12.0.0, released on 01.03.2015

Products

  • Consolidate support of ICON grid
    (missing values, kilometric grids, diagnostic)
  • Full support of synthetic satellite fields
    (GRIB1, GRIB2, NetCDF)
  • Support setting generalized height based coordinates characteristics through namelist (allows hybrid to generalized height based coordinates transformation)

Operators

  • Support EPS member to member transformation using a global EPS operator (e.g. reset EPS by adding a more recent determinist forecast to each EPS perturbation)
  • Improve 'fill_undef' operator to have a more targeted effect (ignore regions where too many undef are present)
  • Operators 'merge_with' and 'compare_with' can now act on a collection of fields (e.g. transformation of all members of an EPS system)
  • New operator to find the surface where a 3D field reaches its maximum or minimum (condition is eveluated independently in each column)
  • Possibility to interpolate to an arbitrary surface
  • New operator to compute an arbitrary sum of fields
  • New operator to compute the (differential) vertical wind shear
  • New operators to compute the divergence and the deformation of the horizontal wind
  • New operator to compute the Gradient Richardson number RI
  • New operators to compute CAT indices
  • Preliminary support to compute synthetic satellite fields
    (RTTOV lib)

Optimization

  • Support duplicated records in input data (memory optimization for output not compatible with just on time, using a temp GRIB)
  • New variable out_production_granularity in &RunSpecification (control balance bewteen memory footprint and OMP speedup)
  • Memory and compute time optimization for large problems

Resources, tools

  • Change format of dictionary
    (use key/value pair)
  • New fxclone tool
  • New dictionary_mill tools
    (convert between GRIB API def files and dictionary)

Others

  • New 'debug' value of verbosity in &RunSpecification
  • Extend information in fieldextra.diagnostic when additional_diagnostic=.true.
  • Bug corrections, miscelleanous (see HISTORY)

v12.1.0, released on 10.12.2015

Products

  • Full support of GRIB 2 local use section
    (Offenbach, Zurich, COSMO-LEPS, COSMO default)
  • Full support of GRIB 2 chemical constituents
  • Further consolidation and extension of GRIB 2 support
    (Full compatibility with ICON and COSMO-EU tested)

Operators

  • Definitive implementation of synthetic satellite operators
    (based on RTTOV 11.2.0)
  • New operator to compute Eddy Dissipation Parameter EDP
    (ICON only)
  • New operator to compute WSHEAR_0-1km
  • Improved computation of fresh snow density RHO_SNOW
  • New poper 'regsum'
  • New poper 'product' and 'quotient'
  • Add field related condition to poper 'create_cond' and 'replace_cod'
    (support complex merge of multiple fields)
  • New voper 'max_sfc2h', 'max_h2h' ...
    (extremum in a column)
  • New voper 'find_nonzero'
  • New voper 'find_condition'
    (e.g. to define tropopause using condition on T, P)
  • New voper 'intpl_k2khalf'
  • Add mode='nearest' to voper interpolation
  • New hoper 'offset_to_reference'
    (offset with respect to a fix point)
  • New hoper 'sqcnt%', 'tiled_sqcnt%', and 'diskcnt%'
    (frequency of active points)
  • New 'data_type' in &GlobalSettings
  • All local keys, and some more keys, can be reset by user
    (see 'auxiliary_metainfo', 'out_auxiliary_metainfo', 'set_auxiliary_metainfo')

Interface

  • Possibility to reset the default values of out_type_* and out_mode_*
  • Improved some namelist naming conventions

Resources, tools

  • Upgrade GRIB API environment to be compatible with COSMO GRIB 2 policy
    (unique set of def files for all COSMO software and all COSMO members)
  • Upgrade dictionaries to be compatible with COSMO GRIB 2 policy
    (common GRIB API package for all COSMO software and all COSMO members)
  • Upgrade fx tools
    (e.g. support duplicated records in input, grins --summary)

Optimization

  • New 'in_read_order' in &Process
    (memory optimisation)

Internal

  • Surface values (e.g. levlist) are now associated with their physical units
  • More complete coding of time range information

Others

  • New 'stop_flag' in &RunSpecification
  • New 'out_filter_time' to filter the output data in the time dimension
  • Improved N_TUPLE output type
  • Improved README.user
  • Improved diagnostic
  • Bug corrections, miscelleanous (see HISTORY)

v12.2.0, released on 31.03.2016

Products

  • Add support for ASCII input
    (based on BLK_TABLE format)
  • Add support for EPS probability defined with respect to a reference distribution
    (IFS products)
  • Introduce some improvements for BLK_TABLE format

Operators

  • New way to compute location dependent height correction
    (development within COSMO PT CORSO-A)
  • Improve support of field upscaling
  • Improve support for re-setting field meta-information

Optimization

  • Improve flexibility in defining partition of threads between inner and outer loop
  • Optimize RTTOV complex clouds computation

Others

  • Exception by input file processing is now non fatal
  • Bug corrections, miscelleanous (see HISTORY)

v12.3.0, released on 09.06.2016

Operators

  • Point operator can be iterated up to 3 times in each processing iteration
  • New poper hshift_loc, inverse, ratio, logarithm_e, exponential, polynomial
  • New voper upscale_grad_min, upscale_grad_max, intpl_k2h++, intpl_k2z++
    (support extrapolation, support definition of target levels through external field)
  • New hoper regfit
    (linear regression within geographical regions)
  • New operator to compute TD_2M using T_2M, QV_2M and PS
  • Projection of model output on a different topography is now possible
    (fieldextra is used at MCH to interpolate COSMO-1 on INCA grid, where INCA is the nowcasting tool from ZAMG)

Optimization

  • Extend and optimize cache usage
  • Optimize arrays initialization
  • Optimize detection of input file type
  • Extend functionality of intermediate files
    (supports namelist optimization)
  • Automatic data reduction when out_regrid_target is specified
  • Level of diagnostic and profiling can now be controled separately

Others

  • Workaround for unreliable time to solution when initializing large arrays
  • Additional tips on namelist optimization in README.user
  • See HISTORY for a full list of modifications

v12.3.1, released on 12.08.2016

Products

  • Add support to process INCA input
    (in GRIB)
  • Add support to generate LAGRANTO compatible output
    (in NetCDF)

Operators

  • Update EDP
    (processing of ICON model)
  • New OMEGA_SLOPE
    (to use fieldextra as FLEXPAR pre-processor)

Others

  • Consolidate regression suite
  • Correct critical bug introduced in 12.3.0
  • Other bug corrections (see HISTORY)

v12.3.2, released on 06.10.2016

Products

  • Support 'levelOfMaxWind' and 'typeOfEnsembleForecast'
  • Support NetCDF standard name for hybrid sigma pressure

Operators

  • Consolidate tiled operators (upscaling)
  • New 'skip_time' and 'toper_mask' (recommended alternative to 'ignore_tri')
  • Extends 'sum', 'inverse' and 'ratio' to support an additional constant term

Others

  • fx tools : add support for input with mixed GRIB and with discontinuous layers
  • Correction of a critical bug : make constant field attribute a dynamic feature
    (e.g. computation of tropopause height incorrectly produced a constant field)
  • Other correction of bugs

v12.4.0, released on 02.12.2016

Products

  • Correct some GRIB 1 and GRIB 2 codes

Operators

  • New operator to compute the 2d advection of an arbitrary tracer
  • Extend out_shuffle_time to filter input fields on the basis of the reference year
  • Automatic generation of HEIGHT on full levels when HEIGHT on half levels is present

Optimization

  • Optimization of collect field step (in particular for EPS)

Others

  • Externalize & consolidate GRIB API environment (-> common COSMO environment)
  • Consolidate versioning of external resources
  • Consolidate installation step (documentation, setup scripts)
  • Correction of bugs and miscelleanous consolidations

v12.5.0, released on 21.02.2017

Products

  • Improve compatibility with GRIB 2 generated by COSMO model
  • Improve compatibility with GRIB 2 generated by IFS model

Operators

  • Support unconnected geographical regions
  • Support any probability interval
  • Operator to compute non normalized vertical integral
  • Operator to compute QV at saturation
  • Operator to use GRIB 1 alternate coding
  • Additional functionality of operator 'out_filter_time'
  • Global output definition for product category, vertical coordinates and model name

Others

  • Miscelleanous code consolidations
    (BLK_TABLE as input, n2geog cache, GRIB 2 local table version, field level...)
  • Correction of bugs

v12.6.0, released on 25.07.2017

ATTENTION: poor OpenMP performances of GRIB API 1.20.0, resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Products

  • Update ECMWF GRIB API to 1.20.0, add support for adaptative entropy coding
  • Add GRIB API definitions for pollen and COSMO 5.05+
  • Add GRIB 2 support for interquantile range
  • Add GRIB 1 support for ECMWF EFI and for ECMWF large data set
  • Add GRIB 1 support for isentropic and PV surfaces
  • Add support of isothermal surfaces
  • Add support of COSMO-IT-EPS
  • Add option to produce simplified NetCDF output
  • More consistent setting of constant fields meta-data
    (now also controlled by out_type_mapcst)

Operators

  • New operator to compute maximum and relative sunshine duration
    (with or without horizon effect)
  • Consolidate thermodynamic operators
    (wet bulb temperature, quantities computed at 2m above ground...)
  • Add support for cloning missing input files
  • Add support for interpolation in the time dimension
    (new toper "fill_undef")
  • Consolidate support for processing inhomogeneous data in the time dimension
    (remove ignore_tri, introduce keep_time...)
  • Consolidate implementation of toper
    (handling of undefined, meta-data of transformed field...)
  • New toper "mask_all"
    (together with toper_mask supports selective setting of undefined values)
  • Consolidate implementation of new_field_id
    (merge with pre-existing field, extended meta-data resetting)
  • Extend functionality of set_leadtime, set_time_range and set_level_property

Others

  • Extend grins default output
  • Consolidation of dictionary usage
    (short name derivation, complement missing meta-data with dictionary information)
  • Consolidate user interface
    (namelist parsing, ambiguous definition of parents...)
  • Consolidate and extend README.user
  • Correction of bugs

v12.7.0, released on 02.02.2018

ATTENTION: poor OpenMP performances of GRIB API 1.20.0, resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Products

  • New subset type 'frame of width frame_ngp'
  • New subset type 'vertical slice'
  • Full support of originating center 'Roma'
  • Add support for cosmo_d2 and cosmo_d2-eps
  • Add support for ART products
  • Add support of surface types 'mass density exceeds the specified value'
  • Consolidate GRIB 1 support (bitmap, some field short names)

Operators

  • New toper 'date_of_min', 'date_of_max', 'value_at_date'
  • New poper 'stretch'
  • New mode 'linear in height' for some vertical interpolation operator
  • Vertical operators 'find_*' may be restricted to any user specified interval

Others

  • New enable_exit_status to control exit process status
  • Improve OpenMP performances (in particular parallel execution of toper, poper, voper)
  • Code consolidation (domain subset processing, no more limitations on number of locations, more robust implementation of out_type_mapcst, remove tmp1_dictionary... and tmp1_gp_partitioning..., and more)
  • Correction of bugs (in particular generation of file name when multiple time stamps are used)

v12.7.1, released on 09.05.2018

ATTENTION: poor OpenMP performances of GRIB API 1.20.0, resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Products

  • Recognize icon-eps
  • Consolidate some ASCII output (XLS_TABLE, DAT_TABLE, and FLD_TABLE)

Operators

  • Point operator can now be iterated up to 5 times (poper ... poper5)
  • Modified behaviour of set_vcoord

Others

  • New fxdestagger
  • Consolidated and extended cookbook
  • Update documentation
  • Correction of bugs
    (in particular related to vertical operator in product using multiple EPS members)

v12.7.2, released on 23.05.2018

ATTENTION: poor OpenMP performances of GRIB API 1.20.0, resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Products Others

  • Correction of bugs
    (GRIB2 : correct coding of scaleFactorOfLowerLimit=-1 and scaleFactorOfUpperLimit=-1)

v12.7.3, released on 02.07.2018

ATTENTION: poor OpenMP performances of GRIB API 1.20.0, resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Others

  • Increases maximum allowed number of in_file/out_file pairs

v12.7.4, released on 23.07.2018

ATTENTION: poor OpenMP performances of GRIB API 1.20.0, resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Others

  • The "stop_flag" now immediately interrupts any wait loop

v12.7.5, released on 27.09.2018

ATTENTION: poor OpenMP performances of GRIB API 1.20.0, resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Others

  • Increases maximum allowed number of input files

v12.8.0, released on 17.12.2018

ATTENTION: poor OpenMP performances of GRIB API 1.20.0, resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Products

  • Add NetCDF import
  • Consolidate NetCDF export
  • Add support of EPS spread products
  • Add support of non standard use of GRIB 2 second surface (e.g. COSMO HHL)

Operators

  • Extend lateral re-gridding
    (generalized distance, filter set of contributing grid points)
  • New operators for QV_SAT and QV_SAT_2M
  • New operator to compute the maximum or the minimum of two fields
  • New operator to project a field on a staggered grid

Tools

  • All fx tools compatible with NetCDF / GRIB 1 / GRIB 2 / BLK_TABLE
    (option -N cosmo | -N extpar required when working with NetCDF)
  • New grins --ntuple
  • New grins --toc
  • New tool for upscaling model output from fine to collocated coarser grid
  • New tool for rendering complex Fortran namelist from a more structured definition

Documentation

  • New cookbook
    (with 55 commented cases)
  • Improve some diagnostics

Others

  • Reduce binary size
    (now 2/3 smaller)
  • Some code re-structuration
    (support_gis, support_vertical_mesh, fxtr_write_obsolete)
  • Correction of bugs

v12.8.1, released on 22.01.2019

ATTENTION: poor OpenMP performances of GRIB API 1.20.0, resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Products

  • consolidate ASCII export (new ASCII_TABLE, remove L2E)

Documentation

  • improve name of some namelist variables

Others

  • introduce new robust definition of undefined flag for real values
  • repair makefile profiling target
  • correction of bugs

v12.8.2, released on 01.03.2019

ATTENTION: poor OpenMP performances of GRIB API 1.20.0, resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Products

  • remove spurious blank line in grins output

Others

  • preprocessor flag to explicitly set the reading buffer to 4MiB in the GRIB1 library

v12.8.3, released on 06.03.2019

ATTENTION: poor OpenMP performances of GRIB API 1.20.0, resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Others

  • new out_type_prefered_tunits to set prefered time unit

v12.8.4, released on 07.03.2019

ATTENTION: poor OpenMP performances of GRIB API 1.20.0, resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Products

  • out_type_prefered_tunits only sets unit of time range

v12.8.5, released on 13.05.2019

ATTENTION: poor OpenMP performances of GRIB API 1.20.0, resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Products

  • admit unlimited usage of Swiss Coordinates transformation formula

v12.8.6, released on 14.05.2019

ATTENTION: poor OpenMP performances of GRIB API 1.20.0, resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Products

  • extend the definition domain in geographical latlon for transformations to Swiss coordinates

v13.0.0, released on 06.06.2019

ATTENTION: poor OpenMP performances of ecCodes 2.10.9 resulting in poor performances of GRIB 2 parallel write (ECMWF ticket SUP-2089).

Products

  • consolidate GRIB 1 support (buffer size, control of cached memory pages, support of constant fields special coding)
  • consolidate NetCDF support (compression, nc4 / nc3 / nc3 with 64bits offset, optional unlimited time dimension)
  • extend ASCII_TABLE output format (blank separator, profile oriented mode)
  • consolidate support of COSMO GRIB 2 conventions used to code height field
  • add full support of ITAF models (cosmo-me, cosmo-me-eps, cosmo-it, cosmo-it-eps)
  • extend domain of validity of Swiss coordinates

Operators

  • consolidate usage of level_class
  • new operator to compute HHL from HFL (new mode of operator "intpl_k2khalf")
  • add bi-linear interpolation option to lateral regridding operator
  • add barycentric interpolation option to lateral regridding operator (ICON grid only)
  • add new option to field reduction obtained by spatial averaging (--> add flexibility to the choice of the reduced grid)
  • consolidate and extend handling of vertical coordinates (support projection from one vertical coordinates system to another)

Tools

  • consolidate fx_upscaling tool
  • new grins option to display horizontal grid information (--hgrid)

Documentation

  • extend cookbook

Others

  • new repeat mode to avoid repeating successful operations in case of restart
  • update GRIB API library to ecCodes v2.10.9
  • update NetCDF library to v4.4.0
  • update icontools library to v2.3.6
  • correction of bugs

v13.1.0, released on 25.10.2019

Products

  • consolidate NetCDF import
  • consolidate support of Swiss coordinates (LV95)
  • add full support of cosmo-1e, cosmo-2e, cosmo-il, cosmo-ile

Operators

  • extend the set of operators compatible with "field=ALL"
  • five successive voper calls can now be made in each iteration
  • consolidate vertical operators find_*, intpl_k2theta, and intpl_k2pv (new rule when top part of profile is degenrate)
  • consolidate vertical operators find_* (introduce better control of target suface location)
  • new point operator "poper=replace_def,value" (replace defined values)
  • new input/output operator "in_crop_size=value" (cut frame)
  • new input/output operator "in_vgrid_target=tag" (reset vcoord info)
  • add multiple options to compute K0INDEX
  • new operator to compute temperature and pressure thickness of reference atmosphere
  • new operators to compute RH_ICE_2M, RH_MIX_EC_2M, GRH
  • new operator to compute balanced PP and QX fields (from INT2LM)

Tools

  • new fx tools option "-N inca" (compatibility with NetCDF produced by INCA)
  • new grins --vgrid (vertical coordinates characteristics)
  • consolidate fx_upscaling tool (GRIB 2, EPS or determinist)

Documentation

  • new section about namelist optimization in README.user

Others

  • update ecCodes to v2.14.1
  • improve some diagnostics
  • improve build-in profiling
  • optimization of some internal procedures
  • introduce OpenMP thread affinity policy (optimization)
  • hoper in in_field is now computed in parallel (optimization)
  • integrate in Jenkins (automatic build and test)
  • correction of bugs (in particular for domain with nj > ni, and for voper=find_nonzero)

v13.2.0, released on 20.04.2020

Products

  • extend functionalities of ASCII_TABLE output

Operators

  • possibility to define symbolic constants in &GlobalSettings

Tools

  • additional options for grins
  • additional options for fx_clone
  • new fx_archive_extract
  • consolidate fx_upscaling

Others

  • implement parallel import
  • improve OMP speedup of operators
  • new "stop_timestamp" to help debug namelist
  • new "out_type_undef_fatal" to raise a fatal exception when undef are detected
  • correction of bugs (in particular: hydrostatic extrapolation, GRIB 2 coding of interquantiles)

v13.2.1, released on 17.07.2020

Private MeteoSwiss release

v13.2.2, released on 28.07.2020

Private MeteoSwiss release

v13.3.0, released on 30.11.2020

Products

  • new registred model names (kenda-1)
  • new supported surface types (snow level)
  • consolidate BLK_TABLE output format

Operators

  • new global operator "in_merge_field" (merge a set of files representing a field defined on distinct spatial patches)
  • new vertical operators supporting multi-layers snow model with variable number of layers ("integ_snow", "pickup,surface")
  • introduce support of GRIB packing information (in grins output, add option to keep original packing rate, add field specific default)
  • consolidate interpolation from ICON to regular grid (field with undefined values, target grid not included in source grid)
  • consolidate HPBL operator

Tools

  • new --packing option to grins and fxconvert
  • new fx_split_merge tool (merge spatial patches, split in time)
  • consolidation and extension of fx_upscaling tool

Diagnostic

  • add absolute timing in fieldextra standard output

Others

  • update support libraries (iconTools to 2.4.12, ecCodes to 2.19.0 ... )
  • code clean-up and code consolidation (repeat mode, support of multiple models in the same task ... )
  • correction of bugs (repeat mode, NetCDF import, BLK_TABLE import, interpolation from ICON to regular grid, units of probability fields in output ... )

v13.3.1, released on 31.12.2020

Products

  • new registred model names (cosmo-sib)
  • update ecCodes COSMO definitions
  • GRIB2 support for PDF of chemical constituents (percentile, probability, derived)

Operators

  • support user specification and computation of reference atmosphere (COSMO,ICON)
  • computation of SNOW_PERCENT using TOT_SNOW and TOT_PREC
  • computation of CONV_PERCENT using TOT_CON and TOT_PREC
  • key 'significanceOfReferenceTime' can be user specified

Tools

  • fx tools use same GRIB compression rate on output as on input

Diagnostic
NA

Others

  • new ./tools/build_fieldextra.sh to better automate installation process
  • code consolidation
    (just on time mode, incore on demand computation, validation dates estimation)
  • correction of bugs
    (ASCCI_TABLE output, GRIB1 special coding for large data sets ...)

v13.4.0, released on 31.03.2021

Products

  • add support for icon-1e & icon-2e (MeteoSwiss)
  • extend support for cosmo-it-eps (ITAF)

Operators

  • new poper="ignore_matching,tag" (restrict the set of active fields)
  • new voper="upscale_grad_mean" (upscaled vertical gradient)

Tools

  • consolidate and extend upscaling tool

Diagnostic NA

Others

  • support fully automated installation
  • consolidate and extend regression suite checking algorithms
  • automate operational regression suite at MeteoSwiss
  • implement continuous installation and deployment (CI/CD) at MeteoSwiss
  • extend support of parallel import (process multiple time stamps in parallel)
  • correction of bugs (parallel import, model name identity, upscaling)

v13.4.1, released on 01.11.2021

Others

  • correction of incompatible key "masterTablesVersion" in auxiliary_metainfo

v13.4.2, released on 26.11.2021

Others

  • support pollen parameters for hazel and emission tuning

v13.4.3, released on 06.12.2021

Others

  • correct/update definitions of SNOWPOLINO parameters

v14.0.0, released on 17.02.2022

Products

  • support originating center "Israel (NMC)"
  • support for models "icon-gl", "icon-eu", "icon-d2", "icon-dwdlam", and "icon-ile"
  • support for surface type 'echo_top[dBZ]'
  • support for fields FR_LUC & HORIZON
  • NetCDF import: improved support of EXTPAR output
  • NetCDF import: add support of trailing 'Z' to specify UTC in time attribute
  • NetCDF export: on demand generation of cells bounds
  • NetCDF export: add z-dimension attributes "number_of_levels", "uid" and "uuid"
  • NetCDF export: add dimensions "azimuth" and "lu_class"
  • NetCDF import & export: support attribute "generating_process_id"
  • extend support of ICON grid: GRIB2, NetCDF and BLK_TABLE import & export
  • extend support of ICON grid: N_TUPLE and ASCII_TABLE export
  • extend support of ICON grid: support multiple subgrids in same output (GRIB2 & NETCDF)
  • extend support of ICON grid: incore production of CLAT, CLON, VLAT, VLON, ELAT, and ELON
  • extend support of ICON grid: support locations (defined through geog. coordinates)
  • extend support of ICON grid: support smoothing by convolution with local function
  • extend support of ICON grid: transparent access to icontools interpolation methods

Operators

  • new Soil Moisture Index operator

Tools

  • compatibility with ICON grid
  • automatic detection of ICON grid by standard installation
  • grins : new --idx (value in 1D array)
  • grins : new --hgrid
  • fxclone : new options --uuid_of_hgrid and --uuid_of_vgrid
  • fxconvert : produce ICON grid coordinates bounds in NetCDF (--> plotting)
  • fx_upscaling : extend support for pollen fields

Diagnostic NA

Others

  • bug corrections (OMP race condition, memory leak)
  • numerous code clean-up and consolidations
  • consolidate and extend regression scripts for tst_opr

v14.1.0, released on 31.03.2023

Products

  • support for models "icon-ch1-eps", "icon-ch2-eps"
  • NetCDF import: vertical coordinate coefficients can be imported
  • NetCDF export: new out_type_ncaspect="icon"
  • NetCDF export: name of dimensions can be set by users
  • NetCDF export: vertical coordinate coefficients can be exported
  • extend support of ICON grid: enable all vector interpolations
  • extend support of ICON grid: enable bilinear interpolation from regular to unstructured
  • extend support of ICON grid: enable masking of field using a template field
  • extend support of ICON grid: support grid defining a subset of a parent grid
  • extend support of ICON grid: support hoper 'fill_undef'
  • ASCII_TABLE export: new out_type_legend='standard&extra'
  • XLS_TABLE export: support ICON on native grid

Operators

  • new "in_mask" operator to mask all collected fields following provided template
  • new poper 'geog2n'
  • new operator to compute W from OMEGA
  • extend poper 'max' and 'min' to support N arguments
  • support "tag=NAN" and "tag!NAN" in definition of logical mask

Runtime

  • mx_wait_time refers now to wall clock time, even for parallel tasks

Tools

  • automatic import/export of vertical coord. coeff. (NetCDF)
  • automatic selection of grid description file (ICON data)
  • gdesc : new tool, returns path of grid description file (ICON data)
  • grins : new options --scan_mode, --vgrid_type, --lclass, --lvalue
  • grins : new options --prod_stat, --data_type, --gproc_type, --bkgrd_proc
  • grins : new options --expand
  • fx_transform (previously fx_upscaling) : consolidate and extend tool
  • fx_transform: template for : cosmo > cosmo upscaling,
  • fx_transform: template for : icon > icon upscaling
  • fx_transform: template for : ifs > icon downscaling

Diagnostic

  • directory where diagnostic files are collected can be user specified

Others

  • bug corrections (NetCDF import, interpolation with ICON tools, ...)
  • numerous code clean-up and consolidations
  • ecCodes update to 2.25.0
  • add jpeg library to package
  • regression suite : support more slurm options,support parallel execution
  • regression suite : make it resilient against changes of compilers and platforms

v14.2.0, released on 20.06.2023

Operators

  • add compatibility of in_crop_size with ICON grid

Runtime

  • optimize hoper on unstructured grid when large neighborhood are used

Tools

  • fx_transform now as separate Python module, but integrated in fx package
  • grins: data extraction: express undefined as 'undef' (instead of numeric flag)

Others

  • bug corrections (crasher when using some interpolation methods ...)
  • increases mx_members from 100 to 150
  • add fx arguments --help, --version and --signature
  • regression suite : new test_fxtool
  • regression suite : improve robustness against change of compiler version

v14.3.0, released on 31.08.2023

Products

  • add support of spatial tiles (GRIB 2, NetCDF, TMPL_BASE, tools)
  • support for model configuration "kenda-ch1"
  • GRIB 2 import : support time coded in second (if multiple of minute)
  • GRIB 2 import : take into account local use for product definition template

Tools

  • grins : new options --mtype, --levid, and --tileid
  • grins : new group options -0, -1, and -2 (pre-selected information)
  • fxfilter : new option --tile_only
  • all : improved detection of type of input

Others

  • bug corrections (NAN in namelist logical expressions...)
  • regression suite : add support for testing fx tools

v14.3.1, released on 22.09.2023

Others

  • bug corrections (too much memory allocated in some cases)
  • add fx argument --syntaxcheck
  • regression suite : improve support for automatic performance check

v14.3.2, released on 10.11.2023

Operators

  • BRN, LAGTIME*: catch some corner cases
  • extend support of ICON grid: poper for statistical corrections

Others

  • bug corrections (compatibility with Intel oneAPI compiler)
  • fx_transform, IFS input: support missing OMEGA
  • consolidate regression scripts
  • consolidate CI/CD

v14.3.3, released on 12.12.2023

Products

  • support of icon-d2-ruc
  • improve support of aerosol optical properties

Runtime

  • some improved diagnostics

Tools

  • fx_transform: avoid exception where U=V=0
  • fx_transform: more robust check of required fx resources

Others

  • bug corrections (icontools inside check, non uniform validation time)
  • installation procedure: improved force mode, new release mode
  • regression suites: add hooks to support performance monitoring

v14.4.0, released on 06.02.2024

Products

  • locations can also be derived from FIS (instead of HSURF)
  • regions sides are closer to geodesics
  • regions can be derived natively on the ICON grid
  • vertical cross-sections can be computed natively on the ICON grid
  • MADUK product can be derived for fields defined on the ICON grid

Operators

  • more flexibility to set typeOfGeneratingProcess
  • operator to associate a unique index to each region (hoper="regidx,s")

Runtime

  • improve some run time diagnostics (potential under/overflow...)

Tools

  • grins: more robust decoding of GRIB 2 messages
  • fx_transform: robust against ridiculously small pollen snc values

CI/CD

  • new installation flag --release-installation (env checks, unique fx_transform name)
  • revise all jenkins plans

Others

  • bug corrections (undefined flag, grins...)
  • internal code clean-up

v14.4.1, released on 06.04.2024

Products

  • extended support for ICON GRIB 1 output (on regular grid)
  • support of icon-alp05-eps configuration

Operators

  • support undef in computation of EPS derived products

Tools

  • fx_transform: new template to upscale icon-ch1 to cosmo-e config

v15.0.0, released on 24.05.2024

Minimal release for MeteoSwiss ICON22 production

Products

  • additional entries in dictionary for ICON-ART
  • full support of ICON grid description files produced by ICONSUB
  • new option out_type_variation="fake_regular_grid" (ASCII_TABLE, XLS_TABLE)

Operators

  • "new_field_id" derive additional information from active dictionary (GRIB 2 PDT)
  • new regridding methods to strictly takes nearest neighbour value even if undef
  • ICON subgrid extraction through use of in_regrid is much more efficient

Tools

  • fx_transform: icon upscaling for ic: also transform 2d pollen fields
  • fxcrop: new option --subgrid to extract a subdomain of an ICON grid

Others

  • bug corrections (METEOG, fxclone)
  • internal code clean-up

v15.0.1, released on 20.06.2024 (hotfix based on v15.0.0)

Operators

  • BRN operator: new out_mode_brn_vmin to set minimal wind velocity

Others

  • bug corrections (exclude/include_all mode and in_regrid, icon subgrid)

v15.0.2, released on 07.11.2024 (hotfix based on v15.0.1)

Products

  • Support new GRIB 2 level types (17)

v15.0.3, released on 26.03.2025 (hotfix based on v15.0.2)

Others

  • bug corrections (too many missing time levels)

v15.1.0, released on 17.01.2025

Products

  • support additional WMO level types (14, 17, 18)
  • consolidate support of GRIB2 in case both local and wmo codes exist (out_type_prefered_g2code)

Operators

  • BRN operator: new out_mode_brn_vmin to set minimal wind velocity
  • consolidate voper (full support of undef values)
  • consolidate support of tiles (tag in operators)
  • extend set_level_property (new surface types)
  • correct order of application of new_field_id (in last iteration)

Runtime

  • add/improve some diagnostics

Tools

  • consolidate build_fieldextra and setup scripts (target 'from-cloud', portability)
  • consolidate fx_transform (use miniconda from conda-forge channel)
  • consolidate grins (--fullname)

CI/CD

  • consolidate regression suites (re-organize, trim/extend, accelerate)
  • new ICON specific examples in cookbook

Others

  • bug corrections (fill_undef, integ_snow, BLK_TABLE, NetCDF import, exclude/include_all mode and in_regrid, icon subgrid)
  • remove some obsolete features (output formats, MCH operators)
  • some code cleanup (readibility, compatibility with gcc 12.3.0)
  • update most libraries
  • re-structure documentation
  • first step to support containerization

v15.2.0, released on 28.05.2025

Products

  • support additional EDZW level types (206, 207, 208, and 209)

Operators

  • ASOD_S_OS : new operator, with parents ASWDIR_S_OS and ASWDIFD_S
  • meteorological operators: consolidate undef support

Tools

  • consolidate installation script build_fieldextra.bash (docu, externalized config, support opr regression)

CI/CD

  • major consolidation of regression suite (opr regression @ MCH production machine)

Others

  • bug corrections (interpolation from ICON to kilometric grid, too many missing time levels, ecCodes OpenMP performances)
  • major consolidation of documentation, in particular for developers (./documentation/README.developer)

v15.2.1, released on 22.07.2025

Tools

  • consolidate installation script (libraries, release installtion ...)

CI/CD

  • performance monitoring (uniform summary log files, documentation, replace 'top')

Others

  • bug corrections (parallel import)
  • code cleanup and improvements (memory management, main & kernel)
  • documentation (INSTALLATION, README.developer)

v16.0.0, released on 31.12.2025

Products

  • support for model configuration "rea-l-ch1"

CI/CD

  • consolidate information provided in performance stamp
  • consolidate regression "test_fxtool" (remove hard coded dependency on $SCRATCH)

Others

  • bug corrections (memory usage reporting, cloning diagnostic, netcdf-c installation)
  • more robust setting of ecCodes environment
  • consolidate packaging script "create_distribution_package.bash"
  • consolidate build script "build_fieldextra.bash" (target, checks)
  • consolidate fx_transform (documentation, style tests, install script)
  • documentation (README.developer)
  • new code owner is Petra Baumann ([email protected])