ticket_298_TicketSummary_FailEnsSmcPerts_stderr - ACCESS-NRI/accessdev-Trac-archive GitHub Wiki

------------------------------------------------------------------------
Job 9630791.r-man2 has exceeded memory allocation on node [38]
Process "EnsScr_ExtractP", pid 28590, rss 1884160, vmem 13082624
Process "ksh", pid 29377, rss 1986560, vmem 13561856
Process "VarProg_UMFileU", pid 29442, rss 43335680, vmem 188497920
Process "bash", pid 31898, rss 1622016, vmem 9961472
Process "9630791.r-man2.", pid 31926, rss 1638400, vmem 9826304
Process "python", pid 32189, rss 13873152, vmem 111607808
Process "engl_smc_perts_", pid 32293, rss 1703936, vmem 13049856
------------------------------------------------------------------------
/home/548/jtl548/cylc-run/u-aj730/share/fcm_make_var-opt/build-serial/bin/VarScr_UMFileUtils: line 296: 29442: Killed
VarScr_UMFileUtils: VarProg_UMFileUtils.exe failed
/home/548/jtl548/cylc-run/u-aj730/app/engl_ens_smcperts/bin/EnsScr_ExtractPertFields_nci: line 260: 29377: Killed
fatal error in create_start_pert_dump: failed to extract data
+ VarScr_UMFileUtils -u MergeData /home/548/jtl548/cylc-run/u-aj730/share/cycle/20160614T1800Z/engl_etkf/perts/engl_pert_015.nosfc /home/548/jtl548/cylc-run/u-aj730/share/cycle/20160614T1800Z/engl_etkf/smc/engl_pert_015.smc.tmp /home/548/jtl548/cylc-run/u-aj730/share/cycle/20160614T1800Z/engl_etkf/perts/engl_pert_015.tmp
VarProg_UMFileUtils
FATAL ERROR
Incompatible dataset types
gc_abort (Processor     0): Incompatible dataset types
forrtl: error (76): Abort trap signal
Image              PC                Routine            Line        Source             
VarProg_UMFileUti  00000000005B0B71  Unknown               Unknown  Unknown
VarProg_UMFileUti  00000000005AF2C7  Unknown               Unknown  Unknown
VarProg_UMFileUti  00000000004C7664  Unknown               Unknown  Unknown
VarProg_UMFileUti  00000000004C7476  Unknown               Unknown  Unknown
VarProg_UMFileUti  0000000000462364  Unknown               Unknown  Unknown
VarProg_UMFileUti  00000000004697A1  Unknown               Unknown  Unknown
libpthread.so.0    00002B0EFB3F47E0  Unknown               Unknown  Unknown
libc.so.6          00002B0EFB8B8495  Unknown               Unknown  Unknown
libc.so.6          00002B0EFB8B9C75  Unknown               Unknown  Unknown
VarProg_UMFileUti  000000000044CF66  Unknown               Unknown  Unknown
VarProg_UMFileUti  0000000000436DF9  opsmod_gcom_mp_gc         174  ifortqibBGn.i90
VarProg_UMFileUti  000000000042A586  genmod_core_mp_ge         144  gen_fail.inc
VarProg_UMFileUti  0000000000429FB6  genmod_core_mp_ge          35  gen_error_report.inc
VarProg_UMFileUti  000000000040F06D  MAIN__                    647  VarProg_UMFileUtils.f90
VarProg_UMFileUti  000000000040DFFE  Unknown               Unknown  Unknown
libc.so.6          00002B0EFB8A4D1D  Unknown               Unknown  Unknown
VarProg_UMFileUti  000000000040DF09  Unknown               Unknown  Unknown
/home/548/jtl548/cylc-run/u-aj730/share/fcm_make_var-opt/build-serial/bin/VarScr_UMFileUtils: line 296: 29509: Abort
VarScr_UMFileUtils: VarProg_UMFileUtils.exe failed
/home/548/jtl548/cylc-run/u-aj730/app/engl_ens_smcperts/bin/engl_smc_perts_nci.ksh: line 278: 29444: Abort
+ RC2=262
+ [ 262 -ne 0 ](/ACCESS-NRI/accessdev-Trac-archive/wiki/-262--ne-0-)
+ echo 'WARNING: Merging SMC Perts with ETKF perts has not worked for member .  Return Code=262'
+ exit 262
[FAIL] engl_smc_perts_nci.ksh # return-code=-6
Received signal EXIT
2017-10-10T17:42:09Z CRITICAL - Task job script received signal EXIT
2017-10-10T17:42:09Z CRITICAL - failed
2017-10-10T17:42:10Z CRITICAL - Task job script received signal EXIT
2017-10-10T17:42:10Z CRITICAL - failed