[DO NOT MERGE] Weekly CI Tests Friday Jan 12, 2024

[emcbot]

[DO NOT MERGE] Weekly CI Tests Friday Jan 12, 2024

[emcbot]

CI Update on Orion at 01/12/24 04:48:08 PM
============================================
Cloning and Building global-workflow PR: 2220
with PID: 162121 on host: Orion-login-1

[emcbot]

CI Update on Hera at 01/12/24 10:48:16 PM
============================================
Cloning and Building global-workflow PR: 2220
with PID: 194231 on host: hfe05

[emcbot]

Automated global-workflow Testing Results:

Machine: Hera
Start: Fri Jan 12 22:56:21 UTC 2024 on hfe05
---------------------------------------------------
Build: Completed at 01/12/24 11:08:43 PM
Case setup: Completed for experiment C384C192_hybatmda_1032dcf3
Case setup: Completed for experiment C384_S2SWA_1032dcf3
Case setup: Completed for experiment C384_atm3DVar_1032dcf3

[emcbot]

Experiment C384_S2SWA_1032dcf3  *** FAILED *** on Hera
Experiment C384_S2SWA_1032dcf3  with 1 tasks failed at 01/12/24 11:16:19 PM
Error logs:
/scratch1/NCEPDEV/global/Terry.McGuinness/GFS_CI_ROOT/PR/2220/RUNTESTS/COMROOT/C384_S2SWA_1032dcf3/logs/2016070100/gfsstage_ic.log

[emcbot]

Automated global-workflow Testing Results:

Machine: Orion
Start: Fri Jan 12 16:50:36 CST 2024 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Build: Completed at 01/12/24 05:44:11 PM
Case setup: Completed for experiment C384_atm3DVar_1032dcf3
Case setup: Completed for experiment C384C192_hybatmda_1032dcf3
Case setup: Completed for experiment C384_S2SWA_1032dcf3

[emcbot]

Experiment C384_S2SWA_1032dcf3  *** FAILED *** on Orion
Experiment C384_S2SWA_1032dcf3  with 1 tasks failed at 01/12/24 05:56:17 PM
Error logs:
/work2/noaa/stmp/GFS_CI_ROOT/ORION/PR/2220/RUNTESTS/COMROOT/C384_S2SWA_1032dcf3/logs/2016070100/gfsstage_ic.log

[DavidHuber-NOAA]

The errors on both Orion and Hera occur during staging of S2SWA ICs with an unsupported ocean resolution of 0.5 degrees:

global-workflow/scripts/exglobal_stage_ic.sh

Lines 86 to 105 in c590476

	case "${OCNRES}" in
	"500" | "100")
	# Nothing more to do for these resolutions
	;;
	"025" )
	for nn in $(seq 1 3); do
	src="${BASE_CPLIC}/${CPL_OCNIC:-}/${PDY}${cyc}/${MEMDIR}/ocean/${PDY}.${cyc}0000.MOM.res_${nn}.nc"
	tgt="${COM_OCEAN_RESTART_PREV}/${PDY}.${cyc}0000.MOM.res_${nn}.nc"
	${NCP} "${src}" "${tgt}"
	rc=$?
	((rc != 0)) && error_message "${src}" "${tgt}" "${rc}"
	err=$((err + rc))
	done
	;;
	*)
	echo "FATAL ERROR: Unsupported ocean resolution ${OCNRES}"
	rc=1
	err=$((err + rc))
	;;
	esac

I am guessing that the ocean resolution needs to be specified via the new setup_expt.py --resdetocean flag. I'm not sure if 0.25, or 1.00 degrees would be most appropriate for this test.

[DavidHuber-NOAA]

Do we know what resolution this test was run at before --resdetocean was added?

[DavidHuber-NOAA]

Per conversation with @aerorahul, closing while the ocean resolution is fixed for the S2SWA test.