justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 256248.182@dunegpschedd02.fnal.gov

Jobsub ID256248.182@dunegpschedd02.fnal.gov
Workflow ID10928
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2025-12-02 09:42:51
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1_multicore
Last heartbeat2025-12-02 09:59:52
From worker nodeHostnamenode2b05.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-12-02 09:44:02
Input filesfardet-hd:nu_dune10kt_1x2x6_1413_726_20230826T183653Z_gen_g4_detsim_hitreco__20240229T163122Z_reco2.root
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-12-02 09:59:52
Saved logsjustin-logs:256248.182-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

RSE/fardet-hd/67/0c/nu_dune10kt_1x2x6_1413_726_20230826T183653Z_gen_g4_detsim_hitreco__20240229T163122Z_reco2.root?xrdcl.requuid=87622ecb-4721-4ce8-8abd-666261b513e7] Sending a read command for handle 0x0 to ds29.farm.particle.cz:22526
[2025-12-02 09:54:19.478366 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] MsgHandler created: 0xb6a3640 (message: kXR_read (handle: 0x00000000, offset: 552559930, size: 159083) ).
[2025-12-02 09:54:19.478435 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Moving MsgHandler: 0xb6a3640 (message: kXR_read (handle: 0x00000000, offset: 552559930, size: 159083) ) from out-queu to in-queue.
[2025-12-02 09:54:19.509752 +0000][Debug  ][ExDbgMsg          ][ 1305] [msg: 0x18e61780] Assigned MsgHandler: 0xb6a3640.
[2025-12-02 09:54:19.509799 +0000][Debug  ][ExDbgMsg          ][ 1305] [handler: 0xb6a3640] Removed MsgHandler: 0xb6a3640 from the in-queue.
[2025-12-02 09:54:19.509968 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Calling MsgHandler: 0xb6a3640 (message: kXR_read (handle: 0x00000000, offset: 552559930, size: 159083) ) with status: [SUCCESS] .
[2025-12-02 09:54:19.509993 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Destroying MsgHandler: 0xb6a3640.
[2025-12-02 09:54:19.514537 +0000][Debug  ][File              ][ 1305] [0xcd2a800@root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/67/0c/nu_dune10kt_1x2x6_1413_726_20230826T183653Z_gen_g4_detsim_hitreco__20240229T163122Z_reco2.root?xrdcl.requuid=87622ecb-4721-4ce8-8abd-666261b513e7] Sending a read command for handle 0x0 to ds29.farm.particle.cz:22526
[2025-12-02 09:54:19.514584 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] MsgHandler created: 0xb6a2c70 (message: kXR_read (handle: 0x00000000, offset: 1126313439, size: 102) ).
[2025-12-02 09:54:19.514663 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Moving MsgHandler: 0xb6a2c70 (message: kXR_read (handle: 0x00000000, offset: 1126313439, size: 102) ) from out-queu to in-queue.
[2025-12-02 09:54:19.545966 +0000][Debug  ][ExDbgMsg          ][ 1305] [msg: 0x9f5d510] Assigned MsgHandler: 0xb6a2c70.
[2025-12-02 09:54:19.546020 +0000][Debug  ][ExDbgMsg          ][ 1305] [handler: 0xb6a2c70] Removed MsgHandler: 0xb6a2c70 from the in-queue.
[2025-12-02 09:54:19.546067 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Calling MsgHandler: 0xb6a2c70 (message: kXR_read (handle: 0x00000000, offset: 1126313439, size: 102) ) with status: [SUCCESS] .
[2025-12-02 09:54:19.546089 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Destroying MsgHandler: 0xb6a2c70.
[2025-12-02 09:54:19.546148 +0000][Debug  ][File              ][ 1305] [0xcd2a800@root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/67/0c/nu_dune10kt_1x2x6_1413_726_20230826T183653Z_gen_g4_detsim_hitreco__20240229T163122Z_reco2.root?xrdcl.requuid=87622ecb-4721-4ce8-8abd-666261b513e7] Sending a read command for handle 0x0 to ds29.farm.particle.cz:22526
[2025-12-02 09:54:19.546186 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] MsgHandler created: 0xb6a2c70 (message: kXR_read (handle: 0x00000000, offset: 1126313541, size: 108) ).
[2025-12-02 09:54:19.546263 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Moving MsgHandler: 0xb6a2c70 (message: kXR_read (handle: 0x00000000, offset: 1126313541, size: 108) ) from out-queu to in-queue.
[2025-12-02 09:54:19.577559 +0000][Debug  ][ExDbgMsg          ][ 1305] [msg: 0x9f5d6f0] Assigned MsgHandler: 0xb6a2c70.
[2025-12-02 09:54:19.577615 +0000][Debug  ][ExDbgMsg          ][ 1305] [handler: 0xb6a2c70] Removed MsgHandler: 0xb6a2c70 from the in-queue.
[2025-12-02 09:54:19.577661 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Calling MsgHandler: 0xb6a2c70 (message: kXR_read (handle: 0x00000000, offset: 1126313541, size: 108) ) with status: [SUCCESS] .
[2025-12-02 09:54:19.577683 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Destroying MsgHandler: 0xb6a2c70.
[2025-12-02 09:54:19.577749 +0000][Debug  ][File              ][ 1305] [0xcd2a800@root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/67/0c/nu_dune10kt_1x2x6_1413_726_20230826T183653Z_gen_g4_detsim_hitreco__20240229T163122Z_reco2.root?xrdcl.requuid=87622ecb-4721-4ce8-8abd-666261b513e7] Sending a read command for handle 0x0 to ds29.farm.particle.cz:22526
[2025-12-02 09:54:19.577774 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] MsgHandler created: 0xb6a2c70 (message: kXR_read (handle: 0x00000000, offset: 1126286153, size: 27286) ).
[2025-12-02 09:54:19.577848 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Moving MsgHandler: 0xb6a2c70 (message: kXR_read (handle: 0x00000000, offset: 1126286153, size: 27286) ) from out-queu to in-queue.
[2025-12-02 09:54:19.609179 +0000][Debug  ][ExDbgMsg          ][ 1305] [msg: 0x9f5dad0] Assigned MsgHandler: 0xb6a2c70.
[2025-12-02 09:54:19.609228 +0000][Debug  ][ExDbgMsg          ][ 1305] [handler: 0xb6a2c70] Removed MsgHandler: 0xb6a2c70 from the in-queue.
[2025-12-02 09:54:19.609284 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Calling MsgHandler: 0xb6a2c70 (message: kXR_read (handle: 0x00000000, offset: 1126286153, size: 27286) ) with status: [SUCCESS] .
[2025-12-02 09:54:19.609307 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Destroying MsgHandler: 0xb6a2c70.
[2025-12-02 09:54:19.617986 +0000][Debug  ][File              ][ 1305] [0xcd2a800@root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/67/0c/nu_dune10kt_1x2x6_1413_726_20230826T183653Z_gen_g4_detsim_hitreco__20240229T163122Z_reco2.root?xrdcl.requuid=87622ecb-4721-4ce8-8abd-666261b513e7] Sending a read command for handle 0x0 to ds29.farm.particle.cz:22526
[2025-12-02 09:54:19.618053 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] MsgHandler created: 0x18e464c0 (message: kXR_read (handle: 0x00000000, offset: 164681, size: 132) ).
[2025-12-02 09:54:19.618156 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Moving MsgHandler: 0x18e464c0 (message: kXR_read (handle: 0x00000000, offset: 164681, size: 132) ) from out-queu to in-queue.
[2025-12-02 09:54:19.649399 +0000][Debug  ][ExDbgMsg          ][ 1305] [msg: 0x1969ed00] Assigned MsgHandler: 0x18e464c0.
[2025-12-02 09:54:19.649458 +0000][Debug  ][ExDbgMsg          ][ 1305] [handler: 0x18e464c0] Removed MsgHandler: 0x18e464c0 from the in-queue.
[2025-12-02 09:54:19.649506 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Calling MsgHandler: 0x18e464c0 (message: kXR_read (handle: 0x00000000, offset: 164681, size: 132) ) with status: [SUCCESS] .
[2025-12-02 09:54:19.649528 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Destroying MsgHandler: 0x18e464c0.
[2025-12-02 09:54:19.649594 +0000][Debug  ][File              ][ 1305] [0xcd2a800@root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/67/0c/nu_dune10kt_1x2x6_1413_726_20230826T183653Z_gen_g4_detsim_hitreco__20240229T163122Z_reco2.root?xrdcl.requuid=87622ecb-4721-4ce8-8abd-666261b513e7] Sending a read command for handle 0x0 to ds29.farm.particle.cz:22526
[2025-12-02 09:54:19.649641 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] MsgHandler created: 0x18e46410 (message: kXR_read (handle: 0x00000000, offset: 164813, size: 138) ).
[2025-12-02 09:54:19.649720 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Moving MsgHandler: 0x18e46410 (message: kXR_read (handle: 0x00000000, offset: 164813, size: 138) ) from out-queu to in-queue.
[2025-12-02 09:54:19.681049 +0000][Debug  ][ExDbgMsg          ][ 1305] [msg: 0x1969ee80] Assigned MsgHandler: 0x18e46410.
[2025-12-02 09:54:19.681107 +0000][Debug  ][ExDbgMsg          ][ 1305] [handler: 0x18e46410] Removed MsgHandler: 0x18e46410 from the in-queue.
[2025-12-02 09:54:19.681154 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Calling MsgHandler: 0x18e46410 (message: kXR_read (handle: 0x00000000, offset: 164813, size: 138) ) with status: [SUCCESS] .
[2025-12-02 09:54:19.681176 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Destroying MsgHandler: 0x18e46410.
[2025-12-02 09:54:19.681243 +0000][Debug  ][File              ][ 1305] [0xcd2a800@root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/67/0c/nu_dune10kt_1x2x6_1413_726_20230826T183653Z_gen_g4_detsim_hitreco__20240229T163122Z_reco2.root?xrdcl.requuid=87622ecb-4721-4ce8-8abd-666261b513e7] Sending a read command for handle 0x0 to ds29.farm.particle.cz:22526
[2025-12-02 09:54:19.681270 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] MsgHandler created: 0x18e465d0 (message: kXR_read (handle: 0x00000000, offset: 114134, size: 2792) ).
[2025-12-02 09:54:19.681345 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Moving MsgHandler: 0x18e465d0 (message: kXR_read (handle: 0x00000000, offset: 114134, size: 2792) ) from out-queu to in-queue.
[2025-12-02 09:54:19.712627 +0000][Debug  ][ExDbgMsg          ][ 1305] [msg: 0x196a0000] Assigned MsgHandler: 0x18e465d0.
[2025-12-02 09:54:19.712684 +0000][Debug  ][ExDbgMsg          ][ 1305] [handler: 0x18e465d0] Removed MsgHandler: 0x18e465d0 from the in-queue.
[2025-12-02 09:54:19.712731 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Calling MsgHandler: 0x18e465d0 (message: kXR_read (handle: 0x00000000, offset: 114134, size: 2792) ) with status: [SUCCESS] .
[2025-12-02 09:54:19.712752 +0000][Debug  ][ExDbgMsg          ][ 1305] [ds29.farm.particle.cz:22526] Destroying MsgHandler: 0x18e465d0.
=== End last 100 lines of lar log file ===
mv: cannot stat 'ClusterValidation_WithAlg.root': No such file or directory
mv: cannot stat 'ClusterValidation_WithoutAlg.root': No such file or directory
justIN time: 2025-12-19 12:23:09 UTC       justIN version: 01.05.03