justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 256238.90@dunegpschedd02.fnal.gov

Jobsub ID256238.90@dunegpschedd02.fnal.gov
Workflow ID10928
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2025-12-02 09:34:52
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1_multicore
Last heartbeat2025-12-02 09:40:23
From worker nodeHostnamenode2b05.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-12-02 09:35:51
Input filesfardet-hd:nu_dune10kt_1x2x6_1102_236_20230826T064155Z_gen_g4_detsim_hitreco__20240229T190205Z_reco2.root
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-12-02 09:40:23
Saved logsjustin-logs:256238.90-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

249
[2025-12-02 09:40:05.030587 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] MsgHandler created: 0xdb6c070 (message: kXR_read (handle: 0x00000000, offset: 246407000, size: 377373) ).
[2025-12-02 09:40:05.030659 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Moving MsgHandler: 0xdb6c070 (message: kXR_read (handle: 0x00000000, offset: 246407000, size: 377373) ) from out-queu to in-queue.
[2025-12-02 09:40:05.048931 +0000][Debug  ][ExDbgMsg          ][ 1307] [msg: 0x1c630f30] Assigned MsgHandler: 0xdb6c070.
[2025-12-02 09:40:05.048983 +0000][Debug  ][ExDbgMsg          ][ 1307] [handler: 0xdb6c070] Removed MsgHandler: 0xdb6c070 from the in-queue.
[2025-12-02 09:40:05.067178 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Calling MsgHandler: 0xdb6c070 (message: kXR_read (handle: 0x00000000, offset: 246407000, size: 377373) ) with status: [SUCCESS] .
[2025-12-02 09:40:05.067233 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Destroying MsgHandler: 0xdb6c070.
[2025-12-02 09:40:05.077525 +0000][Debug  ][File              ][ 1307] [0xa0def80@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/69/14/nu_dune10kt_1x2x6_1102_236_20230826T064155Z_gen_g4_detsim_hitreco__20240229T190205Z_reco2.root?xrdcl.requuid=1bb8f95a-4b77-4462-a4eb-bb22e9def25b] Sending a read command for handle 0x0 to hooimolen-09.nikhef.nl:33249
[2025-12-02 09:40:05.077589 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] MsgHandler created: 0x1c1ecf60 (message: kXR_read (handle: 0x00000000, offset: 1116752932, size: 102) ).
[2025-12-02 09:40:05.077683 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Moving MsgHandler: 0x1c1ecf60 (message: kXR_read (handle: 0x00000000, offset: 1116752932, size: 102) ) from out-queu to in-queue.
[2025-12-02 09:40:05.095689 +0000][Debug  ][ExDbgMsg          ][ 1307] [msg: 0x1c674030] Assigned MsgHandler: 0x1c1ecf60.
[2025-12-02 09:40:05.095746 +0000][Debug  ][ExDbgMsg          ][ 1307] [handler: 0x1c1ecf60] Removed MsgHandler: 0x1c1ecf60 from the in-queue.
[2025-12-02 09:40:05.095809 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Calling MsgHandler: 0x1c1ecf60 (message: kXR_read (handle: 0x00000000, offset: 1116752932, size: 102) ) with status: [SUCCESS] .
[2025-12-02 09:40:05.095831 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Destroying MsgHandler: 0x1c1ecf60.
[2025-12-02 09:40:05.095888 +0000][Debug  ][File              ][ 1307] [0xa0def80@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/69/14/nu_dune10kt_1x2x6_1102_236_20230826T064155Z_gen_g4_detsim_hitreco__20240229T190205Z_reco2.root?xrdcl.requuid=1bb8f95a-4b77-4462-a4eb-bb22e9def25b] Sending a read command for handle 0x0 to hooimolen-09.nikhef.nl:33249
[2025-12-02 09:40:05.095919 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] MsgHandler created: 0x1c1ecf60 (message: kXR_read (handle: 0x00000000, offset: 1116753034, size: 108) ).
[2025-12-02 09:40:05.095996 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Moving MsgHandler: 0x1c1ecf60 (message: kXR_read (handle: 0x00000000, offset: 1116753034, size: 108) ) from out-queu to in-queue.
[2025-12-02 09:40:05.114010 +0000][Debug  ][ExDbgMsg          ][ 1307] [msg: 0x1c66ec70] Assigned MsgHandler: 0x1c1ecf60.
[2025-12-02 09:40:05.114054 +0000][Debug  ][ExDbgMsg          ][ 1307] [handler: 0x1c1ecf60] Removed MsgHandler: 0x1c1ecf60 from the in-queue.
[2025-12-02 09:40:05.114094 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Calling MsgHandler: 0x1c1ecf60 (message: kXR_read (handle: 0x00000000, offset: 1116753034, size: 108) ) with status: [SUCCESS] .
[2025-12-02 09:40:05.114113 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Destroying MsgHandler: 0x1c1ecf60.
[2025-12-02 09:40:05.114166 +0000][Debug  ][File              ][ 1307] [0xa0def80@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/69/14/nu_dune10kt_1x2x6_1102_236_20230826T064155Z_gen_g4_detsim_hitreco__20240229T190205Z_reco2.root?xrdcl.requuid=1bb8f95a-4b77-4462-a4eb-bb22e9def25b] Sending a read command for handle 0x0 to hooimolen-09.nikhef.nl:33249
[2025-12-02 09:40:05.114189 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] MsgHandler created: 0x1c1ecf60 (message: kXR_read (handle: 0x00000000, offset: 1116743572, size: 9360) ).
[2025-12-02 09:40:05.114259 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Moving MsgHandler: 0x1c1ecf60 (message: kXR_read (handle: 0x00000000, offset: 1116743572, size: 9360) ) from out-queu to in-queue.
[2025-12-02 09:40:05.132338 +0000][Debug  ][ExDbgMsg          ][ 1307] [msg: 0x1c6a4ab0] Assigned MsgHandler: 0x1c1ecf60.
[2025-12-02 09:40:05.132389 +0000][Debug  ][ExDbgMsg          ][ 1307] [handler: 0x1c1ecf60] Removed MsgHandler: 0x1c1ecf60 from the in-queue.
[2025-12-02 09:40:05.132434 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Calling MsgHandler: 0x1c1ecf60 (message: kXR_read (handle: 0x00000000, offset: 1116743572, size: 9360) ) with status: [SUCCESS] .
[2025-12-02 09:40:05.132455 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Destroying MsgHandler: 0x1c1ecf60.
[2025-12-02 09:40:05.139642 +0000][Debug  ][File              ][ 1307] [0xa0def80@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/69/14/nu_dune10kt_1x2x6_1102_236_20230826T064155Z_gen_g4_detsim_hitreco__20240229T190205Z_reco2.root?xrdcl.requuid=1bb8f95a-4b77-4462-a4eb-bb22e9def25b] Sending a read command for handle 0x0 to hooimolen-09.nikhef.nl:33249
[2025-12-02 09:40:05.139700 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] MsgHandler created: 0x1b843c60 (message: kXR_read (handle: 0x00000000, offset: 163005, size: 132) ).
[2025-12-02 09:40:05.139788 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Moving MsgHandler: 0x1b843c60 (message: kXR_read (handle: 0x00000000, offset: 163005, size: 132) ) from out-queu to in-queue.
[2025-12-02 09:40:05.157843 +0000][Debug  ][ExDbgMsg          ][ 1307] [msg: 0x1c6a9ee0] Assigned MsgHandler: 0x1b843c60.
[2025-12-02 09:40:05.157888 +0000][Debug  ][ExDbgMsg          ][ 1307] [handler: 0x1b843c60] Removed MsgHandler: 0x1b843c60 from the in-queue.
[2025-12-02 09:40:05.157938 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Calling MsgHandler: 0x1b843c60 (message: kXR_read (handle: 0x00000000, offset: 163005, size: 132) ) with status: [SUCCESS] .
[2025-12-02 09:40:05.157960 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Destroying MsgHandler: 0x1b843c60.
[2025-12-02 09:40:05.158024 +0000][Debug  ][File              ][ 1307] [0xa0def80@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/69/14/nu_dune10kt_1x2x6_1102_236_20230826T064155Z_gen_g4_detsim_hitreco__20240229T190205Z_reco2.root?xrdcl.requuid=1bb8f95a-4b77-4462-a4eb-bb22e9def25b] Sending a read command for handle 0x0 to hooimolen-09.nikhef.nl:33249
[2025-12-02 09:40:05.158050 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] MsgHandler created: 0x1b843c60 (message: kXR_read (handle: 0x00000000, offset: 163137, size: 138) ).
[2025-12-02 09:40:05.158110 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Moving MsgHandler: 0x1b843c60 (message: kXR_read (handle: 0x00000000, offset: 163137, size: 138) ) from out-queu to in-queue.
[2025-12-02 09:40:05.176026 +0000][Debug  ][ExDbgMsg          ][ 1307] [msg: 0x1c678ce0] Assigned MsgHandler: 0x1b843c60.
[2025-12-02 09:40:05.176070 +0000][Debug  ][ExDbgMsg          ][ 1307] [handler: 0x1b843c60] Removed MsgHandler: 0x1b843c60 from the in-queue.
[2025-12-02 09:40:05.176108 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Calling MsgHandler: 0x1b843c60 (message: kXR_read (handle: 0x00000000, offset: 163137, size: 138) ) with status: [SUCCESS] .
[2025-12-02 09:40:05.176128 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Destroying MsgHandler: 0x1b843c60.
[2025-12-02 09:40:05.176194 +0000][Debug  ][File              ][ 1307] [0xa0def80@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/69/14/nu_dune10kt_1x2x6_1102_236_20230826T064155Z_gen_g4_detsim_hitreco__20240229T190205Z_reco2.root?xrdcl.requuid=1bb8f95a-4b77-4462-a4eb-bb22e9def25b] Sending a read command for handle 0x0 to hooimolen-09.nikhef.nl:33249
[2025-12-02 09:40:05.176220 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] MsgHandler created: 0x1b843c60 (message: kXR_read (handle: 0x00000000, offset: 19461, size: 2409) ).
[2025-12-02 09:40:05.176270 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Moving MsgHandler: 0x1b843c60 (message: kXR_read (handle: 0x00000000, offset: 19461, size: 2409) ) from out-queu to in-queue.
[2025-12-02 09:40:05.194201 +0000][Debug  ][ExDbgMsg          ][ 1307] [msg: 0x1c652920] Assigned MsgHandler: 0x1b843c60.
[2025-12-02 09:40:05.194220 +0000][Debug  ][ExDbgMsg          ][ 1307] [handler: 0x1b843c60] Removed MsgHandler: 0x1b843c60 from the in-queue.
[2025-12-02 09:40:05.194245 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Calling MsgHandler: 0x1b843c60 (message: kXR_read (handle: 0x00000000, offset: 19461, size: 2409) ) with status: [SUCCESS] .
[2025-12-02 09:40:05.194262 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooimolen-09.nikhef.nl:33249] Destroying MsgHandler: 0x1b843c60.
=== End last 100 lines of lar log file ===
mv: cannot stat 'ClusterValidation_WithAlg.root': No such file or directory
mv: cannot stat 'ClusterValidation_WithoutAlg.root': No such file or directory
justIN time: 2025-12-19 12:30:16 UTC       justIN version: 01.05.03