justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 256238.155@dunegpschedd02.fnal.gov

Jobsub ID256238.155@dunegpschedd02.fnal.gov
Workflow ID10928
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2025-12-02 09:34:52
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1_multicore
Last heartbeat2025-12-02 09:39:48
From worker nodeHostnamenode2b05.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-12-02 09:35:35
Input filesfardet-hd:nu_dune10kt_1x2x6_1102_611_20230826T070303Z_gen_g4_detsim_hitreco__20240229T164453Z_reco2.root
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-12-02 09:39:48
Saved logsjustin-logs:256238.155-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] MsgHandler created: 0x19688740 (message: kXR_read (handle: 0x00000000, offset: 154619085, size: 195729) ).
[2025-12-02 09:39:31.364375 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Moving MsgHandler: 0x19688740 (message: kXR_read (handle: 0x00000000, offset: 154619085, size: 195729) ) from out-queu to in-queue.
[2025-12-02 09:39:31.382382 +0000][Debug  ][ExDbgMsg          ][ 1310] [msg: 0x19689860] Assigned MsgHandler: 0x19688740.
[2025-12-02 09:39:31.382433 +0000][Debug  ][ExDbgMsg          ][ 1310] [handler: 0x19688740] Removed MsgHandler: 0x19688740 from the in-queue.
[2025-12-02 09:39:31.382656 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Calling MsgHandler: 0x19688740 (message: kXR_read (handle: 0x00000000, offset: 154619085, size: 195729) ) with status: [SUCCESS] .
[2025-12-02 09:39:31.382678 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Destroying MsgHandler: 0x19688740.
[2025-12-02 09:39:31.387441 +0000][Debug  ][File              ][ 1310] [0xd0adb20@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/97/97/nu_dune10kt_1x2x6_1102_611_20230826T070303Z_gen_g4_detsim_hitreco__20240229T164453Z_reco2.root?xrdcl.requuid=ea20107b-d000-4871-9b56-30a1f3b3af14] Sending a read command for handle 0x0 to hooipolder-01.nikhef.nl:33231
[2025-12-02 09:39:31.387481 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] MsgHandler created: 0x19c27060 (message: kXR_read (handle: 0x00000000, offset: 1206912619, size: 102) ).
[2025-12-02 09:39:31.387567 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Moving MsgHandler: 0x19c27060 (message: kXR_read (handle: 0x00000000, offset: 1206912619, size: 102) ) from out-queu to in-queue.
[2025-12-02 09:39:31.405497 +0000][Debug  ][ExDbgMsg          ][ 1310] [msg: 0x19c27ae0] Assigned MsgHandler: 0x19c27060.
[2025-12-02 09:39:31.405543 +0000][Debug  ][ExDbgMsg          ][ 1310] [handler: 0x19c27060] Removed MsgHandler: 0x19c27060 from the in-queue.
[2025-12-02 09:39:31.405582 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Calling MsgHandler: 0x19c27060 (message: kXR_read (handle: 0x00000000, offset: 1206912619, size: 102) ) with status: [SUCCESS] .
[2025-12-02 09:39:31.405601 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Destroying MsgHandler: 0x19c27060.
[2025-12-02 09:39:31.405652 +0000][Debug  ][File              ][ 1310] [0xd0adb20@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/97/97/nu_dune10kt_1x2x6_1102_611_20230826T070303Z_gen_g4_detsim_hitreco__20240229T164453Z_reco2.root?xrdcl.requuid=ea20107b-d000-4871-9b56-30a1f3b3af14] Sending a read command for handle 0x0 to hooipolder-01.nikhef.nl:33231
[2025-12-02 09:39:31.405674 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] MsgHandler created: 0x19c27060 (message: kXR_read (handle: 0x00000000, offset: 1206912721, size: 108) ).
[2025-12-02 09:39:31.405739 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Moving MsgHandler: 0x19c27060 (message: kXR_read (handle: 0x00000000, offset: 1206912721, size: 108) ) from out-queu to in-queue.
[2025-12-02 09:39:31.423727 +0000][Debug  ][ExDbgMsg          ][ 1310] [msg: 0x19c27db0] Assigned MsgHandler: 0x19c27060.
[2025-12-02 09:39:31.423769 +0000][Debug  ][ExDbgMsg          ][ 1310] [handler: 0x19c27060] Removed MsgHandler: 0x19c27060 from the in-queue.
[2025-12-02 09:39:31.423805 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Calling MsgHandler: 0x19c27060 (message: kXR_read (handle: 0x00000000, offset: 1206912721, size: 108) ) with status: [SUCCESS] .
[2025-12-02 09:39:31.423823 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Destroying MsgHandler: 0x19c27060.
[2025-12-02 09:39:31.423870 +0000][Debug  ][File              ][ 1310] [0xd0adb20@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/97/97/nu_dune10kt_1x2x6_1102_611_20230826T070303Z_gen_g4_detsim_hitreco__20240229T164453Z_reco2.root?xrdcl.requuid=ea20107b-d000-4871-9b56-30a1f3b3af14] Sending a read command for handle 0x0 to hooipolder-01.nikhef.nl:33231
[2025-12-02 09:39:31.423892 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] MsgHandler created: 0x19c27060 (message: kXR_read (handle: 0x00000000, offset: 1206869216, size: 43403) ).
[2025-12-02 09:39:31.423960 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Moving MsgHandler: 0x19c27060 (message: kXR_read (handle: 0x00000000, offset: 1206869216, size: 43403) ) from out-queu to in-queue.
[2025-12-02 09:39:31.442379 +0000][Debug  ][ExDbgMsg          ][ 1310] [msg: 0x19c28e80] Assigned MsgHandler: 0x19c27060.
[2025-12-02 09:39:31.442426 +0000][Debug  ][ExDbgMsg          ][ 1310] [handler: 0x19c27060] Removed MsgHandler: 0x19c27060 from the in-queue.
[2025-12-02 09:39:31.442480 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Calling MsgHandler: 0x19c27060 (message: kXR_read (handle: 0x00000000, offset: 1206869216, size: 43403) ) with status: [SUCCESS] .
[2025-12-02 09:39:31.442499 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Destroying MsgHandler: 0x19c27060.
[2025-12-02 09:39:31.451548 +0000][Debug  ][File              ][ 1310] [0xd0adb20@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/97/97/nu_dune10kt_1x2x6_1102_611_20230826T070303Z_gen_g4_detsim_hitreco__20240229T164453Z_reco2.root?xrdcl.requuid=ea20107b-d000-4871-9b56-30a1f3b3af14] Sending a read command for handle 0x0 to hooipolder-01.nikhef.nl:33231
[2025-12-02 09:39:31.451617 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] MsgHandler created: 0x192c8530 (message: kXR_read (handle: 0x00000000, offset: 161340, size: 132) ).
[2025-12-02 09:39:31.451703 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Moving MsgHandler: 0x192c8530 (message: kXR_read (handle: 0x00000000, offset: 161340, size: 132) ) from out-queu to in-queue.
[2025-12-02 09:39:31.469616 +0000][Debug  ][ExDbgMsg          ][ 1310] [msg: 0x192c9090] Assigned MsgHandler: 0x192c8530.
[2025-12-02 09:39:31.469669 +0000][Debug  ][ExDbgMsg          ][ 1310] [handler: 0x192c8530] Removed MsgHandler: 0x192c8530 from the in-queue.
[2025-12-02 09:39:31.469712 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Calling MsgHandler: 0x192c8530 (message: kXR_read (handle: 0x00000000, offset: 161340, size: 132) ) with status: [SUCCESS] .
[2025-12-02 09:39:31.469731 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Destroying MsgHandler: 0x192c8530.
[2025-12-02 09:39:31.469787 +0000][Debug  ][File              ][ 1310] [0xd0adb20@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/97/97/nu_dune10kt_1x2x6_1102_611_20230826T070303Z_gen_g4_detsim_hitreco__20240229T164453Z_reco2.root?xrdcl.requuid=ea20107b-d000-4871-9b56-30a1f3b3af14] Sending a read command for handle 0x0 to hooipolder-01.nikhef.nl:33231
[2025-12-02 09:39:31.469811 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] MsgHandler created: 0x192c8530 (message: kXR_read (handle: 0x00000000, offset: 161472, size: 138) ).
[2025-12-02 09:39:31.469883 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Moving MsgHandler: 0x192c8530 (message: kXR_read (handle: 0x00000000, offset: 161472, size: 138) ) from out-queu to in-queue.
[2025-12-02 09:39:31.488044 +0000][Debug  ][ExDbgMsg          ][ 1310] [msg: 0x192c91d0] Assigned MsgHandler: 0x192c8530.
[2025-12-02 09:39:31.488084 +0000][Debug  ][ExDbgMsg          ][ 1310] [handler: 0x192c8530] Removed MsgHandler: 0x192c8530 from the in-queue.
[2025-12-02 09:39:31.488120 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Calling MsgHandler: 0x192c8530 (message: kXR_read (handle: 0x00000000, offset: 161472, size: 138) ) with status: [SUCCESS] .
[2025-12-02 09:39:31.488137 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Destroying MsgHandler: 0x192c8530.
[2025-12-02 09:39:31.488189 +0000][Debug  ][File              ][ 1310] [0xd0adb20@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/97/97/nu_dune10kt_1x2x6_1102_611_20230826T070303Z_gen_g4_detsim_hitreco__20240229T164453Z_reco2.root?xrdcl.requuid=ea20107b-d000-4871-9b56-30a1f3b3af14] Sending a read command for handle 0x0 to hooipolder-01.nikhef.nl:33231
[2025-12-02 09:39:31.488211 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] MsgHandler created: 0x192c9690 (message: kXR_read (handle: 0x00000000, offset: 20202, size: 2537) ).
[2025-12-02 09:39:31.488269 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Moving MsgHandler: 0x192c9690 (message: kXR_read (handle: 0x00000000, offset: 20202, size: 2537) ) from out-queu to in-queue.
[2025-12-02 09:39:31.506326 +0000][Debug  ][ExDbgMsg          ][ 1310] [msg: 0x1cfcbfb0] Assigned MsgHandler: 0x192c9690.
[2025-12-02 09:39:31.506369 +0000][Debug  ][ExDbgMsg          ][ 1310] [handler: 0x192c9690] Removed MsgHandler: 0x192c9690 from the in-queue.
[2025-12-02 09:39:31.506408 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Calling MsgHandler: 0x192c9690 (message: kXR_read (handle: 0x00000000, offset: 20202, size: 2537) ) with status: [SUCCESS] .
[2025-12-02 09:39:31.506442 +0000][Debug  ][ExDbgMsg          ][ 1310] [hooipolder-01.nikhef.nl:33231] Destroying MsgHandler: 0x192c9690.
=== End last 100 lines of lar log file ===
mv: cannot stat 'ClusterValidation_WithAlg.root': No such file or directory
mv: cannot stat 'ClusterValidation_WithoutAlg.root': No such file or directory
justIN time: 2025-12-19 12:14:14 UTC       justIN version: 01.05.03