justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262037.188@dunegpschedd01.fnal.gov

Jobsub ID262037.188@dunegpschedd01.fnal.gov
Workflow ID10930
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2025-12-02 09:42:54
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1_multicore
Last heartbeat2025-12-02 09:49:17
From worker nodeHostnamenode2b05.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-12-02 09:44:42
Input filesfardet-hd:nu_dune10kt_1x2x6_1102_611_20230826T070303Z_gen_g4_detsim_hitreco__20240229T164453Z_reco2.root
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-12-02 09:49:17
Saved logsjustin-logs:262037.188-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

8:40.993115 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] MsgHandler created: 0x1beb7090 (message: kXR_read (handle: 0x00000000, offset: 154619085, size: 195729) ).
[2025-12-02 09:48:41.003678 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Moving MsgHandler: 0x1beb7090 (message: kXR_read (handle: 0x00000000, offset: 154619085, size: 195729) ) from out-queu to in-queue.
[2025-12-02 09:48:41.021956 +0000][Debug  ][ExDbgMsg          ][ 1307] [msg: 0x1beb81b0] Assigned MsgHandler: 0x1beb7090.
[2025-12-02 09:48:41.022007 +0000][Debug  ][ExDbgMsg          ][ 1307] [handler: 0x1beb7090] Removed MsgHandler: 0x1beb7090 from the in-queue.
[2025-12-02 09:48:41.022362 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Calling MsgHandler: 0x1beb7090 (message: kXR_read (handle: 0x00000000, offset: 154619085, size: 195729) ) with status: [SUCCESS] .
[2025-12-02 09:48:41.022400 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Destroying MsgHandler: 0x1beb7090.
[2025-12-02 09:48:41.027017 +0000][Debug  ][File              ][ 1307] [0x924c950@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/97/97/nu_dune10kt_1x2x6_1102_611_20230826T070303Z_gen_g4_detsim_hitreco__20240229T164453Z_reco2.root?xrdcl.requuid=4c5863c9-d573-484e-9a24-9b23900596fe] Sending a read command for handle 0x0 to hooipolder-01.nikhef.nl:33231
[2025-12-02 09:48:41.027061 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] MsgHandler created: 0xab42150 (message: kXR_read (handle: 0x00000000, offset: 1206912619, size: 102) ).
[2025-12-02 09:48:41.027133 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Moving MsgHandler: 0xab42150 (message: kXR_read (handle: 0x00000000, offset: 1206912619, size: 102) ) from out-queu to in-queue.
[2025-12-02 09:48:41.045626 +0000][Debug  ][ExDbgMsg          ][ 1307] [msg: 0xab42cd0] Assigned MsgHandler: 0xab42150.
[2025-12-02 09:48:41.045656 +0000][Debug  ][ExDbgMsg          ][ 1307] [handler: 0xab42150] Removed MsgHandler: 0xab42150 from the in-queue.
[2025-12-02 09:48:41.045704 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Calling MsgHandler: 0xab42150 (message: kXR_read (handle: 0x00000000, offset: 1206912619, size: 102) ) with status: [SUCCESS] .
[2025-12-02 09:48:41.045732 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Destroying MsgHandler: 0xab42150.
[2025-12-02 09:48:41.046010 +0000][Debug  ][File              ][ 1307] [0x924c950@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/97/97/nu_dune10kt_1x2x6_1102_611_20230826T070303Z_gen_g4_detsim_hitreco__20240229T164453Z_reco2.root?xrdcl.requuid=4c5863c9-d573-484e-9a24-9b23900596fe] Sending a read command for handle 0x0 to hooipolder-01.nikhef.nl:33231
[2025-12-02 09:48:41.046054 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] MsgHandler created: 0xab42150 (message: kXR_read (handle: 0x00000000, offset: 1206912721, size: 108) ).
[2025-12-02 09:48:41.046102 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Moving MsgHandler: 0xab42150 (message: kXR_read (handle: 0x00000000, offset: 1206912721, size: 108) ) from out-queu to in-queue.
[2025-12-02 09:48:41.065032 +0000][Debug  ][ExDbgMsg          ][ 1307] [msg: 0xab42ea0] Assigned MsgHandler: 0xab42150.
[2025-12-02 09:48:41.065070 +0000][Debug  ][ExDbgMsg          ][ 1307] [handler: 0xab42150] Removed MsgHandler: 0xab42150 from the in-queue.
[2025-12-02 09:48:41.065218 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Calling MsgHandler: 0xab42150 (message: kXR_read (handle: 0x00000000, offset: 1206912721, size: 108) ) with status: [SUCCESS] .
[2025-12-02 09:48:41.065254 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Destroying MsgHandler: 0xab42150.
[2025-12-02 09:48:41.065302 +0000][Debug  ][File              ][ 1307] [0x924c950@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/97/97/nu_dune10kt_1x2x6_1102_611_20230826T070303Z_gen_g4_detsim_hitreco__20240229T164453Z_reco2.root?xrdcl.requuid=4c5863c9-d573-484e-9a24-9b23900596fe] Sending a read command for handle 0x0 to hooipolder-01.nikhef.nl:33231
[2025-12-02 09:48:41.065330 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] MsgHandler created: 0xab42150 (message: kXR_read (handle: 0x00000000, offset: 1206869216, size: 43403) ).
[2025-12-02 09:48:41.065386 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Moving MsgHandler: 0xab42150 (message: kXR_read (handle: 0x00000000, offset: 1206869216, size: 43403) ) from out-queu to in-queue.
[2025-12-02 09:48:41.083559 +0000][Debug  ][ExDbgMsg          ][ 1307] [msg: 0xab42a20] Assigned MsgHandler: 0xab42150.
[2025-12-02 09:48:41.083610 +0000][Debug  ][ExDbgMsg          ][ 1307] [handler: 0xab42150] Removed MsgHandler: 0xab42150 from the in-queue.
[2025-12-02 09:48:41.083816 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Calling MsgHandler: 0xab42150 (message: kXR_read (handle: 0x00000000, offset: 1206869216, size: 43403) ) with status: [SUCCESS] .
[2025-12-02 09:48:41.083856 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Destroying MsgHandler: 0xab42150.
[2025-12-02 09:48:41.092566 +0000][Debug  ][File              ][ 1307] [0x924c950@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/97/97/nu_dune10kt_1x2x6_1102_611_20230826T070303Z_gen_g4_detsim_hitreco__20240229T164453Z_reco2.root?xrdcl.requuid=4c5863c9-d573-484e-9a24-9b23900596fe] Sending a read command for handle 0x0 to hooipolder-01.nikhef.nl:33231
[2025-12-02 09:48:41.092646 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] MsgHandler created: 0x187fa060 (message: kXR_read (handle: 0x00000000, offset: 161340, size: 132) ).
[2025-12-02 09:48:41.092735 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Moving MsgHandler: 0x187fa060 (message: kXR_read (handle: 0x00000000, offset: 161340, size: 132) ) from out-queu to in-queue.
[2025-12-02 09:48:41.111000 +0000][Debug  ][ExDbgMsg          ][ 1307] [msg: 0x1a9bb240] Assigned MsgHandler: 0x187fa060.
[2025-12-02 09:48:41.111031 +0000][Debug  ][ExDbgMsg          ][ 1307] [handler: 0x187fa060] Removed MsgHandler: 0x187fa060 from the in-queue.
[2025-12-02 09:48:41.111159 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Calling MsgHandler: 0x187fa060 (message: kXR_read (handle: 0x00000000, offset: 161340, size: 132) ) with status: [SUCCESS] .
[2025-12-02 09:48:41.111190 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Destroying MsgHandler: 0x187fa060.
[2025-12-02 09:48:41.111244 +0000][Debug  ][File              ][ 1307] [0x924c950@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/97/97/nu_dune10kt_1x2x6_1102_611_20230826T070303Z_gen_g4_detsim_hitreco__20240229T164453Z_reco2.root?xrdcl.requuid=4c5863c9-d573-484e-9a24-9b23900596fe] Sending a read command for handle 0x0 to hooipolder-01.nikhef.nl:33231
[2025-12-02 09:48:41.111269 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] MsgHandler created: 0x187fa060 (message: kXR_read (handle: 0x00000000, offset: 161472, size: 138) ).
[2025-12-02 09:48:41.111319 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Moving MsgHandler: 0x187fa060 (message: kXR_read (handle: 0x00000000, offset: 161472, size: 138) ) from out-queu to in-queue.
[2025-12-02 09:48:41.131210 +0000][Debug  ][ExDbgMsg          ][ 1307] [msg: 0x1a9bb420] Assigned MsgHandler: 0x187fa060.
[2025-12-02 09:48:41.131250 +0000][Debug  ][ExDbgMsg          ][ 1307] [handler: 0x187fa060] Removed MsgHandler: 0x187fa060 from the in-queue.
[2025-12-02 09:48:41.131401 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Calling MsgHandler: 0x187fa060 (message: kXR_read (handle: 0x00000000, offset: 161472, size: 138) ) with status: [SUCCESS] .
[2025-12-02 09:48:41.131438 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Destroying MsgHandler: 0x187fa060.
[2025-12-02 09:48:41.131497 +0000][Debug  ][File              ][ 1307] [0x924c950@root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/97/97/nu_dune10kt_1x2x6_1102_611_20230826T070303Z_gen_g4_detsim_hitreco__20240229T164453Z_reco2.root?xrdcl.requuid=4c5863c9-d573-484e-9a24-9b23900596fe] Sending a read command for handle 0x0 to hooipolder-01.nikhef.nl:33231
[2025-12-02 09:48:41.131525 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] MsgHandler created: 0x187fa060 (message: kXR_read (handle: 0x00000000, offset: 20202, size: 2537) ).
[2025-12-02 09:48:41.131579 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Moving MsgHandler: 0x187fa060 (message: kXR_read (handle: 0x00000000, offset: 20202, size: 2537) ) from out-queu to in-queue.
[2025-12-02 09:48:41.149591 +0000][Debug  ][ExDbgMsg          ][ 1307] [msg: 0x1a9bb160] Assigned MsgHandler: 0x187fa060.
[2025-12-02 09:48:41.149632 +0000][Debug  ][ExDbgMsg          ][ 1307] [handler: 0x187fa060] Removed MsgHandler: 0x187fa060 from the in-queue.
[2025-12-02 09:48:41.149682 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Calling MsgHandler: 0x187fa060 (message: kXR_read (handle: 0x00000000, offset: 20202, size: 2537) ) with status: [SUCCESS] .
[2025-12-02 09:48:41.149709 +0000][Debug  ][ExDbgMsg          ][ 1307] [hooipolder-01.nikhef.nl:33231] Destroying MsgHandler: 0x187fa060.
=== End last 100 lines of lar log file ===
mv: cannot stat 'ClusterValidation_WithAlg.root': No such file or directory
mv: cannot stat 'ClusterValidation_WithoutAlg.root': No such file or directory
justIN time: 2025-12-19 12:23:13 UTC       justIN version: 01.05.03