justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 273236.190@dunegpschedd02.fnal.gov

Jobsub ID273236.190@dunegpschedd02.fnal.gov
Workflow ID11955
Stage ID1
User nameimawby@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-01-15 10:27:45
SiteUK_Bristol
EntryCMSHTPC_T2_UK_SGrid_Bristol_lcgce02
Last heartbeat2026-01-15 10:36:24
From worker nodeHostnamehd89.dice.priv
cpuinfoAMD EPYC 7713 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit259200 (72 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-15 10:29:24
Input filesfardet-hd:nu_dune10kt_1x2x6_1408_894_20230826T094902Z_gen_g4_detsim_hitreco__20240229T181659Z_reco2.root
JobscriptExit code0
Real time6m (399s)
CPU time5m (337s = 84%)
Max RSS bytes1324261376 (1262 MiB)
Outputting started2026-01-15 10:36:03
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/metrics_nu_1/fnal/11955/1/001/Validation_nu_dune10kt_1x2x6_1408_894_20230826T094902Z_gen_g4_detsim_hitreco__20240229T181659Z_reco2.root
Finished2026-01-15 10:36:24
Saved logsjustin-logs:273236.190-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

1f448969f3ed8/localProducts_larsoft_v10_13_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/ec/94/nu_dune10kt_1x2x6_1408_894_20230826T094902Z_gen_g4_detsim_hitreco__20240229T181659Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
    in function: GetList
    in file:     /exp/dune/app/users/imawby/dunesw_validation/srcs/larpandoracontent/larpandoradlcontent/LArTwoDReco/DLThreeDClusterSplittingAlgorithm.cc line#: 194
Begin processing the 28th record. run: 1408 subRun: 1 event: 89428 at 15-Jan-2026 10:31:54 UTC
Begin processing the 29th record. run: 1408 subRun: 1 event: 89429 at 15-Jan-2026 10:31:57 UTC
Begin processing the 30th record. run: 1408 subRun: 1 event: 89430 at 15-Jan-2026 10:31:59 UTC
Begin processing the 31st record. run: 1408 subRun: 1 event: 89431 at 15-Jan-2026 10:32:02 UTC
Begin processing the 32nd record. run: 1408 subRun: 1 event: 89432 at 15-Jan-2026 10:32:04 UTC
Begin processing the 33rd record. run: 1408 subRun: 1 event: 89433 at 15-Jan-2026 10:32:08 UTC
Begin processing the 34th record. run: 1408 subRun: 1 event: 89434 at 15-Jan-2026 10:32:10 UTC
Begin processing the 35th record. run: 1408 subRun: 1 event: 89435 at 15-Jan-2026 10:32:13 UTC
Begin processing the 36th record. run: 1408 subRun: 1 event: 89436 at 15-Jan-2026 10:32:15 UTC
Begin processing the 37th record. run: 1408 subRun: 1 event: 89437 at 15-Jan-2026 10:32:18 UTC
Begin processing the 38th record. run: 1408 subRun: 1 event: 89438 at 15-Jan-2026 10:32:26 UTC
Begin processing the 39th record. run: 1408 subRun: 1 event: 89439 at 15-Jan-2026 10:32:29 UTC
Begin processing the 40th record. run: 1408 subRun: 1 event: 89440 at 15-Jan-2026 10:32:32 UTC
Begin processing the 41st record. run: 1408 subRun: 1 event: 89441 at 15-Jan-2026 10:32:45 UTC
Begin processing the 42nd record. run: 1408 subRun: 1 event: 89442 at 15-Jan-2026 10:32:47 UTC
Begin processing the 43rd record. run: 1408 subRun: 1 event: 89443 at 15-Jan-2026 10:32:49 UTC
Begin processing the 44th record. run: 1408 subRun: 1 event: 89444 at 15-Jan-2026 10:32:52 UTC
Begin processing the 45th record. run: 1408 subRun: 1 event: 89445 at 15-Jan-2026 10:32:55 UTC
Begin processing the 46th record. run: 1408 subRun: 1 event: 89446 at 15-Jan-2026 10:32:58 UTC
Begin processing the 47th record. run: 1408 subRun: 1 event: 89447 at 15-Jan-2026 10:33:01 UTC
Begin processing the 48th record. run: 1408 subRun: 1 event: 89448 at 15-Jan-2026 10:33:03 UTC
Begin processing the 49th record. run: 1408 subRun: 1 event: 89449 at 15-Jan-2026 10:33:05 UTC
Begin processing the 50th record. run: 1408 subRun: 1 event: 89450 at 15-Jan-2026 10:33:08 UTC
Begin processing the 51st record. run: 1408 subRun: 1 event: 89451 at 15-Jan-2026 10:33:11 UTC
Begin processing the 52nd record. run: 1408 subRun: 1 event: 89452 at 15-Jan-2026 10:33:13 UTC
Begin processing the 53rd record. run: 1408 subRun: 1 event: 89453 at 15-Jan-2026 10:33:16 UTC
Begin processing the 54th record. run: 1408 subRun: 1 event: 89454 at 15-Jan-2026 10:33:18 UTC
Begin processing the 55th record. run: 1408 subRun: 1 event: 89455 at 15-Jan-2026 10:33:21 UTC
Begin processing the 56th record. run: 1408 subRun: 1 event: 89456 at 15-Jan-2026 10:33:23 UTC
Begin processing the 57th record. run: 1408 subRun: 1 event: 89457 at 15-Jan-2026 10:33:27 UTC
Begin processing the 58th record. run: 1408 subRun: 1 event: 89458 at 15-Jan-2026 10:33:29 UTC
Begin processing the 59th record. run: 1408 subRun: 1 event: 89459 at 15-Jan-2026 10:33:31 UTC
Begin processing the 60th record. run: 1408 subRun: 1 event: 89460 at 15-Jan-2026 10:33:34 UTC
Begin processing the 61st record. run: 1408 subRun: 1 event: 89461 at 15-Jan-2026 10:33:37 UTC
Begin processing the 62nd record. run: 1408 subRun: 1 event: 89462 at 15-Jan-2026 10:33:39 UTC
Begin processing the 63rd record. run: 1408 subRun: 1 event: 89463 at 15-Jan-2026 10:33:42 UTC
Begin processing the 64th record. run: 1408 subRun: 1 event: 89464 at 15-Jan-2026 10:33:44 UTC
Begin processing the 65th record. run: 1408 subRun: 1 event: 89465 at 15-Jan-2026 10:33:48 UTC
Begin processing the 66th record. run: 1408 subRun: 1 event: 89466 at 15-Jan-2026 10:33:50 UTC
Begin processing the 67th record. run: 1408 subRun: 1 event: 89467 at 15-Jan-2026 10:33:53 UTC
Begin processing the 68th record. run: 1408 subRun: 1 event: 89468 at 15-Jan-2026 10:33:56 UTC
Begin processing the 69th record. run: 1408 subRun: 1 event: 89469 at 15-Jan-2026 10:33:58 UTC
Begin processing the 70th record. run: 1408 subRun: 1 event: 89470 at 15-Jan-2026 10:34:00 UTC
Begin processing the 71st record. run: 1408 subRun: 1 event: 89471 at 15-Jan-2026 10:34:02 UTC
Begin processing the 72nd record. run: 1408 subRun: 1 event: 89472 at 15-Jan-2026 10:34:06 UTC
Begin processing the 73rd record. run: 1408 subRun: 1 event: 89473 at 15-Jan-2026 10:34:08 UTC
Begin processing the 74th record. run: 1408 subRun: 1 event: 89474 at 15-Jan-2026 10:34:11 UTC
Begin processing the 75th record. run: 1408 subRun: 1 event: 89475 at 15-Jan-2026 10:34:14 UTC
Begin processing the 76th record. run: 1408 subRun: 1 event: 89476 at 15-Jan-2026 10:34:16 UTC
Begin processing the 77th record. run: 1408 subRun: 1 event: 89477 at 15-Jan-2026 10:34:19 UTC
Begin processing the 78th record. run: 1408 subRun: 1 event: 89478 at 15-Jan-2026 10:34:21 UTC
Begin processing the 79th record. run: 1408 subRun: 1 event: 89479 at 15-Jan-2026 10:34:24 UTC
Begin processing the 80th record. run: 1408 subRun: 1 event: 89480 at 15-Jan-2026 10:34:26 UTC
Begin processing the 81st record. run: 1408 subRun: 1 event: 89481 at 15-Jan-2026 10:34:29 UTC
Begin processing the 82nd record. run: 1408 subRun: 1 event: 89482 at 15-Jan-2026 10:34:31 UTC
Begin processing the 83rd record. run: 1408 subRun: 1 event: 89483 at 15-Jan-2026 10:34:35 UTC
Begin processing the 84th record. run: 1408 subRun: 1 event: 89484 at 15-Jan-2026 10:34:37 UTC
Begin processing the 85th record. run: 1408 subRun: 1 event: 89485 at 15-Jan-2026 10:34:40 UTC
Begin processing the 86th record. run: 1408 subRun: 1 event: 89486 at 15-Jan-2026 10:34:43 UTC
Begin processing the 87th record. run: 1408 subRun: 1 event: 89487 at 15-Jan-2026 10:34:45 UTC
Begin processing the 88th record. run: 1408 subRun: 1 event: 89488 at 15-Jan-2026 10:34:48 UTC
Begin processing the 89th record. run: 1408 subRun: 1 event: 89489 at 15-Jan-2026 10:34:50 UTC
Begin processing the 90th record. run: 1408 subRun: 1 event: 89490 at 15-Jan-2026 10:34:53 UTC
Begin processing the 91st record. run: 1408 subRun: 1 event: 89491 at 15-Jan-2026 10:34:55 UTC
Begin processing the 92nd record. run: 1408 subRun: 1 event: 89492 at 15-Jan-2026 10:34:58 UTC
Begin processing the 93rd record. run: 1408 subRun: 1 event: 89493 at 15-Jan-2026 10:35:00 UTC
PandoraContentApi::GetList(*this, listName, pList) return STATUS_CODE_NOT_INITIALIZED
    in function: GetList
    in file:     /exp/dune/app/users/imawby/dunesw_validation/srcs/larpandoracontent/larpandoradlcontent/LArTwoDReco/DLThreeDClusterSplittingAlgorithm.cc line#: 194
Begin processing the 94th record. run: 1408 subRun: 1 event: 89494 at 15-Jan-2026 10:35:02 UTC
Begin processing the 95th record. run: 1408 subRun: 1 event: 89495 at 15-Jan-2026 10:35:04 UTC
Begin processing the 96th record. run: 1408 subRun: 1 event: 89496 at 15-Jan-2026 10:35:07 UTC
Begin processing the 97th record. run: 1408 subRun: 1 event: 89497 at 15-Jan-2026 10:35:10 UTC
Begin processing the 98th record. run: 1408 subRun: 1 event: 89498 at 15-Jan-2026 10:35:12 UTC
Begin processing the 99th record. run: 1408 subRun: 1 event: 89499 at 15-Jan-2026 10:35:18 UTC
Begin processing the 100th record. run: 1408 subRun: 1 event: 89500 at 15-Jan-2026 10:35:21 UTC
15-Jan-2026 10:36:02 UTC  Closed output file "nu_dune10kt_1x2x6_1408_894_20230826T094902Z_gen_g4_detsim_hitreco__20240229T181659Z_reco2_reco2.root"
15-Jan-2026 10:36:02 UTC  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/ec/94/nu_dune10kt_1x2x6_1408_894_20230826T094902Z_gen_g4_detsim_hitreco__20240229T181659Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      1.69557       3.02285       39.8935       2.37166       3.91449        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.011732      0.0191307     0.044429      0.0164953    0.00644309       100    
reco:pandora:StandardPandora                    1.65544       2.99298       39.8182       2.34465       3.9086         100    
[art]:TriggerResults:TriggerResultInserter     9.889e-06    2.11914e-05    9.961e-05    1.7448e-05    1.45185e-05      100    
end_path:out1:RootOutput                       2.665e-06    3.44748e-06   1.4919e-05    3.1815e-06    1.33913e-06      100    
end_path:out1:RootOutput(write)               0.000817245    0.0105532     0.0613125    0.00949897    0.00893178       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2342.11 MB
  Peak resident set size usage (VmHWM): 1324.26 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-04 04:52:55 UTC       justIN version: 01.06.00