justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 288571.2@dunegpschedd02.fnal.gov

Jobsub ID288571.2@dunegpschedd02.fnal.gov
Workflow ID12095
Stage ID1
User nameimawby@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-01-20 14:50:46
SiteUS_BNL
EntryDUNE_US_BNL_spoolce02
Last heartbeat2026-01-20 15:19:14
From worker nodeHostnamespool0112.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-20 14:51:25
Input filesfardet-hd:nue_dune10kt_1x2x6_1409_93_20230826T103316Z_gen_g4_detsim_hitreco__20240221T050654Z_reco2.root
JobscriptExit code0
Real time27m (1648s)
CPU time22m (1379s = 83%)
Max RSS bytes1335885824 (1274 MiB)
Outputting started2026-01-20 15:18:53
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/metrics_nue_1/fnal/12095/1/001/Validation_nue_dune10kt_1x2x6_1409_93_20230826T103316Z_gen_g4_detsim_hitreco__20240221T050654Z_reco2.root
Finished2026-01-20 15:19:14
Saved logsjustin-logs:288571.2-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

sw/dune/ad554f6b0d8af5cd51272760a301f448969f3ed8/localProducts_larsoft_v10_13_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/c5/7d/nue_dune10kt_1x2x6_1409_93_20230826T103316Z_gen_g4_detsim_hitreco__20240221T050654Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 33rd record. run: 1409 subRun: 1 event: 9333 at 20-Jan-2026 09:59:51 EST
Begin processing the 34th record. run: 1409 subRun: 1 event: 9334 at 20-Jan-2026 09:59:56 EST
Begin processing the 35th record. run: 1409 subRun: 1 event: 9335 at 20-Jan-2026 10:00:01 EST
Begin processing the 36th record. run: 1409 subRun: 1 event: 9336 at 20-Jan-2026 10:00:05 EST
Begin processing the 37th record. run: 1409 subRun: 1 event: 9337 at 20-Jan-2026 10:00:25 EST
Begin processing the 38th record. run: 1409 subRun: 1 event: 9338 at 20-Jan-2026 10:00:31 EST
Begin processing the 39th record. run: 1409 subRun: 1 event: 9339 at 20-Jan-2026 10:00:37 EST
Begin processing the 40th record. run: 1409 subRun: 1 event: 9340 at 20-Jan-2026 10:00:42 EST
Begin processing the 41st record. run: 1409 subRun: 1 event: 9341 at 20-Jan-2026 10:00:47 EST
Begin processing the 42nd record. run: 1409 subRun: 1 event: 9342 at 20-Jan-2026 10:00:52 EST
Begin processing the 43rd record. run: 1409 subRun: 1 event: 9343 at 20-Jan-2026 10:00:56 EST
Begin processing the 44th record. run: 1409 subRun: 1 event: 9344 at 20-Jan-2026 10:01:04 EST
Begin processing the 45th record. run: 1409 subRun: 1 event: 9345 at 20-Jan-2026 10:01:10 EST
PandoraContentApi::GetList(*this, m_inputHitListName, pCaloHitList) return STATUS_CODE_NOT_INITIALIZED
    in function: GetVolumeIdToHitListMap
    in file:     /exp/dune/app/users/imawby/dunesw_validation/srcs/larpandoracontent/larpandoracontent/LArControlFlow/MasterAlgorithm.cc line#: 271
this->GetVolumeIdToHitListMap(volumeIdToHitListMap) return STATUS_CODE_NOT_INITIALIZED
    in function: Run
    in file:     /exp/dune/app/users/imawby/dunesw_validation/srcs/larpandoracontent/larpandoracontent/LArControlFlow/MasterAlgorithm.cc line#: 165
iter->second->Run() throw STATUS_CODE_NOT_INITIALIZED
    in function: RunAlgorithm
    in file:     /scratch/workspace/build-lar-products/BUILDTYPE/prof/QUAL/e26/label1/swarm/label2/ALMA9/build/pandora/v04_16_02/src/pandora-v04-16-02/PandoraSDK-v04-00-02/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0002, LArDLMaster, STATUS_CODE_NOT_INITIALIZED
Begin processing the 46th record. run: 1409 subRun: 1 event: 9346 at 20-Jan-2026 10:01:10 EST
Begin processing the 47th record. run: 1409 subRun: 1 event: 9347 at 20-Jan-2026 10:01:15 EST
Begin processing the 48th record. run: 1409 subRun: 1 event: 9348 at 20-Jan-2026 10:01:22 EST
Begin processing the 49th record. run: 1409 subRun: 1 event: 9349 at 20-Jan-2026 10:01:30 EST
Begin processing the 50th record. run: 1409 subRun: 1 event: 9350 at 20-Jan-2026 10:01:35 EST
Begin processing the 51st record. run: 1409 subRun: 1 event: 9351 at 20-Jan-2026 10:01:40 EST
Begin processing the 52nd record. run: 1409 subRun: 1 event: 9352 at 20-Jan-2026 10:01:45 EST
Begin processing the 53rd record. run: 1409 subRun: 1 event: 9353 at 20-Jan-2026 10:01:50 EST
Begin processing the 54th record. run: 1409 subRun: 1 event: 9354 at 20-Jan-2026 10:01:54 EST
Begin processing the 55th record. run: 1409 subRun: 1 event: 9355 at 20-Jan-2026 10:02:10 EST
Begin processing the 56th record. run: 1409 subRun: 1 event: 9356 at 20-Jan-2026 10:02:15 EST
Begin processing the 57th record. run: 1409 subRun: 1 event: 9357 at 20-Jan-2026 10:03:59 EST
Begin processing the 58th record. run: 1409 subRun: 1 event: 9358 at 20-Jan-2026 10:04:04 EST
Begin processing the 59th record. run: 1409 subRun: 1 event: 9359 at 20-Jan-2026 10:04:10 EST
Begin processing the 60th record. run: 1409 subRun: 1 event: 9360 at 20-Jan-2026 10:04:28 EST
Begin processing the 61st record. run: 1409 subRun: 1 event: 9361 at 20-Jan-2026 10:04:54 EST
Begin processing the 62nd record. run: 1409 subRun: 1 event: 9362 at 20-Jan-2026 10:04:59 EST
Begin processing the 63rd record. run: 1409 subRun: 1 event: 9363 at 20-Jan-2026 10:05:04 EST
Begin processing the 64th record. run: 1409 subRun: 1 event: 9364 at 20-Jan-2026 10:05:09 EST
Begin processing the 65th record. run: 1409 subRun: 1 event: 9365 at 20-Jan-2026 10:05:15 EST
Begin processing the 66th record. run: 1409 subRun: 1 event: 9366 at 20-Jan-2026 10:05:19 EST
Begin processing the 67th record. run: 1409 subRun: 1 event: 9367 at 20-Jan-2026 10:05:26 EST
Begin processing the 68th record. run: 1409 subRun: 1 event: 9368 at 20-Jan-2026 10:05:31 EST
Begin processing the 69th record. run: 1409 subRun: 1 event: 9369 at 20-Jan-2026 10:05:38 EST
Begin processing the 70th record. run: 1409 subRun: 1 event: 9370 at 20-Jan-2026 10:05:45 EST
Begin processing the 71st record. run: 1409 subRun: 1 event: 9371 at 20-Jan-2026 10:05:51 EST
Begin processing the 72nd record. run: 1409 subRun: 1 event: 9372 at 20-Jan-2026 10:05:56 EST
Begin processing the 73rd record. run: 1409 subRun: 1 event: 9373 at 20-Jan-2026 10:06:03 EST
Begin processing the 74th record. run: 1409 subRun: 1 event: 9374 at 20-Jan-2026 10:06:10 EST
Begin processing the 75th record. run: 1409 subRun: 1 event: 9375 at 20-Jan-2026 10:06:21 EST
Begin processing the 76th record. run: 1409 subRun: 1 event: 9376 at 20-Jan-2026 10:06:26 EST
Begin processing the 77th record. run: 1409 subRun: 1 event: 9377 at 20-Jan-2026 10:06:31 EST
Begin processing the 78th record. run: 1409 subRun: 1 event: 9378 at 20-Jan-2026 10:06:46 EST
Begin processing the 79th record. run: 1409 subRun: 1 event: 9379 at 20-Jan-2026 10:06:57 EST
Begin processing the 80th record. run: 1409 subRun: 1 event: 9380 at 20-Jan-2026 10:07:03 EST
Begin processing the 81st record. run: 1409 subRun: 1 event: 9381 at 20-Jan-2026 10:07:09 EST
Begin processing the 82nd record. run: 1409 subRun: 1 event: 9382 at 20-Jan-2026 10:07:57 EST
Begin processing the 83rd record. run: 1409 subRun: 1 event: 9383 at 20-Jan-2026 10:08:03 EST
Begin processing the 84th record. run: 1409 subRun: 1 event: 9384 at 20-Jan-2026 10:08:10 EST
Begin processing the 85th record. run: 1409 subRun: 1 event: 9385 at 20-Jan-2026 10:08:16 EST
Begin processing the 86th record. run: 1409 subRun: 1 event: 9386 at 20-Jan-2026 10:08:23 EST
Begin processing the 87th record. run: 1409 subRun: 1 event: 9387 at 20-Jan-2026 10:08:28 EST
Begin processing the 88th record. run: 1409 subRun: 1 event: 9388 at 20-Jan-2026 10:08:34 EST
Begin processing the 89th record. run: 1409 subRun: 1 event: 9389 at 20-Jan-2026 10:08:40 EST
Begin processing the 90th record. run: 1409 subRun: 1 event: 9390 at 20-Jan-2026 10:08:45 EST
Begin processing the 91st record. run: 1409 subRun: 1 event: 9391 at 20-Jan-2026 10:08:55 EST
Begin processing the 92nd record. run: 1409 subRun: 1 event: 9392 at 20-Jan-2026 10:09:00 EST
Begin processing the 93rd record. run: 1409 subRun: 1 event: 9393 at 20-Jan-2026 10:09:06 EST
Begin processing the 94th record. run: 1409 subRun: 1 event: 9394 at 20-Jan-2026 10:09:14 EST
Begin processing the 95th record. run: 1409 subRun: 1 event: 9395 at 20-Jan-2026 10:09:19 EST
Begin processing the 96th record. run: 1409 subRun: 1 event: 9396 at 20-Jan-2026 10:09:24 EST
Begin processing the 97th record. run: 1409 subRun: 1 event: 9397 at 20-Jan-2026 10:09:30 EST
Begin processing the 98th record. run: 1409 subRun: 1 event: 9398 at 20-Jan-2026 10:09:36 EST
Begin processing the 99th record. run: 1409 subRun: 1 event: 9399 at 20-Jan-2026 10:09:41 EST
Begin processing the 100th record. run: 1409 subRun: 1 event: 9400 at 20-Jan-2026 10:18:46 EST
20-Jan-2026 10:18:52 EST  Closed output file "nue_dune10kt_1x2x6_1409_93_20230826T103316Z_gen_g4_detsim_hitreco__20240221T050654Z_reco2_reco2.root"
20-Jan-2026 10:18:52 EST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/c5/7d/nue_dune10kt_1x2x6_1409_93_20230826T103316Z_gen_g4_detsim_hitreco__20240221T050654Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      0.2557        13.3906       541.974       4.85289       54.6138        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.039248      0.0766186     0.130425      0.0727928     0.0158521       100    
reco:pandora:StandardPandora                    0.18206       13.2882       541.745       4.7565        54.5951        100    
[art]:TriggerResults:TriggerResultInserter    1.9937e-05    4.47202e-05   0.000149525   3.9803e-05    2.09297e-05      100    
end_path:out1:RootOutput                       3.496e-06    6.28963e-06   2.5773e-05    5.7525e-06    2.89918e-06      100    
end_path:out1:RootOutput(write)               0.00202253     0.0253705     0.175379      0.0172655     0.032062        100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2355.7 MB
  Peak resident set size usage (VmHWM): 1335.89 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-04 10:29:38 UTC       justIN version: 01.06.00