justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279414.3@dunegpschedd01.fnal.gov

Jobsub ID279414.3@dunegpschedd01.fnal.gov
Workflow ID11975
Stage ID1
User nameimawby@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-01-16 09:05:11
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2026-01-16 09:46:51
From worker nodeHostnamedunegli-8167448-0-fnpc18001.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-16 09:09:00
Input filesfardet-hd:nue_dune10kt_1x2x6_1435_687_20230828T104432Z_gen_g4_detsim_hitreco__20240221T074016Z_reco2.root
JobscriptExit code0
Real time37m (2253s)
CPU time14m (861s = 38%)
Max RSS bytes1280188416 (1220 MiB)
Outputting started2026-01-16 09:46:33
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/metrics_nue_0/fnal/11975/1/001/Validation_nue_dune10kt_1x2x6_1435_687_20230828T104432Z_gen_g4_detsim_hitreco__20240221T074016Z_reco2.root
Finished2026-01-16 09:46:51
Saved logsjustin-logs:279414.3-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/dd/32/nue_dune10kt_1x2x6_1435_687_20230828T104432Z_gen_g4_detsim_hitreco__20240221T074016Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 26th record. run: 1435 subRun: 1 event: 68726 at 16-Jan-2026 09:35:41 UTC
Begin processing the 27th record. run: 1435 subRun: 1 event: 68727 at 16-Jan-2026 09:35:47 UTC
Begin processing the 28th record. run: 1435 subRun: 1 event: 68728 at 16-Jan-2026 09:35:53 UTC
Begin processing the 29th record. run: 1435 subRun: 1 event: 68729 at 16-Jan-2026 09:36:01 UTC
Begin processing the 30th record. run: 1435 subRun: 1 event: 68730 at 16-Jan-2026 09:36:07 UTC
Begin processing the 31st record. run: 1435 subRun: 1 event: 68731 at 16-Jan-2026 09:36:14 UTC
Begin processing the 32nd record. run: 1435 subRun: 1 event: 68732 at 16-Jan-2026 09:36:19 UTC
Begin processing the 33rd record. run: 1435 subRun: 1 event: 68733 at 16-Jan-2026 09:36:25 UTC
Begin processing the 34th record. run: 1435 subRun: 1 event: 68734 at 16-Jan-2026 09:36:30 UTC
Begin processing the 35th record. run: 1435 subRun: 1 event: 68735 at 16-Jan-2026 09:36:35 UTC
Begin processing the 36th record. run: 1435 subRun: 1 event: 68736 at 16-Jan-2026 09:36:40 UTC
Begin processing the 37th record. run: 1435 subRun: 1 event: 68737 at 16-Jan-2026 09:36:45 UTC
Begin processing the 38th record. run: 1435 subRun: 1 event: 68738 at 16-Jan-2026 09:36:51 UTC
Begin processing the 39th record. run: 1435 subRun: 1 event: 68739 at 16-Jan-2026 09:36:57 UTC
Begin processing the 40th record. run: 1435 subRun: 1 event: 68740 at 16-Jan-2026 09:37:03 UTC
Begin processing the 41st record. run: 1435 subRun: 1 event: 68741 at 16-Jan-2026 09:37:17 UTC
Begin processing the 42nd record. run: 1435 subRun: 1 event: 68742 at 16-Jan-2026 09:37:22 UTC
Begin processing the 43rd record. run: 1435 subRun: 1 event: 68743 at 16-Jan-2026 09:37:27 UTC
Begin processing the 44th record. run: 1435 subRun: 1 event: 68744 at 16-Jan-2026 09:37:34 UTC
Begin processing the 45th record. run: 1435 subRun: 1 event: 68745 at 16-Jan-2026 09:37:39 UTC
Begin processing the 46th record. run: 1435 subRun: 1 event: 68746 at 16-Jan-2026 09:37:44 UTC
Begin processing the 47th record. run: 1435 subRun: 1 event: 68747 at 16-Jan-2026 09:37:49 UTC
Begin processing the 48th record. run: 1435 subRun: 1 event: 68748 at 16-Jan-2026 09:37:55 UTC
Begin processing the 49th record. run: 1435 subRun: 1 event: 68749 at 16-Jan-2026 09:38:00 UTC
Begin processing the 50th record. run: 1435 subRun: 1 event: 68750 at 16-Jan-2026 09:38:08 UTC
Begin processing the 51st record. run: 1435 subRun: 1 event: 68751 at 16-Jan-2026 09:38:13 UTC
Begin processing the 52nd record. run: 1435 subRun: 1 event: 68752 at 16-Jan-2026 09:38:38 UTC
Begin processing the 53rd record. run: 1435 subRun: 1 event: 68753 at 16-Jan-2026 09:38:44 UTC
Begin processing the 54th record. run: 1435 subRun: 1 event: 68754 at 16-Jan-2026 09:38:51 UTC
Begin processing the 55th record. run: 1435 subRun: 1 event: 68755 at 16-Jan-2026 09:38:59 UTC
Begin processing the 56th record. run: 1435 subRun: 1 event: 68756 at 16-Jan-2026 09:39:21 UTC
Begin processing the 57th record. run: 1435 subRun: 1 event: 68757 at 16-Jan-2026 09:39:26 UTC
Begin processing the 58th record. run: 1435 subRun: 1 event: 68758 at 16-Jan-2026 09:39:31 UTC
Begin processing the 59th record. run: 1435 subRun: 1 event: 68759 at 16-Jan-2026 09:39:36 UTC
Begin processing the 60th record. run: 1435 subRun: 1 event: 68760 at 16-Jan-2026 09:39:41 UTC
Begin processing the 61st record. run: 1435 subRun: 1 event: 68761 at 16-Jan-2026 09:39:48 UTC
Begin processing the 62nd record. run: 1435 subRun: 1 event: 68762 at 16-Jan-2026 09:39:53 UTC
Begin processing the 63rd record. run: 1435 subRun: 1 event: 68763 at 16-Jan-2026 09:39:59 UTC
Begin processing the 64th record. run: 1435 subRun: 1 event: 68764 at 16-Jan-2026 09:40:05 UTC
Begin processing the 65th record. run: 1435 subRun: 1 event: 68765 at 16-Jan-2026 09:40:13 UTC
Begin processing the 66th record. run: 1435 subRun: 1 event: 68766 at 16-Jan-2026 09:40:18 UTC
PandoraContentApi::GetList(*this, listName, pList) return STATUS_CODE_NOT_INITIALIZED
    in function: GetList
    in file:     /exp/dune/app/users/imawby/dunesw_validation/srcs/larpandoracontent/larpandoradlcontent/LArTwoDReco/DLThreeDClusterSplittingAlgorithm.cc line#: 194
Begin processing the 67th record. run: 1435 subRun: 1 event: 68767 at 16-Jan-2026 09:40:23 UTC
Begin processing the 68th record. run: 1435 subRun: 1 event: 68768 at 16-Jan-2026 09:40:28 UTC
Begin processing the 69th record. run: 1435 subRun: 1 event: 68769 at 16-Jan-2026 09:40:33 UTC
Begin processing the 70th record. run: 1435 subRun: 1 event: 68770 at 16-Jan-2026 09:41:21 UTC
Begin processing the 71st record. run: 1435 subRun: 1 event: 68771 at 16-Jan-2026 09:41:27 UTC
Begin processing the 72nd record. run: 1435 subRun: 1 event: 68772 at 16-Jan-2026 09:41:33 UTC
Begin processing the 73rd record. run: 1435 subRun: 1 event: 68773 at 16-Jan-2026 09:41:39 UTC
Begin processing the 74th record. run: 1435 subRun: 1 event: 68774 at 16-Jan-2026 09:41:46 UTC
Begin processing the 75th record. run: 1435 subRun: 1 event: 68775 at 16-Jan-2026 09:41:53 UTC
Begin processing the 76th record. run: 1435 subRun: 1 event: 68776 at 16-Jan-2026 09:41:58 UTC
Begin processing the 77th record. run: 1435 subRun: 1 event: 68777 at 16-Jan-2026 09:42:05 UTC
Begin processing the 78th record. run: 1435 subRun: 1 event: 68778 at 16-Jan-2026 09:42:11 UTC
Begin processing the 79th record. run: 1435 subRun: 1 event: 68779 at 16-Jan-2026 09:42:16 UTC
Begin processing the 80th record. run: 1435 subRun: 1 event: 68780 at 16-Jan-2026 09:42:27 UTC
Begin processing the 81st record. run: 1435 subRun: 1 event: 68781 at 16-Jan-2026 09:42:32 UTC
Begin processing the 82nd record. run: 1435 subRun: 1 event: 68782 at 16-Jan-2026 09:42:37 UTC
Begin processing the 83rd record. run: 1435 subRun: 1 event: 68783 at 16-Jan-2026 09:42:42 UTC
Begin processing the 84th record. run: 1435 subRun: 1 event: 68784 at 16-Jan-2026 09:42:47 UTC
Begin processing the 85th record. run: 1435 subRun: 1 event: 68785 at 16-Jan-2026 09:42:53 UTC
Begin processing the 86th record. run: 1435 subRun: 1 event: 68786 at 16-Jan-2026 09:42:59 UTC
Begin processing the 87th record. run: 1435 subRun: 1 event: 68787 at 16-Jan-2026 09:43:43 UTC
Begin processing the 88th record. run: 1435 subRun: 1 event: 68788 at 16-Jan-2026 09:43:49 UTC
Begin processing the 89th record. run: 1435 subRun: 1 event: 68789 at 16-Jan-2026 09:44:13 UTC
Begin processing the 90th record. run: 1435 subRun: 1 event: 68790 at 16-Jan-2026 09:44:18 UTC
Begin processing the 91st record. run: 1435 subRun: 1 event: 68791 at 16-Jan-2026 09:44:28 UTC
Begin processing the 92nd record. run: 1435 subRun: 1 event: 68792 at 16-Jan-2026 09:44:33 UTC
Begin processing the 93rd record. run: 1435 subRun: 1 event: 68793 at 16-Jan-2026 09:45:47 UTC
Begin processing the 94th record. run: 1435 subRun: 1 event: 68794 at 16-Jan-2026 09:45:52 UTC
Begin processing the 95th record. run: 1435 subRun: 1 event: 68795 at 16-Jan-2026 09:45:57 UTC
Begin processing the 96th record. run: 1435 subRun: 1 event: 68796 at 16-Jan-2026 09:46:03 UTC
Begin processing the 97th record. run: 1435 subRun: 1 event: 68797 at 16-Jan-2026 09:46:08 UTC
Begin processing the 98th record. run: 1435 subRun: 1 event: 68798 at 16-Jan-2026 09:46:13 UTC
Begin processing the 99th record. run: 1435 subRun: 1 event: 68799 at 16-Jan-2026 09:46:19 UTC
Begin processing the 100th record. run: 1435 subRun: 1 event: 68800 at 16-Jan-2026 09:46:25 UTC
16-Jan-2026 09:46:32 UTC  Closed output file "nue_dune10kt_1x2x6_1435_687_20230828T104432Z_gen_g4_detsim_hitreco__20240221T074016Z_reco2_reco2.root"
16-Jan-2026 09:46:32 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/dd/32/nue_dune10kt_1x2x6_1435_687_20230828T104432Z_gen_g4_detsim_hitreco__20240221T074016Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      3.72578       7.82396       71.9604       5.38667       9.04582        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00219068     0.0227275     0.184425      0.0178095     0.0234479       100    
reco:pandora:StandardPandora                    3.5401        7.75611       71.7821       5.34003       9.02733        100    
[art]:TriggerResults:TriggerResultInserter    1.8796e-05    5.47128e-05   0.000237628   4.16585e-05   3.09523e-05      100    
end_path:out1:RootOutput                       3.156e-06    5.78738e-06   2.4146e-05    4.6085e-06    2.91419e-06      100    
end_path:out1:RootOutput(write)               0.00245441     0.0447431      0.5245       0.0159719     0.0878561       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2279.96 MB
  Peak resident set size usage (VmHWM): 1280.19 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-04 13:00:31 UTC       justIN version: 01.06.00