Jobsub ID 40043.109@dunegpschedd02.fnal.gov
Jobscript log (last 10,000 characters)
759e-05 0.274543 1.13841 0.211563 0.237548 900
reco:rns:RandomNumberSaver 1.924e-05 4.29987e-05 0.000662466 3.5465e-05 4.32763e-05 900
reco:anglereconue:NuAngularReco 0.000150479 0.00183976 0.0743628 0.000436963 0.0062156 900
reco:anglereconumu:NuAngularReco 6.943e-05 0.00160996 0.0735329 0.000252693 0.0060826 900
reco:anglereconuepfps:NuAngularReco 0.000111699 0.00172019 0.074745 0.000370072 0.00609651 900
reco:anglereconumupfps:NuAngularReco 0.00010122 0.00168809 0.0737639 0.000325218 0.00616296 900
reco:anglerecohits:NuAngularReco 9.639e-05 0.00240668 0.0819227 0.000809915 0.00690007 900
[art]:TriggerResults:TriggerResultInserter 8.711e-06 1.52377e-05 0.000266639 1.37845e-05 1.09263e-05 900
end_path:cafmaker:CAFMaker 0.00120779 0.0229908 0.962414 0.00552323 0.0756935 900
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3814.73 MB
Peak resident set size usage (VmHWM): 2088.2 MB
====================================================================================================
%MSG-s ArtException: PostEndJob 15-Sep-2025 10:26:21 PDT ModuleEndJob
---- FileOpenError BEGIN
RootInputFileSequence::initFile(): Input file root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/3d/61/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74530544_132_20231207T005943Z_gen_g4_detsim_hitreco__20240510T033356Z_reco2.root was not found or could not be opened.
---- FileOpenError END
%MSG
lar exit code 1
=== Start last 100 lines of lar log file ===
minwire 2: 731
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.000900111, 0.986606, 0.0124941,
Output 1: 0.140028, 0.849098, 0.0104458, 0.000428516,
Output 2: 0.998139, 0.00180892, 4.99805e-05, 2.44648e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1491!
Begin processing the 894th record. run: 6416859 subRun: 1 event: 101494 at 15-Sep-2025 10:25:18 PDT
Boundary wire vector sizes: 72, 178, 99
minwire 0: 1768
minwire 1: 268
minwire 2: 2056
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.0231017, 0.00226649, 0.974632,
Output 1: 0.0390565, 0.129501, 0.725189, 0.106254,
Output 2: 0.974287, 0.0241213, 0.00152436, 6.69659e-05,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1230!
Begin processing the 895th record. run: 6416859 subRun: 1 event: 101495 at 15-Sep-2025 10:25:27 PDT
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 850!
Begin processing the 896th record. run: 6416859 subRun: 1 event: 101496 at 15-Sep-2025 10:25:34 PDT
Boundary wire vector sizes: 135, 160, 147
minwire 0: 1178
minwire 1: 1844
minwire 2: 978
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.00664115, 0.00117322, 0.992186,
Output 1: 0.0485594, 0.104811, 0.831037, 0.0155931,
Output 2: 0.951505, 0.0447695, 0.00365165, 7.41082e-05,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2525!
Begin processing the 897th record. run: 6416859 subRun: 1 event: 101497 at 15-Sep-2025 10:25:43 PDT
Boundary wire vector sizes: 2825, 2321, 794
minwire 0: 1841
minwire 1: 248
minwire 2: 1950
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.002132, 0.985404, 0.012464,
Output 1: 0.642502, 0.333832, 0.019402, 0.00426373,
Output 2: 0.0730298, 0.354037, 0.409534, 0.163399,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2822!
Begin processing the 898th record. run: 6416859 subRun: 1 event: 101498 at 15-Sep-2025 10:26:01 PDT
PandoraContentApi::GetList(*this, m_inputHitListName, pCaloHitList) return STATUS_CODE_NOT_INITIALIZED
in function: GetVolumeIdToHitListMap
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/ALMA9/build/larpandoracontent/v04_16_00-buildFW/src/larpandoracontent/LArControlFlow/MasterAlgorithm.cc line#: 271
this->GetVolumeIdToHitListMap(volumeIdToHitListMap) return STATUS_CODE_NOT_INITIALIZED
in function: Run
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/ALMA9/build/larpandoracontent/v04_16_00-buildFW/src/larpandoracontent/LArControlFlow/MasterAlgorithm.cc line#: 165
iter->second->Run() throw STATUS_CODE_NOT_INITIALIZED
in function: RunAlgorithm
in file: /scratch/workspace/build-larbase/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/SLF7/build/pandora/v03_16_00l/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0003, LArDLMaster, STATUS_CODE_NOT_INITIALIZED
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 20!
Begin processing the 899th record. run: 6416859 subRun: 1 event: 101499 at 15-Sep-2025 10:26:06 PDT
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 369!
Begin processing the 900th record. run: 6416859 subRun: 1 event: 101500 at 15-Sep-2025 10:26:13 PDT
Boundary wire vector sizes: 61, 62, 46
minwire 0: 2276
minwire 1: 543
minwire 2: 1950
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max wires due to vertex determination failure: 343, 642
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.203127, 0.560814, 0.236059,
Output 1: 0.930822, 0.0673473, 0.00168536, 0.000145127,
Output 2: 0.927373, 0.0709183, 0.00162103, 8.80528e-05,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1136!
Art has completed and will exit with status 1.
=== End last 100 lines of lar log file ===
processed files
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/69/14/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6491894_529_20231208T005944Z_gen_g4_detsim_hitreco__20240510T031208Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/35/9a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492179_778_20231208T050848Z_gen_g4_detsim_hitreco__20240510T042532Z_reco2.root
root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/63/f1/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419113_918_20231203T161624Z_gen_g4_detsim_hitreco__20240508T060431Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/39/d1/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50261805_185_20231122T104238Z_gen_g4_detsim_hitreco__20240503T055714Z_reco2.root
root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/f3/e2/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74508011_26_20231203T024950Z_gen_g4_detsim_hitreco__20240508T074324Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/fc/00/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6374820_464_20231201T090556Z_gen_g4_detsim_hitreco__20240507T203436Z_reco2.root
root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c7/59/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_475_20231202T160843Z_gen_g4_detsim_hitreco__20240508T041736Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/77/9b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_966_20231204T140427Z_gen_g4_detsim_hitreco__20240509T204113Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/89/02/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6416859_1014_20231203T084721Z_gen_g4_detsim_hitreco__20240509T201930Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/3d/61/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74530544_132_20231207T005943Z_gen_g4_detsim_hitreco__20240510T033356Z_reco2.root
.:
total 42540
-rw-r--r--. 1 cuser cuser 15988754 Sep 15 10:26 flatcaf.root
-rw-r--r--. 1 cuser cuser 13365082 Sep 15 10:26 caf.root
-rw-r--r--. 1 cuser cuser 13365082 Sep 15 10:26 caf_fd_hd_atmo_2501_20250915T142643Z.root
-rw-r--r--. 1 cuser cuser 530491 Sep 15 10:26 caf_20250915T142643Z.log
-rw-r--r--. 1 cuser cuser 210681 Sep 15 10:26 jobscript.log
-rw-r--r--. 1 cuser cuser 1913 Sep 15 10:26 caf_20250915T142643Z.file
-rw-r--r--. 1 cuser cuser 1913 Sep 15 10:26 caf_20250915T142643Z.pfns
-rw-r--r--. 1 cuser cuser 1913 Sep 15 07:26 file.list
-rw-r--r--. 1 cuser cuser 1913 Sep 15 10:26 justin-processed-pfns.txt
-rw-r--r--. 1 cuser cuser 1375 Sep 15 07:26 all-input-dids.txt
-rw-r--r--. 1 cuser cuser 1375 Sep 15 10:26 caf_20250915T142643Z.did
-rw-r--r--. 1 cuser cuser 1375 Sep 15 07:26 did.list
-rw-r--r--. 1 cuser cuser 0 Sep 15 07:26 debugprod.log 