Jobsub ID 46606.2@dunegpschedd01.fnal.gov
Jobscript log (last 10,000 characters)
800
reco:rns:RandomNumberSaver 2.0692e-05 3.20389e-05 0.000383051 2.95955e-05 1.39716e-05 800
reco:anglereconue:NuAngularReco 0.000183309 0.00191219 0.0892833 0.000428797 0.00603882 800
reco:anglereconumu:NuAngularReco 0.000109667 0.00175273 0.0873704 0.000264859 0.00599043 800
reco:anglereconuepfps:NuAngularReco 0.000160266 0.00186444 0.0879269 0.000366758 0.00602259 800
reco:anglereconumupfps:NuAngularReco 0.000149088 0.00185936 0.0870941 0.000339123 0.0060355 800
reco:anglerecohits:NuAngularReco 0.000121441 0.00246702 0.0922401 0.000780078 0.00655743 800
[art]:TriggerResults:TriggerResultInserter 1.3307e-05 1.58466e-05 6.679e-05 1.52015e-05 2.59854e-06 800
end_path:cafmaker:CAFMaker 0.00142414 0.023279 1.02961 0.00513861 0.0706321 800
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3658.4 MB
Peak resident set size usage (VmHWM): 1990.98 MB
====================================================================================================
%MSG-s ArtException: PostEndJob 15-Sep-2025 15:13:48 BST ModuleEndJob
---- FileOpenError BEGIN
RootInputFileSequence::initFile(): Input file root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/09/dc/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50604274_730_20231207T031744Z_gen_g4_detsim_hitreco__20240510T050721Z_reco2.root was not found or could not be opened.
---- FileOpenError END
%MSG
lar exit code 1
=== Start last 100 lines of lar log file ===
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.000308141, 0.998605, 0.00108686,
Output 1: 0.0143977, 0.960995, 0.0237208, 0.000886716,
Output 2: 0.99729, 0.00261607, 9.12468e-05, 2.79279e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2930!
Begin processing the 794th record. run: 66020489 subRun: 1 event: 22394 at 15-Sep-2025 15:13:23 BST
Boundary wire vector sizes: 75, 72, 58
minwire 0: 1795
minwire 1: 1509
minwire 2: 1320
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max wires due to vertex determination failure: 225, 524
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.000407239, 0.996222, 0.00337086,
Output 1: 0.0962598, 0.898167, 0.00539001, 0.000182613,
Output 2: 0.999108, 0.000860316, 3.06285e-05, 1.29238e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1440!
Begin processing the 795th record. run: 66020489 subRun: 1 event: 22395 at 15-Sep-2025 15:13:27 BST
Boundary wire vector sizes: 97, 111, 97
minwire 0: 902
minwire 1: 1500
minwire 2: 674
Used alternate method to get min and max wires due to vertex determination failure: 42, 341
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.00296588, 0.00144515, 0.995589,
Output 1: 0.337596, 0.650782, 0.0111747, 0.000447436,
Output 2: 0.977384, 0.0218408, 0.000749483, 2.52334e-05,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1651!
Begin processing the 796th record. run: 66020489 subRun: 1 event: 22396 at 15-Sep-2025 15:13:31 BST
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 803!
Begin processing the 797th record. run: 66020489 subRun: 1 event: 22397 at 15-Sep-2025 15:13:34 BST
Boundary wire vector sizes: 138, 125, 36
minwire 0: 1188
minwire 1: 2314
minwire 2: 712
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max wires due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.993746, 0.000618008, 0.00563556,
Output 1: 0.180513, 0.814455, 0.00488047, 0.000151481,
Output 2: 0.994312, 0.00557093, 0.00011408, 3.15031e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1573!
Begin processing the 798th record. run: 66020489 subRun: 1 event: 22398 at 15-Sep-2025 15:13:38 BST
PandoraContentApi::GetList(*this, m_inputHitListName, pCaloHitList) return STATUS_CODE_NOT_INITIALIZED
in function: GetVolumeIdToHitListMap
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/ALMA9/build/larpandoracontent/v04_16_00-buildFW/src/larpandoracontent/LArControlFlow/MasterAlgorithm.cc line#: 271
this->GetVolumeIdToHitListMap(volumeIdToHitListMap) return STATUS_CODE_NOT_INITIALIZED
in function: Run
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/ALMA9/build/larpandoracontent/v04_16_00-buildFW/src/larpandoracontent/LArControlFlow/MasterAlgorithm.cc line#: 165
iter->second->Run() throw STATUS_CODE_NOT_INITIALIZED
in function: RunAlgorithm
in file: /scratch/workspace/build-larbase/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/SLF7/build/pandora/v03_16_00l/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0003, LArDLMaster, STATUS_CODE_NOT_INITIALIZED
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 0!
Begin processing the 799th record. run: 66020489 subRun: 1 event: 22399 at 15-Sep-2025 15:13:40 BST
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 186!
Begin processing the 800th record. run: 66020489 subRun: 1 event: 22400 at 15-Sep-2025 15:13:43 BST
Boundary wire vector sizes: 107, 91, 62
minwire 0: 1857
minwire 1: 1424
minwire 2: 1569
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.0420302, 0.010704, 0.947266,
Output 1: 0.11454, 0.4391, 0.382686, 0.0636748,
Output 2: 0.0403526, 0.922199, 0.0369988, 0.000449706,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2253!
Art has completed and will exit with status 1.
=== End last 100 lines of lar log file ===
processed files
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/0a/e1/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574864_129_20231203T151354Z_gen_g4_detsim_hitreco__20240508T025014Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/20/53/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50601160_1030_20231205T055358Z_gen_g4_detsim_hitreco__20240509T222242Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/c6/37/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6467222_180_20231207T035611Z_gen_g4_detsim_hitreco__20240510T043646Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/96/f6/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_1172_20231204T050534Z_gen_g4_detsim_hitreco__20240509T203447Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/f4/a5/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50542963_861_20231202T063747Z_gen_g4_detsim_hitreco__20240507T194716Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/5f/94/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419113_1113_20231203T163139Z_gen_g4_detsim_hitreco__20240508T052412Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/2a/7b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50642276_49_20231208T004444Z_gen_g4_detsim_hitreco__20240510T064146Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/b4/be/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66020489_223_20231205T020756Z_gen_g4_detsim_hitreco__20240509T222750Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/09/dc/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50604274_730_20231207T031744Z_gen_g4_detsim_hitreco__20240510T050721Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/84/83/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_773_20231207T004702Z_gen_g4_detsim_hitreco__20240510T033741Z_reco2.root
.:
total 34296
-rw-r--r--. 1 dune001 dune 12895079 Sep 15 15:13 flatcaf.root
-rw-r--r--. 1 dune001 dune 10751695 Sep 15 15:13 caf.root
-rw-r--r--. 1 dune001 dune 10751695 Sep 15 15:13 caf_fd_hd_atmo_2501_20250915T124944Z.root
-rw-r--r--. 1 dune001 dune 496139 Sep 15 15:13 caf_20250915T124944Z.log
-rw-r--r--. 1 dune001 dune 175429 Sep 15 15:13 jobscript.log
-rw-r--r--. 1 dune001 dune 1869 Sep 15 15:13 caf_20250915T124944Z.file
-rw-r--r--. 1 dune001 dune 1869 Sep 15 15:13 caf_20250915T124944Z.pfns
-rw-r--r--. 1 dune001 dune 1869 Sep 15 13:49 file.list
-rw-r--r--. 1 dune001 dune 1869 Sep 15 15:13 justin-processed-pfns.txt
-rw-r--r--. 1 dune001 dune 1379 Sep 15 13:49 all-input-dids.txt
-rw-r--r--. 1 dune001 dune 1379 Sep 15 15:13 caf_20250915T124944Z.did
-rw-r--r--. 1 dune001 dune 1379 Sep 15 13:49 did.list
-rw-r--r--. 1 dune001 dune 0 Sep 15 13:50 debugprod.log 