Jobsub ID 101241.78@dunegpschedd02.fnal.gov
Jobscript log (last 10,000 characters)
pSlicer 7.1743e-05 0.370678 1.6716 0.286182 0.315148 100
reco:rns:RandomNumberSaver 2.4661e-05 4.09617e-05 0.000467358 3.6586e-05 4.34566e-05 100
reco:anglereconue:NuAngularReco 0.000212789 0.00315142 0.0937032 0.000489695 0.0117594 100
reco:anglereconumu:NuAngularReco 0.000114994 0.00297096 0.0927994 0.000419512 0.0115924 100
reco:anglereconuepfps:NuAngularReco 0.000144926 0.00310415 0.0918641 0.000468439 0.0116467 100
reco:anglereconumupfps:NuAngularReco 0.000135676 0.00302946 0.0933205 0.000485105 0.0116983 100
reco:anglerecohits:NuAngularReco 0.000161686 0.00393369 0.101622 0.000976209 0.0129072 100
[art]:TriggerResults:TriggerResultInserter 1.1611e-05 2.02465e-05 0.000197698 1.73705e-05 1.9526e-05 100
end_path:cafmaker:CAFMaker 0.00157535 0.0350425 0.823996 0.00538234 0.119356 100
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3718.1 MB
Peak resident set size usage (VmHWM): 2037.6 MB
====================================================================================================
%MSG-s ArtException: PostEndJob 23-Sep-2025 07:37:04 -03 ModuleEndJob
---- FileOpenError BEGIN
RootInputFileSequence::initFile(): Input file root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/9c/6f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400837_497_20231202T082908Z_gen_g4_detsim_hitreco__20240507T204957Z_reco2.root was not found or could not be opened.
---- FileOpenError END
%MSG
lar exit code 1
=== Start last 100 lines of lar log file ===
Found hits: 1153!
Begin processing the 94th record. run: 66050399 subRun: 1 event: 28494 at 23-Sep-2025 07:35:24 -03
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 607!
Begin processing the 95th record. run: 66050399 subRun: 1 event: 28495 at 23-Sep-2025 07:35:35 -03
Boundary wire vector sizes: 134, 158, 137
minwire 0: 1483
minwire 1: 1121
minwire 2: 1466
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.613377, 0.00386652, 0.382757,
Output 1: 0.933808, 0.0643624, 0.00174211, 8.75344e-05,
Output 2: 0.476013, 0.50918, 0.0144612, 0.000345855,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2152!
Begin processing the 96th record. run: 66050399 subRun: 1 event: 28496 at 23-Sep-2025 07:35:47 -03
Boundary wire vector sizes: 1339, 999, 1016
minwire 0: 317
minwire 1: 2026
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.98274, 0.00694285, 0.0103175,
Output 1: 0.128673, 0.505654, 0.217051, 0.148622,
Output 2: 0.0744733, 0.286243, 0.389295, 0.249989,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2142!
Begin processing the 97th record. run: 66050399 subRun: 1 event: 28497 at 23-Sep-2025 07:36:08 -03
Boundary wire vector sizes: 272, 177, 211
minwire 0: 609
minwire 1: 1800
minwire 2: 273
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.0532726, 0.00686668, 0.939861,
Output 1: 0.0255461, 0.494109, 0.41082, 0.0695245,
Output 2: 0.0846016, 0.57506, 0.317642, 0.0226965,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1873!
Begin processing the 98th record. run: 66050399 subRun: 1 event: 28498 at 23-Sep-2025 07:36:21 -03
Boundary wire vector sizes: 156, 466, 325
minwire 0: 391
minwire 1: 1546
minwire 2: 14
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.841375, 0.00135199, 0.157273,
Output 1: 0.00654913, 0.987076, 0.00617908, 0.000195454,
Output 2: 0.905659, 0.0923025, 0.00200744, 3.13997e-05,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1664!
Begin processing the 99th record. run: 66050399 subRun: 1 event: 28499 at 23-Sep-2025 07:36:35 -03
Boundary wire vector sizes: 1561, 1553, 1102
minwire 0: 714
minwire 1: 1673
minwire 2: 494
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.996455, 0.000494966, 0.0030499,
Output 1: 0.406598, 0.359913, 0.12994, 0.103548,
Output 2: 0.433493, 0.391282, 0.139619, 0.0356056,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2663!
Begin processing the 100th record. run: 66050399 subRun: 1 event: 28500 at 23-Sep-2025 07:36:55 -03
PandoraContentApi::GetList(*this, m_inputHitListName, pCaloHitList) return STATUS_CODE_NOT_INITIALIZED
in function: GetVolumeIdToHitListMap
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/ALMA9/build/larpandoracontent/v04_16_00-buildFW/src/larpandoracontent/LArControlFlow/MasterAlgorithm.cc line#: 271
this->GetVolumeIdToHitListMap(volumeIdToHitListMap) return STATUS_CODE_NOT_INITIALIZED
in function: Run
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/ALMA9/build/larpandoracontent/v04_16_00-buildFW/src/larpandoracontent/LArControlFlow/MasterAlgorithm.cc line#: 165
iter->second->Run() throw STATUS_CODE_NOT_INITIALIZED
in function: RunAlgorithm
in file: /scratch/workspace/build-larbase/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/SLF7/build/pandora/v03_16_00l/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0003, LArDLMaster, STATUS_CODE_NOT_INITIALIZED
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 0!
Art has completed and will exit with status 1.
=== End last 100 lines of lar log file ===
processed files
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/fb/7f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66050399_284_20231207T200521Z_gen_g4_detsim_hitreco__20240510T042609Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/9c/6f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400837_497_20231202T082908Z_gen_g4_detsim_hitreco__20240507T204957Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/05/0b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50253389_410_20231120T135309Z_gen_g4_detsim_hitreco__20240503T063239Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/e8/94/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_955_20231202T173147Z_gen_g4_detsim_hitreco__20240507T210821Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/3d/37/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481120_475_20231201T132611Z_gen_g4_detsim_hitreco__20240507T194733Z_reco2.root
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/b5/46/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74525168_411_20231206T230320Z_gen_g4_detsim_hitreco__20240510T063057Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/1f/d2/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50607041_726_20231207T044605Z_gen_g4_detsim_hitreco__20240510T060652Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/2c/e8/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_563_20231207T091439Z_gen_g4_detsim_hitreco__20240510T040550Z_reco2.root
root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/44/2f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6454800_260_20231207T100857Z_gen_g4_detsim_hitreco__20240510T045952Z_reco2.root
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/85/16/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74518431_1183_20231205T013905Z_gen_g4_detsim_hitreco__20240510T023707Z_reco2.root
.:
total 5996
-rw-r--r-- 1 nobody nobody 2332224 Sep 23 07:37 flatcaf.root
-rw-r--r-- 1 nobody nobody 1829097 Sep 23 07:37 caf.root
-rw-r--r-- 1 nobody nobody 1829097 Sep 23 07:37 caf_fd_hd_atmo_3301_20250923T100621Z.root
-rw-r--r-- 1 nobody nobody 72899 Sep 23 07:37 caf_20250923T100621Z.log
-rw-r--r-- 1 nobody nobody 39042 Sep 23 07:37 jobscript.log
-rw-r--r-- 1 nobody nobody 1962 Sep 23 07:37 caf_20250923T100621Z.file
-rw-r--r-- 1 nobody nobody 1962 Sep 23 07:37 caf_20250923T100621Z.pfns
-rw-r--r-- 1 nobody nobody 1962 Sep 23 07:06 file.list
-rw-r--r-- 1 nobody nobody 1962 Sep 23 07:37 justin-processed-pfns.txt
-rw-r--r-- 1 nobody nobody 1378 Sep 23 07:06 all-input-dids.txt
-rw-r--r-- 1 nobody nobody 1378 Sep 23 07:37 caf_20250923T100621Z.did
-rw-r--r-- 1 nobody nobody 1378 Sep 23 07:06 did.list
-rw-r--r-- 1 nobody nobody 0 Sep 23 07:06 debugprod.log 