Jobsub ID 46151.28@dunegpschedd02.fnal.gov
Jobscript log (last 10,000 characters)
eco:ophitspe:OpHitFinderDeco 1.76568 1.80205 1.86191 1.77816 0.0366543 200
reco:opflash:OpFlashFinder 0.000231059 0.00179173 0.0218948 0.00163934 0.00161512 200
reco:opslicer:OpSlicer 6.7133e-05 0.363297 1.50584 0.296574 0.282145 200
reco:rns:RandomNumberSaver 2.3801e-05 4.01049e-05 0.000443998 3.6672e-05 3.07471e-05 200
reco:anglereconue:NuAngularReco 0.000200128 0.00200452 0.104007 0.000499976 0.00806912 200
reco:anglereconumu:NuAngularReco 0.000112105 0.00185052 0.103364 0.000356795 0.00803606 200
reco:anglereconuepfps:NuAngularReco 0.000162646 0.00196583 0.103522 0.00047461 0.00799599 200
reco:anglereconumupfps:NuAngularReco 0.000153676 0.00193627 0.103264 0.000446693 0.00797541 200
reco:anglerecohits:NuAngularReco 0.000130136 0.00271921 0.113284 0.000942248 0.00884658 200
[art]:TriggerResults:TriggerResultInserter 1.117e-05 1.78092e-05 6.0873e-05 1.6901e-05 5.96456e-06 200
end_path:cafmaker:CAFMaker 0.00149142 0.0256485 1.29198 0.00553042 0.101664 200
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3762.39 MB
Peak resident set size usage (VmHWM): 2083.13 MB
====================================================================================================
%MSG-s ArtException: PostEndJob 22-Sep-2025 17:09:41 -03 ModuleEndJob
---- FileOpenError BEGIN
---- FatalRootError BEGIN
Fatal Root Error: TNetXNGFile::Open
[FATAL] Connection error
ROOT severity: 3000
---- FatalRootError END
RootInputFileSequence::initFile(): Input file root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/81/41/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6396715_41_20231202T013554Z_gen_g4_detsim_hitreco__20240507T202036Z_reco2.root was not found or could not be opened.
---- FileOpenError END
%MSG
lar exit code 1
=== Start last 100 lines of lar log file ===
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1985!
Begin processing the 195th record. run: 50572032 subRun: 1 event: 75795 at 22-Sep-2025 17:06:31 -03
Boundary wire vector sizes: 368, 517, 382
minwire 0: 2789
minwire 1: 423
minwire 2: 2565
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.0133895, 0.764378, 0.222233,
Output 1: 0.0643323, 0.225149, 0.385097, 0.325422,
Output 2: 0.464075, 0.394082, 0.117165, 0.0246785,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1838!
Begin processing the 196th record. run: 50572032 subRun: 1 event: 75796 at 22-Sep-2025 17:06:42 -03
Boundary wire vector sizes: 418, 125, 313
minwire 0: 1878
minwire 1: 890
minwire 2: 1859
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.995137, 0.000386155, 0.00447732,
Output 1: 0.0893683, 0.828296, 0.0763891, 0.00594673,
Output 2: 0.984219, 0.0150463, 0.000702997, 3.14514e-05,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1756!
Begin processing the 197th record. run: 50572032 subRun: 1 event: 75797 at 22-Sep-2025 17:06:54 -03
Boundary wire vector sizes: 61, 87, 66
minwire 0: 1809
minwire 1: 709
minwire 2: 1795
Used alternate method to get min and max wires due to vertex determination failure: 195, 494
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.891522, 0.0011081, 0.10737,
Output 1: 0.969336, 0.0298214, 0.000775744, 6.65365e-05,
Output 2: 0.913028, 0.0854412, 0.00145681, 7.37195e-05,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1329!
Begin processing the 198th record. run: 50572032 subRun: 1 event: 75798 at 22-Sep-2025 17:07:05 -03
Boundary wire vector sizes: 611, 735, 479
minwire 0: 2383
minwire 1: 619
minwire 2: 2155
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.0306992, 0.537792, 0.431509,
Output 1: 0.255333, 0.486109, 0.191848, 0.0667101,
Output 2: 0.278355, 0.460304, 0.20567, 0.0556715,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2272!
Begin processing the 199th record. run: 50572032 subRun: 1 event: 75799 at 22-Sep-2025 17:07:17 -03
Boundary wire vector sizes: 299, 950, 450
minwire 0: 1818
minwire 1: 659
minwire 2: 1802
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.996924, 0.000364188, 0.00271198,
Output 1: 0.548338, 0.320658, 0.0863324, 0.0446714,
Output 2: 0.889353, 0.100337, 0.00915346, 0.00115611,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2135!
Begin processing the 200th record. run: 50572032 subRun: 1 event: 75800 at 22-Sep-2025 17:07:29 -03
Boundary wire vector sizes: 126, 113, 55
minwire 0: 1294
minwire 1: 1674
minwire 2: 982
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.992034, 0.000675222, 0.00729113,
Output 1: 0.311025, 0.67759, 0.0109371, 0.000448494,
Output 2: 0.99159, 0.0082066, 0.000196934, 6.80643e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1761!
Art has completed and will exit with status 1.
=== End last 100 lines of lar log file ===
processed files
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/90/d9/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6491894_177_20231208T001352Z_gen_g4_detsim_hitreco__20240510T064244Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/77/2d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50572032_757_20231203T065826Z_gen_g4_detsim_hitreco__20240508T080253Z_reco2.root
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/81/41/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6396715_41_20231202T013554Z_gen_g4_detsim_hitreco__20240507T202036Z_reco2.root
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/2d/3f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_283_20231202T093407Z_gen_g4_detsim_hitreco__20240507T212851Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/d0/63/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6210996_454_20231121T155459Z_gen_g4_detsim_hitreco__20240507T181503Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/c7/85/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6468412_571_20231207T080126Z_gen_g4_detsim_hitreco__20240510T061922Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/ff/78/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74508011_348_20231203T035723Z_gen_g4_detsim_hitreco__20240508T074140Z_reco2.root
root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/d3/33/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50538503_106_20231201T170131Z_gen_g4_detsim_hitreco__20240507T191042Z_reco2.root
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/97/df/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_388_20231202T170925Z_gen_g4_detsim_hitreco__20240507T204733Z_reco2.root
root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/ad/d3/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65840069_274_20231121T154256Z_gen_g4_detsim_hitreco__20240503T065746Z_reco2.root
.:
total 9572
-rw-r--r-- 1 nobody nobody 3669885 Sep 22 17:09 flatcaf.root
-rw-r--r-- 1 nobody nobody 2946760 Sep 22 17:09 caf.root
-rw-r--r-- 1 nobody nobody 2946760 Sep 22 17:09 caf_fd_hd_atmo_3301_20250922T191213Z.root
-rw-r--r-- 1 nobody nobody 142078 Sep 22 17:09 caf_20250922T191213Z.log
-rw-r--r-- 1 nobody nobody 55621 Sep 22 17:09 jobscript.log
-rw-r--r-- 1 nobody nobody 2020 Sep 22 17:09 caf_20250922T191213Z.file
-rw-r--r-- 1 nobody nobody 2020 Sep 22 17:09 caf_20250922T191213Z.pfns
-rw-r--r-- 1 nobody nobody 2020 Sep 22 16:12 file.list
-rw-r--r-- 1 nobody nobody 2020 Sep 22 17:09 justin-processed-pfns.txt
-rw-r--r-- 1 nobody nobody 1374 Sep 22 16:12 all-input-dids.txt
-rw-r--r-- 1 nobody nobody 1374 Sep 22 17:09 caf_20250922T191213Z.did
-rw-r--r-- 1 nobody nobody 1374 Sep 22 16:12 did.list
-rw-r--r-- 1 nobody nobody 0 Sep 22 16:12 debugprod.log 