Jobsub ID 99158.89@dunegpschedd02.fnal.gov
Jobscript log (last 10,000 characters)
4629 0.16077 500
reco:opflash:OpFlashFinder 0.000296443 0.00177036 0.00733221 0.00167294 0.000810261 500
reco:opslicer:OpSlicer 0.000536593 0.378984 1.52981 0.293004 0.304763 500
reco:rns:RandomNumberSaver 2.5941e-05 3.85091e-05 0.000527423 3.67615e-05 2.30833e-05 500
reco:anglereconue:NuAngularReco 0.000218589 0.00204515 0.148355 0.000544003 0.00779134 500
reco:anglereconumu:NuAngularReco 0.000122336 0.00190395 0.151595 0.000393903 0.00795384 500
reco:anglereconuepfps:NuAngularReco 0.000176978 0.00201888 0.150263 0.000505997 0.00790281 500
reco:anglereconumupfps:NuAngularReco 0.000168407 0.00197756 0.147453 0.000478246 0.00775096 500
reco:anglerecohits:NuAngularReco 0.000136796 0.00275524 0.150205 0.00101861 0.00821473 500
[art]:TriggerResults:TriggerResultInserter 1.1231e-05 1.825e-05 7.7053e-05 1.74155e-05 5.94013e-06 500
end_path:cafmaker:CAFMaker 0.00149759 0.0243659 1.66092 0.00580741 0.0893345 500
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3751.42 MB
Peak resident set size usage (VmHWM): 2069.13 MB
====================================================================================================
%MSG-s ArtException: PostEndJob 23-Sep-2025 08:26:40 -03 ModuleEndJob
---- FileOpenError BEGIN
---- FatalRootError BEGIN
Fatal Root Error: TNetXNGFile::Open
[FATAL] Connection error
ROOT severity: 3000
---- FatalRootError END
RootInputFileSequence::initFile(): Input file root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/f9/4f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50542214_905_20231201T230316Z_gen_g4_detsim_hitreco__20240507T204358Z_reco2.root was not found or could not be opened.
---- FileOpenError END
%MSG
lar exit code 1
=== Start last 100 lines of lar log file ===
minwire 2: 2711
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.99389, 0.000661602, 0.00544802,
Output 1: 0.32334, 0.673757, 0.00273849, 0.00016411,
Output 2: 0.994536, 0.00528734, 0.00016763, 8.68429e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 824!
Begin processing the 495th record. run: 74540126 subRun: 1 event: 2095 at 23-Sep-2025 08:23:03 -03
Boundary wire vector sizes: 265, 238, 237
minwire 0: 2693
minwire 1: 355
minwire 2: 2812
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.477951, 0.281569, 0.24048,
Output 1: 0.0414282, 0.886959, 0.0685047, 0.00310769,
Output 2: 0.571425, 0.424455, 0.00409251, 2.78186e-05,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1080!
Begin processing the 496th record. run: 74540126 subRun: 1 event: 2096 at 23-Sep-2025 08:23:14 -03
Boundary wire vector sizes: 58, 83, 71
minwire 0: 1403
minwire 1: 1762
minwire 2: 1191
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.289929, 0.697829, 0.0122422,
Output 1: 0.00722956, 0.990111, 0.00259695, 6.21907e-05,
Output 2: 0.992732, 0.00701054, 0.000247926, 9.04897e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1152!
Begin processing the 497th record. run: 74540126 subRun: 1 event: 2097 at 23-Sep-2025 08:23:25 -03
Boundary wire vector sizes: 221, 112, 154
minwire 0: 1884
minwire 1: 843
minwire 2: 2026
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.000818086, 0.994342, 0.00484024,
Output 1: 0.0434281, 0.916059, 0.0388422, 0.00167128,
Output 2: 0.991573, 0.00817838, 0.000240111, 8.09297e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1430!
Begin processing the 498th record. run: 74540126 subRun: 1 event: 2098 at 23-Sep-2025 08:23:36 -03
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 815!
Begin processing the 499th record. run: 74540126 subRun: 1 event: 2099 at 23-Sep-2025 08:23:45 -03
Boundary wire vector sizes: 119, 106, 82
minwire 0: 1167
minwire 1: 2250
minwire 2: 740
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.000365948, 0.998334, 0.00129979,
Output 1: 0.0160683, 0.978553, 0.00521444, 0.000164424,
Output 2: 0.99863, 0.00132368, 4.46288e-05, 1.48964e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1668!
Begin processing the 500th record. run: 74540126 subRun: 1 event: 2100 at 23-Sep-2025 08:23:56 -03
Boundary wire vector sizes: 35, 35, 34
minwire 0: 891
minwire 1: 1543
minwire 2: 903
Used alternate method to get min and max wires due to vertex determination failure: 4, 303
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max wires due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max wires due to vertex determination failure: 89, 388
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.00852214, 0.00388732, 0.987591,
Output 1: 0.881146, 0.117579, 0.0011579, 0.000117725,
Output 2: 0.997504, 0.00242964, 6.12218e-05, 5.46962e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1049!
Art has completed and will exit with status 1.
=== End last 100 lines of lar log file ===
processed files
root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/df/a5/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66050399_371_20231207T200558Z_gen_g4_detsim_hitreco__20240510T042647Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/2e/09/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6470038_705_20231208T014550Z_gen_g4_detsim_hitreco__20240510T031844Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/fc/5d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50584512_840_20231204T075343Z_gen_g4_detsim_hitreco__20240509T220044Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/52/51/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50584512_526_20231204T071354Z_gen_g4_detsim_hitreco__20240509T215946Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/da/ed/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74540126_20_20231207T042627Z_gen_g4_detsim_hitreco__20240510T052953Z_reco2.root
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/f9/4f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50542214_905_20231201T230316Z_gen_g4_detsim_hitreco__20240507T204358Z_reco2.root
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/b6/b3/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_205_20231204T051048Z_gen_g4_detsim_hitreco__20240509T212750Z_reco2.root
root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/cf/6a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_196_20231202T101049Z_gen_g4_detsim_hitreco__20240507T210747Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/d0/f8/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6470038_602_20231208T004816Z_gen_g4_detsim_hitreco__20240510T031329Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/fd/9e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6470038_711_20231208T014557Z_gen_g4_detsim_hitreco__20240510T031830Z_reco2.root
.:
total 22116
-rw-r--r-- 1 nobody nobody 8345472 Sep 23 08:26 flatcaf.root
-rw-r--r-- 1 nobody nobody 6902822 Sep 23 08:26 caf.root
-rw-r--r-- 1 nobody nobody 6902822 Sep 23 08:26 caf_fd_hd_atmo_3301_20250923T093835Z.root
-rw-r--r-- 1 nobody nobody 314126 Sep 23 08:26 caf_20250923T093835Z.log
-rw-r--r-- 1 nobody nobody 121838 Sep 23 08:26 jobscript.log
-rw-r--r-- 1 nobody nobody 1989 Sep 23 08:26 caf_20250923T093835Z.file
-rw-r--r-- 1 nobody nobody 1989 Sep 23 08:26 caf_20250923T093835Z.pfns
-rw-r--r-- 1 nobody nobody 1989 Sep 23 06:38 file.list
-rw-r--r-- 1 nobody nobody 1989 Sep 23 08:26 justin-processed-pfns.txt
-rw-r--r-- 1 nobody nobody 1375 Sep 23 06:38 all-input-dids.txt
-rw-r--r-- 1 nobody nobody 1375 Sep 23 08:26 caf_20250923T093835Z.did
-rw-r--r-- 1 nobody nobody 1375 Sep 23 06:38 did.list
-rw-r--r-- 1 nobody nobody 0 Sep 23 06:38 debugprod.log 