Jobsub ID 96384.105@dunegpschedd02.fnal.gov
Jobscript log (last 10,000 characters)
66 0.192878 200
reco:opflash:OpFlashFinder 0.000180858 0.00165469 0.00503546 0.00161293 0.00076923 200
reco:opslicer:OpSlicer 6.8863e-05 0.344232 1.15215 0.303239 0.272769 200
reco:rns:RandomNumberSaver 2.5121e-05 3.91179e-05 0.000437229 3.6507e-05 2.91094e-05 200
reco:anglereconue:NuAngularReco 0.00022643 0.00147141 0.0355769 0.000458094 0.00357854 200
reco:anglereconumu:NuAngularReco 0.000129796 0.0013075 0.0348238 0.000294047 0.00353458 200
reco:anglereconuepfps:NuAngularReco 0.000172478 0.00143951 0.0360015 0.000431378 0.00360117 200
reco:anglereconumupfps:NuAngularReco 0.000175088 0.00141252 0.0372996 0.000396462 0.00366978 200
reco:anglerecohits:NuAngularReco 0.000160147 0.00215985 0.0413932 0.000879383 0.00421049 200
[art]:TriggerResults:TriggerResultInserter 1.1141e-05 1.79989e-05 6.1142e-05 1.7226e-05 5.55749e-06 200
end_path:cafmaker:CAFMaker 0.00152939 0.0188228 0.460143 0.00459566 0.0482255 200
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3651.12 MB
Peak resident set size usage (VmHWM): 1958.52 MB
====================================================================================================
%MSG-s ArtException: PostEndJob 23-Sep-2025 06:42:39 -03 ModuleEndJob
---- FileOpenError BEGIN
---- FatalRootError BEGIN
Fatal Root Error: TNetXNGFile::Open
[FATAL] Connection error
ROOT severity: 3000
---- FatalRootError END
RootInputFileSequence::initFile(): Input file root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/e4/31/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6467376_519_20231207T072645Z_gen_g4_detsim_hitreco__20240510T053559Z_reco2.root was not found or could not be opened.
---- FileOpenError END
%MSG
lar exit code 1
=== Start last 100 lines of lar log file ===
minwire 2: 2654
Used alternate method to get min and max wires due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max wires due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max wires due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.0159967, 0.00929093, 0.974712,
Output 1: 0.169257, 0.824971, 0.00553006, 0.000241685,
Output 2: 0.989707, 0.00987834, 0.00039702, 1.80365e-05,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 685!
Begin processing the 195th record. run: 74552530 subRun: 1 event: 79995 at 23-Sep-2025 06:37:37 -03
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 323!
Begin processing the 196th record. run: 74552530 subRun: 1 event: 79996 at 23-Sep-2025 06:37:45 -03
Boundary wire vector sizes: 144, 166, 100
minwire 0: 118
minwire 1: 2286
minwire 2: 18
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.000871004, 0.995775, 0.00335369,
Output 1: 0.00727634, 0.157803, 0.804377, 0.0305438,
Output 2: 0.98561, 0.0136264, 0.00074681, 1.72233e-05,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 859!
Begin processing the 197th record. run: 74552530 subRun: 1 event: 79997 at 23-Sep-2025 06:37:53 -03
Boundary wire vector sizes: 34, 33, 40
minwire 0: 1856
minwire 1: 838
minwire 2: 2031
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.00796134, 0.00232455, 0.989714,
Output 1: 0.130302, 0.864085, 0.00540602, 0.000207301,
Output 2: 0.996342, 0.00350397, 0.000146789, 7.67338e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1117!
Begin processing the 198th record. run: 74552530 subRun: 1 event: 79998 at 23-Sep-2025 06:38:02 -03
Boundary wire vector sizes: 164, 35, 117
minwire 0: 1651
minwire 1: 1109
minwire 2: 1740
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.992978, 0.000836314, 0.0061861,
Output 1: 0.0143834, 0.982304, 0.00322673, 8.58452e-05,
Output 2: 0.99454, 0.00533475, 0.000122406, 2.55702e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1558!
Begin processing the 199th record. run: 74552530 subRun: 1 event: 79999 at 23-Sep-2025 06:38:11 -03
Boundary wire vector sizes: 189, 216, 168
minwire 0: 2629
minwire 1: 806
minwire 2: 2460
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.000727094, 0.998021, 0.00125219,
Output 1: 0.00293723, 0.993244, 0.00370322, 0.000115599,
Output 2: 0.997564, 0.00236554, 6.82691e-05, 2.15347e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1725!
Begin processing the 200th record. run: 74552530 subRun: 1 event: 80000 at 23-Sep-2025 06:38:20 -03
Boundary wire vector sizes: 657, 751, 821
minwire 0: 1362
minwire 1: 1640
minwire 2: 725
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.990945, 0.000980869, 0.00807464,
Output 1: 0.00716282, 0.987712, 0.00499635, 0.000128724,
Output 2: 0.992358, 0.00744209, 0.000195405, 4.93815e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2755!
Art has completed and will exit with status 1.
=== End last 100 lines of lar log file ===
processed files
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/df/13/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66009532_81_20231203T223110Z_gen_g4_detsim_hitreco__20240509T210851Z_reco2.root
root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0a/4a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74552530_799_20231207T121223Z_gen_g4_detsim_hitreco__20240510T060132Z_reco2.root
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/e4/31/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6467376_519_20231207T072645Z_gen_g4_detsim_hitreco__20240510T053559Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/03/11/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74496296_410_20231201T212730Z_gen_g4_detsim_hitreco__20240508T045746Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/0e/13/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6411871_1143_20231203T125621Z_gen_g4_detsim_hitreco__20240509T192948Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/d7/75/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515286_30_20231201T132642Z_gen_g4_detsim_hitreco__20240507T190630Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/ad/7f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1500_238_20231028T090451Z_gen_g4_detsim_hitreco__20240503T051359Z_reco2.root
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/8f/c3/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6464269_622_20231207T033946Z_gen_g4_detsim_hitreco__20240510T042754Z_reco2.root
root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/07/b9/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6220954_299_20231122T085103Z_gen_g4_detsim_hitreco__20240503T065912Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/bc/15/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6420853_848_20231204T040238Z_gen_g4_detsim_hitreco__20240509T211321Z_reco2.root
.:
total 7680
-rw-r--r-- 1 nobody nobody 2972834 Sep 23 06:42 flatcaf.root
-rw-r--r-- 1 nobody nobody 2338816 Sep 23 06:42 caf.root
-rw-r--r-- 1 nobody nobody 2338816 Sep 23 06:42 caf_fd_hd_atmo_3301_20250923T090144Z.root
-rw-r--r-- 1 nobody nobody 130906 Sep 23 06:42 caf_20250923T090144Z.log
-rw-r--r-- 1 nobody nobody 52225 Sep 23 06:42 jobscript.log
-rw-r--r-- 1 nobody nobody 1974 Sep 23 06:42 caf_20250923T090144Z.file
-rw-r--r-- 1 nobody nobody 1974 Sep 23 06:42 caf_20250923T090144Z.pfns
-rw-r--r-- 1 nobody nobody 1974 Sep 23 06:01 file.list
-rw-r--r-- 1 nobody nobody 1974 Sep 23 06:42 justin-processed-pfns.txt
-rw-r--r-- 1 nobody nobody 1370 Sep 23 06:01 all-input-dids.txt
-rw-r--r-- 1 nobody nobody 1370 Sep 23 06:42 caf_20250923T090144Z.did
-rw-r--r-- 1 nobody nobody 1370 Sep 23 06:01 did.list
-rw-r--r-- 1 nobody nobody 0 Sep 23 06:02 debugprod.log 