Jobsub ID 103647.22@dunegpschedd02.fnal.gov
Jobscript log (last 10,000 characters)
900
reco:ophitspe:OpHitFinderDeco 1.41415 1.58662 1.87086 1.51087 0.16107 900
reco:opflash:OpFlashFinder 0.00022433 0.0017349 0.00985524 0.00167609 0.000837744 900
reco:opslicer:OpSlicer 7.1103e-05 0.361639 1.64876 0.288248 0.298074 900
reco:rns:RandomNumberSaver 2.4011e-05 3.82319e-05 0.000470331 3.6992e-05 1.67306e-05 900
reco:anglereconue:NuAngularReco 0.000204229 0.00244664 0.124282 0.000516182 0.00924502 900
reco:anglereconumu:NuAngularReco 0.000103864 0.00227131 0.119872 0.000366551 0.00920655 900
reco:anglereconuepfps:NuAngularReco 0.000161867 0.00238422 0.11721 0.000469276 0.00920146 900
reco:anglereconumupfps:NuAngularReco 0.000160027 0.00235114 0.119388 0.000445299 0.00904987 900
reco:anglerecohits:NuAngularReco 0.000129995 0.00318985 0.129897 0.000984603 0.0100216 900
[art]:TriggerResults:TriggerResultInserter 1.068e-05 1.77005e-05 6.2183e-05 1.70655e-05 5.2999e-06 900
end_path:cafmaker:CAFMaker 0.0015155 0.0290747 1.58443 0.00546976 0.111644 900
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3793.4 MB
Peak resident set size usage (VmHWM): 2112.98 MB
====================================================================================================
%MSG-s ArtException: PostEndJob 23-Sep-2025 11:13:53 -03 ModuleEndJob
---- FileOpenError BEGIN
---- FatalRootError BEGIN
Fatal Root Error: TNetXNGFile::Open
[FATAL] Socket timeout
ROOT severity: 3000
---- FatalRootError END
RootInputFileSequence::initFile(): Input file root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/b2/91/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50584512_959_20231204T075739Z_gen_g4_detsim_hitreco__20240509T220542Z_reco2.root was not found or could not be opened.
---- FileOpenError END
%MSG
lar exit code 1
=== Start last 100 lines of lar log file ===
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.000444103, 0.996962, 0.00259333,
Output 1: 0.00381106, 0.990568, 0.00545107, 0.000170347,
Output 2: 0.997241, 0.0026908, 6.57642e-05, 1.92712e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 660!
Begin processing the 891st record. run: 6398928 subRun: 1 event: 83591 at 23-Sep-2025 11:04:39 -03
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 836!
Begin processing the 892nd record. run: 6398928 subRun: 1 event: 83592 at 23-Sep-2025 11:04:48 -03
Boundary wire vector sizes: 129, 425, 222
minwire 0: 1438
minwire 1: 980
minwire 2: 1509
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.997134, 0.000546777, 0.00231888,
Output 1: 0.0170273, 0.968826, 0.0137811, 0.000365475,
Output 2: 0.997957, 0.0019798, 6.18374e-05, 1.3971e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1627!
Begin processing the 893rd record. run: 6398928 subRun: 1 event: 83593 at 23-Sep-2025 11:04:59 -03
Boundary wire vector sizes: 101, 73, 82
minwire 0: 613
minwire 1: 1665
minwire 2: 683
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.000698907, 0.995682, 0.00361955,
Output 1: 0.140432, 0.847105, 0.011983, 0.000480019,
Output 2: 0.996576, 0.00334282, 7.86199e-05, 2.71768e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 809!
Begin processing the 894th record. run: 6398928 subRun: 1 event: 83594 at 23-Sep-2025 11:05:09 -03
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 437!
Begin processing the 895th record. run: 6398928 subRun: 1 event: 83595 at 23-Sep-2025 11:05:18 -03
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 850!
Begin processing the 896th record. run: 6398928 subRun: 1 event: 83596 at 23-Sep-2025 11:05:27 -03
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1561!
Begin processing the 897th record. run: 6398928 subRun: 1 event: 83597 at 23-Sep-2025 11:05:37 -03
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 94!
Begin processing the 898th record. run: 6398928 subRun: 1 event: 83598 at 23-Sep-2025 11:05:46 -03
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1175!
Begin processing the 899th record. run: 6398928 subRun: 1 event: 83599 at 23-Sep-2025 11:05:56 -03
Boundary wire vector sizes: 272, 322, 193
minwire 0: 2997
minwire 1: 630
minwire 2: 2743
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.00545988, 0.985712, 0.0088281,
Output 1: 0.0439069, 0.79642, 0.151585, 0.008088,
Output 2: 0.461826, 0.530605, 0.00751446, 5.38438e-05,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1642!
Begin processing the 900th record. run: 6398928 subRun: 1 event: 83600 at 23-Sep-2025 11:06:06 -03
Boundary wire vector sizes: 543, 485, 548
minwire 0: 63
minwire 1: 2150
minwire 2: 11
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.0808454, 0.709451, 0.209704,
Output 1: 0.332627, 0.630734, 0.0354462, 0.00119312,
Output 2: 0.0718032, 0.766578, 0.15458, 0.00703847,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1228!
Art has completed and will exit with status 1.
=== End last 100 lines of lar log file ===
processed files
root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/3d/37/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481120_475_20231201T132611Z_gen_g4_detsim_hitreco__20240507T194733Z_reco2.root
root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/91/f6/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6171714_169_20231126T014222Z_gen_g4_detsim_hitreco__20240507T182817Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/2c/e8/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_563_20231207T091439Z_gen_g4_detsim_hitreco__20240510T040550Z_reco2.root
root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/62/6f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400837_720_20231202T084547Z_gen_g4_detsim_hitreco__20240507T205530Z_reco2.root
root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/c9/24/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419624_1172_20231204T031956Z_gen_g4_detsim_hitreco__20240509T212700Z_reco2.root
root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/6d/ca/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74505548_828_20231202T144050Z_gen_g4_detsim_hitreco__20240508T055920Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/d1/a7/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6447068_198_20231205T102848Z_gen_g4_detsim_hitreco__20240510T055042Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/86/80/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6398928_835_20231202T071711Z_gen_g4_detsim_hitreco__20240507T204624Z_reco2.root
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/b2/91/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50584512_959_20231204T075739Z_gen_g4_detsim_hitreco__20240509T220542Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/81/64/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66029763_185_20231207T030911Z_gen_g4_detsim_hitreco__20240510T023321Z_reco2.root
.:
total 41208
-rw-r--r-- 1 nobody nobody 15480067 Sep 23 11:13 flatcaf.root
-rw-r--r-- 1 nobody nobody 12935123 Sep 23 11:13 caf.root
-rw-r--r-- 1 nobody nobody 12935123 Sep 23 11:13 caf_fd_hd_atmo_3301_20250923T104005Z.root
-rw-r--r-- 1 nobody nobody 535019 Sep 23 11:13 caf_20250923T104005Z.log
-rw-r--r-- 1 nobody nobody 216687 Sep 23 11:13 jobscript.log
-rw-r--r-- 1 nobody nobody 2037 Sep 23 11:13 caf_20250923T104005Z.file
-rw-r--r-- 1 nobody nobody 2037 Sep 23 11:13 caf_20250923T104005Z.pfns
-rw-r--r-- 1 nobody nobody 2037 Sep 23 07:40 file.list
-rw-r--r-- 1 nobody nobody 2037 Sep 23 11:13 justin-processed-pfns.txt
-rw-r--r-- 1 nobody nobody 1375 Sep 23 07:40 all-input-dids.txt
-rw-r--r-- 1 nobody nobody 1375 Sep 23 11:13 caf_20250923T104005Z.did
-rw-r--r-- 1 nobody nobody 1375 Sep 23 07:40 did.list
-rw-r--r-- 1 nobody nobody 0 Sep 23 07:40 debugprod.log 