Jobsub ID 95113.74@dunegpschedd02.fnal.gov
Jobscript log (last 10,000 characters)
1.76649 1.82578 1.96299 1.84758 0.0372905 300
reco:opflash:OpFlashFinder 0.000211557 0.00173378 0.00451971 0.00168 0.000735015 300
reco:opslicer:OpSlicer 8.4073e-05 0.368346 1.44119 0.312674 0.292739 300
reco:rns:RandomNumberSaver 2.3201e-05 3.92296e-05 0.000485518 3.6616e-05 2.71793e-05 300
reco:anglereconue:NuAngularReco 0.000191667 0.00184266 0.0386287 0.000541144 0.00465957 300
reco:anglereconumu:NuAngularReco 0.000109984 0.00170409 0.0382052 0.000380419 0.00469306 300
reco:anglereconuepfps:NuAngularReco 0.000153576 0.00180851 0.0380003 0.000502028 0.00465758 300
reco:anglereconumupfps:NuAngularReco 0.000143195 0.00178089 0.0383784 0.000463002 0.0046573 300
reco:anglerecohits:NuAngularReco 0.000141405 0.00260648 0.0455302 0.0010102 0.00546847 300
[art]:TriggerResults:TriggerResultInserter 1.138e-05 1.78309e-05 7.0322e-05 1.70155e-05 5.95572e-06 300
end_path:cafmaker:CAFMaker 0.00145151 0.0233113 0.520748 0.00585676 0.0625078 300
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3834.9 MB
Peak resident set size usage (VmHWM): 2135.74 MB
====================================================================================================
%MSG-s ArtException: PostEndJob 23-Sep-2025 06:51:28 -03 ModuleEndJob
---- FileOpenError BEGIN
---- FatalRootError BEGIN
Fatal Root Error: TNetXNGFile::Open
[FATAL] Connection error
ROOT severity: 3000
---- FatalRootError END
RootInputFileSequence::initFile(): Input file root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/98/41/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74551443_446_20231207T112220Z_gen_g4_detsim_hitreco__20240510T053549Z_reco2.root was not found or could not be opened.
---- FileOpenError END
%MSG
lar exit code 1
=== Start last 100 lines of lar log file ===
Boundary wire vector sizes: 46, 45, 38
minwire 0: 1824
minwire 1: 508
minwire 2: 1531
Used alternate method to get min and max wires due to vertex determination failure: 182, 481
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max wires due to vertex determination failure: 905, 1204
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max wires due to vertex determination failure: 17, 316
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.00379092, 0.00212704, 0.994082,
Output 1: 0.857308, 0.141678, 0.000891859, 0.000121967,
Output 2: 0.999013, 0.000956889, 2.72594e-05, 3.09304e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1549!
Begin processing the 296th record. run: 50584512 subRun: 1 event: 60896 at 23-Sep-2025 06:48:01 -03
Boundary wire vector sizes: 188, 206, 187
minwire 0: 2414
minwire 1: 414
minwire 2: 2522
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.000403102, 0.997516, 0.00208126,
Output 1: 0.0135817, 0.767009, 0.21296, 0.00644911,
Output 2: 0.978281, 0.0209997, 0.00070435, 1.44334e-05,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1349!
Begin processing the 297th record. run: 50584512 subRun: 1 event: 60897 at 23-Sep-2025 06:48:12 -03
Boundary wire vector sizes: 270, 280, 203
minwire 0: 2598
minwire 1: 527
minwire 2: 2546
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.430504, 0.0593218, 0.510174,
Output 1: 0.0123363, 0.728296, 0.254553, 0.00481477,
Output 2: 0.0132415, 0.289946, 0.643211, 0.0536014,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1528!
Begin processing the 298th record. run: 50584512 subRun: 1 event: 60898 at 23-Sep-2025 06:48:22 -03
Boundary wire vector sizes: 904, 515, 699
minwire 0: 1192
minwire 1: 726
minwire 2: 1432
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.996946, 0.000577441, 0.00247628,
Output 1: 0.00602437, 0.990422, 0.00347361, 8.04731e-05,
Output 2: 0.996108, 0.00381238, 7.79633e-05, 1.53805e-06,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1659!
Begin processing the 299th record. run: 50584512 subRun: 1 event: 60899 at 23-Sep-2025 06:48:34 -03
Boundary wire vector sizes: 81, 46, 54
minwire 0: 494
minwire 1: 2022
minwire 2: 356
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max wires due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.0128988, 0.00573496, 0.981366,
Output 1: 0.121528, 0.790117, 0.0790273, 0.00932816,
Output 2: 0.0346314, 0.954437, 0.0108643, 6.69171e-05,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 979!
Begin processing the 300th record. run: 50584512 subRun: 1 event: 60900 at 23-Sep-2025 06:48:44 -03
Boundary wire vector sizes: 2423, 2043, 1350
minwire 0: 1531
minwire 1: 367
minwire 2: 1372
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary:
Output 0: 0.448024, 0.247396, 0.30458,
Output 1: 0.55942, 0.355968, 0.0548212, 0.0297905,
Output 2: 0.0293017, 0.151479, 0.300532, 0.518687,
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2653!
Art has completed and will exit with status 1.
=== End last 100 lines of lar log file ===
processed files
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/a2/e5/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74576447_584_20231208T042908Z_gen_g4_detsim_hitreco__20240510T051007Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/a9/15/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6456061_543_20231207T125742Z_gen_g4_detsim_hitreco__20240510T055310Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/21/f9/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50584512_608_20231204T074643Z_gen_g4_detsim_hitreco__20240509T215504Z_reco2.root
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/98/41/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74551443_446_20231207T112220Z_gen_g4_detsim_hitreco__20240510T053549Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/cd/a2/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74553259_65_20231207T130622Z_gen_g4_detsim_hitreco__20240510T063602Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/1d/38/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_559_20231207T003552Z_gen_g4_detsim_hitreco__20240510T031305Z_reco2.root
root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/40/60/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66027687_377_20231207T000848Z_gen_g4_detsim_hitreco__20240510T061211Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/de/62/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6447068_454_20231205T121218Z_gen_g4_detsim_hitreco__20240510T060811Z_reco2.root
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/52/82/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74494002_426_20231201T170131Z_gen_g4_detsim_hitreco__20240507T195148Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/90/86/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74511302_94_20231203T125045Z_gen_g4_detsim_hitreco__20240508T030955Z_reco2.root
.:
total 14020
-rw-r--r-- 1 nobody nobody 5295026 Sep 23 06:51 flatcaf.root
-rw-r--r-- 1 nobody nobody 4342580 Sep 23 06:51 caf.root
-rw-r--r-- 1 nobody nobody 4342580 Sep 23 06:51 caf_fd_hd_atmo_3301_20250923T084453Z.root
-rw-r--r-- 1 nobody nobody 192534 Sep 23 06:51 caf_20250923T084453Z.log
-rw-r--r-- 1 nobody nobody 86067 Sep 23 06:51 jobscript.log
-rw-r--r-- 1 nobody nobody 1949 Sep 23 06:51 caf_20250923T084453Z.file
-rw-r--r-- 1 nobody nobody 1949 Sep 23 06:51 caf_20250923T084453Z.pfns
-rw-r--r-- 1 nobody nobody 1949 Sep 23 05:44 file.list
-rw-r--r-- 1 nobody nobody 1949 Sep 23 06:51 justin-processed-pfns.txt
-rw-r--r-- 1 nobody nobody 1375 Sep 23 05:44 all-input-dids.txt
-rw-r--r-- 1 nobody nobody 1375 Sep 23 06:51 caf_20250923T084453Z.did
-rw-r--r-- 1 nobody nobody 1375 Sep 23 05:44 did.list
-rw-r--r-- 1 nobody nobody 0 Sep 23 05:45 debugprod.log 