justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262088.0@dunegpschedd02.fnal.gov

Jobsub ID262088.0@dunegpschedd02.fnal.gov
Workflow ID11172
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 08:52:26
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-13 16:50:10
From worker nodeHostnamedunegli-8047012-0-fnpc17109.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 08:54:15
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T201632Z_gen_002656_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (28544s)
CPU time7h (28261s = 99%)
Max RSS bytes2799374336 (2669 MiB)
Outputting started2025-12-13 16:49:59
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11172/1/001/analysisLowE_20251213T085416Z.root
Finished2025-12-13 16:50:10
Saved logsjustin-logs:262088.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

r:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 16:48:57 UTC run: 5026 subRun: 0 event: 26560
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 16:48:57 UTC run: 5026 subRun: 0 event: 26560
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6743, 6707, 6571
minwire 0: 42
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0945372, 
Output 1: 0.0677688, 0.0675754, 0.167198, 0.697457, 
Output 2: 0.0473337, 0.17605, 0.757942, 0.0186745, 
Output 3: 0.948723, 0.0390473, 0.00492097, 0.007309, 
Output 4: 0.307344, 0.596037, 0.0875996, 0.00901941, 
Output 5: 0.594267, 0.337701, 0.0564524, 0.011579, 
Output 6: 0.0204278, 0.0670365, 0.0774099, 0.835126, 

13-Dec-2025 16:49:00 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 16:49:00 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/f6/77/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T201632Z_gen_002656_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1441.26       2826.3        3578.8        3230.92       744.575        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000861753    0.0053878     0.0213111    0.00169801    0.00691298       10     
reco:pandora:StandardPandora                            1439.59       2823.56       3575.99       3228.8        743.829        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.0488739     0.0973218     0.151851      0.085656      0.0345505       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00205517    0.00667179     0.0295193     0.0035493    0.00796571       10     
reco:pandoracalo:Calorimetry                          0.000449649   0.00128022    0.00628949    0.000733004   0.00167565       10     
reco:pandorapid:Chi2ParticleID                        0.000108487   0.00037669    0.00223716    0.000156768   0.000622027      10     
reco:cvnmap:CVNMapper                                  0.0845251     0.130345      0.222715      0.120409      0.0397598       10     
reco:cvneva:CVNEvaluator                               0.960623       1.83825       5.63722       1.50698       1.30466        10     
reco:energyrecnumu:EnergyReco                          0.0637357      0.11494      0.211225      0.113347      0.0393845       10     
reco:energyrecnue:EnergyReco                          0.00137635    0.00291961    0.00412806    0.00327502    0.000860392      10     
reco:energyrecnc:EnergyReco                           0.00802069     0.0127224     0.0155329     0.0138241    0.00257839       10     
[art]:TriggerResults:TriggerResultInserter            1.7159e-05    4.09752e-05   0.000114784   3.62095e-05   2.64872e-05      10     
end_path:out1:RootOutput                                6.7e-06     1.36255e-05   3.4363e-05    1.1446e-05    7.22535e-06      10     
end_path:out1:RootOutput(write)                        0.338667      0.530794      0.636883      0.591197      0.119268        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 14057.5 MB
  Peak resident set size usage (VmHWM): 2799.37 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 143.887 | hit correction : 1.43383
hit initial : 127.728 | hit correction : 1.43376
hit initial : 291.62 | hit correction : 1.43449
hit initial : 47.0575 | hit correction : 1.43464
hit initial : 237.348 | hit correction : 1.434
hit initial : 56.0142 | hit correction : 1.43479
hit initial : 220.615 | hit correction : 1.43441
hit initial : 150.218 | hit correction : 1.43499
hit initial : 140.952 | hit correction : 1.43542
hit initial : 185.502 | hit correction : 1.43595
hit initial : 211.77 | hit correction : 1.4367
hit initial : 253.675 | hit correction : 1.43766
hit initial : 227.478 | hit correction : 1.43823
hit initial : 44.0454 | hit correction : 1.43829
 *** Total Charge : 3428.42
 Looking at view: 2 | Number of hits in view: 15
Begin processing the 10th record. run: 5026 subRun: 0 event: 26560 at 13-Dec-2025 16:49:54 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  48
Added hit list length: 48 | Max was set to: -3.40282e+38
This pfp has size:  11
True Neutron Energy: 939.573
True Neutron Energy: 941.518
True Electron Energy: 37.1951
Completed MCParticle Loop
True Neutrino Energy: 54.4877
 Size of all hits: 48
hit initial : 34.2681 | hit correction : 1.4577
hit initial : 105.846 | hit correction : 1.45774
hit initial : 30.5183 | hit correction : 1.45679
hit initial : 166.898 | hit correction : 1.45781
hit initial : 51.2633 | hit correction : 1.45787
hit initial : 56.4483 | hit correction : 1.45604
hit initial : 326.119 | hit correction : 1.45602
hit initial : 103.816 | hit correction : 1.45547
hit initial : 112.527 | hit correction : 1.45467
hit initial : 208.796 | hit correction : 1.45443
hit initial : 190.981 | hit correction : 1.45397
hit initial : 200.748 | hit correction : 1.45357
hit initial : 194.006 | hit correction : 1.45319
hit initial : 332.741 | hit correction : 1.45275
hit initial : 20.8673 | hit correction : 1.45212
hit initial : 360.821 | hit correction : 1.45267
hit initial : 283.628 | hit correction : 1.45266
hit initial : 212.998 | hit correction : 1.45254
 *** Total Charge : 4352.9
 Looking at view: 0 | Number of hits in view: 18
hit initial : 30.8858 | hit correction : 1.45879
hit initial : 23.4899 | hit correction : 1.45882
hit initial : 52.7067 | hit correction : 1.45787
hit initial : 52.0614 | hit correction : 1.45677
hit initial : 141.821 | hit correction : 1.45784
hit initial : 254.596 | hit correction : 1.45655
hit initial : 151.821 | hit correction : 1.45768
hit initial : 320.336 | hit correction : 1.45576
hit initial : 301.866 | hit correction : 1.45496
hit initial : 244.106 | hit correction : 1.45429
hit initial : 227.979 | hit correction : 1.45375
hit initial : 254.67 | hit correction : 1.45325
hit initial : 400.773 | hit correction : 1.45279
hit initial : 390.489 | hit correction : 1.45268
hit initial : 240.975 | hit correction : 1.45266
hit initial : 173.981 | hit correction : 1.45253
 *** Total Charge : 4745.21
 Looking at view: 1 | Number of hits in view: 16
hit initial : 33.8309 | hit correction : 1.44942
hit initial : 14.7294 | hit correction : 1.44956
hit initial : 21.5871 | hit correction : 1.45873
hit initial : 138.249 | hit correction : 1.4579
hit initial : 204.935 | hit correction : 1.45769
hit initial : 31.997 | hit correction : 1.45642
hit initial : 413.985 | hit correction : 1.45614
hit initial : 32.5893 | hit correction : 1.45555
hit initial : 575.313 | hit correction : 1.45459
hit initial : 718.615 | hit correction : 1.45312
hit initial : 25.6787 | hit correction : 1.45217
hit initial : 766.59 | hit correction : 1.45268
hit initial : 107.589 | hit correction : 1.45271
hit initial : 195.267 | hit correction : 1.45233
 *** Total Charge : 4770.88
 Looking at view: 2 | Number of hits in view: 14
13-Dec-2025 16:49:58 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0958498     0.207789       1.0552       0.111888      0.282874        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000365801   0.00910574     0.0868262    0.000487873    0.0259069       10     
end_path:ana:AnalyzeEvents         0.0952323     0.198527      0.967926      0.111302      0.256908        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11954.8 MB
  Peak resident set size usage (VmHWM): 1532.45 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:04:54 UTC       justIN version: 01.06.00