justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267054.2@dunegpschedd01.fnal.gov

Jobsub ID267054.2@dunegpschedd01.fnal.gov
Workflow ID11091
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:22:39
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 02:55:58
From worker nodeHostnamedunegli-7877382-0-fnpc19128.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:23:52
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T190816Z_gen_001901_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (16294s)
CPU time4h (16152s = 99%)
Max RSS bytes2877681664 (2744 MiB)
Outputting started2025-12-12 02:55:26
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11091/1/001/analysisLowE_20251211T222353Z.root
Finished2025-12-12 02:55:58
Saved logsjustin-logs:267054.2-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ut 4: 0.33109, 0.619859, 0.0461489, 0.00290168, 
Output 5: 0.716685, 0.246888, 0.0296247, 0.00680217, 
Output 6: 0.0208236, 0.0534976, 0.0619454, 0.863733, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 19010 at 12-Dec-2025 02:24:16 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 02:54:10 UTC run: 5026 subRun: 0 event: 19010
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6802, 6760, 6722
minwire 0: 49
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 158, 657
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.113707, 
Output 1: 0.0442313, 0.0668014, 0.120538, 0.768429, 
Output 2: 0.0678258, 0.26856, 0.622784, 0.0408298, 
Output 3: 0.959255, 0.024099, 0.0053111, 0.0113351, 
Output 4: 0.445993, 0.46855, 0.0770646, 0.0083932, 
Output 5: 0.727767, 0.228637, 0.035796, 0.00779953, 
Output 6: 0.0125297, 0.0364803, 0.0538894, 0.897101, 

12-Dec-2025 02:54:13 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 02:54:13 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/06/9e/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T190816Z_gen_001901_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1380.8        1612.78       1941.04       1553.1        168.178        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00174515    0.00743969     0.0227518    0.00500672    0.00614634       10     
reco:pandora:StandardPandora                            1377.25       1610.89       1939.03       1551.76       168.357        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00119018     0.020613      0.0895042    0.00751941     0.0274018       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000268804   0.00721565     0.0320177    0.00427883    0.00878846       10     
reco:pandoracalo:Calorimetry                          0.000282883   0.00474971     0.0210795     0.0017407    0.00623278       10     
reco:pandorapid:Chi2ParticleID                        6.1881e-05    0.00024615    0.00102351    0.000133627   0.000273207      10     
reco:cvnmap:CVNMapper                                  0.0285503     0.0362124     0.0509496     0.0348227     0.0075572       10     
reco:cvneva:CVNEvaluator                               0.843718       1.31715       2.83445       1.31996      0.549714        10     
reco:energyrecnumu:EnergyReco                         0.00364178     0.052215      0.139504      0.0500062     0.0454027       10     
reco:energyrecnue:EnergyReco                          0.000899321   0.00360823    0.00739257    0.00149402    0.00296693       10     
reco:energyrecnc:EnergyReco                           0.00695411     0.0494927     0.140709      0.0387107     0.0458789       10     
[art]:TriggerResults:TriggerResultInserter             1.022e-05    1.90833e-05   5.8991e-05    1.46205e-05   1.3626e-05       10     
end_path:out1:RootOutput                                 7e-06      1.0305e-05     2.518e-05     7.595e-06    5.45048e-06      10     
end_path:out1:RootOutput(write)                        0.317408      0.384668      0.483457      0.363974      0.0521314       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21779.3 MB
  Peak resident set size usage (VmHWM): 2877.68 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
Number of reconstructed particles:  2
True Neutron Energy: 939.685
True Electron Energy: 46.5386
Completed MCParticle Loop
True Neutrino Energy: 55.6232
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 19009 at 12-Dec-2025 02:55:17 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  38
Added hit list length: 38 | Max was set to: -3.40282e+38
True Electron Energy: 34.8571
Completed MCParticle Loop
True Neutrino Energy: 50.3624
 Size of all hits: 38
hit initial : 19.1895 | hit correction : 1.06145
hit initial : 33.1159 | hit correction : 1.0614
hit initial : 275.503 | hit correction : 1.06375
hit initial : 307.65 | hit correction : 1.06388
hit initial : 276.024 | hit correction : 1.06348
hit initial : 141.561 | hit correction : 1.06126
hit initial : 370.602 | hit correction : 1.06356
hit initial : 257.348 | hit correction : 1.06127
hit initial : 218.547 | hit correction : 1.06361
hit initial : 77.6934 | hit correction : 1.06126
hit initial : 124.36 | hit correction : 1.06493
hit initial : 336.627 | hit correction : 1.06401
hit initial : 98.6837 | hit correction : 1.06514
hit initial : 338.8 | hit correction : 1.06453
hit initial : 52.5349 | hit correction : 1.06348
hit initial : 63.705 | hit correction : 1.06511
hit initial : 60.9609 | hit correction : 1.06457
hit initial : 17.7386 | hit correction : 1.06347
hit initial : 304.15 | hit correction : 1.06383
 *** Total Charge : 3589.28
 Looking at view: 0 | Number of hits in view: 19
hit initial : 45.1004 | hit correction : 1.06504
hit initial : 242.277 | hit correction : 1.06492
hit initial : 57.9287 | hit correction : 1.06515
hit initial : 359.088 | hit correction : 1.06432
hit initial : 17.8684 | hit correction : 1.06347
hit initial : 288.307 | hit correction : 1.06349
hit initial : 36.0117 | hit correction : 1.06407
hit initial : 139.694 | hit correction : 1.06399
hit initial : 221.449 | hit correction : 1.06388
hit initial : 264.322 | hit correction : 1.06367
hit initial : 422.999 | hit correction : 1.06389
hit initial : 354.823 | hit correction : 1.06367
hit initial : 280.988 | hit correction : 1.06351
 *** Total Charge : 2905.51
 Looking at view: 1 | Number of hits in view: 13
hit initial : 175.554 | hit correction : 1.06481
hit initial : 869.431 | hit correction : 1.06351
hit initial : 976.571 | hit correction : 1.06437
hit initial : 143.225 | hit correction : 1.06405
hit initial : 294.363 | hit correction : 1.06375
hit initial : 181.875 | hit correction : 1.06392
 *** Total Charge : 2810.04
 Looking at view: 2 | Number of hits in view: 6
Begin processing the 10th record. run: 5026 subRun: 0 event: 19010 at 12-Dec-2025 02:55:21 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  9
Added hit list length: 9 | Max was set to: -3.40282e+38
True Neutron Energy: 939.568
True Electron Energy: 6.06514
Completed MCParticle Loop
True Neutrino Energy: 11.8276
 Size of all hits: 9
hit initial : 42.7455 | hit correction : 1.19712
hit initial : 123.742 | hit correction : 1.19689
hit initial : 236.942 | hit correction : 1.19699
hit initial : 189.001 | hit correction : 1.19707
 *** Total Charge : 709.142
 Looking at view: 1 | Number of hits in view: 4
hit initial : 68.2171 | hit correction : 1.19718
hit initial : 263.298 | hit correction : 1.19707
hit initial : 142.466 | hit correction : 1.19693
hit initial : 121.759 | hit correction : 1.19682
hit initial : 19.3188 | hit correction : 1.19681
 *** Total Charge : 736.222
 Looking at view: 2 | Number of hits in view: 5
12-Dec-2025 02:55:25 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0902058     0.125769      0.149912      0.134614      0.0208994       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000439775   0.00217146     0.0149877    0.000702033   0.00428289       10     
end_path:ana:AnalyzeEvents         0.0896157      0.12342      0.149115       0.12732      0.0201742       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19474.9 MB
  Peak resident set size usage (VmHWM): 1535.08 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:25:18 UTC       justIN version: 01.06.00