justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260442.0@dunegpschedd02.fnal.gov

Jobsub ID260442.0@dunegpschedd02.fnal.gov
Workflow ID11111
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 18:35:14
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 11:00:23
From worker nodeHostnamedunegli-7872481-0-fnpc23024.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 08:53:34
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T025350Z_gen_004326_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time2h (7597s)
CPU time2h (7491s = 98%)
Max RSS bytes2921869312 (2786 MiB)
Outputting started2025-12-11 11:00:12
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11111/1/001/analysisLowE_20251211T085335Z.root
Finished2025-12-11 11:00:23
Saved logsjustin-logs:260442.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

tput 6: 0.0414504, 0.0926645, 0.0989634, 0.766922, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 43260 at 11-Dec-2025 10:48:38 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:59:41 UTC run: 5027 subRun: 0 event: 43260
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6712, 6728, 6652
minwire 0: 54
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1899, 2398
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.102437, 
Output 1: 0.0473936, 0.0608743, 0.110776, 0.780956, 
Output 2: 0.0615939, 0.302042, 0.599263, 0.0371013, 
Output 3: 0.946758, 0.0285167, 0.00745511, 0.0172705, 
Output 4: 0.375282, 0.544888, 0.0738891, 0.00594118, 
Output 5: 0.673745, 0.285906, 0.0348962, 0.00545263, 
Output 6: 0.0111971, 0.0332517, 0.0519052, 0.903646, 

11-Dec-2025 10:59:43 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 10:59:43 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/3f/12/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T025350Z_gen_004326_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              661.867       749.204       810.616       762.32        43.5251        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00106088    0.00696392     0.0283408    0.00502076    0.00724204       10     
reco:pandora:StandardPandora                            660.795       747.92        807.636       761.242       43.2432        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000262541    0.0197699     0.0778872     0.014213      0.0219851       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000181878   0.00256426    0.00854536    0.00115464    0.00270388       10     
reco:pandoracalo:Calorimetry                          0.000150287   0.00380611     0.0320877    0.000266369   0.00945702       10     
reco:pandorapid:Chi2ParticleID                        3.9726e-05    0.000150589   0.000900349   6.94975e-05   0.000250413      10     
reco:cvnmap:CVNMapper                                  0.0217466     0.0363077     0.0432667     0.0379626     0.0066952       10     
reco:cvneva:CVNEvaluator                               0.695369      0.903897       2.42633       0.7212       0.509572        10     
reco:energyrecnumu:EnergyReco                          0.0019511     0.0231466     0.0678369    0.00569706     0.0259699       10     
reco:energyrecnue:EnergyReco                          0.000763457   0.00209218    0.00507521    0.000876584    0.0018683       10     
reco:energyrecnc:EnergyReco                           0.00467353     0.0434571     0.0667182     0.054593      0.0256895       10     
[art]:TriggerResults:TriggerResultInserter            1.1281e-05    2.2563e-05    7.9592e-05    1.5464e-05    1.93013e-05      10     
end_path:out1:RootOutput                               5.49e-06     1.0371e-05    2.5128e-05    9.6085e-06    5.18487e-06      10     
end_path:out1:RootOutput(write)                        0.203135      0.241095      0.321807      0.232405      0.0308098       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21679.9 MB
  Peak resident set size usage (VmHWM): 2921.87 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 23.3932 | hit correction : 1.1521
hit initial : 307.836 | hit correction : 1.15231
hit initial : 117.68 | hit correction : 1.15277
hit initial : 155.758 | hit correction : 1.15286
hit initial : 110.895 | hit correction : 1.15303
hit initial : 158.484 | hit correction : 1.15305
 *** Total Charge : 1453.37
 Looking at view: 0 | Number of hits in view: 12
hit initial : 205.281 | hit correction : 1.15177
hit initial : 63.6811 | hit correction : 1.15234
hit initial : 85.734 | hit correction : 1.1517
hit initial : 485.916 | hit correction : 1.15185
hit initial : 231.331 | hit correction : 1.15189
hit initial : 78.1373 | hit correction : 1.15207
hit initial : 236.187 | hit correction : 1.15234
hit initial : 340.237 | hit correction : 1.15242
hit initial : 277.165 | hit correction : 1.15275
hit initial : 182.213 | hit correction : 1.15287
hit initial : 129.746 | hit correction : 1.15302
hit initial : 143.817 | hit correction : 1.15305
 *** Total Charge : 2834.01
 Looking at view: 1 | Number of hits in view: 12
hit initial : 74.3026 | hit correction : 1.1531
hit initial : 155.174 | hit correction : 1.1522
hit initial : 140.113 | hit correction : 1.15191
hit initial : 56.3729 | hit correction : 1.15236
hit initial : 282.142 | hit correction : 1.15174
hit initial : 419.565 | hit correction : 1.15234
hit initial : 543.935 | hit correction : 1.15171
hit initial : 241.463 | hit correction : 1.15188
hit initial : 163.29 | hit correction : 1.15208
hit initial : 25.3577 | hit correction : 1.15206
hit initial : 56.7085 | hit correction : 1.15298
hit initial : 149.094 | hit correction : 1.15243
hit initial : 134.354 | hit correction : 1.15261
hit initial : 124.602 | hit correction : 1.15276
hit initial : 117.292 | hit correction : 1.15282
hit initial : 117.21 | hit correction : 1.15288
hit initial : 128.188 | hit correction : 1.15293
hit initial : 118.41 | hit correction : 1.15298
hit initial : 147.688 | hit correction : 1.15305
 *** Total Charge : 3681.84
 Looking at view: 2 | Number of hits in view: 19
Begin processing the 10th record. run: 5027 subRun: 0 event: 43260 at 11-Dec-2025 11:00:10 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  22
Added hit list length: 22 | Max was set to: -3.40282e+38
This pfp has size:  10
True Neutron Energy: 939.575
True Electron Energy: 23.1042
Completed MCParticle Loop
True Neutrino Energy: 29.3017
 Size of all hits: 22
hit initial : 93.7603 | hit correction : 1.44863
hit initial : 151.251 | hit correction : 1.44955
hit initial : 147.814 | hit correction : 1.44861
hit initial : 417.455 | hit correction : 1.44962
hit initial : 342.872 | hit correction : 1.44977
hit initial : 212.481 | hit correction : 1.44989
hit initial : 108.366 | hit correction : 1.4507
hit initial : 234.663 | hit correction : 1.45062
hit initial : 78.3733 | hit correction : 1.45071
hit initial : 158.995 | hit correction : 1.44996
 *** Total Charge : 2821.35
 Looking at view: 0 | Number of hits in view: 10
hit initial : 58.7185 | hit correction : 1.45072
hit initial : 203.685 | hit correction : 1.45065
hit initial : 117.292 | hit correction : 1.45072
hit initial : 147.502 | hit correction : 1.44999
hit initial : 198.876 | hit correction : 1.44988
hit initial : 327.69 | hit correction : 1.4498
hit initial : 352.881 | hit correction : 1.4497
 *** Total Charge : 2039.7
 Looking at view: 1 | Number of hits in view: 7
hit initial : 387.817 | hit correction : 1.44955
hit initial : 181.978 | hit correction : 1.44861
hit initial : 51.284 | hit correction : 1.44835
hit initial : 756.815 | hit correction : 1.44983
hit initial : 316.921 | hit correction : 1.44977
 *** Total Charge : 2456.76
 Looking at view: 2 | Number of hits in view: 5
11-Dec-2025 11:00:12 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0487093     0.0624818     0.0948941     0.0604771     0.0128698       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000303449   0.000654922   0.00230504    0.000419887   0.000571005      10     
end_path:ana:AnalyzeEvents         0.0482901     0.0616805     0.0921372     0.0598073     0.0123188       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19472 MB
  Peak resident set size usage (VmHWM): 1537.02 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 15:00:10 UTC       justIN version: 01.06.00