justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267839.1@dunegpschedd01.fnal.gov

Jobsub ID267839.1@dunegpschedd01.fnal.gov
Workflow ID11172
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 06:42:19
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-13 17:48:20
From worker nodeHostnamedunegli-8047006-0-fnpc19108.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 06:44:27
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T221415Z_gen_000080_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (39819s)
CPU time10h (38842s = 97%)
Max RSS bytes2838282240 (2706 MiB)
Outputting started2025-12-13 17:48:07
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11172/1/001/analysisLowE_20251213T064429Z.root
Finished2025-12-13 17:48:20
Saved logsjustin-logs:267839.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

3 UTC run: 5027 subRun: 0 event: 800
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 17:47:03 UTC run: 5027 subRun: 0 event: 800
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6909, 6772, 6671
minwire 0: 26
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.150255, 
Output 1: 0.0591621, 0.0345621, 0.0919037, 0.814372, 
Output 2: 0.0700593, 0.260792, 0.637488, 0.0316611, 
Output 3: 0.975108, 0.0148205, 0.00241325, 0.00765797, 
Output 4: 0.351626, 0.570672, 0.0713343, 0.00636759, 
Output 5: 0.346399, 0.550117, 0.0919582, 0.0115262, 
Output 6: 0.0171903, 0.0514323, 0.0724418, 0.858935, 

13-Dec-2025 17:47:06 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 17:47:06 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/3b/63/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T221415Z_gen_000080_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1865.5        3954.87       4911.32       4219.89       866.142        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00106045    0.00678165      0.03613     0.00127945     0.0112463       10     
reco:pandora:StandardPandora                            1863.45       3903.94       4841.77       4149.67       839.71         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00891882     0.0947657     0.161219      0.0980361     0.0500431       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00172546     0.0182887     0.063867     0.00776356     0.0225291       10     
reco:pandoracalo:Calorimetry                          0.000375314   0.00307717     0.0164553    0.000765911   0.00473866       10     
reco:pandorapid:Chi2ParticleID                        9.0731e-05    0.000921119   0.00681962    0.000174721   0.00197881       10     
reco:cvnmap:CVNMapper                                  0.0670307      0.14032      0.385034      0.124987      0.0874138       10     
reco:cvneva:CVNEvaluator                               0.996493       2.10135       6.97689       1.49449       1.67168        10     
reco:energyrecnumu:EnergyReco                          0.102881       48.0462       72.3122       67.3323       31.5277        10     
reco:energyrecnue:EnergyReco                          0.00165072    0.00292878    0.00483934    0.00259651    0.00109201       10     
reco:energyrecnc:EnergyReco                           0.00996506     0.0136236     0.0170184     0.0135018    0.00209487       10     
[art]:TriggerResults:TriggerResultInserter            1.7611e-05    8.60157e-05   0.000389083    3.889e-05    0.000108753      10     
end_path:out1:RootOutput                               9.15e-06     3.24243e-05   0.000108921    1.72e-05     3.11584e-05      10     
end_path:out1:RootOutput(write)                        0.367581      0.494964      0.791644      0.463721      0.110183        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21576.2 MB
  Peak resident set size usage (VmHWM): 2838.28 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 Size of all hits: 75
hit initial : 23.964 | hit correction : 1.07759
hit initial : 55.2089 | hit correction : 1.07758
hit initial : 27.8088 | hit correction : 1.05788
hit initial : 21.1499 | hit correction : 1.05793
hit initial : 70.8317 | hit correction : 1.05699
hit initial : 34.1521 | hit correction : 1.05699
hit initial : 54.5681 | hit correction : 1.05147
hit initial : 36.5558 | hit correction : 1.05146
hit initial : 51.8678 | hit correction : 1.02717
hit initial : 88.3699 | hit correction : 1.02715
hit initial : 88.727 | hit correction : 1.0368
hit initial : 174.349 | hit correction : 1.03678
hit initial : 36.1468 | hit correction : 1.036
hit initial : 102.679 | hit correction : 1.03352
hit initial : 98.8984 | hit correction : 1.0335
hit initial : 161.632 | hit correction : 1.03391
hit initial : 92.6961 | hit correction : 1.03384
hit initial : 52.7032 | hit correction : 1.03304
hit initial : 320.376 | hit correction : 1.03219
hit initial : 320.072 | hit correction : 1.03253
hit initial : 301.98 | hit correction : 1.03199
hit initial : 276.58 | hit correction : 1.03177
hit initial : 329.031 | hit correction : 1.03152
hit initial : 470.675 | hit correction : 1.03128
hit initial : 418.871 | hit correction : 1.03118
 *** Total Charge : 3838.77
 Looking at view: 0 | Number of hits in view: 25
hit initial : 45.2336 | hit correction : 1.07759
hit initial : 37.0512 | hit correction : 1.07758
hit initial : 26.7367 | hit correction : 1.05787
hit initial : 16.4414 | hit correction : 1.05785
hit initial : 64.9268 | hit correction : 1.05701
hit initial : 61.2144 | hit correction : 1.05145
hit initial : 91.6452 | hit correction : 1.02715
hit initial : 114.591 | hit correction : 1.03679
hit initial : 168.978 | hit correction : 1.03679
hit initial : 26.8965 | hit correction : 1.036
hit initial : 20.0385 | hit correction : 1.036
hit initial : 146.421 | hit correction : 1.0335
hit initial : 70.3677 | hit correction : 1.03349
hit initial : 15.1266 | hit correction : 1.0333
hit initial : 24.755 | hit correction : 1.03329
hit initial : 171.638 | hit correction : 1.03386
hit initial : 104.181 | hit correction : 1.03389
hit initial : 117.582 | hit correction : 1.03318
hit initial : 55.3465 | hit correction : 1.03299
hit initial : 32.4087 | hit correction : 1.03228
hit initial : 386.936 | hit correction : 1.03228
hit initial : 349.694 | hit correction : 1.03204
hit initial : 244.514 | hit correction : 1.03181
hit initial : 209.489 | hit correction : 1.03162
hit initial : 262.116 | hit correction : 1.03141
hit initial : 372.156 | hit correction : 1.03126
hit initial : 295.776 | hit correction : 1.03118
hit initial : 136.124 | hit correction : 1.03109
 *** Total Charge : 3794.85
 Looking at view: 1 | Number of hits in view: 28
hit initial : 82.7207 | hit correction : 1.07758
hit initial : 18.8354 | hit correction : 1.07753
hit initial : 51.4989 | hit correction : 1.05785
hit initial : 115.139 | hit correction : 1.05701
hit initial : 100.381 | hit correction : 1.05145
hit initial : 147.925 | hit correction : 1.02715
hit initial : 18.78 | hit correction : 1.02712
hit initial : 35.5044 | hit correction : 1.03679
hit initial : 289.85 | hit correction : 1.03678
hit initial : 60.7043 | hit correction : 1.03599
hit initial : 118.091 | hit correction : 1.03354
hit initial : 133.545 | hit correction : 1.03344
hit initial : 356.152 | hit correction : 1.03331
hit initial : 69.22 | hit correction : 1.03396
hit initial : 239.834 | hit correction : 1.03386
hit initial : 37.3859 | hit correction : 1.03329
hit initial : 281.957 | hit correction : 1.03272
hit initial : 16.1958 | hit correction : 1.03224
hit initial : 590.078 | hit correction : 1.03215
hit initial : 131.949 | hit correction : 1.03184
hit initial : 785.783 | hit correction : 1.03156
hit initial : 759.455 | hit correction : 1.03118
 *** Total Charge : 4595.66
 Looking at view: 2 | Number of hits in view: 22
13-Dec-2025 17:48:06 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.115916      0.130121      0.153156      0.126316      0.0107269       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000407243   0.000589788   0.00126772    0.000550204   0.000234451      10     
end_path:ana:AnalyzeEvents         0.115189      0.129309      0.152582      0.125625      0.0105952       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19481.9 MB
  Peak resident set size usage (VmHWM): 1539.01 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:06:19 UTC       justIN version: 01.06.00