justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262214.0@dunegpschedd02.fnal.gov

Jobsub ID262214.0@dunegpschedd02.fnal.gov
Workflow ID11177
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 14:10:42
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-13 20:08:16
From worker nodeHostnamedunegli-7890613-0-fnpc19133.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 14:12:10
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T180316Z_gen_001344_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (21349s)
CPU time5h (21080s = 98%)
Max RSS bytes2801500160 (2671 MiB)
Outputting started2025-12-13 20:08:00
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11177/1/001/analysisLowE_20251213T141211Z.root
Finished2025-12-13 20:08:16
Saved logsjustin-logs:262214.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

r@BeginModule  13-Dec-2025 20:07:03 UTC run: 5026 subRun: 0 event: 13440
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 20:07:03 UTC run: 5026 subRun: 0 event: 13440
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6928, 6866, 6714
minwire 0: 21
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1317, 1816
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.144295, 
Output 1: 0.0737696, 0.0949824, 0.201221, 0.630027, 
Output 2: 0.03664, 0.190072, 0.744398, 0.0288895, 
Output 3: 0.96729, 0.020775, 0.00448527, 0.00744985, 
Output 4: 0.437987, 0.491795, 0.0643176, 0.00590019, 
Output 5: 0.478935, 0.356287, 0.13394, 0.0308376, 
Output 6: 0.0193328, 0.0539267, 0.0661593, 0.860581, 

13-Dec-2025 20:07:06 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 20:07:06 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/32/87/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T180316Z_gen_001344_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1800.76       2113.67       2569.25       2159.24        219.4         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000728047   0.00336993     0.0158756    0.000971144   0.00506602       10     
reco:pandora:StandardPandora                            1799.08       2111.47       2567.05       2155.76       219.24         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000369743    0.0597932     0.141827      0.0540671     0.0348046       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000355863   0.00559423     0.0194662    0.00406337    0.00541314       10     
reco:pandoracalo:Calorimetry                          0.000188502   0.00136086    0.00491959    0.000668806   0.00158667       10     
reco:pandorapid:Chi2ParticleID                         6.321e-05    0.000332926   0.00207231    0.000137301    0.0005807       10     
reco:cvnmap:CVNMapper                                  0.0654363     0.0924153     0.144869      0.0857517     0.0208587       10     
reco:cvneva:CVNEvaluator                               0.985785       1.47733       3.87247       1.26059       0.81453        10     
reco:energyrecnumu:EnergyReco                          0.0827678     0.116348      0.179097      0.109269      0.0252286       10     
reco:energyrecnue:EnergyReco                          0.00153143    0.00446409     0.0211778    0.00197917    0.00587668       10     
reco:energyrecnc:EnergyReco                           0.00817496     0.0111874     0.0132652     0.0121619    0.00196344       10     
[art]:TriggerResults:TriggerResultInserter             1.541e-05    2.70733e-05   9.1721e-05    1.8455e-05    2.23713e-05      10     
end_path:out1:RootOutput                                8.6e-06     1.19731e-05    3.075e-05    1.0145e-05    6.3037e-06       10     
end_path:out1:RootOutput(write)                        0.321234      0.428031       0.52908      0.436083      0.0604628       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21579.2 MB
  Peak resident set size usage (VmHWM): 2801.5 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 183.111 | hit correction : 1.35989
hit initial : 436.227 | hit correction : 1.36031
hit initial : 341.899 | hit correction : 1.36005
hit initial : 210.482 | hit correction : 1.36054
hit initial : 161.016 | hit correction : 1.361
hit initial : 178.148 | hit correction : 1.36153
hit initial : 202.919 | hit correction : 1.36218
hit initial : 224.412 | hit correction : 1.36281
hit initial : 321.915 | hit correction : 1.3633
hit initial : 223.968 | hit correction : 1.3639
hit initial : 199.411 | hit correction : 1.36469
hit initial : 190.142 | hit correction : 1.36539
hit initial : 69.6205 | hit correction : 1.36616
hit initial : 149.679 | hit correction : 1.36616
 *** Total Charge : 4248.81
 Looking at view: 2 | Number of hits in view: 15
Begin processing the 10th record. run: 5026 subRun: 0 event: 13440 at 13-Dec-2025 20:07:55 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  7
This pfp has size:  47
Added hit list length: 47 | Max was set to: -3.40282e+38
This pfp has size:  7
This pfp has size:  6
This pfp has size:  5
True Neutron Energy: 939.567
True Electron Energy: 33.3524
Completed MCParticle Loop
True Neutrino Energy: 38.7558
 Size of all hits: 47
hit initial : 82.8194 | hit correction : 1.24656
hit initial : 104.966 | hit correction : 1.24656
hit initial : 284.148 | hit correction : 1.24183
hit initial : 71.3726 | hit correction : 1.24181
hit initial : 129.799 | hit correction : 1.2419
hit initial : 336.082 | hit correction : 1.24184
hit initial : 986.966 | hit correction : 1.24207
hit initial : 350.208 | hit correction : 1.24203
hit initial : 179.113 | hit correction : 1.24235
hit initial : 710.907 | hit correction : 1.24215
 *** Total Charge : 4020.56
 Looking at view: 0 | Number of hits in view: 10
hit initial : 76.229 | hit correction : 1.24654
hit initial : 92.5099 | hit correction : 1.24654
hit initial : 35.7952 | hit correction : 1.24192
hit initial : 177.933 | hit correction : 1.24184
hit initial : 298.443 | hit correction : 1.24179
hit initial : 233.627 | hit correction : 1.24186
hit initial : 76.9529 | hit correction : 1.24206
hit initial : 69.1531 | hit correction : 1.24195
hit initial : 178.403 | hit correction : 1.24203
hit initial : 263.937 | hit correction : 1.24204
hit initial : 386.128 | hit correction : 1.2422
hit initial : 409.956 | hit correction : 1.24223
hit initial : 353.059 | hit correction : 1.24216
hit initial : 256.373 | hit correction : 1.24212
hit initial : 231.802 | hit correction : 1.24191
hit initial : 208.879 | hit correction : 1.2415
 *** Total Charge : 4160.47
 Looking at view: 1 | Number of hits in view: 16
hit initial : 56.0302 | hit correction : 1.2412
hit initial : 104.581 | hit correction : 1.24654
hit initial : 109.281 | hit correction : 1.24653
hit initial : 172.279 | hit correction : 1.24192
hit initial : 156.084 | hit correction : 1.24177
hit initial : 128.505 | hit correction : 1.24167
hit initial : 121.244 | hit correction : 1.24176
hit initial : 118.272 | hit correction : 1.24191
hit initial : 115.774 | hit correction : 1.24201
hit initial : 117.544 | hit correction : 1.24206
hit initial : 117.576 | hit correction : 1.24204
hit initial : 134.553 | hit correction : 1.24198
hit initial : 146.407 | hit correction : 1.242
hit initial : 156.31 | hit correction : 1.242
hit initial : 186.54 | hit correction : 1.24213
hit initial : 477.658 | hit correction : 1.24235
hit initial : 366.15 | hit correction : 1.24218
hit initial : 185.911 | hit correction : 1.24214
hit initial : 160.096 | hit correction : 1.242
hit initial : 157.712 | hit correction : 1.24165
hit initial : 152.477 | hit correction : 1.24136
 *** Total Charge : 4274.63
 Looking at view: 2 | Number of hits in view: 21
13-Dec-2025 20:07:59 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0967453     0.112072      0.138047      0.105882      0.0151808       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000365063   0.000582626   0.00148076    0.000509599   0.000312522      10     
end_path:ana:AnalyzeEvents         0.0961011     0.111319      0.137512      0.105224      0.0151028       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19477.9 MB
  Peak resident set size usage (VmHWM): 1534.54 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:12:13 UTC       justIN version: 01.06.00