justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261420.0@dunegpschedd02.fnal.gov

Jobsub ID261420.0@dunegpschedd02.fnal.gov
Workflow ID11110
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-12 00:48:46
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-13 09:13:43
From worker nodeHostnamedunegli-8046903-0-fnpc19120.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 00:48:20
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T001242Z_gen_001950_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time8h (30289s)
CPU time8h (29909s = 98%)
Max RSS bytes2916904960 (2781 MiB)
Outputting started2025-12-13 09:13:09
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11110/1/001/analysisLowE_20251213T004821Z.root
Finished2025-12-13 09:13:43
Saved logsjustin-logs:261420.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

o add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 09:12:13 UTC run: 5027 subRun: 0 event: 19500
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6846, 6816, 6827
minwire 0: 85
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 189, 688
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.120364, 
Output 1: 0.0997139, 0.0345173, 0.0916435, 0.774125, 
Output 2: 0.0798143, 0.180033, 0.715955, 0.0241973, 
Output 3: 0.978685, 0.00887394, 0.00155314, 0.0108876, 
Output 4: 0.688937, 0.275665, 0.0287762, 0.00662121, 
Output 5: 0.259563, 0.637322, 0.0904073, 0.0127069, 
Output 6: 0.0238, 0.0521011, 0.0638991, 0.8602, 

13-Dec-2025 09:12:16 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 09:12:16 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/61/ff/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T001242Z_gen_001950_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1926.73       3007.3        4218.76       2630.18       864.426        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00283842     0.0141548     0.0510332     0.0109133     0.0127477       10     
reco:pandora:StandardPandora                            1924.71       3004.92       4216.44       2628.08       863.776        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00363853     0.038958      0.221844      0.0117654     0.0630482       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00405413     0.0116187     0.0452201    0.00748865     0.0115004       10     
reco:pandoracalo:Calorimetry                          0.000369611   0.00808325     0.0241717    0.00478241    0.00827455       10     
reco:pandorapid:Chi2ParticleID                        0.000100051   0.00051658    0.00220395    0.00016247    0.000686793      10     
reco:cvnmap:CVNMapper                                  0.0493249     0.0734237     0.120003      0.0656776     0.0214915       10     
reco:cvneva:CVNEvaluator                               0.928283       1.66096       4.52714       1.40873      0.977813        10     
reco:energyrecnumu:EnergyReco                          0.007945      0.0815032      0.18425      0.101552      0.0582935       10     
reco:energyrecnue:EnergyReco                          0.00160454    0.00780734     0.0186754    0.00677542    0.00595567       10     
reco:energyrecnc:EnergyReco                           0.00902334     0.0488106     0.135071      0.0140589     0.0467249       10     
[art]:TriggerResults:TriggerResultInserter             1.601e-05    3.9684e-05    0.00012809    2.4245e-05    3.4057e-05       10     
end_path:out1:RootOutput                               8.94e-06     1.6106e-05     4.615e-05     1.116e-05    1.12963e-05      10     
end_path:out1:RootOutput(write)                        0.315853      0.430728      0.523175      0.429735      0.0486529       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21683.5 MB
  Peak resident set size usage (VmHWM): 2916.9 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 21.8889 | hit correction : 1.45269
hit initial : 27.3636 | hit correction : 1.4525
hit initial : 22.5018 | hit correction : 1.4468
hit initial : 52.689 | hit correction : 1.44688
hit initial : 32.5707 | hit correction : 1.44732
hit initial : 123.028 | hit correction : 1.44736
hit initial : 135.024 | hit correction : 1.44744
hit initial : 113.362 | hit correction : 1.44756
hit initial : 104.132 | hit correction : 1.44772
hit initial : 102.15 | hit correction : 1.44785
hit initial : 93.3751 | hit correction : 1.44801
hit initial : 93.3631 | hit correction : 1.44816
hit initial : 118.208 | hit correction : 1.4483
hit initial : 119.851 | hit correction : 1.44842
hit initial : 111.393 | hit correction : 1.44864
hit initial : 130.808 | hit correction : 1.44883
hit initial : 131.319 | hit correction : 1.449
hit initial : 108.989 | hit correction : 1.4492
hit initial : 109.315 | hit correction : 1.44945
hit initial : 117.227 | hit correction : 1.44965
hit initial : 127.694 | hit correction : 1.44986
hit initial : 141.125 | hit correction : 1.45002
hit initial : 139.732 | hit correction : 1.45018
hit initial : 141.86 | hit correction : 1.45037
hit initial : 124.742 | hit correction : 1.45055
hit initial : 117.968 | hit correction : 1.45072
hit initial : 108.814 | hit correction : 1.45085
hit initial : 96.8281 | hit correction : 1.45095
hit initial : 106.831 | hit correction : 1.45103
hit initial : 113.883 | hit correction : 1.45109
hit initial : 149.961 | hit correction : 1.45119
hit initial : 202.192 | hit correction : 1.45147
hit initial : 110.723 | hit correction : 1.45165
hit initial : 70.9055 | hit correction : 1.45251
 *** Total Charge : 5511.36
 Looking at view: 2 | Number of hits in view: 36
Begin processing the 10th record. run: 5027 subRun: 0 event: 19500 at 13-Dec-2025 09:13:06 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  30
Added hit list length: 30 | Max was set to: -3.40282e+38
True Neutron Energy: 939.576
True Electron Energy: 27.7067
Completed MCParticle Loop
True Neutrino Energy: 30.9917
 Size of all hits: 30
hit initial : 45.2065 | hit correction : 1.33587
hit initial : 32.6685 | hit correction : 1.33589
hit initial : 144.53 | hit correction : 1.32828
hit initial : 231.924 | hit correction : 1.3288
hit initial : 94.0327 | hit correction : 1.32806
hit initial : 40.0367 | hit correction : 1.33055
hit initial : 293.385 | hit correction : 1.32909
hit initial : 68.5514 | hit correction : 1.32962
hit initial : 88.4574 | hit correction : 1.32809
hit initial : 66.9287 | hit correction : 1.32987
hit initial : 122.941 | hit correction : 1.3281
hit initial : 35.9045 | hit correction : 1.32809
hit initial : 193.982 | hit correction : 1.33158
hit initial : 59.1248 | hit correction : 1.33155
hit initial : 89.5512 | hit correction : 1.33072
hit initial : 113.994 | hit correction : 1.33058
hit initial : 51.6961 | hit correction : 1.32802
 *** Total Charge : 2357.4
 Looking at view: 0 | Number of hits in view: 17
hit initial : 51.9518 | hit correction : 1.33064
hit initial : 116.034 | hit correction : 1.33155
hit initial : 42.3487 | hit correction : 1.33067
hit initial : 138.541 | hit correction : 1.32803
hit initial : 131.256 | hit correction : 1.33154
hit initial : 34.4637 | hit correction : 1.33163
hit initial : 44.9812 | hit correction : 1.32801
 *** Total Charge : 744.374
 Looking at view: 1 | Number of hits in view: 7
hit initial : 152.204 | hit correction : 1.33166
hit initial : 333.455 | hit correction : 1.33121
hit initial : 208.231 | hit correction : 1.33038
hit initial : 110.07 | hit correction : 1.32955
hit initial : 366.044 | hit correction : 1.32905
hit initial : 161.845 | hit correction : 1.3288
 *** Total Charge : 1771.5
 Looking at view: 2 | Number of hits in view: 6
13-Dec-2025 09:13:09 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0736673     0.0919965     0.107221      0.0919589     0.0109794       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000404291   0.000506083   0.000992123   0.000451927   0.000164979      10     
end_path:ana:AnalyzeEvents         0.0730674     0.0913235     0.106594      0.0909606     0.0109852       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19473.8 MB
  Peak resident set size usage (VmHWM): 1534.53 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:58:49 UTC       justIN version: 01.06.00