justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260096.0@dunegpschedd02.fnal.gov

Jobsub ID260096.0@dunegpschedd02.fnal.gov
Workflow ID11088
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 07:08:40
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-11 01:17:09
From worker nodeHostnamedunegli-8024542-0-fnpc9004.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-10 14:49:54
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T172154Z_gen_001087_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time10h (37596s)
CPU time10h (36733s = 97%)
Max RSS bytes3043078144 (2902 MiB)
Outputting started2025-12-11 01:16:31
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11088/1/001/analysisLowE_20251210T144955Z.root
Finished2025-12-11 01:17:09
Saved logsjustin-logs:260096.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ut 5: 0.473714, 0.386361, 0.120079, 0.0198463, 
Output 6: 0.011065, 0.033769, 0.0549278, 0.900238, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 10870 at 11-Dec-2025 00:05:31 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 01:13:13 UTC run: 5026 subRun: 0 event: 10870
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6780, 6752, 6644
minwire 0: 59
minwire 1: 1
minwire 2: 3
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.102215, 
Output 1: 0.0570047, 0.0550237, 0.122904, 0.765068, 
Output 2: 0.0817571, 0.215567, 0.671134, 0.0315409, 
Output 3: 0.970186, 0.0178182, 0.00260036, 0.0093955, 
Output 4: 0.42229, 0.535616, 0.0386963, 0.00339736, 
Output 5: 0.518396, 0.414713, 0.0561797, 0.0107113, 
Output 6: 0.0160736, 0.0428198, 0.0560437, 0.885063, 

11-Dec-2025 01:14:28 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 01:14:28 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/2e/dc/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T172154Z_gen_001087_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3181.27       3722.89       4387.02       3683.99       369.786        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0045389     0.0270513     0.100447      0.0208953     0.0256189       10     
reco:pandora:StandardPandora                            3174.14       3686.2        4319.37       3647.53       342.782        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000700978    0.0541819     0.251015      0.0145274     0.0758662       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000593645    0.0152699     0.0652103     0.0113657     0.0176848       10     
reco:pandoracalo:Calorimetry                          0.000391256    0.0199621      0.10093     0.00181383     0.0352186       10     
reco:pandorapid:Chi2ParticleID                        0.000102679   0.000695399   0.00341114    0.00022674    0.00103679       10     
reco:cvnmap:CVNMapper                                  0.0937762     0.120464      0.173571      0.117879      0.0222039       10     
reco:cvneva:CVNEvaluator                                1.43023       2.16303       5.83183       1.60827       1.26917        10     
reco:energyrecnumu:EnergyReco                          0.0043001      19.7143       68.2636      0.0306005      30.0778        10     
reco:energyrecnue:EnergyReco                          0.00241632     0.0082559     0.0211279    0.00346652    0.00715128       10     
reco:energyrecnc:EnergyReco                            0.0109906      13.9992       71.2689      0.0859307      27.8982        10     
[art]:TriggerResults:TriggerResultInserter             2.397e-05    5.08341e-05   0.000149827   3.7239e-05    3.49593e-05      10     
end_path:out1:RootOutput                               9.341e-06     1.714e-05    4.4836e-05    1.50915e-05   9.54425e-06      10     
end_path:out1:RootOutput(write)                        0.405172      0.571144      0.804278       0.54223       0.14154        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12094.7 MB
  Peak resident set size usage (VmHWM): 3043.08 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 248.877 | hit correction : 1.12051
hit initial : 255.419 | hit correction : 1.12009
hit initial : 245.785 | hit correction : 1.1197
hit initial : 252.932 | hit correction : 1.1192
hit initial : 264.534 | hit correction : 1.11877
hit initial : 267.73 | hit correction : 1.11837
hit initial : 211.262 | hit correction : 1.11802
hit initial : 71.7805 | hit correction : 1.11795
hit initial : 49.9735 | hit correction : 1.11666
 *** Total Charge : 6962.96
 Looking at view: 1 | Number of hits in view: 33
hit initial : 24.3744 | hit correction : 1.11669
hit initial : 158.853 | hit correction : 1.11667
hit initial : 24.4259 | hit correction : 1.12424
hit initial : 185.214 | hit correction : 1.12423
hit initial : 105.384 | hit correction : 1.12523
hit initial : 93.5792 | hit correction : 1.12526
hit initial : 274.277 | hit correction : 1.12327
hit initial : 404.63 | hit correction : 1.12326
hit initial : 186.087 | hit correction : 1.1232
hit initial : 137.256 | hit correction : 1.12313
hit initial : 131.976 | hit correction : 1.12303
hit initial : 154.732 | hit correction : 1.12291
hit initial : 127.971 | hit correction : 1.12278
hit initial : 212.01 | hit correction : 1.12264
hit initial : 171.623 | hit correction : 1.12257
hit initial : 130.28 | hit correction : 1.12244
hit initial : 120.45 | hit correction : 1.12237
hit initial : 119.175 | hit correction : 1.12235
hit initial : 124.458 | hit correction : 1.12232
hit initial : 139.578 | hit correction : 1.12229
hit initial : 146.17 | hit correction : 1.12225
hit initial : 200.232 | hit correction : 1.12213
hit initial : 208.141 | hit correction : 1.12196
hit initial : 269.715 | hit correction : 1.12164
hit initial : 278.382 | hit correction : 1.1212
hit initial : 294.847 | hit correction : 1.12071
hit initial : 264.964 | hit correction : 1.12021
hit initial : 232.817 | hit correction : 1.11981
hit initial : 233.55 | hit correction : 1.11936
hit initial : 251.495 | hit correction : 1.11893
hit initial : 239.893 | hit correction : 1.11859
hit initial : 211.199 | hit correction : 1.11821
hit initial : 227.322 | hit correction : 1.11792
 *** Total Charge : 6824.08
 Looking at view: 2 | Number of hits in view: 33
Begin processing the 10th record. run: 5026 subRun: 0 event: 10870 at 11-Dec-2025 01:16:24 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  20
Added hit list length: 20 | Max was set to: -3.40282e+38
True Neutron Energy: 939.575
True Electron Energy: 43.2836
Completed MCParticle Loop
True Neutrino Energy: 52.1611
 Size of all hits: 20
hit initial : 40.964 | hit correction : 1.06106
hit initial : 168.339 | hit correction : 1.06106
hit initial : 23.828 | hit correction : 1.06341
hit initial : 43.0602 | hit correction : 1.06339
hit initial : 41.5996 | hit correction : 1.06404
hit initial : 107.283 | hit correction : 1.06129
hit initial : 395.305 | hit correction : 1.0613
hit initial : 195.813 | hit correction : 1.06146
 *** Total Charge : 1078.72
 Looking at view: 0 | Number of hits in view: 8
hit initial : 26.7226 | hit correction : 1.05972
hit initial : 72.5027 | hit correction : 1.05973
hit initial : 40.3441 | hit correction : 1.05973
hit initial : 22.6196 | hit correction : 1.06093
hit initial : 66.4771 | hit correction : 1.06098
hit initial : 216.712 | hit correction : 1.06112
hit initial : 258.049 | hit correction : 1.06144
hit initial : 421.636 | hit correction : 1.06128
 *** Total Charge : 1193.77
 Looking at view: 1 | Number of hits in view: 8
hit initial : 145.396 | hit correction : 1.06146
hit initial : 180.416 | hit correction : 1.06151
hit initial : 533.204 | hit correction : 1.06119
hit initial : 95.4698 | hit correction : 1.06099
 *** Total Charge : 1012.97
 Looking at view: 2 | Number of hits in view: 4
11-Dec-2025 01:16:30 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.160061      0.200241      0.241154      0.199198      0.0264491       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00109407    0.00831329     0.0276465    0.00143648    0.00927741       10     
end_path:ana:AnalyzeEvents         0.158241      0.191439       0.22386       0.18832      0.0208212       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9813.31 MB
  Peak resident set size usage (VmHWM): 1539.65 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:27:49 UTC       justIN version: 01.06.00