justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261119.0@dunegpschedd02.fnal.gov

Jobsub ID261119.0@dunegpschedd02.fnal.gov
Workflow ID11115
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 16:38:19
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 00:21:12
From worker nodeHostnamedunegli-8029038-0-fnpc8027.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 16:39:39
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T001558Z_gen_002164_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (27673s)
CPU time7h (27373s = 98%)
Max RSS bytes2928173056 (2792 MiB)
Outputting started2025-12-12 00:20:52
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11115/1/001/analysisLowE_20251211T163939Z.root
Finished2025-12-12 00:21:12
Saved logsjustin-logs:261119.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ry: 
Output 0: 0.0622338, 
Output 1: 0.125804, 0.107286, 0.178241, 0.588668, 
Output 2: 0.0317866, 0.107736, 0.846691, 0.0137867, 
Output 3: 0.925085, 0.0617714, 0.00726314, 0.00588003, 
Output 4: 0.753158, 0.219525, 0.0226628, 0.0046534, 
Output 5: 0.195462, 0.495012, 0.253805, 0.0557209, 
Output 6: 0.12647, 0.260918, 0.132915, 0.479697, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 21640 at 11-Dec-2025 23:38:28 UTC
Boundary wire vector sizes: 6812, 6672, 6668
minwire 0: 40
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 487, 986
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0737596, 
Output 1: 0.757651, 0.0579163, 0.0675767, 0.116856, 
Output 2: 0.0583043, 0.124558, 0.802933, 0.0142047, 
Output 3: 0.974578, 0.0219658, 0.000906529, 0.00254915, 
Output 4: 0.865542, 0.127786, 0.00545473, 0.00121731, 
Output 5: 0.383519, 0.405996, 0.136863, 0.0736219, 
Output 6: 0.381593, 0.33166, 0.101941, 0.184806, 

12-Dec-2025 00:19:15 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 00:19:15 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/0a/94/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T001558Z_gen_002164_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2206.78       2733.38       3304.72       2615.67       350.57         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00367609     0.0135597     0.0267085     0.0123793    0.00637185       10     
reco:pandora:StandardPandora                            2204.12       2729.85       3301.51       2612.76       349.761        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00047936     0.0441044     0.315198     0.00930268     0.0912749       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000413779    0.0102725     0.049256     0.00711763     0.0134254       10     
reco:pandoracalo:Calorimetry                          0.000324285    0.0255549     0.0645935     0.0137199     0.0235806       10     
reco:pandorapid:Chi2ParticleID                        9.2369e-05    0.000680412   0.00520538    0.000115654   0.00151241       10     
reco:cvnmap:CVNMapper                                  0.0618096     0.0809171      0.13317      0.074531      0.0212087       10     
reco:cvneva:CVNEvaluator                                1.43078       2.60538       7.63335       2.07868       1.6949         10     
reco:energyrecnumu:EnergyReco                          0.0165816     0.117272      0.259062       0.11936      0.0652685       10     
reco:energyrecnue:EnergyReco                          0.00210967     0.0105158     0.0151884     0.0118338     0.004559        10     
reco:energyrecnc:EnergyReco                            0.0112641     0.040047      0.145392      0.0149861     0.0503349       10     
[art]:TriggerResults:TriggerResultInserter            2.6643e-05    4.63315e-05   0.000155814   3.56375e-05   3.70464e-05      10     
end_path:out1:RootOutput                               6.678e-06    1.4943e-05    4.6768e-05    1.09685e-05   1.13576e-05      10     
end_path:out1:RootOutput(write)                        0.437698      0.584788      0.752925      0.610134      0.120682        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 10952.1 MB
  Peak resident set size usage (VmHWM): 2928.17 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.578
True Electron Energy: 41.4564
Completed MCParticle Loop
True Neutrino Energy: 54.1356
 Size of all hits: 0
Begin processing the 7th record. run: 5027 subRun: 0 event: 21637 at 12-Dec-2025 00:20:28 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 4.48975
Completed MCParticle Loop
True Neutrino Energy: 9.99272
 Size of all hits: 0
Begin processing the 8th record. run: 5027 subRun: 0 event: 21638 at 12-Dec-2025 00:20:34 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 8.73681
Completed MCParticle Loop
True Neutrino Energy: 12.464
 Size of all hits: 0
Begin processing the 9th record. run: 5027 subRun: 0 event: 21639 at 12-Dec-2025 00:20:39 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 0.958072
Completed MCParticle Loop
True Neutrino Energy: 4.68211
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 21640 at 12-Dec-2025 00:20:45 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  38
Added hit list length: 38 | Max was set to: -3.40282e+38
True Neutron Energy: 939.571
True Neutron Energy: 941.909
True Neutron Energy: 940.351
True Electron Energy: 37.9012
Completed MCParticle Loop
True Neutrino Energy: 55.2428
 Size of all hits: 38
hit initial : 76.9763 | hit correction : 1.44203
hit initial : 70.9503 | hit correction : 1.4381
hit initial : 142.817 | hit correction : 1.43815
hit initial : 175.27 | hit correction : 1.43823
hit initial : 181.313 | hit correction : 1.4384
hit initial : 201.872 | hit correction : 1.43866
hit initial : 199.811 | hit correction : 1.43898
hit initial : 200.922 | hit correction : 1.43939
hit initial : 284.991 | hit correction : 1.44003
hit initial : 349.782 | hit correction : 1.44072
hit initial : 349.446 | hit correction : 1.44097
hit initial : 289.452 | hit correction : 1.44116
hit initial : 194.901 | hit correction : 1.44164
hit initial : 180.827 | hit correction : 1.4419
hit initial : 184.644 | hit correction : 1.44201
hit initial : 271.174 | hit correction : 1.44203
hit initial : 260.307 | hit correction : 1.44203
 *** Total Charge : 5207.86
 Looking at view: 0 | Number of hits in view: 17
hit initial : 87.2645 | hit correction : 1.4381
hit initial : 127.664 | hit correction : 1.43814
hit initial : 134.725 | hit correction : 1.43822
hit initial : 122.509 | hit correction : 1.43836
hit initial : 142.091 | hit correction : 1.43852
hit initial : 141.943 | hit correction : 1.43871
hit initial : 130.995 | hit correction : 1.43895
hit initial : 132.155 | hit correction : 1.43923
hit initial : 169.651 | hit correction : 1.43959
hit initial : 208.284 | hit correction : 1.44004
hit initial : 375.169 | hit correction : 1.44074
hit initial : 437.796 | hit correction : 1.44097
hit initial : 186.52 | hit correction : 1.4412
hit initial : 123.403 | hit correction : 1.44157
hit initial : 136.873 | hit correction : 1.44179
hit initial : 164.384 | hit correction : 1.44186
hit initial : 163.314 | hit correction : 1.44194
hit initial : 155.743 | hit correction : 1.44203
hit initial : 107.98 | hit correction : 1.44205
hit initial : 192.773 | hit correction : 1.44204
hit initial : 114.73 | hit correction : 1.44217
 *** Total Charge : 5122.22
 Looking at view: 2 | Number of hits in view: 21
12-Dec-2025 00:20:51 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0820463     0.216161      0.959781      0.0911383     0.259075        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000371668   0.00701222     0.0658292    0.000481557    0.0196058       10     
end_path:ana:AnalyzeEvents         0.0814538     0.208976      0.893356      0.0905789     0.240253        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8739.76 MB
  Peak resident set size usage (VmHWM): 1536.89 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:59:41 UTC       justIN version: 01.06.00