justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 257892.70@dunegpschedd02.fnal.gov

Jobsub ID257892.70@dunegpschedd02.fnal.gov
Workflow ID11025
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 10:53:42
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 08:43:34
From worker nodeHostnamedunegli-7988754-0-fnpc18006.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-05 18:42:25
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T020956Z_gen_003691_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time14h (50421s)
CPU time13h (48965s = 97%)
Max RSS bytes2853130240 (2720 MiB)
Outputting started2025-12-06 08:42:47
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11025/1/001/analysisLowE_20251205T184226Z.root
Finished2025-12-06 08:43:34
Saved logsjustin-logs:257892.70-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

mination failure: 0, 499
Classifier summary: 
Output 0: 0.104767, 
Output 1: 0.0522817, 0.0734379, 0.133675, 0.740605, 
Output 2: 0.0936327, 0.27874, 0.594082, 0.0335457, 
Output 3: 0.94993, 0.0449564, 0.00254796, 0.00256616, 
Output 4: 0.195481, 0.717873, 0.0823583, 0.00428718, 
Output 5: 0.799875, 0.172671, 0.0216153, 0.00583848, 
Output 6: 0.0250497, 0.0861823, 0.0950055, 0.793763, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 36910 at 06-Dec-2025 07:35:42 UTC
Boundary wire vector sizes: 6911, 6803, 6817
minwire 0: 34
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0957992, 
Output 1: 0.0376734, 0.0385838, 0.162907, 0.760836, 
Output 2: 0.0680303, 0.193926, 0.709987, 0.0280569, 
Output 3: 0.950185, 0.0390875, 0.00506476, 0.0056629, 
Output 4: 0.118458, 0.777234, 0.0992047, 0.00510313, 
Output 5: 0.716546, 0.24369, 0.0327925, 0.00697183, 
Output 6: 0.0305914, 0.0863942, 0.0846707, 0.798344, 

06-Dec-2025 08:40:55 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 08:40:55 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/48/63/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T020956Z_gen_003691_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3903.37       4993.23       6121.67       5076.39       704.412        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00801024     0.0169076     0.030809      0.0163483     0.0058002       10     
reco:pandora:StandardPandora                            3898.85       4986.92       6116.06       5070.01       703.217        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000840174    0.0950195      0.43856      0.0719812     0.121222        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000747309    0.0121052     0.0691263    0.00432577     0.0196444       10     
reco:pandoracalo:Calorimetry                          0.000499601   0.00534818     0.0217506    0.00158025    0.00669638       10     
reco:pandorapid:Chi2ParticleID                        0.000164791   0.00150787    0.00729391    0.000300567   0.00246182       10     
reco:cvnmap:CVNMapper                                  0.112574      0.179077      0.317833      0.131414      0.0764629       10     
reco:cvneva:CVNEvaluator                                2.94872       4.92843       13.9393       3.80763       3.09168        10     
reco:energyrecnumu:EnergyReco                          0.0149853     0.109309      0.296363      0.0955363     0.0860306       10     
reco:energyrecnue:EnergyReco                           0.0033484    0.00959923     0.0252229    0.00396111    0.00849194       10     
reco:energyrecnc:EnergyReco                            0.0154248     0.0938197     0.283142      0.0779628     0.0858629       10     
[art]:TriggerResults:TriggerResultInserter            3.7952e-05    9.64519e-05   0.00039795    5.22485e-05   0.000104744      10     
end_path:out1:RootOutput                              1.1682e-05    3.54588e-05   0.000122571   2.00975e-05   3.26461e-05      10     
end_path:out1:RootOutput(write)                        0.689709      0.857897       1.39523      0.773803      0.213144        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21758.1 MB
  Peak resident set size usage (VmHWM): 2853.13 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
True Electron Energy: 5.81203
Completed MCParticle Loop
True Neutrino Energy: 9.09747
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 36910 at 06-Dec-2025 08:42:38 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  62
Added hit list length: 62 | Max was set to: -3.40282e+38
True Neutron Energy: 939.572
True Electron Energy: 47.322
Completed MCParticle Loop
True Neutrino Energy: 69.2876
 Size of all hits: 62
hit initial : 88.1799 | hit correction : 1.25528
hit initial : 43.125 | hit correction : 1.25528
hit initial : 86.8788 | hit correction : 1.25761
hit initial : 251.192 | hit correction : 1.25749
hit initial : 99.7009 | hit correction : 1.25752
hit initial : 166.037 | hit correction : 1.25674
hit initial : 210.397 | hit correction : 1.25665
hit initial : 99.3993 | hit correction : 1.25663
hit initial : 40.7837 | hit correction : 1.27123
hit initial : 49.4186 | hit correction : 1.27405
hit initial : 143.336 | hit correction : 1.274
hit initial : 229.391 | hit correction : 1.27415
hit initial : 87.9166 | hit correction : 1.27385
hit initial : 47.1965 | hit correction : 1.2736
hit initial : 161.046 | hit correction : 1.27412
hit initial : 307.814 | hit correction : 1.27298
hit initial : 37.7288 | hit correction : 1.27292
hit initial : 243.313 | hit correction : 1.27275
hit initial : 180.881 | hit correction : 1.2727
hit initial : 112.708 | hit correction : 1.27263
hit initial : 171.58 | hit correction : 1.2722
hit initial : 304.369 | hit correction : 1.27201
hit initial : 303.737 | hit correction : 1.27181
hit initial : 544.607 | hit correction : 1.27181
hit initial : 454.32 | hit correction : 1.27173
 *** Total Charge : 5665.62
 Looking at view: 0 | Number of hits in view: 25
hit initial : 306.782 | hit correction : 1.27172
hit initial : 273.771 | hit correction : 1.27168
hit initial : 193.821 | hit correction : 1.2717
hit initial : 201.056 | hit correction : 1.27177
hit initial : 51.5062 | hit correction : 1.27525
hit initial : 24.4679 | hit correction : 1.27526
hit initial : 96.2274 | hit correction : 1.27415
hit initial : 340.401 | hit correction : 1.27407
hit initial : 400.735 | hit correction : 1.27389
hit initial : 64.4996 | hit correction : 1.27398
hit initial : 259.647 | hit correction : 1.27289
hit initial : 265.28 | hit correction : 1.27241
hit initial : 222.012 | hit correction : 1.27201
hit initial : 198.145 | hit correction : 1.27226
hit initial : 188.466 | hit correction : 1.27204
hit initial : 217.796 | hit correction : 1.27186
hit initial : 219.233 | hit correction : 1.27259
hit initial : 208.237 | hit correction : 1.27279
hit initial : 82.6459 | hit correction : 1.27284
 *** Total Charge : 4854.84
 Looking at view: 1 | Number of hits in view: 19
hit initial : 64.2241 | hit correction : 1.27414
hit initial : 292.335 | hit correction : 1.27414
hit initial : 107.73 | hit correction : 1.27399
hit initial : 158.029 | hit correction : 1.27415
hit initial : 107.775 | hit correction : 1.27384
hit initial : 123.338 | hit correction : 1.27356
hit initial : 199.599 | hit correction : 1.27317
hit initial : 137.726 | hit correction : 1.27288
hit initial : 385.848 | hit correction : 1.27243
hit initial : 186.556 | hit correction : 1.27281
hit initial : 153.789 | hit correction : 1.27258
hit initial : 132.384 | hit correction : 1.27236
hit initial : 159.059 | hit correction : 1.27212
hit initial : 173.973 | hit correction : 1.27197
hit initial : 244.499 | hit correction : 1.27179
hit initial : 421.879 | hit correction : 1.27185
hit initial : 263.314 | hit correction : 1.27171
hit initial : 379.167 | hit correction : 1.27166
 *** Total Charge : 4697.45
 Looking at view: 2 | Number of hits in view: 18
06-Dec-2025 08:42:45 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.144888      0.186341      0.241042      0.185328      0.0235812       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000767077    0.0016471    0.00534378    0.00101742    0.00141712       10     
end_path:ana:AnalyzeEvents         0.143835      0.184345      0.239831      0.182745      0.0234971       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19478.7 MB
  Peak resident set size usage (VmHWM): 1542.38 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:10:30 UTC       justIN version: 01.06.00