justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261221.2@dunegpschedd02.fnal.gov

Jobsub ID261221.2@dunegpschedd02.fnal.gov
Workflow ID11113
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 21:12:35
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 02:15:46
From worker nodeHostnamedunegli-7878639-0-fnpc9105.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 21:13:18
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T215203Z_gen_004495_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (18132s)
CPU time4h (17960s = 99%)
Max RSS bytes2780004352 (2651 MiB)
Outputting started2025-12-12 02:15:30
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11113/1/001/analysisLowE_20251211T211319Z.root
Finished2025-12-12 02:15:46
Saved logsjustin-logs:261221.2-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ation failure: 0, 499
Classifier summary: 
Output 0: 0.0708153, 
Output 1: 0.194757, 0.127575, 0.167063, 0.510604, 
Output 2: 0.0226891, 0.118383, 0.847947, 0.0109815, 
Output 3: 0.941798, 0.0480537, 0.00529382, 0.00485403, 
Output 4: 0.620143, 0.33656, 0.0375885, 0.00570862, 
Output 5: 0.230863, 0.460408, 0.247725, 0.0610042, 
Output 6: 0.117326, 0.325572, 0.160594, 0.396509, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 44950 at 12-Dec-2025 01:39:08 UTC
Boundary wire vector sizes: 6707, 6645, 6598
minwire 0: 35
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.166295, 
Output 1: 0.102988, 0.0649119, 0.125012, 0.707087, 
Output 2: 0.0670485, 0.211458, 0.682142, 0.0393509, 
Output 3: 0.970691, 0.00623286, 0.00211975, 0.0209566, 
Output 4: 0.465826, 0.482157, 0.0461134, 0.00590424, 
Output 5: 0.412152, 0.45417, 0.106881, 0.0267964, 
Output 6: 0.0246312, 0.0491524, 0.0650438, 0.861172, 

12-Dec-2025 02:14:21 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 02:14:21 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/35/8d/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T215203Z_gen_004495_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                               1523          1786         2107.29       1773.29       206.41         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00109663     0.0105535     0.0591047    0.00466621     0.0164881       10     
reco:pandora:StandardPandora                            1521.29       1783.56       2105.37       1770.69       206.652        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00144505     0.0130642     0.0829595    0.00535413     0.0235684       10     
reco:pandoraShower:LArPandoraModularShowerCreation     0.0016373     0.016796      0.077103      0.010764      0.021342        10     
reco:pandoracalo:Calorimetry                          0.000341161    0.0066811     0.0245899     0.002365     0.00828444       10     
reco:pandorapid:Chi2ParticleID                        7.9391e-05    0.000347496   0.00146474    0.000198885   0.000408674      10     
reco:cvnmap:CVNMapper                                  0.0379994     0.0712644     0.0950666     0.0752516     0.0156367       10     
reco:cvneva:CVNEvaluator                                1.05036       1.65979       3.8176        1.46092      0.778895        10     
reco:energyrecnumu:EnergyReco                         0.00940803     0.0751157     0.132286      0.0856637     0.0494559       10     
reco:energyrecnue:EnergyReco                          0.00103531    0.00503005     0.0116768    0.00166168    0.00450221       10     
reco:energyrecnc:EnergyReco                           0.00781593     0.0462682     0.118371      0.0114105      0.04565        10     
[art]:TriggerResults:TriggerResultInserter            1.6649e-05    2.93144e-05   7.1555e-05    2.54015e-05   1.50527e-05      10     
end_path:out1:RootOutput                               5.015e-06    8.8339e-06    2.1568e-05    6.9175e-06    5.12165e-06      10     
end_path:out1:RootOutput(write)                        0.368955       0.52885      0.711675      0.574922      0.114228        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12030.3 MB
  Peak resident set size usage (VmHWM): 2780 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 *** Total Charge : 1829.64
 Looking at view: 0 | Number of hits in view: 11
hit initial : 383.493 | hit correction : 1.07066
hit initial : 437.464 | hit correction : 1.06991
hit initial : 384.404 | hit correction : 1.06907
hit initial : 226.366 | hit correction : 1.06868
hit initial : 86.3959 | hit correction : 1.06864
hit initial : 98.8367 | hit correction : 1.07155
hit initial : 353.227 | hit correction : 1.07172
hit initial : 284.446 | hit correction : 1.07219
 *** Total Charge : 2413.28
 Looking at view: 1 | Number of hits in view: 8
hit initial : 217.529 | hit correction : 1.07345
hit initial : 201.31 | hit correction : 1.07279
hit initial : 1077.93 | hit correction : 1.07302
hit initial : 621.15 | hit correction : 1.07305
hit initial : 414.691 | hit correction : 1.0728
hit initial : 219.333 | hit correction : 1.07233
hit initial : 647.612 | hit correction : 1.07045
hit initial : 20.8611 | hit correction : 1.06863
hit initial : 809.738 | hit correction : 1.069
hit initial : 92.7339 | hit correction : 1.06863
hit initial : 402.932 | hit correction : 1.07154
hit initial : 224.312 | hit correction : 1.07204
 *** Total Charge : 5305.19
 Looking at view: 2 | Number of hits in view: 12
Begin processing the 10th record. run: 5026 subRun: 0 event: 44950 at 12-Dec-2025 02:15:26 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  40
Added hit list length: 40 | Max was set to: -3.40282e+38
True Neutron Energy: 939.577
True Electron Energy: 54.9126
Completed MCParticle Loop
True Neutrino Energy: 67.5424
 Size of all hits: 40
hit initial : 31.7739 | hit correction : 1.47138
hit initial : 207.421 | hit correction : 1.47067
hit initial : 398.413 | hit correction : 1.47182
hit initial : 1566.18 | hit correction : 1.47184
hit initial : 1147.5 | hit correction : 1.47221
hit initial : 259.018 | hit correction : 1.47241
 *** Total Charge : 5314.1
 Looking at view: 0 | Number of hits in view: 6
hit initial : 69.6799 | hit correction : 1.47148
hit initial : 194.331 | hit correction : 1.47153
hit initial : 175.728 | hit correction : 1.47066
hit initial : 388.007 | hit correction : 1.47084
hit initial : 426.28 | hit correction : 1.4712
hit initial : 408.428 | hit correction : 1.47181
hit initial : 215.461 | hit correction : 1.47179
hit initial : 290.291 | hit correction : 1.4725
hit initial : 389.707 | hit correction : 1.47214
hit initial : 204.134 | hit correction : 1.4721
hit initial : 203.024 | hit correction : 1.47264
hit initial : 167.745 | hit correction : 1.47267
hit initial : 204.958 | hit correction : 1.47253
hit initial : 212.2 | hit correction : 1.4723
 *** Total Charge : 5224.92
 Looking at view: 1 | Number of hits in view: 14
hit initial : 118.351 | hit correction : 1.47041
hit initial : 269.796 | hit correction : 1.4707
hit initial : 319.469 | hit correction : 1.47097
hit initial : 171.017 | hit correction : 1.47122
hit initial : 182.106 | hit correction : 1.47166
hit initial : 368.78 | hit correction : 1.47185
hit initial : 217.973 | hit correction : 1.47202
hit initial : 122.67 | hit correction : 1.47238
hit initial : 202.779 | hit correction : 1.47249
hit initial : 163.766 | hit correction : 1.47257
hit initial : 126.844 | hit correction : 1.47267
hit initial : 105.599 | hit correction : 1.47132
hit initial : 173.275 | hit correction : 1.47149
hit initial : 135.379 | hit correction : 1.4727
hit initial : 122.564 | hit correction : 1.47267
hit initial : 159.71 | hit correction : 1.47185
hit initial : 131.382 | hit correction : 1.47255
hit initial : 135.763 | hit correction : 1.47237
hit initial : 183.92 | hit correction : 1.47204
hit initial : 159.302 | hit correction : 1.4722
 *** Total Charge : 5255.06
 Looking at view: 2 | Number of hits in view: 20
12-Dec-2025 02:15:30 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0769193     0.130603      0.237173      0.115359      0.0533511       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000338806   0.00610976     0.0183937    0.000562171   0.00709212       10     
end_path:ana:AnalyzeEvents         0.076458      0.124334      0.222906      0.113746      0.0498771       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9815.7 MB
  Peak resident set size usage (VmHWM): 1539.09 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:57:48 UTC       justIN version: 01.06.00