justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258165.2@dunegpschedd02.fnal.gov

Jobsub ID258165.2@dunegpschedd02.fnal.gov
Workflow ID11028
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 20:42:07
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 12:31:51
From worker nodeHostnamedunegli-7832230-0-fnpc18004.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:35:59
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T160402Z_gen_000144_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time10h (39334s)
CPU time10h (38017s = 96%)
Max RSS bytes3054092288 (2912 MiB)
Outputting started2025-12-06 12:31:34
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11028/1/001/analysisLowE_20251206T013601Z.root
Finished2025-12-06 12:31:51
Saved logsjustin-logs:258165.2-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.566115, 
Output 2: 0.048339, 0.0797918, 0.856512, 0.0153568, 
Output 3: 0.9546, 0.0341847, 0.00380421, 0.00741082, 
Output 4: 0.418424, 0.513943, 0.056367, 0.0112659, 
Output 5: 0.267002, 0.453607, 0.203189, 0.0762025, 
Output 6: 0.0966017, 0.176034, 0.117542, 0.609823, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 1440 at 06-Dec-2025 11:38:37 UTC
Boundary wire vector sizes: 6886, 6843, 6777
minwire 0: 35
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1881, 2380
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.118676, 
Output 1: 0.055167, 0.123947, 0.1743, 0.646586, 
Output 2: 0.0564719, 0.227183, 0.685888, 0.0304577, 
Output 3: 0.926859, 0.0547001, 0.00905567, 0.00938495, 
Output 4: 0.462908, 0.451412, 0.0762553, 0.00942514, 
Output 5: 0.467476, 0.414092, 0.0999377, 0.0184949, 
Output 6: 0.0299725, 0.0810536, 0.0901261, 0.798848, 

06-Dec-2025 12:30:07 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 12:30:07 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/86/76/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T160402Z_gen_000144_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3082.81       3897.22       4265.72       4039.93       339.063        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00272247     0.0115795     0.0229373    0.00990026    0.00587105       10     
reco:pandora:StandardPandora                            3078.43       3845.23       4187.22       3970.91       311.628        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00316053     0.0589529     0.176819      0.0658588     0.0485962       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000642513    0.0110592     0.0612332    0.00412835     0.0171478       10     
reco:pandoracalo:Calorimetry                          0.000560619   0.00972587     0.0596437    0.00112934     0.0174255       10     
reco:pandorapid:Chi2ParticleID                        0.00014809    0.00127356    0.00746182    0.000231622   0.00229577       10     
reco:cvnmap:CVNMapper                                  0.0612256     0.0918069     0.128193      0.0842826     0.0189703       10     
reco:cvneva:CVNEvaluator                                3.06176       4.58474       9.86735       4.17353       1.81736        10     
reco:energyrecnumu:EnergyReco                         0.00883856      19.828        73.3109      0.0162166      30.3763        10     
reco:energyrecnue:EnergyReco                          0.00241905    0.00833652     0.0217129    0.00439364    0.00738913       10     
reco:energyrecnc:EnergyReco                            0.0159877      26.6564       74.2997      0.125874       32.7531        10     
[art]:TriggerResults:TriggerResultInserter            2.8584e-05    5.90413e-05   0.000239001   3.83975e-05   6.04832e-05      10     
end_path:out1:RootOutput                               9.849e-06     1.751e-05    6.9962e-05    1.1662e-05    1.75103e-05      10     
end_path:out1:RootOutput(write)                        0.634862      0.719227      0.953972      0.692584      0.0963525       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21761 MB
  Peak resident set size usage (VmHWM): 3054.09 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 288.451 | hit correction : 1.20752
hit initial : 202.895 | hit correction : 1.20725
hit initial : 217.977 | hit correction : 1.20714
 *** Total Charge : 2817.21
 Looking at view: 1 | Number of hits in view: 13
hit initial : 103.477 | hit correction : 1.20707
hit initial : 255.548 | hit correction : 1.20702
hit initial : 148.044 | hit correction : 1.20702
hit initial : 64.3219 | hit correction : 1.2082
hit initial : 383.781 | hit correction : 1.20798
hit initial : 336.367 | hit correction : 1.20771
hit initial : 215.707 | hit correction : 1.20734
hit initial : 151.677 | hit correction : 1.20721
hit initial : 118.856 | hit correction : 1.20713
hit initial : 119.2 | hit correction : 1.2071
hit initial : 122.604 | hit correction : 1.20708
 *** Total Charge : 2438.49
 Looking at view: 2 | Number of hits in view: 11
Begin processing the 9th record. run: 5026 subRun: 0 event: 1439 at 06-Dec-2025 12:31:23 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 17.4778
Completed MCParticle Loop
True Neutrino Energy: 25.2759
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 1440 at 06-Dec-2025 12:31:28 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  41
Added hit list length: 41 | Max was set to: -3.40282e+38
True Neutron Energy: 939.587
True Electron Energy: 23.4274
Completed MCParticle Loop
True Neutrino Energy: 26.7325
 Size of all hits: 41
hit initial : 30.171 | hit correction : 1.23729
hit initial : 25.4257 | hit correction : 1.23735
hit initial : 24.807 | hit correction : 1.23802
hit initial : 93.9406 | hit correction : 1.23802
hit initial : 47.644 | hit correction : 1.23805
hit initial : 136.538 | hit correction : 1.24477
hit initial : 81.085 | hit correction : 1.24472
hit initial : 131.262 | hit correction : 1.24461
hit initial : 294.436 | hit correction : 1.24401
hit initial : 342.277 | hit correction : 1.2434
hit initial : 75.0901 | hit correction : 1.24248
hit initial : 238.611 | hit correction : 1.24131
hit initial : 547.619 | hit correction : 1.24114
hit initial : 82.4445 | hit correction : 1.24032
hit initial : 169.708 | hit correction : 1.24025
hit initial : 220.068 | hit correction : 1.23928
 *** Total Charge : 3155.54
 Looking at view: 0 | Number of hits in view: 16
hit initial : 122.261 | hit correction : 1.24423
hit initial : 110.5 | hit correction : 1.24479
hit initial : 42.3203 | hit correction : 1.24482
hit initial : 128.166 | hit correction : 1.24308
hit initial : 907.419 | hit correction : 1.24183
hit initial : 75.6841 | hit correction : 1.24121
hit initial : 482.9 | hit correction : 1.24114
hit initial : 46.7121 | hit correction : 1.23998
hit initial : 29.5487 | hit correction : 1.23926
hit initial : 14.9282 | hit correction : 1.23874
 *** Total Charge : 2434.85
 Looking at view: 1 | Number of hits in view: 10
hit initial : 25.9401 | hit correction : 1.24414
hit initial : 40.7658 | hit correction : 1.23727
hit initial : 23.6407 | hit correction : 1.23725
hit initial : 27.8566 | hit correction : 1.24481
hit initial : 263.196 | hit correction : 1.24478
hit initial : 262.703 | hit correction : 1.24435
hit initial : 16.5296 | hit correction : 1.24424
hit initial : 136.634 | hit correction : 1.24389
hit initial : 160.937 | hit correction : 1.24355
hit initial : 168.001 | hit correction : 1.24318
hit initial : 202.425 | hit correction : 1.24276
hit initial : 232.784 | hit correction : 1.24132
hit initial : 599.434 | hit correction : 1.24055
hit initial : 56.928 | hit correction : 1.24032
hit initial : 296.076 | hit correction : 1.23919
 *** Total Charge : 3122.32
 Looking at view: 2 | Number of hits in view: 15
06-Dec-2025 12:31:33 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.125094      0.158987      0.198835      0.150753      0.0236647       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000626925   0.00110161     0.0041773    0.000787648   0.00102878       10     
end_path:ana:AnalyzeEvents         0.124157      0.157568      0.197698      0.149772      0.0232076       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19480.9 MB
  Peak resident set size usage (VmHWM): 1542 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:08:23 UTC       justIN version: 01.06.00