justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261284.0@dunegpschedd02.fnal.gov

Jobsub ID261284.0@dunegpschedd02.fnal.gov
Workflow ID11115
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:28:39
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 00:10:50
From worker nodeHostnamedunegli-8033263-0-fnpc22010.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:29:36
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T163222Z_gen_000410_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time1h (6060s)
CPU time1h (6015s = 99%)
Max RSS bytes2932621312 (2796 MiB)
Outputting started2025-12-12 00:10:36
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11115/1/001/analysisLowE_20251211T222936Z.root
Finished2025-12-12 00:10:50
Saved logsjustin-logs:261284.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.846729, 
Output 2: 0.28417, 0.240921, 0.405592, 0.0693168, 
Output 3: 0.929063, 0.0651561, 0.00288474, 0.00289584, 
Output 4: 0.0719653, 0.901858, 0.025648, 0.000529098, 
Output 5: 0.899689, 0.0932372, 0.00514141, 0.0019323, 
Output 6: 0.0176214, 0.0902271, 0.089727, 0.802425, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 4100 at 12-Dec-2025 00:00:08 UTC
Boundary wire vector sizes: 6725, 6701, 6764
minwire 0: 32
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1249, 1748
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.114879, 
Output 1: 0.096686, 0.0813902, 0.195189, 0.626735, 
Output 2: 0.0430962, 0.161438, 0.772422, 0.0230438, 
Output 3: 0.947959, 0.0404769, 0.0055471, 0.00601744, 
Output 4: 0.515849, 0.418051, 0.0583365, 0.00776382, 
Output 5: 0.393781, 0.418986, 0.152696, 0.0345375, 
Output 6: 0.039312, 0.101463, 0.095275, 0.76395, 

12-Dec-2025 00:10:08 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 00:10:08 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/6c/79/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T163222Z_gen_000410_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              589.536       597.833       606.92        595.92        5.73027        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0013163    0.00561738     0.0201663     0.0033973    0.00542112       10     
reco:pandora:StandardPandora                            588.553       596.739       604.735       594.945       5.54738        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00140247     0.0108212     0.0488693    0.00431266     0.0138448       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000803939   0.00467403     0.0178865     0.0042369     0.0045959       10     
reco:pandoracalo:Calorimetry                          0.000155013   0.00361961     0.0142234    0.00103164    0.00528004       10     
reco:pandorapid:Chi2ParticleID                        3.5277e-05    0.000239415   0.00131916    6.03285e-05   0.000381725      10     
reco:cvnmap:CVNMapper                                  0.0132389     0.0212176     0.0276393     0.0213924    0.00347569       10     
reco:cvneva:CVNEvaluator                               0.664851      0.774335       1.73173      0.667883      0.319138        10     
reco:energyrecnumu:EnergyReco                         0.00205724     0.0420006     0.0833684     0.0569348     0.0316467       10     
reco:energyrecnue:EnergyReco                          0.000837302   0.00299694    0.00521479    0.00298736    0.00211407       10     
reco:energyrecnc:EnergyReco                            0.0049726      0.02515      0.0582566    0.00511906     0.0246466       10     
[art]:TriggerResults:TriggerResultInserter             8.707e-06    1.34724e-05   3.8463e-05    1.0074e-05    8.66615e-06      10     
end_path:out1:RootOutput                               7.023e-06    1.02634e-05    2.156e-05    7.8895e-06     4.694e-06       10     
end_path:out1:RootOutput(write)                        0.192098      0.202899      0.265557      0.193632      0.0212949       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21689.4 MB
  Peak resident set size usage (VmHWM): 2932.62 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 45.9199 | hit correction : 1.03603
hit initial : 444.498 | hit correction : 1.03862
hit initial : 98.4785 | hit correction : 1.0376
hit initial : 394.33 | hit correction : 1.03763
hit initial : 472.363 | hit correction : 1.03778
hit initial : 115.84 | hit correction : 1.03784
 *** Total Charge : 1659.71
 Looking at view: 1 | Number of hits in view: 7
hit initial : 26.6 | hit correction : 1.03698
hit initial : 32.9829 | hit correction : 1.03868
hit initial : 30.2687 | hit correction : 1.0387
hit initial : 490.418 | hit correction : 1.03804
hit initial : 236.514 | hit correction : 1.03754
hit initial : 57.3852 | hit correction : 1.03602
hit initial : 36.8665 | hit correction : 1.03598
hit initial : 23.1506 | hit correction : 1.03745
hit initial : 45.345 | hit correction : 1.0376
hit initial : 490.68 | hit correction : 1.03765
 *** Total Charge : 1525.61
 Looking at view: 2 | Number of hits in view: 10
Begin processing the 7th record. run: 5026 subRun: 0 event: 4097 at 12-Dec-2025 00:10:28 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 2.50482
Completed MCParticle Loop
True Neutrino Energy: 7.3397
 Size of all hits: 0
Begin processing the 8th record. run: 5026 subRun: 0 event: 4098 at 12-Dec-2025 00:10:30 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 12.0773
Completed MCParticle Loop
True Neutrino Energy: 29.3089
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 4099 at 12-Dec-2025 00:10:32 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 37.0271
Completed MCParticle Loop
True Neutrino Energy: 44.828
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 4100 at 12-Dec-2025 00:10:34 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  27
Added hit list length: 27 | Max was set to: -3.40282e+38
True Neutron Energy: 939.574
True Electron Energy: 37.5189
Completed MCParticle Loop
True Neutrino Energy: 53.0256
 Size of all hits: 27
hit initial : 155.827 | hit correction : 1.25889
hit initial : 58.5718 | hit correction : 1.26003
hit initial : 42.5504 | hit correction : 1.26002
hit initial : 108.696 | hit correction : 1.25891
hit initial : 47.2871 | hit correction : 1.25599
hit initial : 231.363 | hit correction : 1.25618
hit initial : 409.283 | hit correction : 1.25699
hit initial : 79.4633 | hit correction : 1.2587
hit initial : 129.198 | hit correction : 1.26011
hit initial : 360.885 | hit correction : 1.2611
hit initial : 73.7627 | hit correction : 1.26124
hit initial : 400.051 | hit correction : 1.26125
hit initial : 40.1132 | hit correction : 1.26311
hit initial : 29.7291 | hit correction : 1.26312
 *** Total Charge : 2728.67
 Looking at view: 1 | Number of hits in view: 14
hit initial : 28.6263 | hit correction : 1.25386
hit initial : 198.426 | hit correction : 1.25595
hit initial : 352.746 | hit correction : 1.25662
hit initial : 320.746 | hit correction : 1.2576
hit initial : 21.0844 | hit correction : 1.25803
hit initial : 114.866 | hit correction : 1.25876
hit initial : 322.543 | hit correction : 1.25879
hit initial : 84.4528 | hit correction : 1.26002
hit initial : 399.221 | hit correction : 1.26005
hit initial : 230.269 | hit correction : 1.26112
hit initial : 473.719 | hit correction : 1.26115
hit initial : 161.136 | hit correction : 1.26167
hit initial : 66.0198 | hit correction : 1.2631
 *** Total Charge : 3492.84
 Looking at view: 2 | Number of hits in view: 13
12-Dec-2025 00:10:36 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.046949      0.0592783     0.0718481     0.0590151    0.00777815       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000404375   0.000610356   0.000907525   0.000525533   0.000190307      10     
end_path:ana:AnalyzeEvents         0.0459133     0.0584648     0.0705117     0.0584223    0.00777859       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19479.8 MB
  Peak resident set size usage (VmHWM): 1537.51 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:58:09 UTC       justIN version: 01.06.00