justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258167.13@dunegpschedd02.fnal.gov

Jobsub ID258167.13@dunegpschedd02.fnal.gov
Workflow ID11022
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 20:51:07
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 09:08:09
From worker nodeHostnamedunegli-7988752-0-fnpc18001.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:37:07
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T202703Z_gen_002013_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (27039s)
CPU time7h (26471s = 97%)
Max RSS bytes3044954112 (2903 MiB)
Outputting started2025-12-06 09:07:47
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11022/1/001/analysisLowE_20251206T013709Z.root
Finished2025-12-06 09:08:09
Saved logsjustin-logs:258167.13-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

72379, 0.0361678, 
Output 6: 0.0210563, 0.0559159, 0.0749164, 0.848111, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 20130 at 06-Dec-2025 08:31:12 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  06-Dec-2025 09:05:35 UTC run: 5026 subRun: 0 event: 20130
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6665, 6643, 6566
minwire 0: 22
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.153985, 
Output 1: 0.0839166, 0.0912339, 0.198502, 0.626348, 
Output 2: 0.0639994, 0.152135, 0.753275, 0.0305912, 
Output 3: 0.978909, 0.0135169, 0.00178189, 0.00579175, 
Output 4: 0.359465, 0.594469, 0.042137, 0.00392894, 
Output 5: 0.369088, 0.42567, 0.153471, 0.0517711, 
Output 6: 0.0345383, 0.0939046, 0.0930818, 0.778475, 

06-Dec-2025 09:05:39 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 09:05:39 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/00/e6/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T202703Z_gen_002013_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2061.98       2663.9        4134.17       2440.35       615.679        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00270635     0.0105856     0.0259184    0.00735532     0.007392        10     
reco:pandora:StandardPandora                            2059.41       2660.25       4123.37       2437.71       613.656        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00144313     0.0586335     0.374811      0.0159403     0.107529        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00162409     0.0116369     0.0832762    0.00252249     0.0240191       10     
reco:pandoracalo:Calorimetry                          0.000373735   0.00622316     0.0371557    0.000692741    0.0117487       10     
reco:pandorapid:Chi2ParticleID                        0.000112562   0.000611955   0.00449007    0.000184337   0.00129313       10     
reco:cvnmap:CVNMapper                                  0.0415005     0.0735612     0.231069      0.0544306     0.0535517       10     
reco:cvneva:CVNEvaluator                                1.97981       2.75527       8.72374       2.04563       1.99342        10     
reco:energyrecnumu:EnergyReco                          0.0151598     0.106183      0.503493      0.0260683     0.148555        10     
reco:energyrecnue:EnergyReco                          0.00172071    0.00458802     0.0100557    0.00271381     0.0034349       10     
reco:energyrecnc:EnergyReco                            0.0097632     0.0712534     0.137496      0.0945016     0.0500021       10     
[art]:TriggerResults:TriggerResultInserter            2.2772e-05    4.02199e-05   0.000136528   2.91195e-05   3.24333e-05      10     
end_path:out1:RootOutput                               1.074e-05    1.61314e-05   4.0376e-05    1.2999e-05    8.36971e-06      10     
end_path:out1:RootOutput(write)                        0.404414      0.552379       1.05829      0.436301      0.233907        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21779.3 MB
  Peak resident set size usage (VmHWM): 3044.95 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 112.192 | hit correction : 1.35353
hit initial : 214.753 | hit correction : 1.35359
hit initial : 145.659 | hit correction : 1.35392
hit initial : 90.9447 | hit correction : 1.3498
hit initial : 111.098 | hit correction : 1.34978
hit initial : 22.4904 | hit correction : 1.35275
hit initial : 83.3034 | hit correction : 1.35271
hit initial : 14.779 | hit correction : 1.35277
hit initial : 129.127 | hit correction : 1.35481
hit initial : 152.491 | hit correction : 1.35514
hit initial : 174.775 | hit correction : 1.35556
hit initial : 139.653 | hit correction : 1.35763
hit initial : 178.219 | hit correction : 1.35658
hit initial : 157.689 | hit correction : 1.35657
hit initial : 147.001 | hit correction : 1.35602
hit initial : 129.848 | hit correction : 1.35634
hit initial : 157.034 | hit correction : 1.35648
hit initial : 109.13 | hit correction : 1.35668
hit initial : 99.7929 | hit correction : 1.3568
hit initial : 106.57 | hit correction : 1.35686
hit initial : 211.284 | hit correction : 1.35695
hit initial : 263.314 | hit correction : 1.35715
hit initial : 137.058 | hit correction : 1.35691
hit initial : 101.244 | hit correction : 1.35692
hit initial : 107.27 | hit correction : 1.35694
hit initial : 157.104 | hit correction : 1.35702
hit initial : 115.898 | hit correction : 1.35698
hit initial : 20.0224 | hit correction : 1.35695
 *** Total Charge : 4866.49
 Looking at view: 2 | Number of hits in view: 28
Begin processing the 10th record. run: 5026 subRun: 0 event: 20130 at 06-Dec-2025 09:07:34 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  36
Added hit list length: 36 | Max was set to: -3.40282e+38
True Neutron Energy: 939.566
True Electron Energy: 14.7448
Completed MCParticle Loop
True Neutrino Energy: 20.1322
 Size of all hits: 36
hit initial : 35.5854 | hit correction : 1.05347
hit initial : 100.135 | hit correction : 1.05585
hit initial : 43.0798 | hit correction : 1.05586
hit initial : 51.046 | hit correction : 1.05518
hit initial : 108.937 | hit correction : 1.05638
hit initial : 109.068 | hit correction : 1.05921
hit initial : 311.891 | hit correction : 1.05629
hit initial : 68.5218 | hit correction : 1.05925
hit initial : 675.606 | hit correction : 1.0561
hit initial : 644.571 | hit correction : 1.05602
hit initial : 157.062 | hit correction : 1.05599
 *** Total Charge : 2435.24
 Looking at view: 0 | Number of hits in view: 11
hit initial : 109.068 | hit correction : 1.05633
hit initial : 421.108 | hit correction : 1.05629
hit initial : 426.196 | hit correction : 1.05616
hit initial : 38.1542 | hit correction : 1.05518
hit initial : 26.6194 | hit correction : 1.05519
hit initial : 27.8395 | hit correction : 1.05459
hit initial : 25.9965 | hit correction : 1.05616
hit initial : 127.066 | hit correction : 1.05611
hit initial : 246.142 | hit correction : 1.05601
hit initial : 254.16 | hit correction : 1.05592
hit initial : 271.906 | hit correction : 1.05594
 *** Total Charge : 2084.94
 Looking at view: 1 | Number of hits in view: 11
hit initial : 39.5519 | hit correction : 1.0545
hit initial : 144.898 | hit correction : 1.05445
hit initial : 159.157 | hit correction : 1.05639
hit initial : 147.622 | hit correction : 1.05635
hit initial : 178.217 | hit correction : 1.05629
hit initial : 137.988 | hit correction : 1.05624
hit initial : 144.579 | hit correction : 1.05614
hit initial : 85.5685 | hit correction : 1.05516
hit initial : 188.959 | hit correction : 1.05602
hit initial : 184.939 | hit correction : 1.05591
hit initial : 215.957 | hit correction : 1.05588
hit initial : 197.436 | hit correction : 1.05595
hit initial : 248.566 | hit correction : 1.05607
hit initial : 68.9389 | hit correction : 1.05616
 *** Total Charge : 2262.19
 Looking at view: 2 | Number of hits in view: 14
06-Dec-2025 09:07:46 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0984753     0.468782       1.21323      0.360264      0.301354        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000611272   0.000929012   0.00214881    0.000811736   0.000414051      10     
end_path:ana:AnalyzeEvents         0.0974089     0.467544       1.21021      0.359141      0.300894        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19473.1 MB
  Peak resident set size usage (VmHWM): 1530.83 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:07:32 UTC       justIN version: 01.06.00