justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261908.0@dunegpschedd02.fnal.gov

Jobsub ID261908.0@dunegpschedd02.fnal.gov
Workflow ID11173
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 04:44:13
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-13 15:57:09
From worker nodeHostnamedunegli-7890455-0-fnpc18002.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 04:45:57
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T031657Z_gen_004848_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (40251s)
CPU time10h (39273s = 97%)
Max RSS bytes2852384768 (2720 MiB)
Outputting started2025-12-13 15:56:48
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11173/1/001/analysisLowE_20251213T044559Z.root
Finished2025-12-13 15:57:09
Saved logsjustin-logs:261908.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

IZED
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 15:55:37 UTC run: 5027 subRun: 0 event: 48480
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 15:55:37 UTC run: 5027 subRun: 0 event: 48480
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6837, 6834, 6758
minwire 0: 29
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.120973, 
Output 1: 0.0666049, 0.0784025, 0.129477, 0.725516, 
Output 2: 0.0481666, 0.188145, 0.73732, 0.0263678, 
Output 3: 0.974898, 0.0132937, 0.00251568, 0.00929319, 
Output 4: 0.539463, 0.402066, 0.0513987, 0.00707175, 
Output 5: 0.495599, 0.377576, 0.101898, 0.0249272, 
Output 6: 0.0182145, 0.0459287, 0.0602212, 0.875636, 

13-Dec-2025 15:55:42 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 15:55:42 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/3d/0d/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T031657Z_gen_004848_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2580.37       3979.98       5023.43       4119.96       771.811        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00147835     0.0890702     0.815701     0.00413558     0.242359        10     
reco:pandora:StandardPandora                            2577.52       3975.1        5019.19       4112.08       771.278        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000901945    0.101726      0.183723      0.100293      0.0495021       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00120003     0.0114654     0.0651157    0.00561927     0.0181464       10     
reco:pandoracalo:Calorimetry                          0.000596175   0.00372746     0.0167047    0.00119364    0.00492653       10     
reco:pandorapid:Chi2ParticleID                        0.000144713   0.000961163   0.00692549    0.000232994   0.00199561       10     
reco:cvnmap:CVNMapper                                  0.0760467     0.151766       0.34184      0.147031      0.0712448       10     
reco:cvneva:CVNEvaluator                                1.9862        3.66322       8.19415       3.04164       1.80932        10     
reco:energyrecnumu:EnergyReco                          0.0946344     0.153897      0.267862      0.143724      0.0516578       10     
reco:energyrecnue:EnergyReco                          0.00188162     0.0060148     0.0178556    0.00406263    0.00495783       10     
reco:energyrecnc:EnergyReco                            0.0101118     0.014728      0.0179419     0.0165756    0.00329782       10     
[art]:TriggerResults:TriggerResultInserter            2.6191e-05    5.15506e-05   0.000149322   3.6353e-05    3.58313e-05      10     
end_path:out1:RootOutput                              1.2292e-05    2.68684e-05   7.4102e-05    1.62035e-05   2.07021e-05      10     
end_path:out1:RootOutput(write)                        0.459358       0.68353       1.00186      0.740483      0.176729        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21575.3 MB
  Peak resident set size usage (VmHWM): 2852.38 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 302.186 | hit correction : 1.01214
hit initial : 291.514 | hit correction : 1.01238
 *** Total Charge : 3453.56
 Looking at view: 1 | Number of hits in view: 18
hit initial : 268.643 | hit correction : 1.01763
hit initial : 65.8664 | hit correction : 1.00625
hit initial : 63.4332 | hit correction : 1.00718
hit initial : 133.517 | hit correction : 1.00699
hit initial : 671.299 | hit correction : 1.0105
hit initial : 92.0207 | hit correction : 1.00995
hit initial : 430.139 | hit correction : 1.01077
hit initial : 818.758 | hit correction : 1.01123
hit initial : 1190.77 | hit correction : 1.01177
hit initial : 419.3 | hit correction : 1.01241
 *** Total Charge : 4201.29
 Looking at view: 2 | Number of hits in view: 10
Begin processing the 10th record. run: 5027 subRun: 0 event: 48480 at 13-Dec-2025 15:56:44 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  48
Added hit list length: 48 | Max was set to: -3.40282e+38
This pfp has size:  7
This pfp has size:  6
True Neutron Energy: 939.566
True Electron Energy: 30.2643
Completed MCParticle Loop
True Neutrino Energy: 35.7847
 Size of all hits: 48
hit initial : 369.922 | hit correction : 1.16597
hit initial : 32.4121 | hit correction : 1.17931
hit initial : 96.0029 | hit correction : 1.17929
hit initial : 59.1242 | hit correction : 1.17929
hit initial : 161.505 | hit correction : 1.17615
hit initial : 170.665 | hit correction : 1.17611
hit initial : 87.6254 | hit correction : 1.16833
hit initial : 296.177 | hit correction : 1.16832
hit initial : 72.4556 | hit correction : 1.16839
hit initial : 410.689 | hit correction : 1.16763
hit initial : 447.216 | hit correction : 1.16709
hit initial : 45.9718 | hit correction : 1.1672
hit initial : 317.156 | hit correction : 1.16511
hit initial : 167.17 | hit correction : 1.16494
hit initial : 2.78328 | hit correction : 1.1641
hit initial : 126.186 | hit correction : 1.16355
hit initial : 339.828 | hit correction : 1.16343
hit initial : 115.686 | hit correction : 1.1632
 *** Total Charge : 3875.61
 Looking at view: 0 | Number of hits in view: 18
hit initial : 76.2045 | hit correction : 1.17929
hit initial : 81.1195 | hit correction : 1.17928
hit initial : 22.916 | hit correction : 1.17931
hit initial : 66.8355 | hit correction : 1.17616
hit initial : 203.007 | hit correction : 1.17612
hit initial : 118.465 | hit correction : 1.17607
hit initial : 54.6828 | hit correction : 1.1684
hit initial : 192.33 | hit correction : 1.16837
hit initial : 272.432 | hit correction : 1.1682
hit initial : 469.497 | hit correction : 1.16742
hit initial : 590.981 | hit correction : 1.16674
hit initial : 391.977 | hit correction : 1.1652
hit initial : 20.2332 | hit correction : 1.16405
hit initial : 315.019 | hit correction : 1.16433
hit initial : 94.4451 | hit correction : 1.16343
hit initial : 182.251 | hit correction : 1.16332
hit initial : 160.156 | hit correction : 1.16327
 *** Total Charge : 3869
 Looking at view: 1 | Number of hits in view: 17
hit initial : 83.3784 | hit correction : 1.17928
hit initial : 97.8049 | hit correction : 1.17927
hit initial : 54.3155 | hit correction : 1.17623
hit initial : 287.488 | hit correction : 1.17608
hit initial : 35.4889 | hit correction : 1.17604
hit initial : 144.385 | hit correction : 1.1684
hit initial : 212.681 | hit correction : 1.16795
hit initial : 481.223 | hit correction : 1.16724
hit initial : 1340.2 | hit correction : 1.1655
hit initial : 259.069 | hit correction : 1.16463
hit initial : 15.0207 | hit correction : 1.1641
hit initial : 28.1943 | hit correction : 1.16376
hit initial : 110.615 | hit correction : 1.16318
 *** Total Charge : 3678.89
 Looking at view: 2 | Number of hits in view: 13
13-Dec-2025 15:56:48 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0952125     0.123198      0.156654      0.119842      0.0167013       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000559019   0.000735189   0.00130913    0.000671465   0.000206776      10     
end_path:ana:AnalyzeEvents         0.094412      0.122226      0.154651      0.119042      0.0164436       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19478 MB
  Peak resident set size usage (VmHWM): 1543.11 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:03:55 UTC       justIN version: 01.06.00