justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258133.0@dunegpschedd02.fnal.gov

Jobsub ID258133.0@dunegpschedd02.fnal.gov
Workflow ID11022
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 19:28:03
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 08:52:04
From worker nodeHostnamedunegli-7988996-0-fnpc18005.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:32:31
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T201350Z_gen_002581_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (26354s)
CPU time7h (25809s = 97%)
Max RSS bytes3071217664 (2928 MiB)
Outputting started2025-12-06 08:51:46
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11022/1/001/analysisLowE_20251206T013232Z.root
Finished2025-12-06 08:52:04
Saved logsjustin-logs:258133.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

in processing the 10th record. run: 5026 subRun: 0 event: 25810 at 06-Dec-2025 08:13:53 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  06-Dec-2025 08:50:44 UTC run: 5026 subRun: 0 event: 25810
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6833, 6770, 6677
minwire 0: 24
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 367, 866
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.126114, 
Output 1: 0.114611, 0.0684188, 0.221533, 0.595438, 
Output 2: 0.0628525, 0.0997272, 0.81598, 0.0214407, 
Output 3: 0.977931, 0.0172395, 0.00146348, 0.00336586, 
Output 4: 0.535722, 0.430474, 0.0293443, 0.00445962, 
Output 5: 0.266539, 0.467512, 0.196945, 0.0690032, 
Output 6: 0.0633163, 0.141024, 0.103587, 0.692072, 

06-Dec-2025 08:50:48 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 08:50:48 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/93/96/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T201350Z_gen_002581_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2013.54       2595.22       3117.92       2659.07       378.193        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00363889    0.00881023     0.0297166    0.00610655    0.00737874       10     
reco:pandora:StandardPandora                            2010.13       2591.09       3113.87       2654.25       377.567        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000522324    0.0249876     0.148181     0.00545322     0.043245        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000437925   0.00706923     0.0413983    0.00312009     0.0116988       10     
reco:pandoracalo:Calorimetry                          0.000224232   0.00837605     0.0502357     0.0018304     0.0144778       10     
reco:pandorapid:Chi2ParticleID                        7.7376e-05    0.000571144   0.00408345    0.000163964   0.00117506       10     
reco:cvnmap:CVNMapper                                  0.0358178     0.0585926     0.0987845     0.0511227     0.0217524       10     
reco:cvneva:CVNEvaluator                                1.87741       3.26954       6.6934        3.06249       1.20161        10     
reco:energyrecnumu:EnergyReco                          0.0082575     0.0952482     0.292459      0.0645816     0.0972218       10     
reco:energyrecnue:EnergyReco                          0.00211578    0.00678875     0.0157791    0.00417074    0.00519279       10     
reco:energyrecnc:EnergyReco                           0.00939751     0.0830226     0.165784      0.0776134     0.069764        10     
[art]:TriggerResults:TriggerResultInserter            2.1811e-05    4.43046e-05   0.000177264   2.62345e-05    4.501e-05       10     
end_path:out1:RootOutput                               7.494e-06    1.56566e-05   4.7499e-05    1.1161e-05    1.12222e-05      10     
end_path:out1:RootOutput(write)                        0.359929      0.566418      0.765796      0.583685      0.120171        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21786 MB
  Peak resident set size usage (VmHWM): 3071.22 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 238.549 | hit correction : 1.16895
hit initial : 268.114 | hit correction : 1.16898
hit initial : 19.9709 | hit correction : 1.16917
hit initial : 364.969 | hit correction : 1.16927
hit initial : 61.5726 | hit correction : 1.16959
hit initial : 283.677 | hit correction : 1.17024
hit initial : 251.373 | hit correction : 1.17064
hit initial : 210.811 | hit correction : 1.17087
hit initial : 56.9536 | hit correction : 1.17093
hit initial : 124.981 | hit correction : 1.17934
hit initial : 198.701 | hit correction : 1.17952
hit initial : 181.34 | hit correction : 1.17957
hit initial : 178.268 | hit correction : 1.17965
hit initial : 205.527 | hit correction : 1.17997
hit initial : 203.386 | hit correction : 1.18037
hit initial : 215.88 | hit correction : 1.18069
hit initial : 198.16 | hit correction : 1.18104
hit initial : 249.693 | hit correction : 1.18137
hit initial : 194.516 | hit correction : 1.18166
hit initial : 88.5932 | hit correction : 1.1819
 *** Total Charge : 4937.47
 Looking at view: 2 | Number of hits in view: 23
Begin processing the 9th record. run: 5026 subRun: 0 event: 25809 at 06-Dec-2025 08:51:38 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 24.1083
Completed MCParticle Loop
True Neutrino Energy: 29.6275
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 25810 at 06-Dec-2025 08:51:42 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  37
Added hit list length: 37 | Max was set to: -3.40282e+38
True Neutron Energy: 939.574
True Electron Energy: 18.8377
Completed MCParticle Loop
True Neutrino Energy: 22.9993
 Size of all hits: 37
hit initial : 25.0388 | hit correction : 1.23388
hit initial : 42.1519 | hit correction : 1.23354
hit initial : 68.9358 | hit correction : 1.2335
hit initial : 36.3035 | hit correction : 1.23354
hit initial : 37.0059 | hit correction : 1.23855
hit initial : 19.3198 | hit correction : 1.23854
hit initial : 54.0291 | hit correction : 1.23788
hit initial : 53.5627 | hit correction : 1.23787
hit initial : 76.3819 | hit correction : 1.23663
hit initial : 335.004 | hit correction : 1.23626
hit initial : 619.184 | hit correction : 1.23581
hit initial : 394.806 | hit correction : 1.23567
hit initial : 122.967 | hit correction : 1.23532
hit initial : 159.994 | hit correction : 1.23528
 *** Total Charge : 2526.84
 Looking at view: 0 | Number of hits in view: 14
hit initial : 32.9958 | hit correction : 1.23857
hit initial : 43.6059 | hit correction : 1.23786
hit initial : 26.8908 | hit correction : 1.23789
hit initial : 64.0914 | hit correction : 1.23786
hit initial : 693.273 | hit correction : 1.23588
hit initial : 489.519 | hit correction : 1.23586
hit initial : 328.649 | hit correction : 1.23539
hit initial : 117.853 | hit correction : 1.23532
hit initial : 52.5443 | hit correction : 1.2353
hit initial : 63.8394 | hit correction : 1.23349
hit initial : 38.4842 | hit correction : 1.23349
 *** Total Charge : 2411.97
 Looking at view: 1 | Number of hits in view: 11
hit initial : 26.121 | hit correction : 1.23862
hit initial : 42.1773 | hit correction : 1.23858
hit initial : 108.092 | hit correction : 1.23785
hit initial : 60.0536 | hit correction : 1.23351
hit initial : 79.77 | hit correction : 1.2335
hit initial : 38.6173 | hit correction : 1.23784
hit initial : 30.8084 | hit correction : 1.23691
hit initial : 246.064 | hit correction : 1.23665
hit initial : 427.522 | hit correction : 1.23603
hit initial : 715.846 | hit correction : 1.23562
hit initial : 11.0062 | hit correction : 1.23539
hit initial : 368.686 | hit correction : 1.23531
 *** Total Charge : 2663.06
 Looking at view: 2 | Number of hits in view: 12
06-Dec-2025 08:51:45 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0933977     0.109169      0.142359       0.10817      0.0128324       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000454977   0.000626168   0.00112062    0.000590487   0.000175318      10     
end_path:ana:AnalyzeEvents         0.0926204     0.108328      0.140636       0.10739      0.0125837       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19478.4 MB
  Peak resident set size usage (VmHWM): 1539.84 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:10:27 UTC       justIN version: 01.06.00