justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260480.0@dunegpschedd02.fnal.gov

Jobsub ID260480.0@dunegpschedd02.fnal.gov
Workflow ID11111
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 19:37:17
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 13:40:57
From worker nodeHostnamedunegli-7867878-0-fnpc19135.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 08:55:46
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T204306Z_gen_003122_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (17098s)
CPU time4h (16926s = 98%)
Max RSS bytes2925572096 (2790 MiB)
Outputting started2025-12-11 13:40:45
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11111/1/001/analysisLowE_20251211T085548Z.root
Finished2025-12-11 13:40:57
Saved logsjustin-logs:260480.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

7, 0.201863, 0.123509, 0.535851, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 31220 at 11-Dec-2025 13:16:15 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 13:40:02 UTC run: 5026 subRun: 0 event: 31220
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6873, 6884, 6791
minwire 0: 13
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1256, 1755
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.104135, 
Output 1: 0.105568, 0.0513187, 0.103265, 0.739848, 
Output 2: 0.0347815, 0.195156, 0.740717, 0.0293453, 
Output 3: 0.961956, 0.0133242, 0.0048658, 0.0198536, 
Output 4: 0.747585, 0.212182, 0.033364, 0.0068685, 
Output 5: 0.523931, 0.325371, 0.119887, 0.0308106, 
Output 6: 0.0137511, 0.0365262, 0.0521713, 0.897551, 

11-Dec-2025 13:40:05 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 13:40:05 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/3e/5c/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T204306Z_gen_003122_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1426.59       1686.09       2610.31       1517.64       340.187        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0024942    0.00649065     0.0210825    0.00363882    0.00615327       10     
reco:pandora:StandardPandora                            1424.86       1683.93       2604.7        1515.89       339.112        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000294553    0.0312331     0.157427      0.0266955     0.0434729       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000299183   0.00423009    0.00783756     0.0049012    0.00224752       10     
reco:pandoracalo:Calorimetry                          0.000155762   0.000905628   0.00364545    0.000377099   0.00101737       10     
reco:pandorapid:Chi2ParticleID                        4.7261e-05    0.000321525   0.00166857    9.3416e-05    0.000481349      10     
reco:cvnmap:CVNMapper                                  0.0242016     0.0343564     0.0807264     0.0294322     0.015671        10     
reco:cvneva:CVNEvaluator                                1.23392       1.64105       4.73123       1.27628       1.03243        10     
reco:energyrecnumu:EnergyReco                          0.0056004     0.0622349     0.167975      0.0474035     0.0587934       10     
reco:energyrecnue:EnergyReco                          0.00099274    0.00380912     0.0136453    0.00120704    0.00424425       10     
reco:energyrecnc:EnergyReco                           0.00758999     0.047211      0.101843      0.0438147     0.0392573       10     
[art]:TriggerResults:TriggerResultInserter             1.232e-05    2.85462e-05   0.000144021    1.579e-05    3.85542e-05      10     
end_path:out1:RootOutput                               6.261e-06    1.10412e-05    3.734e-05     7.825e-06    8.91714e-06      10     
end_path:out1:RootOutput(write)                         0.30269      0.327128      0.419895      0.317546      0.0315236       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21682.4 MB
  Peak resident set size usage (VmHWM): 2925.57 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 18.2199 | hit correction : 1.21733
hit initial : 332.195 | hit correction : 1.21655
 *** Total Charge : 2865.33
 Looking at view: 2 | Number of hits in view: 11
Begin processing the 8th record. run: 5026 subRun: 0 event: 31218 at 11-Dec-2025 13:40:36 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 27.8499
Completed MCParticle Loop
True Neutrino Energy: 33.2298
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 31219 at 11-Dec-2025 13:40:39 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 27.7826
Completed MCParticle Loop
True Neutrino Energy: 33.1812
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 31220 at 11-Dec-2025 13:40:42 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  48
Added hit list length: 48 | Max was set to: -3.40282e+38
This pfp has size:  24
True Neutron Energy: 939.575
True Neutron Energy: 940.484
True Electron Energy: 47.7841
Completed MCParticle Loop
True Neutrino Energy: 63.3516
 Size of all hits: 48
hit initial : 130.678 | hit correction : 1.09708
hit initial : 241.976 | hit correction : 1.09711
hit initial : 275.24 | hit correction : 1.0972
hit initial : 111.825 | hit correction : 1.09743
hit initial : 28.8232 | hit correction : 1.09736
hit initial : 40.3365 | hit correction : 1.09496
hit initial : 143.726 | hit correction : 1.095
hit initial : 129.914 | hit correction : 1.09506
hit initial : 179.909 | hit correction : 1.09785
hit initial : 196.894 | hit correction : 1.09808
hit initial : 321.077 | hit correction : 1.09831
hit initial : 273.917 | hit correction : 1.09848
hit initial : 252.882 | hit correction : 1.09873
hit initial : 282.628 | hit correction : 1.09895
hit initial : 274.078 | hit correction : 1.09922
hit initial : 270.397 | hit correction : 1.09958
hit initial : 308.228 | hit correction : 1.09996
hit initial : 335.042 | hit correction : 1.10036
hit initial : 311.746 | hit correction : 1.10083
hit initial : 307.617 | hit correction : 1.10121
hit initial : 290.175 | hit correction : 1.10158
hit initial : 141.776 | hit correction : 1.10176
 *** Total Charge : 5328.76
 Looking at view: 1 | Number of hits in view: 22
hit initial : 22.845 | hit correction : 1.10194
hit initial : 572.744 | hit correction : 1.09714
hit initial : 99.9747 | hit correction : 1.09714
hit initial : 46.1669 | hit correction : 1.09672
hit initial : 19.1747 | hit correction : 1.09714
hit initial : 357.184 | hit correction : 1.09753
hit initial : 203.64 | hit correction : 1.09796
hit initial : 189.801 | hit correction : 1.09811
hit initial : 259.754 | hit correction : 1.09833
hit initial : 204.268 | hit correction : 1.09842
hit initial : 171.133 | hit correction : 1.09858
hit initial : 176.365 | hit correction : 1.09874
hit initial : 256.109 | hit correction : 1.09894
hit initial : 35.7192 | hit correction : 1.09895
hit initial : 241.926 | hit correction : 1.09917
hit initial : 221 | hit correction : 1.09947
hit initial : 239.181 | hit correction : 1.09977
hit initial : 234.163 | hit correction : 1.10011
hit initial : 220.692 | hit correction : 1.10038
hit initial : 161.348 | hit correction : 1.10069
hit initial : 160.707 | hit correction : 1.1009
hit initial : 165.295 | hit correction : 1.1011
hit initial : 124.488 | hit correction : 1.10129
hit initial : 144.292 | hit correction : 1.10148
hit initial : 156.803 | hit correction : 1.10165
hit initial : 153.506 | hit correction : 1.10184
 *** Total Charge : 5317.93
 Looking at view: 2 | Number of hits in view: 26
11-Dec-2025 13:40:44 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0692099     0.082438      0.0953068     0.0839216    0.00849856       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000353943   0.000436104   0.000560116   0.000419594   7.88226e-05      10     
end_path:ana:AnalyzeEvents         0.0686864     0.0818159     0.0947963     0.0834041    0.00857772       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.3 MB
  Peak resident set size usage (VmHWM): 1538.38 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:58:50 UTC       justIN version: 01.06.00