justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258268.0@dunegpschedd02.fnal.gov

Jobsub ID258268.0@dunegpschedd02.fnal.gov
Workflow ID11028
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 23:09:14
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 11:55:06
From worker nodeHostnamedunegli-7989276-0-fnpc18006.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:38:49
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T231919Z_gen_001436_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time10h (36945s)
CPU time9h (35324s = 95%)
Max RSS bytes3054223360 (2912 MiB)
Outputting started2025-12-06 11:54:34
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11028/1/001/analysisLowE_20251206T013850Z.root
Finished2025-12-06 11:55:06
Saved logsjustin-logs:258268.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

run: 5027 subRun: 0 event: 14360
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  06-Dec-2025 11:52:59 UTC run: 5027 subRun: 0 event: 14360
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6722, 6780, 6737
minwire 0: 27
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1474, 1973
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0512877, 
Output 1: 0.0630567, 0.0690724, 0.127843, 0.740028, 
Output 2: 0.0642025, 0.146153, 0.76707, 0.0225746, 
Output 3: 0.913873, 0.0709298, 0.00872157, 0.00647557, 
Output 4: 0.847225, 0.119306, 0.0238344, 0.00963489, 
Output 5: 0.592841, 0.325207, 0.0658244, 0.0161278, 
Output 6: 0.0466956, 0.137583, 0.101601, 0.71412, 

06-Dec-2025 11:53:06 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 11:53:06 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/65/03/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T231919Z_gen_001436_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2197.75       3658.92       4445.72       3898.27       777.243        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00308269     0.0140825     0.0315273     0.0108069    0.00863367       10     
reco:pandora:StandardPandora                            2193.76       3612.05       4367.9        3818.53       748.46         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000811267    0.045571      0.263227      0.0216525     0.0755389       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000758451    0.0280458     0.149995     0.00878303     0.045421        10     
reco:pandoracalo:Calorimetry                          0.000474403    0.0056868     0.0180094    0.00189922    0.00680844       10     
reco:pandorapid:Chi2ParticleID                        0.000154742    0.0010629    0.00807304    0.000269308   0.00233909       10     
reco:cvnmap:CVNMapper                                  0.0542129     0.0933518     0.208871      0.0850718     0.0402653       10     
reco:cvneva:CVNEvaluator                                3.22923       4.40692       11.897        3.53783       2.51663        10     
reco:energyrecnumu:EnergyReco                          0.0138561      21.368        74.4445      0.128048       32.5909        10     
reco:energyrecnue:EnergyReco                          0.00237623    0.00754102     0.0317524    0.00463263    0.00833429       10     
reco:energyrecnc:EnergyReco                            0.0140823      20.0616       72.2996      0.0243136      30.6839        10     
[art]:TriggerResults:TriggerResultInserter            3.9474e-05    7.91543e-05   0.000276501   5.8225e-05    6.78367e-05      10     
end_path:out1:RootOutput                              1.6231e-05    2.90249e-05   9.2504e-05    2.1065e-05    2.15173e-05      10     
end_path:out1:RootOutput(write)                        0.521876      0.830099       1.28362      0.784472      0.224404        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21786.6 MB
  Peak resident set size usage (VmHWM): 3054.22 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
Begin processing the 7th record. run: 5027 subRun: 0 event: 14357 at 06-Dec-2025 11:54:13 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  44
Added hit list length: 44 | Max was set to: -3.40282e+38
True Neutron Energy: 940.811
True Electron Energy: 34.4936
Completed MCParticle Loop
True Neutrino Energy: 47.0871
 Size of all hits: 44
hit initial : 83.2277 | hit correction : 1.35493
hit initial : 179.61 | hit correction : 1.35185
hit initial : 93.9697 | hit correction : 1.35495
hit initial : 233.075 | hit correction : 1.35147
hit initial : 243.133 | hit correction : 1.35105
hit initial : 256.561 | hit correction : 1.35071
hit initial : 233.073 | hit correction : 1.35049
hit initial : 209.929 | hit correction : 1.35027
hit initial : 228.457 | hit correction : 1.3501
hit initial : 104.426 | hit correction : 1.35147
hit initial : 356.274 | hit correction : 1.35012
hit initial : 177.382 | hit correction : 1.35143
hit initial : 435.013 | hit correction : 1.35031
hit initial : 44.3134 | hit correction : 1.3515
hit initial : 38.6888 | hit correction : 1.34746
hit initial : 56.9564 | hit correction : 1.34747
hit initial : 64.6822 | hit correction : 1.35199
 *** Total Charge : 4105.06
 Looking at view: 1 | Number of hits in view: 17
hit initial : 77.3497 | hit correction : 1.35213
hit initial : 137.454 | hit correction : 1.35192
hit initial : 65.3649 | hit correction : 1.35485
hit initial : 117.661 | hit correction : 1.35496
hit initial : 46.4166 | hit correction : 1.35505
hit initial : 58.4738 | hit correction : 1.35426
hit initial : 41.0472 | hit correction : 1.35421
hit initial : 228.266 | hit correction : 1.35139
hit initial : 306.018 | hit correction : 1.35095
hit initial : 134.55 | hit correction : 1.35052
hit initial : 119.088 | hit correction : 1.35036
hit initial : 96.3747 | hit correction : 1.35025
hit initial : 104.705 | hit correction : 1.35018
hit initial : 115.654 | hit correction : 1.35012
hit initial : 113.248 | hit correction : 1.35003
hit initial : 118.991 | hit correction : 1.34999
hit initial : 105.261 | hit correction : 1.35003
hit initial : 119.878 | hit correction : 1.35009
hit initial : 120.777 | hit correction : 1.35018
hit initial : 111.551 | hit correction : 1.35033
hit initial : 150.775 | hit correction : 1.35046
hit initial : 171.676 | hit correction : 1.35058
hit initial : 127.784 | hit correction : 1.35077
hit initial : 124.283 | hit correction : 1.35096
hit initial : 128.203 | hit correction : 1.35113
hit initial : 132.802 | hit correction : 1.35138
hit initial : 133.407 | hit correction : 1.35163
 *** Total Charge : 4468.3
 Looking at view: 2 | Number of hits in view: 27
Begin processing the 8th record. run: 5027 subRun: 0 event: 14358 at 06-Dec-2025 11:54:18 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 12.3915
Completed MCParticle Loop
True Neutrino Energy: 20.1778
 Size of all hits: 0
Begin processing the 9th record. run: 5027 subRun: 0 event: 14359 at 06-Dec-2025 11:54:23 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 940.835
True Electron Energy: 12.0164
Completed MCParticle Loop
True Neutrino Energy: 24.6097
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 14360 at 06-Dec-2025 11:54:28 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Neutron Energy: 939.569
True Neutron Energy: 939.72
True Electron Energy: 12.2939
Completed MCParticle Loop
True Neutrino Energy: 21.2501
 Size of all hits: 0
06-Dec-2025 11:54:34 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.130051      0.169235      0.215458      0.169773      0.0266561       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000577719   0.00103398     0.0037745    0.000728193   0.000920109      10     
end_path:ana:AnalyzeEvents          0.1292        0.16788      0.210698      0.168866      0.0259407       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.2 MB
  Peak resident set size usage (VmHWM): 1538.44 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:09:06 UTC       justIN version: 01.06.00