justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258334.0@dunegpschedd02.fnal.gov

Jobsub ID258334.0@dunegpschedd02.fnal.gov
Workflow ID11029
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 01:40:22
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 08:20:32
From worker nodeHostnamedunegli-7988825-0-fnpc17114.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:42:27
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T013125Z_gen_003102_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (23871s)
CPU time6h (23606s = 98%)
Max RSS bytes3046727680 (2905 MiB)
Outputting started2025-12-06 08:20:19
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11029/1/001/analysisLowE_20251206T014228Z.root
Finished2025-12-06 08:20:32
Saved logsjustin-logs:258334.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ubRun: 0 event: 31020
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  06-Dec-2025 08:19:02 UTC run: 5027 subRun: 0 event: 31020
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6867, 6844, 6654
minwire 0: 26
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 822, 1321
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.106561, 
Output 1: 0.0264335, 0.0562574, 0.159374, 0.757935, 
Output 2: 0.104193, 0.256632, 0.594124, 0.04505, 
Output 3: 0.932646, 0.05076, 0.00828952, 0.00830482, 
Output 4: 0.195299, 0.680229, 0.115664, 0.00880814, 
Output 5: 0.815447, 0.16644, 0.0149318, 0.00318215, 
Output 6: 0.0157881, 0.0554792, 0.0695673, 0.859165, 

06-Dec-2025 08:19:06 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 08:19:06 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/d1/9a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T013125Z_gen_003102_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2115.45       2362.24       2558.36       2361.85       118.714        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00185848    0.00794073     0.0137613    0.00765044     0.0033858       10     
reco:pandora:StandardPandora                            2113.15       2359.47       2555.91       2359.43       118.221        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000515585    0.0209777     0.105147     0.00289297     0.0315834       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000610443    0.0059501     0.0140689    0.00583116    0.00453636       10     
reco:pandoracalo:Calorimetry                          0.000345609   0.00290678     0.0110666    0.000694117   0.00389292       10     
reco:pandorapid:Chi2ParticleID                        7.5737e-05    0.000294203   0.00155526    0.000159219   0.000422392      10     
reco:cvnmap:CVNMapper                                  0.0568981     0.074734      0.0839526     0.0749443    0.00736725       10     
reco:cvneva:CVNEvaluator                                1.14216       1.82062       5.41565       1.51373       1.20681        10     
reco:energyrecnumu:EnergyReco                         0.00629895     0.0878328     0.191441      0.0884304     0.0706938       10     
reco:energyrecnue:EnergyReco                          0.00190642    0.00645482     0.0156401    0.00272118    0.00593152       10     
reco:energyrecnc:EnergyReco                            0.0150681     0.0765521     0.161349      0.0656287     0.0619618       10     
[art]:TriggerResults:TriggerResultInserter            2.6067e-05    4.17556e-05   0.000111413   3.30555e-05   2.45516e-05      10     
end_path:out1:RootOutput                               8.139e-06    1.10545e-05   2.6787e-05    8.6445e-06    5.63558e-06      10     
end_path:out1:RootOutput(write)                        0.513344      0.662884      0.800789      0.687913      0.0838465       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 14269.4 MB
  Peak resident set size usage (VmHWM): 3046.73 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 37.7609 | hit correction : 1.10968
hit initial : 71.2763 | hit correction : 1.10802
hit initial : 274.105 | hit correction : 1.10802
hit initial : 297.394 | hit correction : 1.10801
hit initial : 80.3125 | hit correction : 1.10801
hit initial : 83.8349 | hit correction : 1.10624
hit initial : 231.878 | hit correction : 1.10623
hit initial : 251.526 | hit correction : 1.10617
hit initial : 281.679 | hit correction : 1.10586
hit initial : 307.499 | hit correction : 1.10559
hit initial : 266.605 | hit correction : 1.1053
hit initial : 277.72 | hit correction : 1.1049
hit initial : 361.968 | hit correction : 1.10467
hit initial : 366.371 | hit correction : 1.10443
hit initial : 268.467 | hit correction : 1.10396
hit initial : 222.295 | hit correction : 1.10362
hit initial : 115.744 | hit correction : 1.10343
 *** Total Charge : 5192.63
 Looking at view: 1 | Number of hits in view: 24
hit initial : 46.4305 | hit correction : 1.10736
hit initial : 217.173 | hit correction : 1.10969
hit initial : 161.617 | hit correction : 1.10984
hit initial : 217.79 | hit correction : 1.1097
hit initial : 254.732 | hit correction : 1.1095
hit initial : 243.175 | hit correction : 1.10808
hit initial : 407.286 | hit correction : 1.10799
hit initial : 86.6903 | hit correction : 1.10793
hit initial : 168.142 | hit correction : 1.10625
hit initial : 192.544 | hit correction : 1.10619
hit initial : 80.7269 | hit correction : 1.10617
hit initial : 69.1422 | hit correction : 1.10557
hit initial : 1078.74 | hit correction : 1.10558
hit initial : 36.3483 | hit correction : 1.10481
hit initial : 1089.65 | hit correction : 1.10411
hit initial : 114.585 | hit correction : 1.10345
 *** Total Charge : 4939.91
 Looking at view: 2 | Number of hits in view: 16
Begin processing the 9th record. run: 5027 subRun: 0 event: 31019 at 06-Dec-2025 08:20:09 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 8.33456
Completed MCParticle Loop
True Neutrino Energy: 13.8381
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 31020 at 06-Dec-2025 08:20:14 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  22
Added hit list length: 22 | Max was set to: -3.40282e+38
True Neutron Energy: 939.567
True Electron Energy: 9.46445
Completed MCParticle Loop
True Neutrino Energy: 14.8448
 Size of all hits: 22
hit initial : 98.3739 | hit correction : 1.23417
hit initial : 125.195 | hit correction : 1.23413
hit initial : 86.4307 | hit correction : 1.23408
hit initial : 154.3 | hit correction : 1.23322
hit initial : 111.052 | hit correction : 1.23283
hit initial : 140.994 | hit correction : 1.23274
 *** Total Charge : 883.582
 Looking at view: 0 | Number of hits in view: 6
hit initial : 66.0125 | hit correction : 1.23182
hit initial : 35.1382 | hit correction : 1.23431
hit initial : 174.909 | hit correction : 1.23417
hit initial : 70.7576 | hit correction : 1.23395
hit initial : 311.954 | hit correction : 1.23385
hit initial : 13.7373 | hit correction : 1.2334
hit initial : 187.447 | hit correction : 1.23298
hit initial : 181.227 | hit correction : 1.23267
hit initial : 55.6488 | hit correction : 1.23249
hit initial : 88.7503 | hit correction : 1.23182
 *** Total Charge : 1462.14
 Looking at view: 1 | Number of hits in view: 10
hit initial : 36.5633 | hit correction : 1.23429
hit initial : 241.754 | hit correction : 1.2342
hit initial : 144.075 | hit correction : 1.23394
hit initial : 163.4 | hit correction : 1.23335
hit initial : 232.259 | hit correction : 1.23299
hit initial : 195.832 | hit correction : 1.23256
 *** Total Charge : 1250.56
 Looking at view: 2 | Number of hits in view: 6
06-Dec-2025 08:20:18 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.107823      0.146368      0.207532      0.137884      0.0326363       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000552467   0.000728242   0.00136432    0.000659715   0.000230874      10     
end_path:ana:AnalyzeEvents         0.107045      0.145423      0.205436      0.137062      0.0323602       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11959.8 MB
  Peak resident set size usage (VmHWM): 1537.73 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:08:58 UTC       justIN version: 01.06.00