justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 257900.65@dunegpschedd02.fnal.gov

Jobsub ID257900.65@dunegpschedd02.fnal.gov
Workflow ID11029
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 10:57:44
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2025-12-06 07:44:18
From worker nodeHostnamedunegli-48727-0-cmswn5027.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-05 19:55:41
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T003141Z_gen_002448_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (42508s)
CPU time11h (42146s = 99%)
Max RSS bytes2976739328 (2838 MiB)
Outputting started2025-12-06 07:44:10
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11029/1/001/analysisLowE_20251205T195543Z.root
Finished2025-12-06 07:44:18
Saved logsjustin-logs:257900.65-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

5 07:43:37 UTC run: 5027 subRun: 0 event: 24480
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  06-Dec-2025 07:43:37 UTC run: 5027 subRun: 0 event: 24480
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6823, 6721, 6727
minwire 0: 14
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.126216, 
Output 1: 0.0759349, 0.0775111, 0.120179, 0.726375, 
Output 2: 0.0841834, 0.161855, 0.734326, 0.0196357, 
Output 3: 0.98547, 0.0114635, 0.000544027, 0.00252247, 
Output 4: 0.306424, 0.649029, 0.0409829, 0.00356343, 
Output 5: 0.344496, 0.513846, 0.110747, 0.0309119, 
Output 6: 0.0444778, 0.10711, 0.102938, 0.745474, 

06-Dec-2025 07:43:38 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 07:43:38 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/75/82/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T003141Z_gen_002448_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              800.23         4219         6184.69       4964.59       1963.45        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00781147     0.0192848     0.0341613     0.0190208    0.00782849       10     
reco:pandora:StandardPandora                            799.181       4215.84       6181.33       4962.8        1961.8         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000729733    0.0843798     0.491585      0.020643      0.143129        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000585831    0.0116313     0.0676836    0.00376911     0.0196873       10     
reco:pandoracalo:Calorimetry                          0.000181855    0.0233344      0.10804     0.000592974    0.0416389       10     
reco:pandorapid:Chi2ParticleID                         5.277e-05    0.00107163    0.00932968    0.000135853    0.0027536       10     
reco:cvnmap:CVNMapper                                  0.0253423     0.134935      0.369166      0.110587      0.0995762       10     
reco:cvneva:CVNEvaluator                               0.715896       2.09943       7.62105       1.20991       1.9771         10     
reco:energyrecnumu:EnergyReco                         0.00542947     0.0866375     0.210068      0.0632235     0.0702361       10     
reco:energyrecnue:EnergyReco                          0.00103363    0.00812586     0.0250146    0.00238409     0.0093285       10     
reco:energyrecnc:EnergyReco                           0.00479189     0.0596165     0.214967      0.0212507     0.0677406       10     
[art]:TriggerResults:TriggerResultInserter             8.907e-06    7.19193e-05   0.000244854   6.4172e-05    6.47307e-05      10     
end_path:out1:RootOutput                               8.866e-06    3.33019e-05   0.000103236   2.4802e-05    2.67067e-05      10     
end_path:out1:RootOutput(write)                        0.203617      0.634907       1.78587       0.51949      0.457175        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21780.9 MB
  Peak resident set size usage (VmHWM): 2976.74 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 33.2772 | hit correction : 1.0281
hit initial : 105.648 | hit correction : 1.02876
hit initial : 130.657 | hit correction : 1.02881
hit initial : 147.213 | hit correction : 1.02876
hit initial : 27.013 | hit correction : 1.02883
hit initial : 46.533 | hit correction : 1.02948
hit initial : 144.152 | hit correction : 1.0296
hit initial : 302.523 | hit correction : 1.02961
hit initial : 114.522 | hit correction : 1.02961
hit initial : 216.52 | hit correction : 1.03173
hit initial : 70.1824 | hit correction : 1.03167
hit initial : 85.4298 | hit correction : 1.03225
hit initial : 391.226 | hit correction : 1.03235
hit initial : 81.3323 | hit correction : 1.0324
hit initial : 34.7873 | hit correction : 1.03314
hit initial : 790.027 | hit correction : 1.0337
hit initial : 60.1277 | hit correction : 1.03415
hit initial : 77.0655 | hit correction : 1.03525
hit initial : 50.0579 | hit correction : 1.03531
hit initial : 38.2753 | hit correction : 1.03597
hit initial : 72.6507 | hit correction : 1.03594
hit initial : 62.6828 | hit correction : 1.03658
hit initial : 43.5226 | hit correction : 1.03701
hit initial : 121.12 | hit correction : 1.037
hit initial : 65.5065 | hit correction : 1.03697
 *** Total Charge : 3715.03
 Looking at view: 0 | Number of hits in view: 29
hit initial : 210.576 | hit correction : 1.02744
hit initial : 377.607 | hit correction : 1.02788
hit initial : 131.527 | hit correction : 1.02873
hit initial : 305.778 | hit correction : 1.02879
hit initial : 436.908 | hit correction : 1.02899
hit initial : 229.399 | hit correction : 1.02956
hit initial : 254.363 | hit correction : 1.02961
hit initial : 160.213 | hit correction : 1.02964
hit initial : 84.9008 | hit correction : 1.03188
hit initial : 77.7503 | hit correction : 1.03239
hit initial : 659.817 | hit correction : 1.03288
hit initial : 925.593 | hit correction : 1.03385
hit initial : 444.404 | hit correction : 1.0339
hit initial : 14.2248 | hit correction : 1.0352
hit initial : 48.0993 | hit correction : 1.03597
hit initial : 105.093 | hit correction : 1.03613
hit initial : 34.7653 | hit correction : 1.03699
hit initial : 102.253 | hit correction : 1.03699
hit initial : 71.0974 | hit correction : 1.03697
 *** Total Charge : 4822.03
 Looking at view: 1 | Number of hits in view: 19
hit initial : 10.92 | hit correction : 1.03703
hit initial : 29.1617 | hit correction : 1.0394
hit initial : 104.951 | hit correction : 1.03685
hit initial : 119.506 | hit correction : 1.02711
hit initial : 287.592 | hit correction : 1.02754
hit initial : 21.6728 | hit correction : 1.02773
hit initial : 239.364 | hit correction : 1.02816
hit initial : 448.91 | hit correction : 1.02871
hit initial : 144.474 | hit correction : 1.02884
hit initial : 263.403 | hit correction : 1.02917
hit initial : 224.927 | hit correction : 1.02956
hit initial : 279.704 | hit correction : 1.02959
hit initial : 242.69 | hit correction : 1.02967
hit initial : 344.953 | hit correction : 1.03177
hit initial : 451.312 | hit correction : 1.03201
hit initial : 527.64 | hit correction : 1.03239
hit initial : 305.045 | hit correction : 1.03274
hit initial : 263.582 | hit correction : 1.03337
hit initial : 673.911 | hit correction : 1.0344
hit initial : 288.803 | hit correction : 1.03535
hit initial : 56.6953 | hit correction : 1.03599
hit initial : 312.242 | hit correction : 1.03595
hit initial : 267.33 | hit correction : 1.03658
hit initial : 273.863 | hit correction : 1.03701
 *** Total Charge : 6381.29
 Looking at view: 2 | Number of hits in view: 24
Begin processing the 10th record. run: 5027 subRun: 0 event: 24480 at 06-Dec-2025 07:44:08 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Neutron Energy: 939.574
True Electron Energy: 38.2643
Completed MCParticle Loop
True Neutrino Energy: 41.6155
 Size of all hits: 0
06-Dec-2025 07:44:10 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0489281     0.057321      0.0774684     0.0555042    0.00856474       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00032699    0.000488868   0.00103481    0.000415107   0.000200859      10     
end_path:ana:AnalyzeEvents         0.048413      0.0566781     0.075877      0.0550229    0.00829944       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19473.5 MB
  Peak resident set size usage (VmHWM): 1529.66 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:11:01 UTC       justIN version: 01.06.00