justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261330.0@dunegpschedd02.fnal.gov

Jobsub ID261330.0@dunegpschedd02.fnal.gov
Workflow ID11108
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:58:41
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 02:58:45
From worker nodeHostnamedunegli-7878618-0-fnpc19122.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 23:00:03
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T015204Z_gen_001269_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time3h (14310s)
CPU time3h (14215s = 99%)
Max RSS bytes2925207552 (2789 MiB)
Outputting started2025-12-12 02:58:33
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11108/1/001/analysisLowE_20251211T230003Z.root
Finished2025-12-12 02:58:45
Saved logsjustin-logs:261330.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

2, 0.197776, 0.621676, 
Output 2: 0.0266703, 0.133602, 0.824143, 0.0155846, 
Output 3: 0.971252, 0.0216788, 0.0027742, 0.00429535, 
Output 4: 0.437534, 0.475946, 0.0765871, 0.00993252, 
Output 5: 0.245946, 0.446839, 0.251124, 0.0560916, 
Output 6: 0.0212227, 0.0736014, 0.0862619, 0.818914, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 12690 at 12-Dec-2025 02:33:36 UTC
Boundary wire vector sizes: 6792, 6741, 6756
minwire 0: 55
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 566, 1065
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.169875, 
Output 1: 0.0786095, 0.0854613, 0.158231, 0.677698, 
Output 2: 0.0244348, 0.111417, 0.847646, 0.0165022, 
Output 3: 0.983901, 0.00767213, 0.00139794, 0.00702905, 
Output 4: 0.361183, 0.559483, 0.0707492, 0.00858507, 
Output 5: 0.191721, 0.3672, 0.326911, 0.114169, 
Output 6: 0.0336205, 0.0779624, 0.0871449, 0.801272, 

12-Dec-2025 02:57:54 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 02:57:54 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/78/4a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T015204Z_gen_001269_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1381.15       1418.69       1465.39       1412.36       27.2776        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00115819    0.00514277     0.0248486    0.00341674    0.00660967       10     
reco:pandora:StandardPandora                            1378.21       1417.29       1464.18       1411.13       27.5241        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000732325    0.0177292     0.0617116     0.015602      0.0180947       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00108046     0.0034503    0.00914261    0.00298439    0.00243611       10     
reco:pandoracalo:Calorimetry                          0.000199511    0.0037581     0.0208366    0.000773495   0.00613114       10     
reco:pandorapid:Chi2ParticleID                         5.31e-05     0.000211598   0.000620585   7.4485e-05    0.000198556      10     
reco:cvnmap:CVNMapper                                  0.0230861     0.0313678     0.0464918     0.0286203    0.00781154       10     
reco:cvneva:CVNEvaluator                               0.791525      0.959071       2.37697      0.804346      0.472672        10     
reco:energyrecnumu:EnergyReco                         0.00468886     0.0517761     0.145638      0.042163      0.0465757       10     
reco:energyrecnue:EnergyReco                          0.000832746   0.00380007    0.00723023    0.00371709     0.0029297       10     
reco:energyrecnc:EnergyReco                           0.00628755     0.0416979     0.0903967     0.0370853     0.0355586       10     
[art]:TriggerResults:TriggerResultInserter             9.72e-06     1.80672e-05   6.8191e-05     1.268e-05    1.68122e-05      10     
end_path:out1:RootOutput                               5.43e-06      8.287e-06     2.462e-05     6.82e-06     5.48643e-06      10     
end_path:out1:RootOutput(write)                        0.263904      0.277549       0.33191      0.270652      0.0186558       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21687.2 MB
  Peak resident set size usage (VmHWM): 2925.21 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 135.033 | hit correction : 1.42928
hit initial : 140.216 | hit correction : 1.42933
hit initial : 129.232 | hit correction : 1.42937
hit initial : 131.52 | hit correction : 1.42938
hit initial : 141.975 | hit correction : 1.42943
hit initial : 129.5 | hit correction : 1.42951
hit initial : 146.987 | hit correction : 1.42961
hit initial : 157.542 | hit correction : 1.42971
hit initial : 161.62 | hit correction : 1.42985
hit initial : 45.9306 | hit correction : 1.42973
hit initial : 276.934 | hit correction : 1.4298
hit initial : 200.026 | hit correction : 1.43001
hit initial : 312.071 | hit correction : 1.43003
hit initial : 181.345 | hit correction : 1.43
hit initial : 235.062 | hit correction : 1.43003
hit initial : 148.644 | hit correction : 1.43004
hit initial : 232.599 | hit correction : 1.43002
hit initial : 125.572 | hit correction : 1.43007
 *** Total Charge : 6821.29
 Looking at view: 2 | Number of hits in view: 29
Begin processing the 9th record. run: 5027 subRun: 0 event: 12689 at 12-Dec-2025 02:58:27 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 2.26001
Completed MCParticle Loop
True Neutrino Energy: 5.54375
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 12690 at 12-Dec-2025 02:58:30 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  37
Added hit list length: 37 | Max was set to: -3.40282e+38
True Neutron Energy: 939.578
True Neutron Energy: 942.959
True Neutron Energy: 940.375
True Electron Energy: 16.7815
Completed MCParticle Loop
True Neutrino Energy: 34.0265
 Size of all hits: 37
hit initial : 175.241 | hit correction : 1.06588
hit initial : 32.4377 | hit correction : 1.06475
hit initial : 103.182 | hit correction : 1.06473
hit initial : 79.5536 | hit correction : 1.0693
hit initial : 44.0583 | hit correction : 1.06472
hit initial : 11.6297 | hit correction : 1.0653
hit initial : 28.2666 | hit correction : 1.06532
hit initial : 377.327 | hit correction : 1.06769
hit initial : 156.691 | hit correction : 1.06766
hit initial : 221.698 | hit correction : 1.06921
hit initial : 288.779 | hit correction : 1.06904
hit initial : 309.58 | hit correction : 1.06881
hit initial : 360.626 | hit correction : 1.06842
hit initial : 344.337 | hit correction : 1.06787
 *** Total Charge : 2705.47
 Looking at view: 0 | Number of hits in view: 14
hit initial : 109.94 | hit correction : 1.07026
hit initial : 147.305 | hit correction : 1.07028
hit initial : 37.6382 | hit correction : 1.07031
hit initial : 100.392 | hit correction : 1.06592
hit initial : 265.687 | hit correction : 1.0659
hit initial : 138.583 | hit correction : 1.06588
hit initial : 17.7205 | hit correction : 1.06523
hit initial : 31.7205 | hit correction : 1.06932
hit initial : 31.9726 | hit correction : 1.0653
hit initial : 48.6966 | hit correction : 1.06474
hit initial : 142.188 | hit correction : 1.06926
hit initial : 232.006 | hit correction : 1.06915
hit initial : 248.681 | hit correction : 1.06897
hit initial : 238.753 | hit correction : 1.06877
hit initial : 261.469 | hit correction : 1.06848
hit initial : 341.831 | hit correction : 1.06796
hit initial : 408.811 | hit correction : 1.0677
hit initial : 204.44 | hit correction : 1.06768
 *** Total Charge : 3212.53
 Looking at view: 1 | Number of hits in view: 18
hit initial : 53.7246 | hit correction : 1.0653
hit initial : 566.75 | hit correction : 1.06913
hit initial : 565.289 | hit correction : 1.06871
hit initial : 454.778 | hit correction : 1.06791
hit initial : 570.065 | hit correction : 1.06768
 *** Total Charge : 2361.6
 Looking at view: 2 | Number of hits in view: 5
12-Dec-2025 02:58:33 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0665823     0.0795052     0.0945275     0.0796996    0.00949336       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000318772   0.000546421   0.00118018    0.000424313   0.000267595      10     
end_path:ana:AnalyzeEvents         0.0660841     0.0788045     0.0941039     0.0792016    0.00959954       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19474.3 MB
  Peak resident set size usage (VmHWM): 1534.4 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:58:49 UTC       justIN version: 01.06.00