justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267746.2@dunegpschedd01.fnal.gov

Jobsub ID267746.2@dunegpschedd01.fnal.gov
Workflow ID11173
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 05:08:14
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-13 16:59:29
From worker nodeHostnamedunegli-7890610-0-fnpc9038.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 05:10:03
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T180347Z_gen_001352_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (42525s)
CPU time11h (41357s = 97%)
Max RSS bytes2799693824 (2669 MiB)
Outputting started2025-12-13 16:58:49
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11173/1/001/analysisLowE_20251213T051005Z.root
Finished2025-12-13 16:59:29
Saved logsjustin-logs:267746.2-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

aShower@BeginModule  13-Dec-2025 16:55:16 UTC run: 5026 subRun: 0 event: 13520
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 16:55:16 UTC run: 5026 subRun: 0 event: 13520
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6754, 6638, 6584
minwire 0: 24
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0684109, 
Output 1: 0.138419, 0.217364, 0.226422, 0.417795, 
Output 2: 0.0174735, 0.0670511, 0.910923, 0.00455223, 
Output 3: 0.957045, 0.0345089, 0.00309397, 0.00535205, 
Output 4: 0.533351, 0.382552, 0.065722, 0.0183756, 
Output 5: 0.348326, 0.471186, 0.139168, 0.0413198, 
Output 6: 0.0843181, 0.22598, 0.135447, 0.554255, 

13-Dec-2025 16:56:36 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 16:56:36 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/4a/ac/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T180347Z_gen_001352_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3740.3        4208.06       4432.46       4295.76       224.146        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00126041    0.00662154     0.0231388    0.00211706    0.00759614       10     
reco:pandora:StandardPandora                            3664.84       4135.34       4355.84       4227.43       227.024        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.0221177     0.154802      0.193224      0.172388      0.0478556       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00278647     0.0281618     0.153174     0.00914256     0.0449811       10     
reco:pandoracalo:Calorimetry                          0.000776443   0.00316198     0.0159109    0.00134643    0.00448728       10     
reco:pandorapid:Chi2ParticleID                        0.000201447   0.00129562    0.00670996    0.000308074   0.00206921       10     
reco:cvnmap:CVNMapper                                  0.116733      0.159869      0.200922      0.159589      0.0211758       10     
reco:cvneva:CVNEvaluator                                1.46506       3.1416        10.7687       2.39258       2.55878        10     
reco:energyrecnumu:EnergyReco                           63.3197       68.5246       73.332        67.8138       3.60272        10     
reco:energyrecnue:EnergyReco                          0.00236676    0.00452473    0.00734709    0.00394799    0.00151966       10     
reco:energyrecnc:EnergyReco                            0.0107571     0.016652      0.0213779     0.0165005    0.00271885       10     
[art]:TriggerResults:TriggerResultInserter            2.8016e-05    6.48106e-05   0.000202725   5.1416e-05    4.72381e-05      10     
end_path:out1:RootOutput                              1.3684e-05    1.8863e-05    4.9758e-05    1.56235e-05   1.0386e-05       10     
end_path:out1:RootOutput(write)                        0.452035      0.676075       1.03634      0.668549      0.138363        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11906.6 MB
  Peak resident set size usage (VmHWM): 2799.69 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 71.1311 | hit correction : 1.03685
 *** Total Charge : 6189.7
 Looking at view: 2 | Number of hits in view: 23
Begin processing the 10th record. run: 5026 subRun: 0 event: 13520 at 13-Dec-2025 16:58:40 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  63
Added hit list length: 63 | Max was set to: -3.40282e+38
True Neutron Energy: 939.57
True Electron Energy: 37.3837
Completed MCParticle Loop
True Neutrino Energy: 40.746
 Size of all hits: 63
hit initial : 22.1578 | hit correction : 1.26022
hit initial : 30.0014 | hit correction : 1.27409
hit initial : 36.0687 | hit correction : 1.27412
hit initial : 122.308 | hit correction : 1.26955
hit initial : 117.437 | hit correction : 1.26961
hit initial : 37.7192 | hit correction : 1.26224
hit initial : 247.047 | hit correction : 1.26159
hit initial : 577.295 | hit correction : 1.2589
hit initial : 1245.17 | hit correction : 1.25751
hit initial : 210.263 | hit correction : 1.25542
hit initial : 670.186 | hit correction : 1.25527
hit initial : 119.033 | hit correction : 1.25407
hit initial : 191.711 | hit correction : 1.25394
hit initial : 118.996 | hit correction : 1.25319
hit initial : 75.0279 | hit correction : 1.25317
 *** Total Charge : 4806.39
 Looking at view: 0 | Number of hits in view: 15
hit initial : 258.294 | hit correction : 1.26028
hit initial : 30.0131 | hit correction : 1.27411
hit initial : 18.7784 | hit correction : 1.27412
hit initial : 44.8071 | hit correction : 1.26962
hit initial : 136.086 | hit correction : 1.26959
hit initial : 84.7776 | hit correction : 1.26955
hit initial : 30.3656 | hit correction : 1.26222
hit initial : 90.8366 | hit correction : 1.26219
hit initial : 199.217 | hit correction : 1.26153
hit initial : 44.8433 | hit correction : 1.26214
hit initial : 52.774 | hit correction : 1.26163
hit initial : 282.294 | hit correction : 1.26101
hit initial : 466.264 | hit correction : 1.25885
hit initial : 119.046 | hit correction : 1.25884
hit initial : 89.7243 | hit correction : 1.25857
hit initial : 64.4054 | hit correction : 1.25708
hit initial : 85.9911 | hit correction : 1.25676
hit initial : 410.047 | hit correction : 1.25671
hit initial : 70.072 | hit correction : 1.25563
hit initial : 320.843 | hit correction : 1.25544
hit initial : 268.08 | hit correction : 1.25481
hit initial : 235.708 | hit correction : 1.25425
hit initial : 264.934 | hit correction : 1.2538
hit initial : 213.854 | hit correction : 1.25335
 *** Total Charge : 4885.53
 Looking at view: 1 | Number of hits in view: 24
hit initial : 240.248 | hit correction : 1.25965
hit initial : 302.355 | hit correction : 1.26045
hit initial : 45.799 | hit correction : 1.27411
hit initial : 20.9958 | hit correction : 1.27412
hit initial : 25.2024 | hit correction : 1.26954
hit initial : 195.235 | hit correction : 1.26959
hit initial : 49.1744 | hit correction : 1.26961
hit initial : 32.6795 | hit correction : 1.26224
hit initial : 125.605 | hit correction : 1.26221
hit initial : 290.122 | hit correction : 1.26156
hit initial : 36.8086 | hit correction : 1.26192
hit initial : 170.057 | hit correction : 1.26103
hit initial : 280.01 | hit correction : 1.25878
hit initial : 278.145 | hit correction : 1.2579
hit initial : 227.553 | hit correction : 1.25702
hit initial : 212.18 | hit correction : 1.25635
hit initial : 250.786 | hit correction : 1.25572
hit initial : 173.664 | hit correction : 1.25532
hit initial : 172.564 | hit correction : 1.25492
hit initial : 156.643 | hit correction : 1.25457
hit initial : 185.453 | hit correction : 1.25424
hit initial : 174.772 | hit correction : 1.25391
hit initial : 154.717 | hit correction : 1.25357
hit initial : 168.772 | hit correction : 1.25323
 *** Total Charge : 4995.99
 Looking at view: 2 | Number of hits in view: 24
13-Dec-2025 16:58:47 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.177748      0.228534      0.381759      0.202644      0.0580631       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00106293    0.00392639     0.0169145    0.00133873     0.0053947       10     
end_path:ana:AnalyzeEvents         0.174918      0.224129      0.368104      0.201024      0.0561244       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9811.58 MB
  Peak resident set size usage (VmHWM): 1538.33 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:04:27 UTC       justIN version: 01.06.00