justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261263.0@dunegpschedd02.fnal.gov

Jobsub ID261263.0@dunegpschedd02.fnal.gov
Workflow ID11091
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:06:38
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 03:01:11
From worker nodeHostnamedunegli-7878598-0-fnpc8002.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:07:10
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T142421Z_gen_000921_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (17625s)
CPU time4h (17446s = 98%)
Max RSS bytes2885730304 (2752 MiB)
Outputting started2025-12-12 03:00:56
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11091/1/001/analysisLowE_20251211T220712Z.root
Finished2025-12-12 03:01:11
Saved logsjustin-logs:261263.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

vent: 9210
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 02:59:16 UTC run: 4696 subRun: 0 event: 9210
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6933, 6829, 6797
minwire 0: 20
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2376, 2875
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.059628, 
Output 1: 0.0754615, 0.129528, 0.140585, 0.654426, 
Output 2: 0.041829, 0.124781, 0.817173, 0.0162177, 
Output 3: 0.948191, 0.0422257, 0.00407681, 0.00550687, 
Output 4: 0.821297, 0.151154, 0.0212035, 0.00634525, 
Output 5: 0.496172, 0.341481, 0.121628, 0.0407186, 
Output 6: 0.0483424, 0.116434, 0.0928796, 0.742344, 

12-Dec-2025 02:59:23 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 02:59:23 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/83/fe/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T142421Z_gen_000921_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1465.06       1732.12       2336.52       1645.82       262.638        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00153163     0.0102257     0.0456799    0.00525861     0.0126193       10     
reco:pandora:StandardPandora                            1463.32       1729.4        2329.84       1643.45       261.423        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00318823     0.0220078     0.0919134     0.0145658     0.0248865       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00153301     0.0307406     0.170183     0.00449888     0.0533973       10     
reco:pandoracalo:Calorimetry                          0.000297991     0.00221     0.00766393    0.00042072    0.00270577       10     
reco:pandorapid:Chi2ParticleID                        7.4189e-05    0.000273098   0.00190109    9.3544e-05    0.000542732      10     
reco:cvnmap:CVNMapper                                  0.0358312     0.0643317     0.247654      0.0426928     0.0616793       10     
reco:cvneva:CVNEvaluator                                1.12696       1.79015       5.26424       1.15503       1.21221        10     
reco:energyrecnumu:EnergyReco                         0.00669281     0.130847      0.474012      0.0926805      0.14496        10     
reco:energyrecnue:EnergyReco                           0.001231     0.00417795     0.0135739    0.00185483    0.00463356       10     
reco:energyrecnc:EnergyReco                           0.00968993     0.0849336     0.251914      0.0555747     0.0805994       10     
[art]:TriggerResults:TriggerResultInserter             1.506e-05    3.21762e-05   0.00011086    2.6144e-05    2.67454e-05      10     
end_path:out1:RootOutput                               3.654e-06    9.6046e-06    3.8691e-05    6.8745e-06    9.82041e-06      10     
end_path:out1:RootOutput(write)                        0.386277      0.587294      0.792809      0.637412      0.140261        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11048.4 MB
  Peak resident set size usage (VmHWM): 2885.73 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 303.291 | hit correction : 1.03626
hit initial : 947.408 | hit correction : 1.03804
hit initial : 301.7 | hit correction : 1.03831
 *** Total Charge : 2172.27
 Looking at view: 1 | Number of hits in view: 8
hit initial : 35.3603 | hit correction : 1.03515
hit initial : 60.7076 | hit correction : 1.03515
hit initial : 130.976 | hit correction : 1.03585
hit initial : 530.005 | hit correction : 1.03618
hit initial : 236.808 | hit correction : 1.03695
hit initial : 35.4107 | hit correction : 1.03733
hit initial : 554.428 | hit correction : 1.03789
 *** Total Charge : 1642.02
 Looking at view: 2 | Number of hits in view: 7
Begin processing the 10th record. run: 4696 subRun: 0 event: 9210 at 12-Dec-2025 03:00:50 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  52
Added hit list length: 52 | Max was set to: -3.40282e+38
True Neutron Energy: 939.572
True Electron Energy: 47.1354
Completed MCParticle Loop
True Neutrino Energy: 52.5397
 Size of all hits: 52
hit initial : 124.189 | hit correction : 1.10251
hit initial : 71.6989 | hit correction : 1.10255
hit initial : 15.0931 | hit correction : 1.10584
hit initial : 109.148 | hit correction : 1.10576
hit initial : 236.651 | hit correction : 1.10562
hit initial : 511.086 | hit correction : 1.1055
hit initial : 1032.24 | hit correction : 1.10543
hit initial : 1034.12 | hit correction : 1.10532
hit initial : 44.2725 | hit correction : 1.10539
hit initial : 198.226 | hit correction : 1.1047
hit initial : 244.9 | hit correction : 1.10441
hit initial : 228.239 | hit correction : 1.10415
hit initial : 119.142 | hit correction : 1.1034
hit initial : 278.261 | hit correction : 1.10362
hit initial : 93.7377 | hit correction : 1.10353
hit initial : 47.1367 | hit correction : 1.10261
hit initial : 132.721 | hit correction : 1.10263
hit initial : 60.1708 | hit correction : 1.10266
hit initial : 37.5237 | hit correction : 1.10355
hit initial : 82.386 | hit correction : 1.10353
hit initial : 283.456 | hit correction : 1.10459
 *** Total Charge : 5506.6
 Looking at view: 0 | Number of hits in view: 21
hit initial : 24.3538 | hit correction : 1.10351
hit initial : 67.9591 | hit correction : 1.10353
hit initial : 52.1857 | hit correction : 1.10264
hit initial : 23.2026 | hit correction : 1.1018
hit initial : 52.0505 | hit correction : 1.10352
hit initial : 116.159 | hit correction : 1.10263
hit initial : 58.0269 | hit correction : 1.1018
hit initial : 17.9066 | hit correction : 1.10094
hit initial : 54.3736 | hit correction : 1.10343
hit initial : 39.9136 | hit correction : 1.10262
hit initial : 125.666 | hit correction : 1.10351
hit initial : 94.1942 | hit correction : 1.10463
hit initial : 124.225 | hit correction : 1.10461
hit initial : 275.458 | hit correction : 1.10456
 *** Total Charge : 1242.35
 Looking at view: 1 | Number of hits in view: 14
hit initial : 397.254 | hit correction : 1.10515
hit initial : 581.734 | hit correction : 1.10506
hit initial : 459.306 | hit correction : 1.10541
hit initial : 270.261 | hit correction : 1.10472
hit initial : 164.486 | hit correction : 1.10554
hit initial : 169.586 | hit correction : 1.10448
hit initial : 163.155 | hit correction : 1.10432
hit initial : 242.043 | hit correction : 1.10407
hit initial : 406.935 | hit correction : 1.10352
hit initial : 22.664 | hit correction : 1.10344
hit initial : 46.6233 | hit correction : 1.10263
hit initial : 190.915 | hit correction : 1.10263
hit initial : 27.332 | hit correction : 1.10355
hit initial : 58.8204 | hit correction : 1.10354
hit initial : 37.7864 | hit correction : 1.1035
hit initial : 142.902 | hit correction : 1.10465
hit initial : 118.252 | hit correction : 1.10456
 *** Total Charge : 3865.95
 Looking at view: 2 | Number of hits in view: 17
12-Dec-2025 03:00:55 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.115242      0.250139       0.92207      0.169562      0.232486        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000356898    0.0113756     0.0770472    0.00054522     0.0228523       10     
end_path:ana:AnalyzeEvents         0.114683       0.23858      0.921416      0.132222      0.234819        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8739.6 MB
  Peak resident set size usage (VmHWM): 1538.51 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:25:46 UTC       justIN version: 01.06.00