justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260331.0@dunegpschedd02.fnal.gov

Jobsub ID260331.0@dunegpschedd02.fnal.gov
Workflow ID11093
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 16:19:07
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-11 19:30:50
From worker nodeHostnamedunegli-8028879-0-fnpc9056.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 08:51:46
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213118Z_gen_004109_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time10h (38325s)
CPU time10h (37909s = 98%)
Max RSS bytes3023372288 (2883 MiB)
Outputting started2025-12-11 19:30:32
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11093/1/001/analysisLowE_20251211T085147Z.root
Finished2025-12-11 19:30:50
Saved logsjustin-logs:260331.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ailure: 0, 499
Classifier summary: 
Output 0: 0.132617, 
Output 1: 0.0996049, 0.104345, 0.257788, 0.538262, 
Output 2: 0.0430521, 0.121493, 0.817466, 0.0179889, 
Output 3: 0.958225, 0.0340609, 0.00368755, 0.0040262, 
Output 4: 0.416931, 0.499445, 0.0729527, 0.0106713, 
Output 5: 0.347004, 0.445434, 0.164423, 0.0431394, 
Output 6: 0.0627935, 0.151596, 0.115818, 0.669793, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 41090 at 11-Dec-2025 18:33:03 UTC
Boundary wire vector sizes: 6404, 6316, 6450
minwire 0: 30
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0533148, 
Output 1: 0.280092, 0.0880965, 0.135955, 0.495856, 
Output 2: 0.0314353, 0.0755145, 0.885204, 0.007846, 
Output 3: 0.937065, 0.0580483, 0.00249408, 0.00239264, 
Output 4: 0.733958, 0.244228, 0.0176984, 0.00411646, 
Output 5: 0.108616, 0.462893, 0.322236, 0.106256, 
Output 6: 0.212844, 0.462322, 0.14513, 0.179704, 

11-Dec-2025 19:29:09 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 19:29:09 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/85/97/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213118Z_gen_004109_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3358.59       3797.15       4267.92       3778.45       299.125        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00336307     0.0183165     0.0380673     0.0156028    0.00979266       10     
reco:pandora:StandardPandora                            3355.87       3793.42       4264.98       3775.25       298.733        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000837347    0.0430823     0.226822      0.0300527     0.0625179       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00184933     0.0240734     0.108557      0.0123259     0.0315473       10     
reco:pandoracalo:Calorimetry                          0.00051314     0.0116806     0.0962713    0.00100922     0.0284147       10     
reco:pandorapid:Chi2ParticleID                        0.000130542   0.000730875   0.00544671    0.000208459   0.00157341       10     
reco:cvnmap:CVNMapper                                  0.0529888     0.139317      0.425531      0.105032      0.0989875       10     
reco:cvneva:CVNEvaluator                                1.87373       2.66286       7.24521       2.23799       1.5318         10     
reco:energyrecnumu:EnergyReco                         0.00787812     0.0825858     0.168655      0.101033      0.0608656       10     
reco:energyrecnue:EnergyReco                          0.00189534    0.00454902     0.0135178    0.00370658    0.00306866       10     
reco:energyrecnc:EnergyReco                            0.0109522     0.0899752     0.209906      0.0775486     0.0781984       10     
[art]:TriggerResults:TriggerResultInserter            2.5553e-05    5.54566e-05   0.000193686   3.9094e-05    4.70317e-05      10     
end_path:out1:RootOutput                               7.863e-06    2.21355e-05   6.3191e-05    1.7125e-05    1.48433e-05      10     
end_path:out1:RootOutput(write)                         0.55004      0.649356      0.773787      0.662134      0.0624476       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12122 MB
  Peak resident set size usage (VmHWM): 3023.37 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
True Neutron Energy: 939.57
True Electron Energy: 53.8333
Completed MCParticle Loop
True Neutrino Energy: 60.9708
 Size of all hits: 71
hit initial : 46.9613 | hit correction : 1.17944
hit initial : 51.5631 | hit correction : 1.17849
hit initial : 81.7857 | hit correction : 1.17759
hit initial : 21.8587 | hit correction : 1.17633
hit initial : 133.358 | hit correction : 1.18127
hit initial : 62.7091 | hit correction : 1.18065
hit initial : 96.4175 | hit correction : 1.1795
hit initial : 235.395 | hit correction : 1.18114
hit initial : 135.418 | hit correction : 1.17938
hit initial : 105.386 | hit correction : 1.17859
hit initial : 44.6765 | hit correction : 1.18123
hit initial : 34.4089 | hit correction : 1.18061
hit initial : 33.2863 | hit correction : 1.17865
hit initial : 25.9654 | hit correction : 1.17622
hit initial : 69.647 | hit correction : 1.17494
hit initial : 164 | hit correction : 1.17293
hit initial : 99.4216 | hit correction : 1.1785
hit initial : 21.0533 | hit correction : 1.1775
hit initial : 42.2716 | hit correction : 1.17685
hit initial : 65.647 | hit correction : 1.17633
hit initial : 30.7458 | hit correction : 1.17497
hit initial : 574.209 | hit correction : 1.17472
hit initial : 71.9543 | hit correction : 1.17397
 *** Total Charge : 2646.85
 Looking at view: 0 | Number of hits in view: 23
hit initial : 53.54 | hit correction : 1.17348
hit initial : 39.349 | hit correction : 1.17282
hit initial : 19.5703 | hit correction : 1.17851
hit initial : 28.8054 | hit correction : 1.17849
hit initial : 63.5905 | hit correction : 1.17854
hit initial : 88.2158 | hit correction : 1.18127
hit initial : 37.8059 | hit correction : 1.1806
hit initial : 205.043 | hit correction : 1.17929
hit initial : 193.543 | hit correction : 1.18126
hit initial : 115.176 | hit correction : 1.18061
hit initial : 163.044 | hit correction : 1.17949
hit initial : 76.1242 | hit correction : 1.18126
hit initial : 65.9169 | hit correction : 1.18063
hit initial : 45.2744 | hit correction : 1.17958
hit initial : 116.737 | hit correction : 1.17857
hit initial : 399.371 | hit correction : 1.17853
hit initial : 296.952 | hit correction : 1.17779
hit initial : 312.843 | hit correction : 1.17715
hit initial : 373.999 | hit correction : 1.17648
hit initial : 50.9671 | hit correction : 1.17633
hit initial : 335.44 | hit correction : 1.17569
hit initial : 362.961 | hit correction : 1.17493
hit initial : 343.784 | hit correction : 1.17417
hit initial : 288.777 | hit correction : 1.17352
hit initial : 108.412 | hit correction : 1.17277
 *** Total Charge : 4926.38
 Looking at view: 1 | Number of hits in view: 25
hit initial : 35.3763 | hit correction : 1.17851
hit initial : 13.8693 | hit correction : 1.17855
hit initial : 27.8256 | hit correction : 1.17931
hit initial : 53.3614 | hit correction : 1.18132
hit initial : 263.206 | hit correction : 1.18128
hit initial : 158.032 | hit correction : 1.18064
hit initial : 85.2005 | hit correction : 1.18093
hit initial : 17.8011 | hit correction : 1.18048
hit initial : 81.164 | hit correction : 1.17963
hit initial : 212.676 | hit correction : 1.17947
hit initial : 206.511 | hit correction : 1.17908
hit initial : 215.086 | hit correction : 1.17865
hit initial : 255.51 | hit correction : 1.17839
hit initial : 242.606 | hit correction : 1.17788
hit initial : 214.633 | hit correction : 1.17742
hit initial : 210.659 | hit correction : 1.17699
hit initial : 360.956 | hit correction : 1.17644
hit initial : 287.879 | hit correction : 1.17597
hit initial : 249.858 | hit correction : 1.17526
hit initial : 269.388 | hit correction : 1.17469
hit initial : 344.039 | hit correction : 1.17395
hit initial : 367.115 | hit correction : 1.17305
hit initial : 52.818 | hit correction : 1.17264
 *** Total Charge : 4973.86
 Looking at view: 2 | Number of hits in view: 23
11-Dec-2025 19:30:30 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          0.11466      0.180475      0.263806      0.182473      0.0489083       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000399305   0.00728873     0.0418809    0.000584232    0.0138938       10     
end_path:ana:AnalyzeEvents         0.113744      0.172995      0.243948      0.168932      0.0431721       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9814.75 MB
  Peak resident set size usage (VmHWM): 1540.3 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:19:43 UTC       justIN version: 01.06.00