justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266863.1@dunegpschedd01.fnal.gov

Jobsub ID266863.1@dunegpschedd01.fnal.gov
Workflow ID11110
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 16:12:19
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 03:00:00
From worker nodeHostnamedunegli-8029141-0-fnpc19104.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 16:13:49
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T003132Z_gen_002443_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time10h (38756s)
CPU time10h (37860s = 97%)
Max RSS bytes2926403584 (2790 MiB)
Outputting started2025-12-12 02:59:46
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11110/1/001/analysisLowE_20251211T161351Z.root
Finished2025-12-12 03:00:00
Saved logsjustin-logs:266863.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 02:59:02 UTC run: 5027 subRun: 0 event: 24430
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 02:59:02 UTC run: 5027 subRun: 0 event: 24430
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6870, 6871, 6802
minwire 0: 42
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.151394, 
Output 1: 0.0881547, 0.0765871, 0.126699, 0.70856, 
Output 2: 0.0948821, 0.198105, 0.677488, 0.0295253, 
Output 3: 0.985008, 0.00916889, 0.000796462, 0.00502667, 
Output 4: 0.353104, 0.600401, 0.0424666, 0.00402805, 
Output 5: 0.441705, 0.450023, 0.0843273, 0.0239452, 
Output 6: 0.0305399, 0.0674759, 0.0793733, 0.822611, 

12-Dec-2025 02:59:04 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 02:59:04 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/c2/46/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T003132Z_gen_002443_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2362.21       3851.79       5001.85       4017.47       853.377        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00488109     0.0160999     0.0287108     0.0161065    0.00659949       10     
reco:pandora:StandardPandora                            2360.87       3809.36       4931.91       3948.13       823.628        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000553306    0.0690646     0.309661      0.0518895     0.0855068       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000572956    0.0114953     0.0663454    0.00598707     0.0185097       10     
reco:pandoracalo:Calorimetry                          0.000246782   0.00184556    0.00703709    0.000819492   0.00231786       10     
reco:pandorapid:Chi2ParticleID                        8.1421e-05    0.000625787   0.00253508    0.000192276   0.000924309      10     
reco:cvnmap:CVNMapper                                  0.0541367     0.103057       0.2028       0.0950835      0.04453        10     
reco:cvneva:CVNEvaluator                               0.847659       2.20777       8.06794       1.56395       2.02005        10     
reco:energyrecnumu:EnergyReco                         0.00816394      12.5835       63.3741      0.023811       25.116         10     
reco:energyrecnue:EnergyReco                          0.00120648     0.0055483     0.0164902    0.00305405    0.00542098       10     
reco:energyrecnc:EnergyReco                           0.00783017      26.9488       71.2612      0.0956552      33.0066        10     
[art]:TriggerResults:TriggerResultInserter             1.593e-05    7.14666e-05   0.000408804    2.959e-05    0.000114336      10     
end_path:out1:RootOutput                               7.49e-06     2.91471e-05   0.000116681    1.795e-05    3.22986e-05      10     
end_path:out1:RootOutput(write)                        0.297593      0.479512      0.834606      0.471679      0.150917        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21690.9 MB
  Peak resident set size usage (VmHWM): 2926.4 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
This pfp has size:  33
Added hit list length: 33 | Max was set to: -3.40282e+38
This pfp has size:  23
True Neutron Energy: 939.683
True Electron Energy: 40.2142
Completed MCParticle Loop
True Neutrino Energy: 49.265
 Size of all hits: 33
hit initial : 87.4372 | hit correction : 1.0353
hit initial : 349.801 | hit correction : 1.03645
hit initial : 49.6501 | hit correction : 1.03919
hit initial : 45.2439 | hit correction : 1.04179
hit initial : 132.868 | hit correction : 1.04043
hit initial : 41.8729 | hit correction : 1.0392
hit initial : 138.895 | hit correction : 1.04179
hit initial : 309.501 | hit correction : 1.04052
hit initial : 78.6804 | hit correction : 1.04184
hit initial : 647.929 | hit correction : 1.04098
hit initial : 386.394 | hit correction : 1.0412
hit initial : 97.6987 | hit correction : 1.04125
hit initial : 98.614 | hit correction : 1.03879
hit initial : 401.483 | hit correction : 1.03877
hit initial : 452.85 | hit correction : 1.03814
hit initial : 418.808 | hit correction : 1.03731
hit initial : 183.613 | hit correction : 1.03611
 *** Total Charge : 4075.09
 Looking at view: 0 | Number of hits in view: 17
hit initial : 130.162 | hit correction : 1.04186
hit initial : 335.196 | hit correction : 1.04175
hit initial : 403.876 | hit correction : 1.04109
hit initial : 144.624 | hit correction : 1.04133
hit initial : 172.604 | hit correction : 1.04128
hit initial : 127.035 | hit correction : 1.0412
hit initial : 160.358 | hit correction : 1.0411
hit initial : 231.592 | hit correction : 1.04088
hit initial : 231.832 | hit correction : 1.04059
hit initial : 419.103 | hit correction : 1.04039
hit initial : 148.56 | hit correction : 1.03921
hit initial : 284.272 | hit correction : 1.03895
hit initial : 145.215 | hit correction : 1.03872
hit initial : 201.881 | hit correction : 1.03849
hit initial : 813.036 | hit correction : 1.03754
hit initial : 573.641 | hit correction : 1.03624
 *** Total Charge : 4701.36
 Looking at view: 2 | Number of hits in view: 16
Begin processing the 10th record. run: 5027 subRun: 0 event: 24430 at 12-Dec-2025 02:59:43 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  21
Added hit list length: 21 | Max was set to: -3.40282e+38
True Neutron Energy: 939.575
True Electron Energy: 42.5127
Completed MCParticle Loop
True Neutrino Energy: 45.8567
 Size of all hits: 21
hit initial : 41.9671 | hit correction : 1.38815
hit initial : 275.444 | hit correction : 1.38882
hit initial : 216.492 | hit correction : 1.38912
hit initial : 132.52 | hit correction : 1.38951
hit initial : 67.5121 | hit correction : 1.38978
hit initial : 278.922 | hit correction : 1.38886
hit initial : 114.255 | hit correction : 1.38886
 *** Total Charge : 1565.56
 Looking at view: 0 | Number of hits in view: 7
hit initial : 17.2953 | hit correction : 1.38985
hit initial : 372.468 | hit correction : 1.38905
hit initial : 612.079 | hit correction : 1.38881
hit initial : 244.261 | hit correction : 1.38885
hit initial : 90.5119 | hit correction : 1.38889
 *** Total Charge : 1856.43
 Looking at view: 1 | Number of hits in view: 5
hit initial : 128.79 | hit correction : 1.38867
hit initial : 257.359 | hit correction : 1.38839
hit initial : 182.941 | hit correction : 1.38865
hit initial : 103.406 | hit correction : 1.38897
hit initial : 135.211 | hit correction : 1.38908
hit initial : 194.313 | hit correction : 1.38935
hit initial : 124.658 | hit correction : 1.38981
hit initial : 114.896 | hit correction : 1.38893
hit initial : 134.571 | hit correction : 1.38888
 *** Total Charge : 1911.35
 Looking at view: 2 | Number of hits in view: 9
12-Dec-2025 02:59:46 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0672041     0.0890587     0.102206      0.0905719    0.00880279       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000397334   0.000563764   0.00142557    0.00047476    0.000291057      10     
end_path:ana:AnalyzeEvents         0.0665783     0.0882961     0.101614      0.0892883    0.00879587       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19477.7 MB
  Peak resident set size usage (VmHWM): 1537.37 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:58:50 UTC       justIN version: 01.06.00