justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 249757.5@dunegpschedd02.fnal.gov

Jobsub ID249757.5@dunegpschedd02.fnal.gov
Workflow ID10521
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-22 19:12:13
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-11-22 21:15:54
From worker nodeHostnamedunegli-7693770-0-fnpc22034.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-22 19:18:32
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193456Z_gen_000443_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time1h (6329s)
CPU time1h (6285s = 99%)
Max RSS bytes3048718336 (2907 MiB)
Outputting started2025-11-22 21:04:02
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/10521/1/001/analysisLowE_20251122T191832Z.root
Finished2025-11-22 21:15:54
Saved logsjustin-logs:249757.5-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  22-Nov-2025 21:03:34 UTC run: 3799 subRun: 0 event: 4430
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6720, 6632, 6687
minwire 0: 39
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1724, 2223
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.126809, 
Output 1: 0.0817543, 0.0561535, 0.151738, 0.710354, 
Output 2: 0.047369, 0.222216, 0.698158, 0.0322568, 
Output 3: 0.956513, 0.0238036, 0.00642623, 0.0132574, 
Output 4: 0.325484, 0.577403, 0.0888769, 0.0082358, 
Output 5: 0.582241, 0.326576, 0.0751741, 0.0160096, 
Output 6: 0.0225282, 0.0656344, 0.0788709, 0.832967, 

22-Nov-2025 21:03:35 UTC  Closed output file "matt_reco2.root"
22-Nov-2025 21:03:35 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/f2/be/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193456Z_gen_000443_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              608.774       624.628       637.719       625.218       8.97302        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000703886   0.00396181    0.00579578     0.0045197    0.00172627       10     
reco:pandora:StandardPandora                            607.811       623.544       636.733       624.235       9.00327        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00135871     0.015341      0.0627168      0.01236      0.0173324       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00137198    0.00424595    0.00955362     0.0035611    0.00241982       10     
reco:pandoracalo:Calorimetry                          0.000222305   0.00111755    0.00340906    0.000336058    0.0012159       10     
reco:pandorapid:Chi2ParticleID                        3.7392e-05    0.000158414   0.000637389   7.0284e-05    0.00019306       10     
reco:cvnmap:CVNMapper                                  0.0174497     0.0229783     0.0297452     0.0226623    0.00404227       10     
reco:cvneva:CVNEvaluator                               0.671087      0.793258       1.78646      0.685219      0.331171        10     
reco:energyrecnumu:EnergyReco                         0.00239219     0.0275339     0.052745      0.0348584     0.0163396       10     
reco:energyrecnue:EnergyReco                          0.000752339   0.00171967    0.00471884    0.000954876   0.00151018       10     
reco:energyrecnc:EnergyReco                           0.00445877     0.0134899     0.034845     0.00469224     0.0135696       10     
[art]:TriggerResults:TriggerResultInserter             8.907e-06    1.66259e-05   5.9373e-05    1.11315e-05   1.45593e-05      10     
end_path:out1:RootOutput                               5.089e-06    9.4879e-06    2.8123e-05    7.7745e-06    6.39352e-06      10     
end_path:out1:RootOutput(write)                        0.188542      0.199966      0.207734       0.20329     0.00719748       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21782.5 MB
  Peak resident set size usage (VmHWM): 3048.72 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 198.301 | hit correction : 1.09601
hit initial : 42.8834 | hit correction : 1.096
hit initial : 70.7952 | hit correction : 1.09527
hit initial : 171.896 | hit correction : 1.09496
hit initial : 256.759 | hit correction : 1.09496
hit initial : 566.696 | hit correction : 1.09482
hit initial : 514.052 | hit correction : 1.09438
hit initial : 189.194 | hit correction : 1.09407
hit initial : 209.535 | hit correction : 1.09392
hit initial : 169.358 | hit correction : 1.09388
hit initial : 550.546 | hit correction : 1.09387
hit initial : 175.001 | hit correction : 1.09322
hit initial : 16.3866 | hit correction : 1.0932
hit initial : 258.93 | hit correction : 1.09319
hit initial : 678.539 | hit correction : 1.09222
hit initial : 197.284 | hit correction : 1.09162
hit initial : 451.413 | hit correction : 1.09075
hit initial : 244.084 | hit correction : 1.09067
 *** Total Charge : 6279.94
 Looking at view: 2 | Number of hits in view: 24
Begin processing the 10th record. run: 3799 subRun: 0 event: 4430 at 22-Nov-2025 21:04:00 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  46
Added hit list length: 46 | Max was set to: -3.40282e+38
True Neutron Energy: 939.572
True Electron Energy: 35.2159
Completed MCParticle Loop
True Neutrino Energy: 40.5999
 Size of all hits: 46
hit initial : 70.808 | hit correction : 1.33535
hit initial : 28.61 | hit correction : 1.33533
hit initial : 195.814 | hit correction : 1.3314
hit initial : 207.034 | hit correction : 1.33133
hit initial : 42.239 | hit correction : 1.33125
hit initial : 67.8359 | hit correction : 1.33141
hit initial : 72.1326 | hit correction : 1.33377
hit initial : 277.401 | hit correction : 1.33386
hit initial : 402.435 | hit correction : 1.33412
hit initial : 359.24 | hit correction : 1.33444
hit initial : 216.716 | hit correction : 1.33486
hit initial : 176.842 | hit correction : 1.33512
hit initial : 181.705 | hit correction : 1.33537
hit initial : 182.13 | hit correction : 1.33579
hit initial : 208.015 | hit correction : 1.33618
hit initial : 167.375 | hit correction : 1.33659
 *** Total Charge : 3811.12
 Looking at view: 0 | Number of hits in view: 16
hit initial : 95.5736 | hit correction : 1.33143
hit initial : 221.831 | hit correction : 1.33137
hit initial : 27.8802 | hit correction : 1.32172
hit initial : 74.6166 | hit correction : 1.32169
hit initial : 60.3822 | hit correction : 1.32169
hit initial : 126.904 | hit correction : 1.33132
hit initial : 400.526 | hit correction : 1.33407
hit initial : 638.366 | hit correction : 1.33431
hit initial : 412.735 | hit correction : 1.33497
hit initial : 330.221 | hit correction : 1.33566
hit initial : 359.687 | hit correction : 1.33638
hit initial : 351.421 | hit correction : 1.33711
hit initial : 229.705 | hit correction : 1.33746
 *** Total Charge : 4442.76
 Looking at view: 1 | Number of hits in view: 13
hit initial : 30.616 | hit correction : 1.3398
hit initial : 23.8693 | hit correction : 1.33774
hit initial : 256.748 | hit correction : 1.33752
hit initial : 319.535 | hit correction : 1.33713
hit initial : 52.8628 | hit correction : 1.32168
hit initial : 41.3197 | hit correction : 1.33121
hit initial : 202.509 | hit correction : 1.33125
hit initial : 146.116 | hit correction : 1.33141
hit initial : 94.7599 | hit correction : 1.33157
hit initial : 56.4441 | hit correction : 1.33381
hit initial : 273.815 | hit correction : 1.3338
hit initial : 343.837 | hit correction : 1.33409
hit initial : 408.232 | hit correction : 1.33443
hit initial : 280.856 | hit correction : 1.33494
hit initial : 368.648 | hit correction : 1.33531
hit initial : 346.862 | hit correction : 1.33581
hit initial : 280.852 | hit correction : 1.33649
 *** Total Charge : 4708.65
 Looking at view: 2 | Number of hits in view: 17
22-Nov-2025 21:04:01 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0466222     0.0563486     0.0632752     0.0560122     0.0043214       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000320223   0.000389464   0.000471772   0.000378674   4.62357e-05      10     
end_path:ana:AnalyzeEvents         0.0461072     0.055774      0.0627184     0.0555243    0.00426375       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.3 MB
  Peak resident set size usage (VmHWM): 1537.38 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-08 21:37:57 UTC       justIN version: 01.06.00