justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265370.0@dunegpschedd01.fnal.gov

Jobsub ID265370.0@dunegpschedd01.fnal.gov
Workflow ID11086
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-09 12:47:44
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-10 16:58:40
From worker nodeHostnamedunegli-8024576-0-fnpc18006.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-10 11:57:15
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T003611Z_gen_002515_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (18048s)
CPU time4h (17820s = 98%)
Max RSS bytes3046514688 (2905 MiB)
Outputting started2025-12-10 16:58:04
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11086/1/001/analysisLowE_20251210T115716Z.root
Finished2025-12-10 16:58:40
Saved logsjustin-logs:265370.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

34, 0.00274421, 
Output 5: 0.350594, 0.310173, 0.258145, 0.0810882, 
Output 6: 0.0194841, 0.0431806, 0.0599347, 0.877401, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 25150 at 10-Dec-2025 16:30:47 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  10-Dec-2025 16:56:48 UTC run: 5027 subRun: 0 event: 25150
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6839, 6746, 6661
minwire 0: 55
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0809735, 
Output 1: 0.0291993, 0.0467214, 0.110918, 0.813162, 
Output 2: 0.0806719, 0.234182, 0.649709, 0.0354372, 
Output 3: 0.935897, 0.0479627, 0.00710918, 0.00903066, 
Output 4: 0.391032, 0.525959, 0.0752434, 0.00776582, 
Output 5: 0.711894, 0.24817, 0.0331746, 0.0067608, 
Output 6: 0.0138305, 0.0479557, 0.062501, 0.875713, 

10-Dec-2025 16:56:52 UTC  Closed output file "matt_reco2.root"
10-Dec-2025 16:56:52 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/40/7e/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T003611Z_gen_002515_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1559.87       1784.47       2136.21       1741.86       177.958        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00241311     0.0074206     0.0212536    0.00490135    0.00580959       10     
reco:pandora:StandardPandora                            1557.56       1781.25       2132.19       1738.51       177.77         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00188793     0.017997      0.0689549     0.0111268     0.0200957       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00250847    0.00737903     0.0228114    0.00677764    0.00557148       10     
reco:pandoracalo:Calorimetry                          0.000299545   0.000956216   0.00330666    0.000504236   0.000909043      10     
reco:pandorapid:Chi2ParticleID                        9.6873e-05    0.000342536   0.00112395    0.000162968   0.000334645      10     
reco:cvnmap:CVNMapper                                  0.036066      0.0805356     0.278276      0.0510309     0.0728228       10     
reco:cvneva:CVNEvaluator                                1.76843       2.48484       3.56498       2.38352      0.637278        10     
reco:energyrecnumu:EnergyReco                          0.0105517     0.0884247     0.172806      0.114434      0.0639221       10     
reco:energyrecnue:EnergyReco                           0.0012566    0.00558284     0.015177      0.0027039     0.0046863       10     
reco:energyrecnc:EnergyReco                           0.00932859     0.0506083     0.137352      0.0146996     0.0496302       10     
[art]:TriggerResults:TriggerResultInserter            1.8956e-05    3.69497e-05   0.000124375   2.61595e-05   3.00701e-05      10     
end_path:out1:RootOutput                               8.847e-06    1.53889e-05   4.5626e-05    1.0685e-05    1.06923e-05      10     
end_path:out1:RootOutput(write)                        0.365514      0.476013      0.622658      0.470088      0.0983185       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21751.1 MB
  Peak resident set size usage (VmHWM): 3046.51 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 84.2898 | hit correction : 1.00553
hit initial : 47.7386 | hit correction : 1.00598
hit initial : 32.045 | hit correction : 1.0055
hit initial : 87.1487 | hit correction : 1.00738
hit initial : 412.989 | hit correction : 1.00767
hit initial : 493.345 | hit correction : 1.00831
hit initial : 432.625 | hit correction : 1.00846
hit initial : 81.0389 | hit correction : 1.00845
hit initial : 107.438 | hit correction : 1.00889
hit initial : 23.0464 | hit correction : 1.00889
 *** Total Charge : 2876.4
 Looking at view: 0 | Number of hits in view: 17
hit initial : 79.4462 | hit correction : 1.00622
hit initial : 34.8067 | hit correction : 1.00553
hit initial : 151.216 | hit correction : 1.0073
hit initial : 232.652 | hit correction : 1.00617
hit initial : 103.2 | hit correction : 1.00552
hit initial : 102.693 | hit correction : 1.00838
hit initial : 96.8881 | hit correction : 1.00741
hit initial : 36.8527 | hit correction : 1.00614
hit initial : 45.2448 | hit correction : 1.00553
hit initial : 540.824 | hit correction : 1.00835
hit initial : 135.038 | hit correction : 1.00884
hit initial : 207.71 | hit correction : 1.00839
hit initial : 21.2394 | hit correction : 1.00771
 *** Total Charge : 1801.28
 Looking at view: 1 | Number of hits in view: 13
hit initial : 268.994 | hit correction : 1.00683
hit initial : 15.6645 | hit correction : 1.00723
hit initial : 19.9485 | hit correction : 1.00824
hit initial : 108.719 | hit correction : 1.00685
hit initial : 144.804 | hit correction : 1.00655
hit initial : 346.551 | hit correction : 1.00605
hit initial : 251.064 | hit correction : 1.00551
hit initial : 535.674 | hit correction : 1.00745
hit initial : 22.7743 | hit correction : 1.00833
hit initial : 25.2427 | hit correction : 1.00838
hit initial : 1257.39 | hit correction : 1.00839
 *** Total Charge : 3019.05
 Looking at view: 2 | Number of hits in view: 11
Begin processing the 10th record. run: 5027 subRun: 0 event: 25150 at 10-Dec-2025 16:57:58 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  26
Added hit list length: 26 | Max was set to: -3.40282e+38
True Neutron Energy: 939.566
True Electron Energy: 12.609
Completed MCParticle Loop
True Neutrino Energy: 16.344
 Size of all hits: 26
hit initial : 35.5144 | hit correction : 1.15313
hit initial : 141.726 | hit correction : 1.15419
hit initial : 53.9951 | hit correction : 1.15312
hit initial : 384.467 | hit correction : 1.15422
hit initial : 152.491 | hit correction : 1.15426
hit initial : 48.7198 | hit correction : 1.15253
hit initial : 80.2412 | hit correction : 1.15253
 *** Total Charge : 1035.2
 Looking at view: 0 | Number of hits in view: 7
hit initial : 36.6148 | hit correction : 1.15447
hit initial : 174.312 | hit correction : 1.15435
hit initial : 338.824 | hit correction : 1.15417
hit initial : 257.432 | hit correction : 1.15406
hit initial : 43.9758 | hit correction : 1.15421
hit initial : 162.265 | hit correction : 1.15321
hit initial : 95.5935 | hit correction : 1.1575
hit initial : 127.485 | hit correction : 1.1575
hit initial : 81.7645 | hit correction : 1.15273
hit initial : 65.285 | hit correction : 1.15251
hit initial : 66.8909 | hit correction : 1.1525
 *** Total Charge : 1674.32
 Looking at view: 1 | Number of hits in view: 11
hit initial : 263.226 | hit correction : 1.1544
hit initial : 399.334 | hit correction : 1.1541
hit initial : 113.48 | hit correction : 1.15426
hit initial : 432.796 | hit correction : 1.15333
hit initial : 17.3888 | hit correction : 1.15287
hit initial : 15.001 | hit correction : 1.15243
hit initial : 28.6208 | hit correction : 1.15272
hit initial : 213.911 | hit correction : 1.15251
 *** Total Charge : 1711.74
 Looking at view: 2 | Number of hits in view: 8
10-Dec-2025 16:58:03 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0878119     0.198251      0.447862      0.159195      0.112135        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00039802     0.040007      0.256316     0.000592292    0.0824701       10     
end_path:ana:AnalyzeEvents         0.0865682     0.158033      0.349106       0.12871      0.0777249       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19478.2 MB
  Peak resident set size usage (VmHWM): 1537.75 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:29:00 UTC       justIN version: 01.06.00