justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267143.0@dunegpschedd01.fnal.gov

Jobsub ID267143.0@dunegpschedd01.fnal.gov
Workflow ID11109
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-12 00:30:45
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-13 00:18:00
From worker nodeHostnamedunegli-7890252-0-fnpc23020.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-12 17:49:47
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T134840Z_gen_000591_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (23236s)
CPU time5h (20090s = 86%)
Max RSS bytes2933735424 (2797 MiB)
Outputting started2025-12-13 00:17:03
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11109/1/001/analysisLowE_20251212T174947Z.root
Finished2025-12-13 00:18:00
Saved logsjustin-logs:267143.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

2: 0.118209, 0.227119, 0.623141, 0.0315301, 
Output 3: 0.969655, 0.0254509, 0.00165392, 0.00324007, 
Output 4: 0.20377, 0.718558, 0.0726618, 0.00501021, 
Output 5: 0.82049, 0.161731, 0.0137125, 0.00406648, 
Output 6: 0.0244219, 0.0832624, 0.0872775, 0.805038, 

Begin processing the 10th record. run: 4696 subRun: 0 event: 5910 at 12-Dec-2025 23:40:40 UTC
Boundary wire vector sizes: 6884, 6813, 6765
minwire 0: 40
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 650, 1149
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.117274, 
Output 1: 0.0556493, 0.144766, 0.205756, 0.593828, 
Output 2: 0.0299799, 0.178872, 0.775258, 0.0158907, 
Output 3: 0.939831, 0.0489991, 0.00547947, 0.0056901, 
Output 4: 0.257006, 0.643885, 0.0923092, 0.00679974, 
Output 5: 0.457791, 0.396398, 0.121297, 0.024513, 
Output 6: 0.0177131, 0.0656772, 0.0823621, 0.834248, 

13-Dec-2025 00:15:57 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 00:15:57 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/ed/de/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T134840Z_gen_000591_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2100.01       2308.16       2529.55       2313.78       126.078        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0042549     0.0211679     0.0588801     0.0140055     0.0159542       10     
reco:pandora:StandardPandora                            2093.79       2305.95       2527.98       2311.75       126.749        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.0106354      0.0893       0.338057      0.0717335     0.0893292       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00644753      0.01268      0.028476     0.00949907    0.00742103       10     
reco:pandoracalo:Calorimetry                          0.000366421    0.0144188     0.109626     0.000490834    0.0326234       10     
reco:pandorapid:Chi2ParticleID                        9.7366e-05    0.000739565    0.0044759    0.000144547    0.0013444       10     
reco:cvnmap:CVNMapper                                  0.0648881     0.0857562      0.13501      0.0839014     0.0192684       10     
reco:cvneva:CVNEvaluator                               0.867768       1.50546       5.10114       1.06311       1.22188        10     
reco:energyrecnumu:EnergyReco                          0.010137      0.0384887     0.088207      0.0248012     0.0275329       10     
reco:energyrecnue:EnergyReco                          0.000979204   0.00290437     0.0119963    0.00144903     0.003332        10     
reco:energyrecnc:EnergyReco                           0.00541551     0.0582913     0.124795      0.0614443     0.0389731       10     
[art]:TriggerResults:TriggerResultInserter            2.2684e-05    4.54789e-05   0.000133235   3.80975e-05   2.99259e-05      10     
end_path:out1:RootOutput                               1.049e-05    1.80325e-05   4.3172e-05    1.55195e-05   8.79901e-06      10     
end_path:out1:RootOutput(write)                        0.272355       0.38571      0.548784      0.366062      0.104065        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21686.2 MB
  Peak resident set size usage (VmHWM): 2933.74 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 175.207 | hit correction : 1.01882
hit initial : 347.327 | hit correction : 1.01816
hit initial : 190.56 | hit correction : 1.01791
hit initial : 151.704 | hit correction : 1.01731
hit initial : 254.742 | hit correction : 1.01709
hit initial : 206.842 | hit correction : 1.01687
 *** Total Charge : 3251.93
 Looking at view: 1 | Number of hits in view: 21
hit initial : 70.8663 | hit correction : 1.01934
hit initial : 380.953 | hit correction : 1.0207
hit initial : 409.959 | hit correction : 1.02124
hit initial : 303.056 | hit correction : 1.01927
hit initial : 383.282 | hit correction : 1.0191
hit initial : 211.175 | hit correction : 1.01876
hit initial : 259.868 | hit correction : 1.01893
hit initial : 248.917 | hit correction : 1.01849
hit initial : 185.98 | hit correction : 1.01821
hit initial : 311.056 | hit correction : 1.0179
hit initial : 301 | hit correction : 1.01734
hit initial : 250.648 | hit correction : 1.01698
hit initial : 165.819 | hit correction : 1.01676
 *** Total Charge : 3548.39
 Looking at view: 2 | Number of hits in view: 13
Begin processing the 10th record. run: 4696 subRun: 0 event: 5910 at 13-Dec-2025 00:16:58 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  43
Added hit list length: 43 | Max was set to: -3.40282e+38
True Neutron Energy: 939.568
True Electron Energy: 63.091
Completed MCParticle Loop
True Neutrino Energy: 69.0294
 Size of all hits: 43
hit initial : 94.0838 | hit correction : 1.13921
hit initial : 388.194 | hit correction : 1.14022
hit initial : 295.33 | hit correction : 1.1427
hit initial : 42.9606 | hit correction : 1.14167
hit initial : 97.4422 | hit correction : 1.14283
hit initial : 49.1508 | hit correction : 1.14157
hit initial : 27.412 | hit correction : 1.14156
hit initial : 329.167 | hit correction : 1.14227
hit initial : 284.954 | hit correction : 1.14192
hit initial : 268.135 | hit correction : 1.14162
hit initial : 300.378 | hit correction : 1.14135
hit initial : 278.217 | hit correction : 1.14104
hit initial : 272.282 | hit correction : 1.14064
hit initial : 748.428 | hit correction : 1.14004
hit initial : 833.444 | hit correction : 1.13973
hit initial : 443.921 | hit correction : 1.13936
 *** Total Charge : 5422.38
 Looking at view: 0 | Number of hits in view: 16
hit initial : 29.2761 | hit correction : 1.14155
hit initial : 51.1666 | hit correction : 1.14287
hit initial : 255.029 | hit correction : 1.14031
hit initial : 517.729 | hit correction : 1.14003
hit initial : 82.74 | hit correction : 1.14137
hit initial : 1264.11 | hit correction : 1.13979
hit initial : 205.615 | hit correction : 1.13996
hit initial : 189.279 | hit correction : 1.13926
hit initial : 87.6376 | hit correction : 1.14339
hit initial : 27.8025 | hit correction : 1.1434
hit initial : 177.313 | hit correction : 1.14271
hit initial : 384.375 | hit correction : 1.14231
hit initial : 543.245 | hit correction : 1.14176
hit initial : 129.812 | hit correction : 1.14144
 *** Total Charge : 4500.35
 Looking at view: 1 | Number of hits in view: 14
hit initial : 937.612 | hit correction : 1.13984
hit initial : 29.6629 | hit correction : 1.14229
hit initial : 209.813 | hit correction : 1.14286
hit initial : 117.996 | hit correction : 1.14159
hit initial : 731.334 | hit correction : 1.14222
hit initial : 182.905 | hit correction : 1.14167
hit initial : 252.61 | hit correction : 1.1415
hit initial : 288.784 | hit correction : 1.14119
hit initial : 189.389 | hit correction : 1.14091
hit initial : 181.579 | hit correction : 1.14061
hit initial : 238.147 | hit correction : 1.14032
hit initial : 648.18 | hit correction : 1.1401
hit initial : 696.516 | hit correction : 1.13931
 *** Total Charge : 5366.46
 Looking at view: 2 | Number of hits in view: 13
13-Dec-2025 00:17:02 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0929332     0.118287      0.153049      0.120052      0.0167341       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000481191   0.000717145   0.00160623    0.000596867   0.000316573      10     
end_path:ana:AnalyzeEvents         0.0922752     0.117361       0.15079      0.119305      0.0163766       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.6 MB
  Peak resident set size usage (VmHWM): 1538.15 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:58:09 UTC       justIN version: 01.06.00