justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 255401.3@dunegpschedd01.fnal.gov

Jobsub ID255401.3@dunegpschedd01.fnal.gov
Workflow ID10521
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-22 16:21:48
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-11-22 23:35:51
From worker nodeHostnamedunegli-7694052-0-fnpc18001.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-22 16:22:35
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T235801Z_gen_003413_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (25879s)
CPU time6h (23469s = 90%)
Max RSS bytes3073404928 (2931 MiB)
Outputting started2025-11-22 23:33:55
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/10521/1/001/analysisLowE_20251122T162236Z.root
Finished2025-11-22 23:35:51
Saved logsjustin-logs:255401.3-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

753165, 0.279697, 0.602786, 0.0422009, 
Output 3: 0.972976, 0.0145547, 0.00286803, 0.00960093, 
Output 4: 0.357748, 0.583419, 0.0550016, 0.003832, 
Output 5: 0.680419, 0.274984, 0.03701, 0.00758664, 
Output 6: 0.0112142, 0.0350839, 0.0526329, 0.901069, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 34130 at 22-Nov-2025 22:26:04 UTC
Boundary wire vector sizes: 6478, 6509, 6630
minwire 0: 36
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 786, 1285
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0988943, 
Output 1: 0.0326259, 0.0744659, 0.120446, 0.772462, 
Output 2: 0.0715242, 0.198922, 0.698104, 0.0314504, 
Output 3: 0.977136, 0.0112488, 0.00184977, 0.00976583, 
Output 4: 0.22117, 0.710159, 0.0644319, 0.00423907, 
Output 5: 0.747285, 0.209307, 0.0326394, 0.0107684, 
Output 6: 0.0237107, 0.0442569, 0.0541807, 0.877852, 

22-Nov-2025 22:57:35 UTC  Closed output file "matt_reco2.root"
22-Nov-2025 22:57:35 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/3c/0c/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T235801Z_gen_003413_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1883.79       2352.4        3156.32       2251.82       343.361        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00151058    0.00663468     0.0147296    0.00647845    0.00325615       10     
reco:pandora:StandardPandora                            1880.1        2348.1        3152.08       2247.96       343.448        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00247644     0.0273843     0.107373      0.0211828     0.0304945       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00257668     0.0100926     0.0361226    0.00846215    0.00930944       10     
reco:pandoracalo:Calorimetry                          0.000465668   0.00608782     0.0296537    0.00103869     0.0086591       10     
reco:pandorapid:Chi2ParticleID                        0.000109977   0.000492009   0.00307887    0.000174183   0.000868969      10     
reco:cvnmap:CVNMapper                                  0.0345687     0.168768      0.886467      0.0481104     0.263944        10     
reco:cvneva:CVNEvaluator                                1.77395       3.23834       5.46844       3.28345       1.00279        10     
reco:energyrecnumu:EnergyReco                         0.00226365     0.0833736     0.140003      0.0977701     0.0498465       10     
reco:energyrecnue:EnergyReco                          0.00126924    0.00629865     0.0157657    0.00303049    0.00571923       10     
reco:energyrecnc:EnergyReco                            0.0142261     0.0396231     0.106006      0.0155424     0.0375216       10     
[art]:TriggerResults:TriggerResultInserter            2.2583e-05    4.66229e-05   0.000139833   3.81925e-05   3.20407e-05      10     
end_path:out1:RootOutput                               1.031e-05    1.71692e-05   4.4344e-05     1.328e-05    9.85833e-06      10     
end_path:out1:RootOutput(write)                        0.592148       0.71382       1.03227      0.654171      0.130267        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21794.1 MB
  Peak resident set size usage (VmHWM): 3073.4 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 183.882 | hit correction : 1.47151
hit initial : 100.694 | hit correction : 1.47025
 *** Total Charge : 2589.34
 Looking at view: 0 | Number of hits in view: 14
hit initial : 138.132 | hit correction : 1.47383
hit initial : 173.246 | hit correction : 1.47379
hit initial : 154.967 | hit correction : 1.47252
hit initial : 22.1188 | hit correction : 1.47248
hit initial : 160.946 | hit correction : 1.47263
hit initial : 470.861 | hit correction : 1.4718
hit initial : 28.4078 | hit correction : 1.47131
hit initial : 175.929 | hit correction : 1.47265
hit initial : 66.4662 | hit correction : 1.47264
hit initial : 307.626 | hit correction : 1.47145
hit initial : 61.6874 | hit correction : 1.47139
hit initial : 39.3774 | hit correction : 1.47015
hit initial : 24.9249 | hit correction : 1.47019
 *** Total Charge : 2686.42
 Looking at view: 1 | Number of hits in view: 13
hit initial : 177.824 | hit correction : 1.47385
hit initial : 59.6598 | hit correction : 1.47384
hit initial : 38.9269 | hit correction : 1.47383
hit initial : 383.675 | hit correction : 1.47248
hit initial : 20.3129 | hit correction : 1.47197
hit initial : 161.32 | hit correction : 1.47268
hit initial : 741.122 | hit correction : 1.47165
hit initial : 87.8991 | hit correction : 1.47125
hit initial : 145.427 | hit correction : 1.47265
hit initial : 18.2166 | hit correction : 1.47268
hit initial : 40.2679 | hit correction : 1.4702
 *** Total Charge : 2760
 Looking at view: 2 | Number of hits in view: 11
Begin processing the 10th record. run: 3799 subRun: 0 event: 34130 at 22-Nov-2025 23:00:15 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  36
Added hit list length: 36 | Max was set to: -3.40282e+38
True Neutron Energy: 939.566
True Electron Energy: 59.8539
Completed MCParticle Loop
True Neutrino Energy: 63.7372
 Size of all hits: 36
hit initial : 80.9305 | hit correction : 1.38838
hit initial : 482.768 | hit correction : 1.39207
hit initial : 256.6 | hit correction : 1.39202
hit initial : 163.534 | hit correction : 1.39208
hit initial : 256.765 | hit correction : 1.39114
hit initial : 392.947 | hit correction : 1.39083
hit initial : 82.1207 | hit correction : 1.39037
hit initial : 25.93 | hit correction : 1.38989
hit initial : 20.1384 | hit correction : 1.38988
hit initial : 125.943 | hit correction : 1.39036
hit initial : 456.163 | hit correction : 1.38949
hit initial : 368.118 | hit correction : 1.38936
hit initial : 39.8106 | hit correction : 1.38898
hit initial : 44.4643 | hit correction : 1.38887
hit initial : 241.266 | hit correction : 1.38934
hit initial : 61.6191 | hit correction : 1.38878
hit initial : 60.4244 | hit correction : 1.38877
 *** Total Charge : 4393.31
 Looking at view: 0 | Number of hits in view: 17
hit initial : 114.349 | hit correction : 1.392
hit initial : 219.679 | hit correction : 1.39208
hit initial : 211.874 | hit correction : 1.39214
hit initial : 192.553 | hit correction : 1.39213
hit initial : 157.651 | hit correction : 1.39204
hit initial : 152.536 | hit correction : 1.39191
hit initial : 165.31 | hit correction : 1.39174
hit initial : 194.032 | hit correction : 1.39149
hit initial : 247.262 | hit correction : 1.39122
hit initial : 238.642 | hit correction : 1.39099
hit initial : 288.799 | hit correction : 1.39047
hit initial : 645.91 | hit correction : 1.39019
hit initial : 389.591 | hit correction : 1.39055
hit initial : 651.089 | hit correction : 1.38952
hit initial : 168.128 | hit correction : 1.39043
hit initial : 606.546 | hit correction : 1.38934
hit initial : 307.662 | hit correction : 1.389
hit initial : 156.921 | hit correction : 1.38851
hit initial : 70.159 | hit correction : 1.38835
 *** Total Charge : 7200.82
 Looking at view: 1 | Number of hits in view: 19
22-Nov-2025 23:00:28 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.451861       1.24783       2.36223       1.22486      0.515743        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000565758    0.278993       1.05226     0.000718635    0.380076        10     
end_path:ana:AnalyzeEvents         0.450496      0.968518       1.65714      0.927091      0.428929        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19480.3 MB
  Peak resident set size usage (VmHWM): 1539.23 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-08 21:38:17 UTC       justIN version: 01.06.00