justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261071.0@dunegpschedd02.fnal.gov

Jobsub ID261071.0@dunegpschedd02.fnal.gov
Workflow ID11087
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 15:36:16
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 02:59:42
From worker nodeHostnamedunegli-8029141-0-fnpc19104.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 15:37:23
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T183329Z_gen_001589_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (40923s)
CPU time11h (39929s = 97%)
Max RSS bytes3005448192 (2866 MiB)
Outputting started2025-12-12 02:59:26
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11087/1/001/analysisLowE_20251211T153724Z.root
Finished2025-12-12 02:59:42
Saved logsjustin-logs:261071.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.108706, 
Output 1: 0.0560104, 0.0673185, 0.131194, 0.745477, 
Output 2: 0.0542598, 0.197126, 0.726666, 0.021948, 
Output 3: 0.975373, 0.0159983, 0.00200384, 0.00662494, 
Output 4: 0.30899, 0.61718, 0.0680843, 0.00574488, 
Output 5: 0.605802, 0.329382, 0.0530616, 0.0117539, 
Output 6: 0.015144, 0.0428436, 0.0580498, 0.883962, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 15890 at 12-Dec-2025 02:08:08 UTC
Boundary wire vector sizes: 6848, 6804, 6686
minwire 0: 7
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 484, 983
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.110644, 
Output 1: 0.0939789, 0.0737923, 0.0907213, 0.741508, 
Output 2: 0.0611954, 0.206563, 0.702656, 0.0295857, 
Output 3: 0.98197, 0.0108418, 0.00125749, 0.00593079, 
Output 4: 0.620887, 0.342414, 0.0323092, 0.00439015, 
Output 5: 0.499678, 0.34942, 0.112918, 0.0379844, 
Output 6: 0.0315654, 0.0756713, 0.0836129, 0.80915, 

12-Dec-2025 02:58:41 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 02:58:41 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/8f/cb/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T183329Z_gen_001589_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3028.36       4059.34       4880.98       4190.41       661.795        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00357359     0.0183972     0.0280944      0.01863     0.00733964       10     
reco:pandora:StandardPandora                            3026.79       4010.84       4809.06       4122.03       634.161        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000857268    0.0524349     0.206785      0.0210815     0.0699481       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00226458     0.0243272     0.109363     0.00740243     0.0340483       10     
reco:pandoracalo:Calorimetry                          0.000299562   0.00849799     0.0710863    0.000780193    0.0209347       10     
reco:pandorapid:Chi2ParticleID                        9.3981e-05    0.00048175     0.002623     0.000175457   0.000730893      10     
reco:cvnmap:CVNMapper                                  0.0458934     0.0733594     0.115143      0.0704932     0.023548        10     
reco:cvneva:CVNEvaluator                                1.05247       2.24456       5.88913       1.94058       1.30248        10     
reco:energyrecnumu:EnergyReco                         0.00821776      13.0016       69.3946      0.0645053      25.9949        10     
reco:energyrecnue:EnergyReco                          0.00138326    0.00340369     0.0117032    0.00256466    0.00287634       10     
reco:energyrecnc:EnergyReco                           0.00741586      32.6506       69.2991       31.1368       32.6964        10     
[art]:TriggerResults:TriggerResultInserter             1.515e-05    9.11468e-05   0.000248952   4.2085e-05    8.52132e-05      10     
end_path:out1:RootOutput                               8.33e-06     3.42013e-05    7.649e-05    2.3595e-05    2.54289e-05      10     
end_path:out1:RootOutput(write)                         0.29712      0.428461      0.514079      0.443315      0.0731962       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21770.9 MB
  Peak resident set size usage (VmHWM): 3005.45 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 *** Total Charge : 917.724
 Looking at view: 0 | Number of hits in view: 5
hit initial : 62.3065 | hit correction : 1.21317
hit initial : 237.544 | hit correction : 1.21129
hit initial : 245.599 | hit correction : 1.21141
hit initial : 182.969 | hit correction : 1.21152
 *** Total Charge : 882.513
 Looking at view: 2 | Number of hits in view: 4
Begin processing the 9th record. run: 5026 subRun: 0 event: 15889 at 12-Dec-2025 02:59:19 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Neutron Energy: 943.34
True Neutron Energy: 941.192
True Electron Energy: 20.5046
Completed MCParticle Loop
True Neutrino Energy: 33.1151
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 15890 at 12-Dec-2025 02:59:23 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  48
Added hit list length: 48 | Max was set to: -3.40282e+38
True Neutron Energy: 939.575
True Neutron Energy: 940.907
True Electron Energy: 40.6091
Completed MCParticle Loop
True Neutrino Energy: 56.1289
 Size of all hits: 48
hit initial : 51.8411 | hit correction : 1.39703
hit initial : 69.6569 | hit correction : 1.39701
hit initial : 35.3696 | hit correction : 1.39692
hit initial : 83.6847 | hit correction : 1.38331
hit initial : 66.7193 | hit correction : 1.38885
hit initial : 231.861 | hit correction : 1.38342
hit initial : 56.6793 | hit correction : 1.38772
hit initial : 25.989 | hit correction : 1.38645
hit initial : 303.951 | hit correction : 1.38369
hit initial : 1053.64 | hit correction : 1.38813
hit initial : 77.3206 | hit correction : 1.38658
hit initial : 270.025 | hit correction : 1.38517
hit initial : 71.3956 | hit correction : 1.38514
hit initial : 223.372 | hit correction : 1.3889
hit initial : 73.2861 | hit correction : 1.38986
hit initial : 6.04711 | hit correction : 1.39034
hit initial : 278.373 | hit correction : 1.39192
hit initial : 116.274 | hit correction : 1.39212
hit initial : 57.0987 | hit correction : 1.39336
hit initial : 142.636 | hit correction : 1.3934
 *** Total Charge : 4574.48
 Looking at view: 0 | Number of hits in view: 20
hit initial : 260.812 | hit correction : 1.3844
hit initial : 145.637 | hit correction : 1.38503
hit initial : 265.713 | hit correction : 1.3859
hit initial : 304.743 | hit correction : 1.38672
hit initial : 59.5333 | hit correction : 1.39698
hit initial : 67.8327 | hit correction : 1.397
hit initial : 272.846 | hit correction : 1.38915
hit initial : 55.907 | hit correction : 1.38933
hit initial : 575.517 | hit correction : 1.3899
hit initial : 75.975 | hit correction : 1.39007
hit initial : 213.598 | hit correction : 1.39157
hit initial : 218.785 | hit correction : 1.39195
hit initial : 162.905 | hit correction : 1.39314
hit initial : 37.7027 | hit correction : 1.39349
 *** Total Charge : 3775.03
 Looking at view: 1 | Number of hits in view: 14
hit initial : 142.58 | hit correction : 1.38537
hit initial : 42.5221 | hit correction : 1.38749
hit initial : 257.343 | hit correction : 1.38611
hit initial : 271.208 | hit correction : 1.38779
hit initial : 205.998 | hit correction : 1.3866
hit initial : 35.9759 | hit correction : 1.38721
hit initial : 63.9839 | hit correction : 1.39697
hit initial : 89.0011 | hit correction : 1.39699
hit initial : 263.426 | hit correction : 1.38893
hit initial : 254.629 | hit correction : 1.38968
hit initial : 238.038 | hit correction : 1.39057
hit initial : 380.026 | hit correction : 1.39186
hit initial : 325.519 | hit correction : 1.39308
hit initial : 37.4768 | hit correction : 1.39375
 *** Total Charge : 3624.26
 Looking at view: 2 | Number of hits in view: 14
12-Dec-2025 02:59:26 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0659645     0.0916991     0.139669      0.0921726     0.0194291       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000388173   0.000563761   0.00116372    0.000505685   0.000210845      10     
end_path:ana:AnalyzeEvents         0.0652978     0.0909316     0.137852      0.0916124     0.0191543       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19472 MB
  Peak resident set size usage (VmHWM): 1531.85 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:28:16 UTC       justIN version: 01.06.00