justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266166.5@dunegpschedd01.fnal.gov

Jobsub ID266166.5@dunegpschedd01.fnal.gov
Workflow ID11094
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 16:51:09
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 00:18:17
From worker nodeHostnamedunegli-8029139-0-fnpc19104.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 08:49:13
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T201655Z_gen_002671_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time15h (55699s)
CPU time13h (49238s = 88%)
Max RSS bytes3023892480 (2883 MiB)
Outputting started2025-12-12 00:17:33
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11094/1/001/analysisLowE_20251211T084915Z.root
Finished2025-12-12 00:18:17
Saved logsjustin-logs:266166.5-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

4, 0.277717, 0.592088, 0.0553305, 
Output 3: 0.952899, 0.0251475, 0.00658206, 0.0153718, 
Output 4: 0.580251, 0.378457, 0.0374901, 0.00380181, 
Output 5: 0.659788, 0.269409, 0.05672, 0.0140825, 
Output 6: 0.0141157, 0.0396394, 0.0557332, 0.890512, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 26710 at 11-Dec-2025 23:23:09 UTC
Boundary wire vector sizes: 6969, 6925, 6779
minwire 0: 34
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1810, 2309
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.095071, 
Output 1: 0.0500194, 0.0626331, 0.106792, 0.780556, 
Output 2: 0.0614151, 0.21215, 0.705554, 0.0208807, 
Output 3: 0.963638, 0.0298675, 0.00237638, 0.00411756, 
Output 4: 0.331628, 0.576521, 0.0835459, 0.00830521, 
Output 5: 0.597533, 0.336044, 0.0547939, 0.0116291, 
Output 6: 0.0216903, 0.0753619, 0.0877206, 0.815227, 

12-Dec-2025 00:16:07 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 00:16:07 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/7a/0c/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T201655Z_gen_002671_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3166.74       5507.87       7638.78       6052.36       1634.53        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00832927     0.0243426     0.0396357     0.0262524     0.011149        10     
reco:pandora:StandardPandora                            3164.65       5503.73       7625.24       6049.21       1632.7         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00160815     0.0822649     0.621365      0.0159812     0.181089        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00099191     0.0530511      0.2459       0.0156378     0.0751087       10     
reco:pandoracalo:Calorimetry                          0.000356744    0.0245241     0.0812608     0.0068346     0.0286493       10     
reco:pandorapid:Chi2ParticleID                        9.0921e-05    0.00435771     0.0252875    0.000229792   0.00854551       10     
reco:cvnmap:CVNMapper                                  0.0295728     0.132533      0.264718      0.128934      0.0761007       10     
reco:cvneva:CVNEvaluator                                1.4226        3.00891       11.3582       2.4284        2.82909        10     
reco:energyrecnumu:EnergyReco                          0.0199281     0.133685      0.186023      0.152285      0.0487461       10     
reco:energyrecnue:EnergyReco                          0.00106134    0.00859209     0.0168188    0.00796563    0.00614012       10     
reco:energyrecnc:EnergyReco                           0.00693811     0.0578334      0.25437      0.0220825     0.0748183       10     
[art]:TriggerResults:TriggerResultInserter             1.701e-05    9.10568e-05   0.000330303   5.10905e-05   9.67259e-05      10     
end_path:out1:RootOutput                               1.032e-05    3.88874e-05   0.000129961   2.42955e-05   3.55715e-05      10     
end_path:out1:RootOutput(write)                        0.434591      0.607647      0.742515      0.617752      0.101347        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21791.9 MB
  Peak resident set size usage (VmHWM): 3023.89 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 86.4088 | hit correction : 1.05044
hit initial : 280.598 | hit correction : 1.05055
hit initial : 101.641 | hit correction : 1.05111
 *** Total Charge : 1079.97
 Looking at view: 1 | Number of hits in view: 8
hit initial : 40.7776 | hit correction : 1.05223
hit initial : 164.557 | hit correction : 1.05215
hit initial : 175.133 | hit correction : 1.05199
hit initial : 229.744 | hit correction : 1.0517
hit initial : 363.366 | hit correction : 1.05115
hit initial : 512.439 | hit correction : 1.05049
hit initial : 35.5677 | hit correction : 1.05036
 *** Total Charge : 1599.53
 Looking at view: 2 | Number of hits in view: 7
Begin processing the 10th record. run: 5026 subRun: 0 event: 26710 at 12-Dec-2025 00:17:28 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  52
Added hit list length: 52 | Max was set to: -3.40282e+38
True Neutron Energy: 939.571
True Electron Energy: 40.9895
Completed MCParticle Loop
True Neutrino Energy: 47.7198
 Size of all hits: 52
hit initial : 70.6615 | hit correction : 1.16561
hit initial : 33.3872 | hit correction : 1.1704
hit initial : 155.791 | hit correction : 1.17036
hit initial : 97.4871 | hit correction : 1.17021
hit initial : 38.7462 | hit correction : 1.16964
hit initial : 274.198 | hit correction : 1.1697
hit initial : 51.1216 | hit correction : 1.16931
hit initial : 27.0245 | hit correction : 1.16933
hit initial : 112.27 | hit correction : 1.16935
hit initial : 233.277 | hit correction : 1.16911
hit initial : 257.768 | hit correction : 1.16877
hit initial : 333.777 | hit correction : 1.16839
hit initial : 334.577 | hit correction : 1.16778
hit initial : 377.698 | hit correction : 1.16711
hit initial : 311.917 | hit correction : 1.16636
hit initial : 239.68 | hit correction : 1.16583
 *** Total Charge : 3445.3
 Looking at view: 0 | Number of hits in view: 16
hit initial : 83.7475 | hit correction : 1.16821
hit initial : 73.3543 | hit correction : 1.16734
hit initial : 34.9331 | hit correction : 1.16689
hit initial : 192.567 | hit correction : 1.16596
hit initial : 282.027 | hit correction : 1.16597
hit initial : 15.1785 | hit correction : 1.16674
hit initial : 113.216 | hit correction : 1.16611
hit initial : 90.2385 | hit correction : 1.1702
hit initial : 213.76 | hit correction : 1.17332
hit initial : 290.433 | hit correction : 1.17025
hit initial : 292.934 | hit correction : 1.17334
hit initial : 78.2469 | hit correction : 1.17033
hit initial : 88.8858 | hit correction : 1.17337
hit initial : 412.988 | hit correction : 1.16952
hit initial : 680.654 | hit correction : 1.16913
hit initial : 434.372 | hit correction : 1.16867
hit initial : 165.696 | hit correction : 1.16764
hit initial : 343.997 | hit correction : 1.16728
 *** Total Charge : 4544.61
 Looking at view: 1 | Number of hits in view: 18
hit initial : 34.2353 | hit correction : 1.16543
hit initial : 228.789 | hit correction : 1.17035
hit initial : 401.754 | hit correction : 1.17004
hit initial : 155.686 | hit correction : 1.16956
hit initial : 142.719 | hit correction : 1.16941
hit initial : 157.079 | hit correction : 1.16928
hit initial : 156.632 | hit correction : 1.16912
hit initial : 148.849 | hit correction : 1.16896
hit initial : 133.336 | hit correction : 1.16878
hit initial : 152.271 | hit correction : 1.16859
hit initial : 163.761 | hit correction : 1.16836
hit initial : 165.074 | hit correction : 1.16809
hit initial : 211.49 | hit correction : 1.16771
hit initial : 200.911 | hit correction : 1.16733
hit initial : 193.943 | hit correction : 1.16692
hit initial : 192.663 | hit correction : 1.16647
hit initial : 220.44 | hit correction : 1.16605
hit initial : 170.651 | hit correction : 1.1656
 *** Total Charge : 3773.94
 Looking at view: 2 | Number of hits in view: 18
12-Dec-2025 00:17:31 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.079002      0.104728      0.136245      0.096653      0.0203767       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000547165   0.00239708     0.0135899    0.000867318   0.00384438       10     
end_path:ana:AnalyzeEvents         0.0765774     0.101942      0.132813      0.0956486     0.0209725       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19481.5 MB
  Peak resident set size usage (VmHWM): 1539.22 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:28:55 UTC       justIN version: 01.06.00