justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267093.1@dunegpschedd01.fnal.gov

Jobsub ID267093.1@dunegpschedd01.fnal.gov
Workflow ID11116
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 23:00:41
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 04:07:46
From worker nodeHostnamedunegli-7875979-0-fnpc19123.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 23:01:42
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T230735Z_gen_001191_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (18344s)
CPU time5h (18193s = 99%)
Max RSS bytes2911002624 (2776 MiB)
Outputting started2025-12-12 04:07:27
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11116/1/001/analysisLowE_20251211T230143Z.root
Finished2025-12-12 04:07:46
Saved logsjustin-logs:267093.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

, 0.0835041, 0.0513841, 0.824433, 
Output 2: 0.118731, 0.401161, 0.455109, 0.0249997, 
Output 3: 0.978066, 0.0153632, 0.000928543, 0.00564273, 
Output 4: 0.563648, 0.404505, 0.0292175, 0.00262974, 
Output 5: 0.298869, 0.663792, 0.0347525, 0.00258622, 
Output 6: 0.00629004, 0.0211863, 0.045583, 0.926941, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 11910 at 12-Dec-2025 03:35:29 UTC
Boundary wire vector sizes: 6657, 6661, 6610
minwire 0: 66
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 549, 1048
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.136363, 
Output 1: 0.0610422, 0.052441, 0.163222, 0.723295, 
Output 2: 0.0622546, 0.184461, 0.718377, 0.0349074, 
Output 3: 0.968927, 0.0191093, 0.00335365, 0.00861035, 
Output 4: 0.279115, 0.656768, 0.0596553, 0.00446161, 
Output 5: 0.493901, 0.371696, 0.106014, 0.0283883, 
Output 6: 0.0218103, 0.060356, 0.072256, 0.845578, 

12-Dec-2025 04:06:26 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 04:06:26 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/94/cb/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T230735Z_gen_001191_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1725.4        1817.56       1860.89       1833.17       43.9047        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00143308    0.00697651     0.0224581    0.00388254    0.00716324       10     
reco:pandora:StandardPandora                            1721.42       1815.39       1858.87       1831.2        44.3218        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000670533    0.0167803     0.0810819    0.00394086     0.0244531       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00120479    0.00605261     0.0230066    0.00336272    0.00653321       10     
reco:pandoracalo:Calorimetry                          0.000269861    0.0058416     0.0229268     0.0050506    0.00641713       10     
reco:pandorapid:Chi2ParticleID                         7.313e-05    0.000379934   0.00128155    0.000276912   0.00037377       10     
reco:cvnmap:CVNMapper                                  0.0398982     0.0494528     0.0559846     0.0517213    0.00522289       10     
reco:cvneva:CVNEvaluator                                1.31176       1.5278        3.16415       1.34992      0.545721        10     
reco:energyrecnumu:EnergyReco                         0.00441897     0.0754122     0.141097      0.0943249     0.0450592       10     
reco:energyrecnue:EnergyReco                          0.00144909    0.00747275     0.0119013     0.011045     0.00474607       10     
reco:energyrecnc:EnergyReco                            0.0109578     0.0370052     0.102414      0.0117531     0.0391943       10     
[art]:TriggerResults:TriggerResultInserter            1.6561e-05    2.93283e-05   0.000124681    1.857e-05    3.18131e-05      10     
end_path:out1:RootOutput                               9.04e-06     1.2894e-05     3.884e-05     1.003e-05    8.66768e-06      10     
end_path:out1:RootOutput(write)                        0.407563      0.433638       0.48639      0.431333      0.0224187       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21675.3 MB
  Peak resident set size usage (VmHWM): 2911 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 51.317 | hit correction : 1.41094
hit initial : 146.705 | hit correction : 1.4124
hit initial : 42.2308 | hit correction : 1.41257
hit initial : 201.817 | hit correction : 1.41207
hit initial : 194.342 | hit correction : 1.41166
hit initial : 244.21 | hit correction : 1.41128
hit initial : 300.689 | hit correction : 1.41104
hit initial : 221.71 | hit correction : 1.41096
 *** Total Charge : 1980.35
 Looking at view: 1 | Number of hits in view: 8
hit initial : 27.9018 | hit correction : 1.41101
hit initial : 145.53 | hit correction : 1.41249
hit initial : 28.4001 | hit correction : 1.41261
hit initial : 194.308 | hit correction : 1.4121
hit initial : 155.738 | hit correction : 1.41172
hit initial : 139.904 | hit correction : 1.41144
hit initial : 142.686 | hit correction : 1.41124
hit initial : 147.929 | hit correction : 1.41107
hit initial : 201.966 | hit correction : 1.41097
hit initial : 192.11 | hit correction : 1.41093
 *** Total Charge : 1942.88
 Looking at view: 2 | Number of hits in view: 10
Begin processing the 8th record. run: 5027 subRun: 0 event: 11908 at 12-Dec-2025 04:07:14 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.711
True Electron Energy: 19.3731
Completed MCParticle Loop
True Neutrino Energy: 28.3277
 Size of all hits: 0
Begin processing the 9th record. run: 5027 subRun: 0 event: 11909 at 12-Dec-2025 04:07:18 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  29
Added hit list length: 29 | Max was set to: -3.40282e+38
True Electron Energy: 21.124
Completed MCParticle Loop
True Neutrino Energy: 24.4313
 Size of all hits: 29
hit initial : 88.8786 | hit correction : 1.15127
hit initial : 376.366 | hit correction : 1.15129
hit initial : 460.509 | hit correction : 1.1513
hit initial : 287.403 | hit correction : 1.15127
hit initial : 205.238 | hit correction : 1.15117
hit initial : 200.831 | hit correction : 1.15109
hit initial : 217.381 | hit correction : 1.15104
hit initial : 291.709 | hit correction : 1.15104
hit initial : 269.73 | hit correction : 1.1511
hit initial : 134.538 | hit correction : 1.15119
hit initial : 27.8458 | hit correction : 1.15126
 *** Total Charge : 2947.54
 Looking at view: 0 | Number of hits in view: 11
hit initial : 50.7104 | hit correction : 1.15126
hit initial : 157.069 | hit correction : 1.15119
hit initial : 237.058 | hit correction : 1.15109
hit initial : 266.225 | hit correction : 1.15103
hit initial : 255.32 | hit correction : 1.15104
hit initial : 280.881 | hit correction : 1.15112
hit initial : 260.949 | hit correction : 1.15124
hit initial : 205.285 | hit correction : 1.15134
hit initial : 233.996 | hit correction : 1.15131
hit initial : 324.86 | hit correction : 1.15127
hit initial : 222.557 | hit correction : 1.15126
hit initial : 46.9913 | hit correction : 1.15127
 *** Total Charge : 2926.21
 Looking at view: 1 | Number of hits in view: 12
hit initial : 10.4508 | hit correction : 1.15146
hit initial : 507.684 | hit correction : 1.1513
hit initial : 581.772 | hit correction : 1.1511
hit initial : 1052.17 | hit correction : 1.15114
hit initial : 142.181 | hit correction : 1.15125
hit initial : 273.766 | hit correction : 1.15127
 *** Total Charge : 2956.26
 Looking at view: 2 | Number of hits in view: 6
Begin processing the 10th record. run: 5027 subRun: 0 event: 11910 at 12-Dec-2025 04:07:22 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.569
True Electron Energy: 11.3834
Completed MCParticle Loop
True Neutrino Energy: 16.8942
 Size of all hits: 0
12-Dec-2025 04:07:26 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0824036     0.110245      0.138641      0.105925      0.0151684       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000448642   0.000724887   0.00144152    0.000552088   0.00032298       10     
end_path:ana:AnalyzeEvents         0.0813857     0.109319      0.137939      0.105295      0.0152406       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19512.8 MB
  Peak resident set size usage (VmHWM): 1571.22 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:59:41 UTC       justIN version: 01.06.00