justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264296.0@dunegpschedd01.fnal.gov

Jobsub ID264296.0@dunegpschedd01.fnal.gov
Workflow ID11023
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 06:55:41
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 16:01:13
From worker nodeHostnamedunegli-7832046-0-fnpc18007.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 06:56:20
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T171354Z_gen_000922_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time9h (32672s)
CPU time8h (32100s = 98%)
Max RSS bytes3045142528 (2904 MiB)
Outputting started2025-12-06 16:00:53
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11023/1/001/analysisLowE_20251206T065621Z.root
Finished2025-12-06 16:01:13
Saved logsjustin-logs:264296.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

762, 0.221503, 0.689856, 0.0361644, 
Output 3: 0.939166, 0.0328661, 0.00867527, 0.0192924, 
Output 4: 0.887957, 0.0817873, 0.0217217, 0.00853378, 
Output 5: 0.835264, 0.124095, 0.0305022, 0.010139, 
Output 6: 0.00599808, 0.01866, 0.0322714, 0.943071, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 9220 at 06-Dec-2025 15:11:35 UTC
Boundary wire vector sizes: 6558, 6514, 6562
minwire 0: 11
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1483, 1982
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0978764, 
Output 1: 0.0543494, 0.0748663, 0.116928, 0.753856, 
Output 2: 0.0517965, 0.274294, 0.647677, 0.0262327, 
Output 3: 0.952886, 0.0363279, 0.00441396, 0.00637186, 
Output 4: 0.272591, 0.630558, 0.0909408, 0.00591091, 
Output 5: 0.696113, 0.255334, 0.0406255, 0.0079282, 
Output 6: 0.0184423, 0.0608528, 0.077734, 0.842971, 

06-Dec-2025 15:59:23 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 15:59:23 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/02/0a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T171354Z_gen_000922_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2693.92       3241.14       3866.04       3190.94       381.059        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00218946     0.0124287     0.0283368    0.00817346    0.00902614       10     
reco:pandora:StandardPandora                            2687.47        3236         3861.01       3186.6        381.264        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00320412     0.0478817     0.199497      0.0392676     0.0538846       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00192261     0.0263079     0.168824     0.00770509     0.0489567       10     
reco:pandoracalo:Calorimetry                          0.00045583    0.00178607    0.00828694    0.000854583    0.0023163       10     
reco:pandorapid:Chi2ParticleID                        9.7514e-05    0.000615312   0.00417606    0.000199612   0.00118951       10     
reco:cvnmap:CVNMapper                                  0.0442716     0.0691868     0.102862      0.0668231     0.0183397       10     
reco:cvneva:CVNEvaluator                                1.99921       4.18767       7.79619       4.00531       1.46433        10     
reco:energyrecnumu:EnergyReco                         0.00403721     0.0533803     0.151463      0.0217073     0.053969        10     
reco:energyrecnue:EnergyReco                           0.0020072    0.00296547    0.00390199    0.00288763    0.000715367      10     
reco:energyrecnc:EnergyReco                            0.0111749     0.101996      0.187986      0.126264      0.0605786       10     
[art]:TriggerResults:TriggerResultInserter            2.3975e-05    4.56471e-05   0.000147168   3.3443e-05     3.473e-05       10     
end_path:out1:RootOutput                              1.0209e-05    1.83838e-05   4.3232e-05    1.43975e-05   9.52499e-06      10     
end_path:out1:RootOutput(write)                         0.39043      0.630641      0.774264      0.641501      0.0953503       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21784.4 MB
  Peak resident set size usage (VmHWM): 3045.14 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 654.698 | hit correction : 1.09831
hit initial : 1413.67 | hit correction : 1.09831
 *** Total Charge : 3486.77
 Looking at view: 0 | Number of hits in view: 9
hit initial : 347.854 | hit correction : 1.09819
hit initial : 51.8542 | hit correction : 1.09817
hit initial : 257.151 | hit correction : 1.0982
hit initial : 543.551 | hit correction : 1.09829
hit initial : 837.007 | hit correction : 1.09837
hit initial : 763.114 | hit correction : 1.0983
 *** Total Charge : 3075.8
 Looking at view: 1 | Number of hits in view: 6
Begin processing the 10th record. run: 5026 subRun: 0 event: 9220 at 06-Dec-2025 16:00:46 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  54
Added hit list length: 54 | Max was set to: -3.40282e+38
True Neutron Energy: 939.572
True Electron Energy: 37.2823
Completed MCParticle Loop
True Neutrino Energy: 42.6696
 Size of all hits: 54
hit initial : 77.6056 | hit correction : 1.21143
hit initial : 81.8901 | hit correction : 1.21145
hit initial : 27.3953 | hit correction : 1.20638
hit initial : 57.2303 | hit correction : 1.2075
hit initial : 41.2916 | hit correction : 1.20337
hit initial : 34.6313 | hit correction : 1.20345
hit initial : 327.411 | hit correction : 1.20197
hit initial : 92.4908 | hit correction : 1.20203
hit initial : 557.397 | hit correction : 1.20201
hit initial : 47.1205 | hit correction : 1.2029
hit initial : 233.321 | hit correction : 1.20307
hit initial : 129.377 | hit correction : 1.20383
hit initial : 329.614 | hit correction : 1.2042
hit initial : 404.584 | hit correction : 1.20486
hit initial : 346.228 | hit correction : 1.20561
hit initial : 250.02 | hit correction : 1.20636
hit initial : 235.801 | hit correction : 1.20681
hit initial : 238.982 | hit correction : 1.20717
hit initial : 175.355 | hit correction : 1.20738
 *** Total Charge : 4442.78
 Looking at view: 0 | Number of hits in view: 19
hit initial : 39.1801 | hit correction : 1.20341
hit initial : 25.1139 | hit correction : 1.20648
hit initial : 153.736 | hit correction : 1.20195
hit initial : 275.206 | hit correction : 1.20193
hit initial : 212.113 | hit correction : 1.20194
hit initial : 187.292 | hit correction : 1.20202
hit initial : 227.037 | hit correction : 1.20221
hit initial : 305.721 | hit correction : 1.20268
hit initial : 319.206 | hit correction : 1.20309
hit initial : 326.622 | hit correction : 1.20387
hit initial : 318.584 | hit correction : 1.2045
hit initial : 290.627 | hit correction : 1.20512
hit initial : 311.328 | hit correction : 1.20582
hit initial : 262.466 | hit correction : 1.20642
hit initial : 249.989 | hit correction : 1.20692
hit initial : 225.803 | hit correction : 1.20725
hit initial : 112.019 | hit correction : 1.20744
 *** Total Charge : 4626.56
 Looking at view: 1 | Number of hits in view: 17
hit initial : 19.0901 | hit correction : 1.20653
hit initial : 42.0012 | hit correction : 1.2065
hit initial : 27.469 | hit correction : 1.202
hit initial : 57.7176 | hit correction : 1.20335
hit initial : 48.0032 | hit correction : 1.20331
hit initial : 21.2165 | hit correction : 1.20912
hit initial : 235.03 | hit correction : 1.20196
hit initial : 161.842 | hit correction : 1.20192
hit initial : 135.032 | hit correction : 1.20188
hit initial : 197.684 | hit correction : 1.20195
hit initial : 221.433 | hit correction : 1.20206
hit initial : 113.787 | hit correction : 1.20223
hit initial : 374.334 | hit correction : 1.20274
hit initial : 221.199 | hit correction : 1.20442
hit initial : 1631.89 | hit correction : 1.20504
hit initial : 169.031 | hit correction : 1.20596
hit initial : 16.4853 | hit correction : 1.20727
hit initial : 62.1539 | hit correction : 1.20734
 *** Total Charge : 4521.41
 Looking at view: 2 | Number of hits in view: 18
06-Dec-2025 16:00:52 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.151496      0.174489      0.202794      0.170494      0.0173798       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000609691    0.0013057     0.0055941    0.000792222   0.00144067       10     
end_path:ana:AnalyzeEvents          0.15059      0.172891      0.197876      0.169335      0.0164965       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19474.6 MB
  Peak resident set size usage (VmHWM): 1533.84 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:11:02 UTC       justIN version: 01.06.00