justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260373.0@dunegpschedd02.fnal.gov

Jobsub ID260373.0@dunegpschedd02.fnal.gov
Workflow ID11093
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 16:37:08
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-11 20:42:40
From worker nodeHostnamedunegli-8029135-0-fnpc19104.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 08:51:48
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T183320Z_gen_001585_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (42637s)
CPU time11h (41523s = 97%)
Max RSS bytes3025076224 (2884 MiB)
Outputting started2025-12-11 20:42:26
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11093/1/001/analysisLowE_20251211T085149Z.root
Finished2025-12-11 20:42:40
Saved logsjustin-logs:260373.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

861297, 0.0067087, 
Output 3: 0.970516, 0.0229764, 0.00155061, 0.00495675, 
Output 4: 0.739121, 0.251373, 0.00851488, 0.000990955, 
Output 5: 0.283393, 0.464166, 0.180886, 0.0715552, 
Output 6: 0.157228, 0.373438, 0.148414, 0.32092, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 15850 at 11-Dec-2025 19:38:06 UTC
Boundary wire vector sizes: 6820, 6777, 6817
minwire 0: 40
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 19, 518
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.103698, 
Output 1: 0.0465064, 0.0737493, 0.10875, 0.770994, 
Output 2: 0.0607471, 0.227463, 0.681012, 0.0307772, 
Output 3: 0.97049, 0.0198614, 0.00308167, 0.00656645, 
Output 4: 0.544718, 0.377591, 0.0678169, 0.00987389, 
Output 5: 0.668667, 0.267785, 0.0513743, 0.0121744, 
Output 6: 0.0197164, 0.0553234, 0.0679495, 0.857011, 

11-Dec-2025 20:41:46 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 20:41:46 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/4a/5b/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T183320Z_gen_001585_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3815.37       4246.68       4429.28       4279.95       175.801        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0043949     0.0155269     0.0251881     0.0155731    0.00616639       10     
reco:pandora:StandardPandora                            3745.98       4177.05       4361.21       4211.8        174.413        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00114328     0.0589869     0.260789      0.025458      0.0767381       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000404724   0.00500589     0.034055     0.00186825    0.00972451       10     
reco:pandoracalo:Calorimetry                          0.000344804    0.0144474     0.0713902    0.000831068    0.0218851       10     
reco:pandorapid:Chi2ParticleID                        0.000100451   0.000836546   0.00601769    0.000154181   0.00175039       10     
reco:cvnmap:CVNMapper                                  0.0323013      0.06784      0.105145      0.0673726     0.0186226       10     
reco:cvneva:CVNEvaluator                               0.802745       1.65978       5.8077        1.32581       1.39613        10     
reco:energyrecnumu:EnergyReco                         0.00514627      40.4593       73.2347       62.7345       33.179         10     
reco:energyrecnue:EnergyReco                          0.000991279   0.00547488     0.010296     0.00410132    0.00345133       10     
reco:energyrecnc:EnergyReco                           0.00828196      27.0049       74.2695      0.0112437      33.3377        10     
[art]:TriggerResults:TriggerResultInserter            2.0911e-05    4.70145e-05   0.000163551   3.34255e-05   4.12479e-05      10     
end_path:out1:RootOutput                               1.294e-05    2.87672e-05   9.9221e-05     1.958e-05    2.51431e-05      10     
end_path:out1:RootOutput(write)                        0.287527      0.342562       0.47605      0.330154      0.0510883       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21779.4 MB
  Peak resident set size usage (VmHWM): 3025.08 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 118.493 | hit correction : 1.25682
hit initial : 92.1991 | hit correction : 1.25815
hit initial : 88.3973 | hit correction : 1.25598
hit initial : 93.4216 | hit correction : 1.25587
hit initial : 178.23 | hit correction : 1.25592
hit initial : 231.441 | hit correction : 1.25672
hit initial : 21.7104 | hit correction : 1.25759
hit initial : 526.452 | hit correction : 1.25802
hit initial : 474.79 | hit correction : 1.25896
hit initial : 193.897 | hit correction : 1.26066
hit initial : 341.539 | hit correction : 1.26155
 *** Total Charge : 2970.61
 Looking at view: 1 | Number of hits in view: 11
hit initial : 38.2073 | hit correction : 1.2635
hit initial : 48.4636 | hit correction : 1.25685
hit initial : 229.203 | hit correction : 1.25685
hit initial : 251.841 | hit correction : 1.25588
hit initial : 18.0363 | hit correction : 1.26285
hit initial : 168.915 | hit correction : 1.26265
hit initial : 184.552 | hit correction : 1.2626
hit initial : 26.4713 | hit correction : 1.2559
hit initial : 5.48517 | hit correction : 1.25855
hit initial : 47.168 | hit correction : 1.25898
hit initial : 965.969 | hit correction : 1.25981
hit initial : 1261.38 | hit correction : 1.26078
 *** Total Charge : 4089.41
 Looking at view: 2 | Number of hits in view: 12
Begin processing the 10th record. run: 5026 subRun: 0 event: 15850 at 11-Dec-2025 20:42:23 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  41
Added hit list length: 41 | Max was set to: -3.40282e+38
True Neutron Energy: 939.575
True Electron Energy: 54.7922
Completed MCParticle Loop
True Neutrino Energy: 60.2844
 Size of all hits: 41
hit initial : 47.8141 | hit correction : 1.02094
hit initial : 28.7257 | hit correction : 1.02037
hit initial : 26.7878 | hit correction : 1.01844
hit initial : 48.2785 | hit correction : 1.02095
hit initial : 208.196 | hit correction : 1.02094
hit initial : 374.775 | hit correction : 1.02092
hit initial : 387.249 | hit correction : 1.02084
hit initial : 295.302 | hit correction : 1.02069
hit initial : 272.771 | hit correction : 1.02053
hit initial : 272.606 | hit correction : 1.02023
hit initial : 367.456 | hit correction : 1.02011
hit initial : 267.341 | hit correction : 1.02035
hit initial : 583.286 | hit correction : 1.01996
hit initial : 528.415 | hit correction : 1.02001
hit initial : 371.87 | hit correction : 1.02014
hit initial : 328.112 | hit correction : 1.02022
hit initial : 390.5 | hit correction : 1.02033
hit initial : 532.293 | hit correction : 1.0204
hit initial : 279.158 | hit correction : 1.02043
 *** Total Charge : 5725.19
 Looking at view: 0 | Number of hits in view: 19
hit initial : 34.9313 | hit correction : 1.0198
hit initial : 54.2072 | hit correction : 1.01981
hit initial : 35.8431 | hit correction : 1.02096
hit initial : 20.7779 | hit correction : 1.02032
hit initial : 152.136 | hit correction : 1.02031
hit initial : 429.252 | hit correction : 1.02035
hit initial : 350.72 | hit correction : 1.02047
hit initial : 252.156 | hit correction : 1.02039
hit initial : 241.383 | hit correction : 1.02024
hit initial : 267.334 | hit correction : 1.02018
hit initial : 269.09 | hit correction : 1.02015
hit initial : 468.881 | hit correction : 1.02003
hit initial : 650.511 | hit correction : 1.01993
hit initial : 375.409 | hit correction : 1.02006
hit initial : 237.063 | hit correction : 1.02022
hit initial : 229.349 | hit correction : 1.02031
hit initial : 233.596 | hit correction : 1.02046
hit initial : 249.762 | hit correction : 1.0206
hit initial : 290.528 | hit correction : 1.02075
hit initial : 371.82 | hit correction : 1.02087
hit initial : 320.646 | hit correction : 1.02092
hit initial : 174.295 | hit correction : 1.02095
 *** Total Charge : 5825.88
 Looking at view: 1 | Number of hits in view: 22
11-Dec-2025 20:42:26 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0663099     0.079634      0.102559      0.0804882    0.00975554       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000461984   0.000798413   0.00173676    0.000624236   0.000389257      10     
end_path:ana:AnalyzeEvents         0.0650034     0.0785858     0.100113      0.079673     0.00940892       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19472.3 MB
  Peak resident set size usage (VmHWM): 1530.48 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:20:36 UTC       justIN version: 01.06.00