justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 257717.62@dunegpschedd02.fnal.gov

Jobsub ID257717.62@dunegpschedd02.fnal.gov
Workflow ID11006
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-04 23:14:05
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-05 06:36:35
From worker nodeHostnamedunegli-7985083-0-fnpc18009.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-05 00:26:30
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T233752Z_gen_004772_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (22178s)
CPU time5h (21491s = 96%)
Max RSS bytes3071332352 (2929 MiB)
Outputting started2025-12-05 06:36:09
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11006/1/001/analysisLowE_20251205T002631Z.root
Finished2025-12-05 06:36:31
Saved logsjustin-logs:257717.62-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

put 2: 0.0426799, 0.082617, 0.860757, 0.013946, 
Output 3: 0.978568, 0.0176694, 0.00117674, 0.00258625, 
Output 4: 0.520782, 0.434153, 0.0383651, 0.00669918, 
Output 5: 0.216761, 0.431732, 0.2525, 0.0990067, 
Output 6: 0.073902, 0.15897, 0.113083, 0.654045, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 47720 at 05-Dec-2025 05:59:06 UTC
Boundary wire vector sizes: 6907, 6864, 6691
minwire 0: 31
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2104, 2603
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.062163, 
Output 1: 0.0417342, 0.0649427, 0.127184, 0.766139, 
Output 2: 0.0530871, 0.152024, 0.771474, 0.0234152, 
Output 3: 0.933489, 0.046682, 0.00867095, 0.0111577, 
Output 4: 0.6874, 0.249463, 0.0503466, 0.0127901, 
Output 5: 0.62067, 0.29857, 0.065, 0.0157601, 
Output 6: 0.0340713, 0.0763856, 0.072307, 0.817236, 

05-Dec-2025 06:35:00 UTC  Closed output file "matt_reco2.root"
05-Dec-2025 06:35:00 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/bb/52/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T233752Z_gen_004772_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1667.79       2154.42       2503.17       2184.28       264.165        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00134683    0.00962993     0.0428821    0.00422842     0.0123195       10     
reco:pandora:StandardPandora                            1662.13       2151.24       2500.76       2180.88       264.765        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00201626     0.0213788     0.101992      0.0107205     0.0286221       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00052417     0.0790145     0.725667     0.00755275      0.21558        10     
reco:pandoracalo:Calorimetry                          0.000579625   0.00179901    0.00804505    0.000747181   0.00233297       10     
reco:pandorapid:Chi2ParticleID                        9.3867e-05    0.000338417   0.00192394    0.000172536   0.000529072      10     
reco:cvnmap:CVNMapper                                  0.0369742      0.1304       0.876488       0.04839      0.248798        10     
reco:cvneva:CVNEvaluator                                1.82766       2.31006       4.59686       1.90699      0.819728        10     
reco:energyrecnumu:EnergyReco                         0.00591049     0.0776638     0.151453      0.0975157     0.056558        10     
reco:energyrecnue:EnergyReco                          0.00109197    0.00277788     0.0101048    0.00210239    0.00249319       10     
reco:energyrecnc:EnergyReco                            0.0090271     0.0435742     0.101925      0.013956      0.0403253       10     
[art]:TriggerResults:TriggerResultInserter             1.594e-05    2.86541e-05   9.2164e-05    2.04385e-05   2.18938e-05      10     
end_path:out1:RootOutput                               6.963e-06    1.04429e-05    2.635e-05    7.9205e-06    5.68541e-06      10     
end_path:out1:RootOutput(write)                        0.368272      0.498537       0.90034      0.416252      0.167965        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21788.4 MB
  Peak resident set size usage (VmHWM): 3071.33 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 *** Total Charge : 6097.95
 Looking at view: 1 | Number of hits in view: 18
hit initial : 168.327 | hit correction : 1.44147
hit initial : 281.786 | hit correction : 1.44145
hit initial : 240.011 | hit correction : 1.44189
hit initial : 187.236 | hit correction : 1.4425
hit initial : 177.425 | hit correction : 1.44274
hit initial : 40.2785 | hit correction : 1.44269
hit initial : 114.177 | hit correction : 1.45106
hit initial : 112.396 | hit correction : 1.45125
hit initial : 172.394 | hit correction : 1.45117
hit initial : 117.292 | hit correction : 1.4512
hit initial : 71.0429 | hit correction : 1.45183
hit initial : 169.926 | hit correction : 1.45184
hit initial : 146.747 | hit correction : 1.45221
hit initial : 123.215 | hit correction : 1.45238
hit initial : 117.367 | hit correction : 1.4526
hit initial : 140.253 | hit correction : 1.45295
hit initial : 134.524 | hit correction : 1.45336
hit initial : 171.337 | hit correction : 1.45381
hit initial : 195.157 | hit correction : 1.45416
hit initial : 153.44 | hit correction : 1.45456
hit initial : 138.245 | hit correction : 1.45496
hit initial : 130.274 | hit correction : 1.45544
hit initial : 126.397 | hit correction : 1.45585
hit initial : 137.981 | hit correction : 1.45625
hit initial : 145.533 | hit correction : 1.45663
hit initial : 137.006 | hit correction : 1.45709
hit initial : 136.062 | hit correction : 1.45759
hit initial : 17.0617 | hit correction : 1.45778
hit initial : 137.126 | hit correction : 1.45809
hit initial : 117.723 | hit correction : 1.45844
hit initial : 21.7818 | hit correction : 1.45854
 *** Total Charge : 6209.91
 Looking at view: 2 | Number of hits in view: 31
Begin processing the 10th record. run: 5026 subRun: 0 event: 47720 at 05-Dec-2025 06:36:05 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  31
Added hit list length: 31 | Max was set to: -3.40282e+38
True Neutron Energy: 939.569
True Electron Energy: 18.0433
Completed MCParticle Loop
True Neutrino Energy: 33.5368
 Size of all hits: 31
hit initial : 39.7526 | hit correction : 1.0723
hit initial : 141.062 | hit correction : 1.06899
hit initial : 130.208 | hit correction : 1.06902
hit initial : 51.5272 | hit correction : 1.06904
hit initial : 212.752 | hit correction : 1.06971
hit initial : 77.4727 | hit correction : 1.06978
hit initial : 24.1036 | hit correction : 1.06983
hit initial : 37.8941 | hit correction : 1.07037
hit initial : 182.258 | hit correction : 1.07068
hit initial : 224.262 | hit correction : 1.07096
hit initial : 272.183 | hit correction : 1.07133
hit initial : 219.742 | hit correction : 1.07173
hit initial : 57.5061 | hit correction : 1.07187
 *** Total Charge : 1788.56
 Looking at view: 0 | Number of hits in view: 13
hit initial : 174.448 | hit correction : 1.069
hit initial : 86.0251 | hit correction : 1.06898
hit initial : 47.2208 | hit correction : 1.06904
hit initial : 71.1522 | hit correction : 1.06945
hit initial : 353.701 | hit correction : 1.06953
hit initial : 85.0117 | hit correction : 1.06979
hit initial : 51.402 | hit correction : 1.06987
hit initial : 176.01 | hit correction : 1.07056
hit initial : 351.789 | hit correction : 1.07102
hit initial : 283.672 | hit correction : 1.07154
hit initial : 88.6846 | hit correction : 1.07181
 *** Total Charge : 1893.48
 Looking at view: 1 | Number of hits in view: 11
hit initial : 219.294 | hit correction : 1.06896
hit initial : 143.64 | hit correction : 1.06898
hit initial : 424.358 | hit correction : 1.06939
hit initial : 424.979 | hit correction : 1.06988
hit initial : 369.402 | hit correction : 1.07065
hit initial : 350.45 | hit correction : 1.07113
hit initial : 331.757 | hit correction : 1.07173
 *** Total Charge : 2422.88
 Looking at view: 2 | Number of hits in view: 7
05-Dec-2025 06:36:08 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0927262     0.230907      0.659656      0.109552       0.18675        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000414964   0.000821844   0.00308901    0.000533557   0.000780839      10     
end_path:ana:AnalyzeEvents         0.091421      0.229852      0.655797      0.108888      0.186089        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.5 MB
  Peak resident set size usage (VmHWM): 1535.62 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 20:42:09 UTC       justIN version: 01.06.00