justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261321.0@dunegpschedd02.fnal.gov

Jobsub ID261321.0@dunegpschedd02.fnal.gov
Workflow ID11091
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:38:40
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 03:33:29
From worker nodeHostnamedunegli-8033738-0-fnpc9018.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:39:43
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T164355Z_gen_000587_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (17604s)
CPU time4h (17488s = 99%)
Max RSS bytes2847645696 (2715 MiB)
Outputting started2025-12-12 03:33:08
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11091/1/001/analysisLowE_20251211T223944Z.root
Finished2025-12-12 03:33:29
Saved logsjustin-logs:261321.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

.0849306, 
Output 1: 0.350426, 0.0580083, 0.17416, 0.417406, 
Output 2: 0.0336384, 0.089172, 0.869485, 0.00770437, 
Output 3: 0.958986, 0.0367867, 0.00165357, 0.00257418, 
Output 4: 0.537065, 0.404707, 0.0483751, 0.00985272, 
Output 5: 0.396356, 0.428068, 0.131516, 0.0440601, 
Output 6: 0.104465, 0.204393, 0.126789, 0.564353, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 5870 at 12-Dec-2025 03:06:32 UTC
Boundary wire vector sizes: 6853, 6791, 6695
minwire 0: 38
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.160437, 
Output 1: 0.0881333, 0.0992786, 0.259203, 0.553385, 
Output 2: 0.0801123, 0.178209, 0.686206, 0.0554719, 
Output 3: 0.960349, 0.0226278, 0.00599811, 0.011025, 
Output 4: 0.59177, 0.37485, 0.0296787, 0.00370167, 
Output 5: 0.39356, 0.419856, 0.145765, 0.040819, 
Output 6: 0.0409473, 0.0859332, 0.0804758, 0.792644, 

12-Dec-2025 03:31:41 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 03:31:41 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/c3/3d/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T164355Z_gen_000587_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1450.38       1736.88       2138.96       1691.4        205.135        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00142366     0.0701698     0.630039     0.00743083     0.186692        10     
reco:pandora:StandardPandora                            1448.07       1734.1         2137         1689.08       205.376        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00136633     0.0200378     0.0690509    0.00863245     0.0219709       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00172017     0.016331      0.0886144    0.00394281     0.0256185       10     
reco:pandoracalo:Calorimetry                          0.000316293   0.00148273    0.00732296    0.000689422    0.0020386       10     
reco:pandorapid:Chi2ParticleID                        6.9865e-05    0.000254975   0.000864662   0.000114164   0.000257801      10     
reco:cvnmap:CVNMapper                                  0.0391812      0.0527       0.0617402     0.0544697    0.00706316       10     
reco:cvneva:CVNEvaluator                                1.14956       1.78948       4.63032       1.64371      0.979795        10     
reco:energyrecnumu:EnergyReco                         0.00901625      0.23597       1.55163      0.114566      0.440863        10     
reco:energyrecnue:EnergyReco                          0.00142321    0.00582737     0.0115541     0.0049646    0.00431385       10     
reco:energyrecnc:EnergyReco                           0.00775366     0.0274617      0.10989      0.0113614     0.034864        10     
[art]:TriggerResults:TriggerResultInserter            1.7031e-05    3.06537e-05   7.7103e-05    2.54985e-05   1.63394e-05      10     
end_path:out1:RootOutput                               5.885e-06    1.03665e-05   3.1597e-05    7.8945e-06    7.19757e-06      10     
end_path:out1:RootOutput(write)                        0.359235      0.553586      0.684215      0.604253      0.110697        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12082.2 MB
  Peak resident set size usage (VmHWM): 2847.65 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 261.042 | hit correction : 1.00621
hit initial : 285.822 | hit correction : 1.0058
hit initial : 203.135 | hit correction : 1.00579
hit initial : 202.261 | hit correction : 1.00646
hit initial : 8.34305 | hit correction : 1.00756
hit initial : 187.012 | hit correction : 1.00675
hit initial : 353.254 | hit correction : 1.00762
hit initial : 188.96 | hit correction : 1.00691
hit initial : 290.235 | hit correction : 1.00732
hit initial : 6.62269 | hit correction : 1.00707
hit initial : 158.796 | hit correction : 1.00722
hit initial : 167.901 | hit correction : 1.00583
hit initial : 167.783 | hit correction : 1.00619
hit initial : 168.705 | hit correction : 1.00601
hit initial : 298.922 | hit correction : 1.00583
hit initial : 310.831 | hit correction : 1.00599
 *** Total Charge : 3723.72
 Looking at view: 2 | Number of hits in view: 18
Begin processing the 10th record. run: 5026 subRun: 0 event: 5870 at 12-Dec-2025 03:33:00 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  48
Added hit list length: 48 | Max was set to: -3.40282e+38
True Neutron Energy: 939.575
True Electron Energy: 29.1616
Completed MCParticle Loop
True Neutrino Energy: 46.4561
 Size of all hits: 48
hit initial : 39.3415 | hit correction : 1.22896
hit initial : 89.2949 | hit correction : 1.23409
hit initial : 45.0823 | hit correction : 1.23404
hit initial : 40.0654 | hit correction : 1.23123
hit initial : 358.552 | hit correction : 1.23205
hit initial : 280.894 | hit correction : 1.23272
hit initial : 599.134 | hit correction : 1.23153
hit initial : 160.595 | hit correction : 1.2326
hit initial : 197.286 | hit correction : 1.23123
hit initial : 283.684 | hit correction : 1.2312
hit initial : 325.962 | hit correction : 1.23101
hit initial : 205.043 | hit correction : 1.23085
hit initial : 324.493 | hit correction : 1.23111
 *** Total Charge : 3632.62
 Looking at view: 0 | Number of hits in view: 13
hit initial : 82.2654 | hit correction : 1.2329
hit initial : 217.585 | hit correction : 1.23279
hit initial : 244.779 | hit correction : 1.2325
hit initial : 243.378 | hit correction : 1.23208
hit initial : 286.955 | hit correction : 1.2317
hit initial : 290.748 | hit correction : 1.23144
hit initial : 215.005 | hit correction : 1.23091
hit initial : 36.3113 | hit correction : 1.23408
hit initial : 179.345 | hit correction : 1.2308
hit initial : 85.4425 | hit correction : 1.23407
hit initial : 182.182 | hit correction : 1.23084
hit initial : 39.7939 | hit correction : 1.23406
hit initial : 215.357 | hit correction : 1.23124
hit initial : 92.9421 | hit correction : 1.23121
hit initial : 215.665 | hit correction : 1.23122
hit initial : 190.914 | hit correction : 1.23104
hit initial : 246.128 | hit correction : 1.23114
 *** Total Charge : 3774.84
 Looking at view: 1 | Number of hits in view: 17
hit initial : 24.1855 | hit correction : 1.23294
hit initial : 237.633 | hit correction : 1.23286
hit initial : 216.117 | hit correction : 1.23257
hit initial : 20.3208 | hit correction : 1.23409
hit initial : 166.313 | hit correction : 1.23224
hit initial : 120.454 | hit correction : 1.23406
hit initial : 146.399 | hit correction : 1.23203
hit initial : 21.3055 | hit correction : 1.23412
hit initial : 137.254 | hit correction : 1.23182
hit initial : 208.863 | hit correction : 1.23157
hit initial : 145.04 | hit correction : 1.23146
hit initial : 108.532 | hit correction : 1.23126
hit initial : 160.203 | hit correction : 1.23097
hit initial : 211.68 | hit correction : 1.23081
hit initial : 326.25 | hit correction : 1.23086
hit initial : 123.457 | hit correction : 1.23113
hit initial : 329.345 | hit correction : 1.23118
hit initial : 273.909 | hit correction : 1.23122
 *** Total Charge : 3667.06
 Looking at view: 2 | Number of hits in view: 18
12-Dec-2025 03:33:06 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.139064      0.202989      0.294275      0.194288      0.0442113       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000529722    0.0206519     0.104238     0.000739415    0.0332808       10     
end_path:ana:AnalyzeEvents         0.135103      0.182118      0.258241      0.186779      0.0388278       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9813.45 MB
  Peak resident set size usage (VmHWM): 1537.67 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:25:46 UTC       justIN version: 01.06.00