justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267089.0@dunegpschedd01.fnal.gov

Jobsub ID267089.0@dunegpschedd01.fnal.gov
Workflow ID11112
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:54:40
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 02:58:47
From worker nodeHostnamedunegli-7877339-0-fnpc19129.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:55:18
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T163117Z_gen_000387_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (14596s)
CPU time4h (14479s = 99%)
Max RSS bytes2932416512 (2796 MiB)
Outputting started2025-12-12 02:58:35
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11112/1/001/analysisLowE_20251211T225518Z.root
Finished2025-12-12 02:58:47
Saved logsjustin-logs:267089.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

29, 
Output 3: 0.965837, 0.0299845, 0.0017774, 0.00240116, 
Output 4: 0.529271, 0.418807, 0.0436441, 0.00827783, 
Output 5: 0.197193, 0.422594, 0.273637, 0.106576, 
Output 6: 0.113735, 0.225157, 0.132909, 0.528198, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 3870 at 12-Dec-2025 02:33:12 UTC
Boundary wire vector sizes: 6707, 6633, 6797
minwire 0: 16
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 432, 931
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.113159, 
Output 1: 0.0693346, 0.0333486, 0.0970496, 0.800267, 
Output 2: 0.0656921, 0.182244, 0.719615, 0.0324491, 
Output 3: 0.974208, 0.0119901, 0.00242198, 0.0113799, 
Output 4: 0.592304, 0.361082, 0.0402353, 0.00637823, 
Output 5: 0.457936, 0.412025, 0.105021, 0.0250175, 
Output 6: 0.0194512, 0.0430375, 0.056023, 0.881488, 

12-Dec-2025 02:57:55 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 02:57:55 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/02/e9/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T163117Z_gen_000387_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1391.89       1446.92       1501.05       1443.87       36.4227        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.000918     0.00463562     0.0189798    0.00330008    0.00491089       10     
reco:pandora:StandardPandora                            1390.5        1445.41       1499.8        1442.57       36.5432        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00133985     0.0186824     0.0631183     0.0167985     0.0182361       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00175991    0.00519039     0.0128191    0.00485179     0.0028846       10     
reco:pandoracalo:Calorimetry                          0.000217223   0.00318081     0.0264424    0.000384883   0.00777895       10     
reco:pandorapid:Chi2ParticleID                        5.3621e-05    0.000253441   0.00096436    9.0861e-05    0.000315711      10     
reco:cvnmap:CVNMapper                                  0.0224083     0.0280728     0.038555      0.0257591    0.00541103       10     
reco:cvneva:CVNEvaluator                               0.839986       1.00498       2.34464      0.847348      0.446882        10     
reco:energyrecnumu:EnergyReco                         0.00605004     0.0820053     0.129088      0.0951623     0.0376158       10     
reco:energyrecnue:EnergyReco                          0.00094462    0.00336244     0.0111154    0.00116351    0.00347665       10     
reco:energyrecnc:EnergyReco                           0.00691484     0.0213243     0.087692     0.00722846     0.0279254       10     
[art]:TriggerResults:TriggerResultInserter             1.02e-05     2.50933e-05   9.2251e-05    1.66005e-05   2.30242e-05      10     
end_path:out1:RootOutput                                6.6e-06     1.0976e-05     2.752e-05     8.43e-06     6.09001e-06      10     
end_path:out1:RootOutput(write)                        0.299536      0.340708      0.432632      0.320802      0.0477272       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21691.6 MB
  Peak resident set size usage (VmHWM): 2932.42 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 Looking at view: 2 | Number of hits in view: 11
Begin processing the 10th record. run: 5026 subRun: 0 event: 3870 at 12-Dec-2025 02:58:32 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  65
Added hit list length: 65 | Max was set to: -3.40282e+38
True Neutron Energy: 939.568
True Electron Energy: 42.4974
Completed MCParticle Loop
True Neutrino Energy: 64.582
 Size of all hits: 65
hit initial : 82.0056 | hit correction : 1.20456
hit initial : 155.374 | hit correction : 1.20154
hit initial : 45.1901 | hit correction : 1.19949
hit initial : 75.8677 | hit correction : 1.20412
hit initial : 333.57 | hit correction : 1.20231
hit initial : 212.095 | hit correction : 1.20095
hit initial : 47.7567 | hit correction : 1.1995
hit initial : 99.0121 | hit correction : 1.20475
hit initial : 82.2444 | hit correction : 1.20036
hit initial : 39.1282 | hit correction : 1.20757
hit initial : 99.2913 | hit correction : 1.20648
hit initial : 87.1654 | hit correction : 1.20492
hit initial : 97.7414 | hit correction : 1.20809
hit initial : 46.902 | hit correction : 1.20734
hit initial : 29.751 | hit correction : 1.20661
hit initial : 247.664 | hit correction : 1.20772
hit initial : 139.906 | hit correction : 1.2066
hit initial : 27.517 | hit correction : 1.20574
hit initial : 126.43 | hit correction : 1.20483
hit initial : 60.0174 | hit correction : 1.20356
hit initial : 86.2289 | hit correction : 1.20236
hit initial : 12.5081 | hit correction : 1.20167
hit initial : 73.0116 | hit correction : 1.20089
hit initial : 149.08 | hit correction : 1.20028
 *** Total Charge : 2955.75
 Looking at view: 0 | Number of hits in view: 24
hit initial : 118.388 | hit correction : 1.20451
hit initial : 334.428 | hit correction : 1.20444
hit initial : 153.088 | hit correction : 1.20454
hit initial : 80.2015 | hit correction : 1.20403
hit initial : 43.1786 | hit correction : 1.20239
hit initial : 68.2671 | hit correction : 1.20236
hit initial : 163.327 | hit correction : 1.20484
hit initial : 41.1648 | hit correction : 1.20364
hit initial : 61.0793 | hit correction : 1.20236
hit initial : 64.7962 | hit correction : 1.20093
hit initial : 18.2 | hit correction : 1.20031
hit initial : 166.547 | hit correction : 1.20406
hit initial : 87.2969 | hit correction : 1.20795
hit initial : 192.054 | hit correction : 1.2079
hit initial : 170.416 | hit correction : 1.20727
hit initial : 99.7508 | hit correction : 1.20676
hit initial : 72.6314 | hit correction : 1.20651
hit initial : 51.1109 | hit correction : 1.20647
hit initial : 31.3131 | hit correction : 1.20573
hit initial : 76.7828 | hit correction : 1.20485
hit initial : 39.4401 | hit correction : 1.20163
hit initial : 141.818 | hit correction : 1.20088
hit initial : 168.523 | hit correction : 1.20044
hit initial : 104.409 | hit correction : 1.20031
hit initial : 50.2764 | hit correction : 1.19949
hit initial : 20.873 | hit correction : 1.19948
 *** Total Charge : 3154.1
 Looking at view: 1 | Number of hits in view: 26
hit initial : 18.7324 | hit correction : 1.20024
hit initial : 31.2556 | hit correction : 1.19949
hit initial : 463.478 | hit correction : 1.20773
hit initial : 419.996 | hit correction : 1.2065
hit initial : 91.2144 | hit correction : 1.20577
hit initial : 639.138 | hit correction : 1.20486
hit initial : 375.586 | hit correction : 1.20376
hit initial : 314.012 | hit correction : 1.20277
hit initial : 130.366 | hit correction : 1.20235
hit initial : 324.147 | hit correction : 1.20201
hit initial : 80.6395 | hit correction : 1.20126
hit initial : 25.3567 | hit correction : 1.20083
hit initial : 471.08 | hit correction : 1.20082
hit initial : 223.807 | hit correction : 1.20029
hit initial : 92.7046 | hit correction : 1.19948
 *** Total Charge : 4455.52
 Looking at view: 2 | Number of hits in view: 15
12-Dec-2025 02:58:34 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0713859     0.0876422      0.14129      0.0843899     0.0185728       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000391764   0.000923426   0.00424155    0.00046764    0.00112513       10     
end_path:ana:AnalyzeEvents         0.0703584     0.0865668     0.139874      0.0838428     0.0186211       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19477.4 MB
  Peak resident set size usage (VmHWM): 1539.39 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 15:00:05 UTC       justIN version: 01.06.00