justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258152.0@dunegpschedd02.fnal.gov

Jobsub ID258152.0@dunegpschedd02.fnal.gov
Workflow ID11022
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 20:32:06
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 07:42:28
From worker nodeHostnamedunegli-7832117-0-fnpc9041.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:35:21
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T185825Z_gen_001764_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (22019s)
CPU time6h (21883s = 99%)
Max RSS bytes3058282496 (2916 MiB)
Outputting started2025-12-06 07:42:20
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11022/1/001/analysisLowE_20251206T013522Z.root
Finished2025-12-06 07:42:28
Saved logsjustin-logs:258152.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

utput 2: 0.0341515, 0.193945, 0.751276, 0.0206284, 
Output 3: 0.965806, 0.0222248, 0.00384949, 0.00812017, 
Output 4: 0.525313, 0.400974, 0.0652829, 0.0084298, 
Output 5: 0.390726, 0.430992, 0.149456, 0.0288263, 
Output 6: 0.023859, 0.064504, 0.0775627, 0.834074, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 17640 at 06-Dec-2025 07:17:01 UTC
Boundary wire vector sizes: 6799, 6749, 6756
minwire 0: 5
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 55, 554
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0968532, 
Output 1: 0.0462019, 0.0379493, 0.085098, 0.830751, 
Output 2: 0.118463, 0.166876, 0.682287, 0.0323747, 
Output 3: 0.982575, 0.0124295, 0.000785054, 0.00421086, 
Output 4: 0.298752, 0.668184, 0.0307661, 0.00229749, 
Output 5: 0.479282, 0.397236, 0.0894748, 0.0340078, 
Output 6: 0.0374439, 0.0916106, 0.0901695, 0.780776, 

06-Dec-2025 07:41:18 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 07:41:18 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/d5/ec/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T185825Z_gen_001764_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1452.22       2174.8        3575.89       1790.87       664.164        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00359919    0.00824371     0.0181786    0.00768441    0.00409505       10     
reco:pandora:StandardPandora                            1450.61       2172.04       3567.52       1788.35       662.655        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00211985     0.046479      0.281211      0.0195554     0.0797513       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00152401    0.00639217     0.0185161    0.00424959    0.00539325       10     
reco:pandoracalo:Calorimetry                          0.000344756    0.0067035     0.0394166    0.00213458     0.0113419       10     
reco:pandorapid:Chi2ParticleID                        7.4697e-05    0.00048877    0.00233918    0.000145211   0.000717262      10     
reco:cvnmap:CVNMapper                                  0.044834      0.0737161     0.152033      0.0641477     0.0312924       10     
reco:cvneva:CVNEvaluator                                1.06486       1.98207       7.02029       1.46559       1.70409        10     
reco:energyrecnumu:EnergyReco                         0.00475755     0.105666      0.445978      0.0824419     0.127083        10     
reco:energyrecnue:EnergyReco                          0.00108553    0.00578717     0.0171478    0.00310131    0.00532798       10     
reco:energyrecnc:EnergyReco                           0.00813548     0.0466519     0.120943      0.0155868     0.0449278       10     
[art]:TriggerResults:TriggerResultInserter            1.7208e-05    3.77558e-05   0.000168211   2.1725e-05    4.38624e-05      10     
end_path:out1:RootOutput                               5.089e-06    1.10284e-05   4.6059e-05     7.225e-06    1.18211e-05      10     
end_path:out1:RootOutput(write)                        0.359308      0.477794      0.656132      0.403761       0.12338        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12077.9 MB
  Peak resident set size usage (VmHWM): 3058.28 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  67
Added hit list length: 67 | Max was set to: -3.40282e+38
True Neutron Energy: 939.57
True Electron Energy: 35.7737
Completed MCParticle Loop
True Neutrino Energy: 43.6243
 Size of all hits: 67
hit initial : 92.8844 | hit correction : 1.21606
hit initial : 49.9776 | hit correction : 1.21607
hit initial : 50.6376 | hit correction : 1.19266
hit initial : 183.641 | hit correction : 1.19256
hit initial : 145.716 | hit correction : 1.19244
hit initial : 64.023 | hit correction : 1.20978
hit initial : 64.693 | hit correction : 1.20976
hit initial : 130.179 | hit correction : 1.21277
hit initial : 215.731 | hit correction : 1.21276
hit initial : 59.637 | hit correction : 1.21276
hit initial : 51.2108 | hit correction : 1.21272
hit initial : 335.368 | hit correction : 1.21224
hit initial : 63.976 | hit correction : 1.21217
hit initial : 304.822 | hit correction : 1.21186
hit initial : 206.355 | hit correction : 1.21152
hit initial : 107.022 | hit correction : 1.21107
hit initial : 104.733 | hit correction : 1.21074
hit initial : 131.236 | hit correction : 1.21066
hit initial : 90.646 | hit correction : 1.2
hit initial : 256.754 | hit correction : 1.19996
hit initial : 301.768 | hit correction : 1.19972
hit initial : 34.7355 | hit correction : 1.19904
hit initial : 15.6643 | hit correction : 1.1986
hit initial : 445.103 | hit correction : 1.19856
hit initial : 47.065 | hit correction : 1.19819
hit initial : 62.8367 | hit correction : 1.19749
hit initial : 151.841 | hit correction : 1.19747
hit initial : 83.9972 | hit correction : 1.19745
 *** Total Charge : 4642.2
 Looking at view: 0 | Number of hits in view: 28
hit initial : 65.5692 | hit correction : 1.19261
hit initial : 194.128 | hit correction : 1.19255
hit initial : 156.3 | hit correction : 1.19249
hit initial : 252.105 | hit correction : 1.21275
hit initial : 180.88 | hit correction : 1.21273
hit initial : 94.319 | hit correction : 1.21275
hit initial : 186.832 | hit correction : 1.21215
hit initial : 280.745 | hit correction : 1.21197
hit initial : 230.737 | hit correction : 1.21162
hit initial : 235.349 | hit correction : 1.21103
hit initial : 133.552 | hit correction : 1.21069
hit initial : 33.9921 | hit correction : 1.20006
hit initial : 114.033 | hit correction : 1.20003
hit initial : 87.7782 | hit correction : 1.19974
hit initial : 358.89 | hit correction : 1.19971
hit initial : 95.009 | hit correction : 1.19881
hit initial : 219.933 | hit correction : 1.19835
hit initial : 119.072 | hit correction : 1.19751
hit initial : 242.451 | hit correction : 1.1975
hit initial : 69.1019 | hit correction : 1.19745
 *** Total Charge : 4035.21
 Looking at view: 1 | Number of hits in view: 20
hit initial : 63.4538 | hit correction : 1.20976
hit initial : 86.2972 | hit correction : 1.20975
hit initial : 30.3596 | hit correction : 1.21603
hit initial : 253.271 | hit correction : 1.19987
hit initial : 144.474 | hit correction : 1.20005
hit initial : 83.8282 | hit correction : 1.20003
hit initial : 17.0405 | hit correction : 1.19763
hit initial : 29.8836 | hit correction : 1.19716
hit initial : 135.082 | hit correction : 1.21605
hit initial : 253.691 | hit correction : 1.21275
hit initial : 256.673 | hit correction : 1.21274
hit initial : 393.884 | hit correction : 1.21205
hit initial : 372.836 | hit correction : 1.21168
hit initial : 227.971 | hit correction : 1.21093
hit initial : 116.766 | hit correction : 1.21054
hit initial : 265.468 | hit correction : 1.19929
hit initial : 244.526 | hit correction : 1.19874
hit initial : 306.832 | hit correction : 1.19815
hit initial : 360.383 | hit correction : 1.19748
 *** Total Charge : 4392.58
 Looking at view: 2 | Number of hits in view: 19
06-Dec-2025 07:42:20 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0733573     0.108214      0.162467      0.0951615     0.0299364       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000335194   0.000510658   0.00100603    0.000457058   0.000189057      10     
end_path:ana:AnalyzeEvents         0.072898      0.107558      0.161726      0.0941819     0.0299352       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9811 MB
  Peak resident set size usage (VmHWM): 1532.42 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:09:00 UTC       justIN version: 01.06.00