justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258509.0@dunegpschedd02.fnal.gov

Jobsub ID258509.0@dunegpschedd02.fnal.gov
Workflow ID11030
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 11:39:56
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 18:59:52
From worker nodeHostnamedunegli-7832230-0-fnpc18004.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 11:40:55
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T225334Z_gen_000839_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (26322s)
CPU time7h (26005s = 98%)
Max RSS bytes3069304832 (2927 MiB)
Outputting started2025-12-06 18:59:38
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11030/1/001/analysisLowE_20251206T114056Z.root
Finished2025-12-06 18:59:52
Saved logsjustin-logs:258509.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

n failure: 0, 499
Classifier summary: 
Output 0: 0.072149, 
Output 1: 0.0368114, 0.0321295, 0.0987677, 0.832291, 
Output 2: 0.0392993, 0.165733, 0.776784, 0.0181844, 
Output 3: 0.95552, 0.0328716, 0.00441808, 0.00719013, 
Output 4: 0.287411, 0.583831, 0.116175, 0.0125826, 
Output 5: 0.750119, 0.197973, 0.0409272, 0.0109809, 
Output 6: 0.0125517, 0.0473553, 0.0623686, 0.877724, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 8390 at 06-Dec-2025 18:14:56 UTC
Boundary wire vector sizes: 6686, 6683, 6722
minwire 0: 45
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.146463, 
Output 1: 0.0839937, 0.0913665, 0.141114, 0.683526, 
Output 2: 0.0381142, 0.138806, 0.801495, 0.0215851, 
Output 3: 0.977208, 0.0138394, 0.00187313, 0.0070792, 
Output 4: 0.423461, 0.520148, 0.0505303, 0.00586008, 
Output 5: 0.192384, 0.406673, 0.301042, 0.0999009, 
Output 6: 0.0471136, 0.104102, 0.104254, 0.744531, 

06-Dec-2025 18:58:47 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 18:58:47 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/e1/14/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T225334Z_gen_000839_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2359.34       2605.99       3021.59       2590.48       196.003        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00156927     0.0240888     0.186196     0.00476382     0.0541979       10     
reco:pandora:StandardPandora                            2355.63       2601.84       3013.7        2586.81       195.099        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00116297     0.0313251     0.128376      0.0233975     0.0351157       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000456233   0.00747041     0.0360209    0.00436992    0.00991878       10     
reco:pandoracalo:Calorimetry                          0.000307361   0.00841269     0.037434     0.000851158    0.0136146       10     
reco:pandorapid:Chi2ParticleID                        9.1373e-05    0.000548214     0.00392     0.000165006   0.00112583       10     
reco:cvnmap:CVNMapper                                  0.0380425     0.0578616     0.080742      0.0520552     0.0142221       10     
reco:cvneva:CVNEvaluator                                2.32311       3.2721        6.62837       2.83367       1.18155        10     
reco:energyrecnumu:EnergyReco                          0.0112742      0.11974       0.24529      0.124498      0.0646456       10     
reco:energyrecnue:EnergyReco                          0.00198346    0.00629683     0.0158728    0.00256348    0.00575889       10     
reco:energyrecnc:EnergyReco                            0.0136889     0.035779      0.120102      0.0148869     0.0415796       10     
[art]:TriggerResults:TriggerResultInserter            2.2182e-05    3.63336e-05   0.000127341    2.649e-05    3.04791e-05      10     
end_path:out1:RootOutput                               8.045e-06    1.31609e-05   3.9825e-05     1.061e-05    8.94672e-06      10     
end_path:out1:RootOutput(write)                        0.512247      0.582757      0.643658      0.574646      0.0395738       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21787.9 MB
  Peak resident set size usage (VmHWM): 3069.3 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 405.73 | hit correction : 1.29388
hit initial : 91.5331 | hit correction : 1.29466
hit initial : 145.745 | hit correction : 1.29434
hit initial : 276.945 | hit correction : 1.29395
hit initial : 168.991 | hit correction : 1.29469
hit initial : 160.391 | hit correction : 1.29506
hit initial : 207.524 | hit correction : 1.29536
hit initial : 401.276 | hit correction : 1.29545
hit initial : 285.775 | hit correction : 1.29627
hit initial : 374.413 | hit correction : 1.29731
hit initial : 370.732 | hit correction : 1.29847
hit initial : 386.107 | hit correction : 1.29965
hit initial : 511.782 | hit correction : 1.30093
hit initial : 178.036 | hit correction : 1.30157
hit initial : 75.5418 | hit correction : 1.30195
 *** Total Charge : 6075.92
 Looking at view: 2 | Number of hits in view: 25
Begin processing the 9th record. run: 5027 subRun: 0 event: 8389 at 06-Dec-2025 18:59:31 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 940.331
True Electron Energy: 0.895935
Completed MCParticle Loop
True Neutrino Energy: 4.17941
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 8390 at 06-Dec-2025 18:59:34 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  40
Added hit list length: 40 | Max was set to: -3.40282e+38
True Neutron Energy: 939.571
True Neutron Energy: 939.732
True Electron Energy: 35.5252
Completed MCParticle Loop
True Neutrino Energy: 44.5118
 Size of all hits: 40
hit initial : 156.785 | hit correction : 1.11176
hit initial : 349.953 | hit correction : 1.11168
hit initial : 138.617 | hit correction : 1.11059
hit initial : 582.689 | hit correction : 1.11063
hit initial : 1148.58 | hit correction : 1.10858
hit initial : 654.377 | hit correction : 1.10743
hit initial : 192.754 | hit correction : 1.10719
 *** Total Charge : 3575.83
 Looking at view: 0 | Number of hits in view: 7
hit initial : 98.632 | hit correction : 1.10584
hit initial : 20.3498 | hit correction : 1.10676
hit initial : 38.193 | hit correction : 1.10581
hit initial : 75.2453 | hit correction : 1.11183
hit initial : 162.191 | hit correction : 1.11179
hit initial : 332.012 | hit correction : 1.11146
hit initial : 79.1936 | hit correction : 1.1114
hit initial : 28.9337 | hit correction : 1.1108
hit initial : 199.125 | hit correction : 1.11062
hit initial : 120.199 | hit correction : 1.11062
hit initial : 161.606 | hit correction : 1.11038
hit initial : 48.779 | hit correction : 1.10942
hit initial : 46.4859 | hit correction : 1.10865
hit initial : 104.798 | hit correction : 1.10865
hit initial : 59.5467 | hit correction : 1.10832
hit initial : 11.5549 | hit correction : 1.10794
hit initial : 14.4035 | hit correction : 1.10793
hit initial : 195.733 | hit correction : 1.10709
hit initial : 44.598 | hit correction : 1.10678
 *** Total Charge : 2043.72
 Looking at view: 1 | Number of hits in view: 19
hit initial : 103.462 | hit correction : 1.10565
hit initial : 322.406 | hit correction : 1.10596
hit initial : 44.317 | hit correction : 1.1119
hit initial : 21.2383 | hit correction : 1.10729
hit initial : 227.865 | hit correction : 1.11186
hit initial : 186.561 | hit correction : 1.11166
hit initial : 105.577 | hit correction : 1.11146
hit initial : 123.177 | hit correction : 1.11137
hit initial : 195.869 | hit correction : 1.11101
hit initial : 663.429 | hit correction : 1.11064
hit initial : 453.12 | hit correction : 1.10971
hit initial : 413.967 | hit correction : 1.10859
hit initial : 472.32 | hit correction : 1.10781
hit initial : 297.615 | hit correction : 1.10676
 *** Total Charge : 4027.56
 Looking at view: 2 | Number of hits in view: 14
06-Dec-2025 18:59:38 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0888305     0.105707      0.139468      0.105962      0.0142869       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00042316    0.000556282   0.000817025   0.000524611   0.000109732      10     
end_path:ana:AnalyzeEvents         0.0881485     0.104948      0.138037      0.105206      0.0140945       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19476.1 MB
  Peak resident set size usage (VmHWM): 1535.19 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:08:57 UTC       justIN version: 01.06.00