justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 257906.0@dunegpschedd02.fnal.gov

Jobsub ID257906.0@dunegpschedd02.fnal.gov
Workflow ID11024
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 11:19:42
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 09:04:06
From worker nodeHostnamedunegli-7832314-0-fnpc18010.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-05 22:10:17
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T230404Z_gen_001136_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time10h (39207s)
CPU time10h (38390s = 97%)
Max RSS bytes3069804544 (2927 MiB)
Outputting started2025-12-06 09:03:45
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11024/1/001/analysisLowE_20251205T221019Z.root
Finished2025-12-06 09:04:06
Saved logsjustin-logs:257906.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

: 0.0547965, 0.0772718, 0.15299, 0.714942, 
Output 2: 0.0969736, 0.249505, 0.601749, 0.0517715, 
Output 3: 0.955445, 0.0305317, 0.0049722, 0.00905134, 
Output 4: 0.43074, 0.518995, 0.0462925, 0.0039724, 
Output 5: 0.656943, 0.279533, 0.0502273, 0.0132964, 
Output 6: 0.0217215, 0.060592, 0.0716918, 0.845995, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 11360 at 06-Dec-2025 08:15:03 UTC
Boundary wire vector sizes: 6695, 6631, 6493
minwire 0: 46
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 141, 640
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.174309, 
Output 1: 0.061983, 0.0990252, 0.143704, 0.695288, 
Output 2: 0.0505609, 0.210445, 0.712162, 0.0268322, 
Output 3: 0.976473, 0.0179573, 0.00177836, 0.00379111, 
Output 4: 0.27475, 0.632493, 0.0859633, 0.0067937, 
Output 5: 0.376687, 0.41475, 0.16627, 0.0422934, 
Output 6: 0.0310018, 0.0860469, 0.100538, 0.782414, 

06-Dec-2025 09:02:38 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 09:02:38 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/04/bf/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T230404Z_gen_001136_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2849.34       3874.96       5533.34       3655.32       902.873        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00522937     0.011351      0.0218961    0.00983735    0.00518918       10     
reco:pandora:StandardPandora                            2846.75       3870.24       5520.82       3651.67       900.674        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000723845    0.0585879     0.305937      0.0235912     0.0862228       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000864479    0.0110739     0.0697391    0.00350382     0.0200153       10     
reco:pandoracalo:Calorimetry                          0.000352715   0.00280858     0.0123773    0.000945917   0.00404115       10     
reco:pandorapid:Chi2ParticleID                        0.000142439   0.00145658    0.00793048    0.000283059    0.002459        10     
reco:cvnmap:CVNMapper                                  0.0413485     0.0953285     0.194877      0.0881729     0.048195        10     
reco:cvneva:CVNEvaluator                                1.79961       3.63643       10.7251       3.23726       2.50825        10     
reco:energyrecnumu:EnergyReco                         0.00477169     0.0630753     0.216581      0.0164873     0.076108        10     
reco:energyrecnue:EnergyReco                          0.00137102    0.00666976     0.0234502     0.0032468    0.00701332       10     
reco:energyrecnc:EnergyReco                            0.0160989     0.0935022     0.134578      0.120016      0.0479553       10     
[art]:TriggerResults:TriggerResultInserter            2.5428e-05    6.38355e-05   0.00025424    4.2866e-05    6.43456e-05      10     
end_path:out1:RootOutput                               9.849e-06    2.3947e-05    8.3417e-05    1.7593e-05    2.05516e-05      10     
end_path:out1:RootOutput(write)                        0.407587      0.739319      0.994356      0.721897      0.166922        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21742.3 MB
  Peak resident set size usage (VmHWM): 3069.8 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 227.991 | hit correction : 1.42839
hit initial : 198.715 | hit correction : 1.42863
hit initial : 202.596 | hit correction : 1.42893
hit initial : 196.462 | hit correction : 1.42916
hit initial : 121.171 | hit correction : 1.42933
 *** Total Charge : 4769.26
 Looking at view: 1 | Number of hits in view: 23
hit initial : 33.575 | hit correction : 1.43207
hit initial : 197.932 | hit correction : 1.43192
hit initial : 335.257 | hit correction : 1.43155
hit initial : 24.6258 | hit correction : 1.4251
hit initial : 136.504 | hit correction : 1.43079
hit initial : 195.279 | hit correction : 1.42502
hit initial : 63.4289 | hit correction : 1.43073
hit initial : 324.998 | hit correction : 1.42852
hit initial : 182.593 | hit correction : 1.42497
hit initial : 884.961 | hit correction : 1.42814
hit initial : 20.0361 | hit correction : 1.42498
hit initial : 105.305 | hit correction : 1.42855
hit initial : 103.551 | hit correction : 1.42731
hit initial : 38.4897 | hit correction : 1.42748
hit initial : 160.632 | hit correction : 1.43133
hit initial : 118.148 | hit correction : 1.43102
hit initial : 58.9905 | hit correction : 1.4294
hit initial : 316.228 | hit correction : 1.42931
 *** Total Charge : 4716.2
 Looking at view: 2 | Number of hits in view: 18
Begin processing the 9th record. run: 5027 subRun: 0 event: 11359 at 06-Dec-2025 09:03:36 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  12
Added hit list length: 12 | Max was set to: -3.40282e+38
True Electron Energy: 22.225
Completed MCParticle Loop
True Neutrino Energy: 27.6238
 Size of all hits: 12
hit initial : 52.8767 | hit correction : 1.06143
hit initial : 93.2958 | hit correction : 1.06024
hit initial : 327.827 | hit correction : 1.0603
hit initial : 375.934 | hit correction : 1.06055
hit initial : 314.908 | hit correction : 1.06087
hit initial : 323.717 | hit correction : 1.06113
hit initial : 231.463 | hit correction : 1.06135
 *** Total Charge : 1824.58
 Looking at view: 1 | Number of hits in view: 7
hit initial : 36.4015 | hit correction : 1.06142
hit initial : 333.938 | hit correction : 1.06037
hit initial : 231.006 | hit correction : 1.06017
hit initial : 439.53 | hit correction : 1.06073
hit initial : 708.074 | hit correction : 1.06119
 *** Total Charge : 1855.26
 Looking at view: 2 | Number of hits in view: 5
Begin processing the 10th record. run: 5027 subRun: 0 event: 11360 at 06-Dec-2025 09:03:40 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  16
Added hit list length: 16 | Max was set to: -3.40282e+38
True Neutron Energy: 939.571
True Electron Energy: 12.0259
Completed MCParticle Loop
True Neutrino Energy: 17.4062
 Size of all hits: 16
hit initial : 38.784 | hit correction : 1.07289
hit initial : 179.329 | hit correction : 1.06851
hit initial : 73.6866 | hit correction : 1.06842
hit initial : 467.391 | hit correction : 1.06853
hit initial : 121.841 | hit correction : 1.06918
hit initial : 193.355 | hit correction : 1.06926
hit initial : 157.248 | hit correction : 1.06937
hit initial : 79.8872 | hit correction : 1.06946
hit initial : 75.3742 | hit correction : 1.06948
hit initial : 23.1055 | hit correction : 1.06944
 *** Total Charge : 1507.3
 Looking at view: 0 | Number of hits in view: 10
hit initial : 12.9617 | hit correction : 1.06947
hit initial : 378.48 | hit correction : 1.0684
hit initial : 288.761 | hit correction : 1.06855
hit initial : 134.178 | hit correction : 1.06894
hit initial : 410.186 | hit correction : 1.06919
hit initial : 173.476 | hit correction : 1.06939
 *** Total Charge : 1494.29
 Looking at view: 2 | Number of hits in view: 6
06-Dec-2025 09:03:44 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0957193     0.121954      0.138142      0.121032      0.0113054       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000589762   0.00123255    0.00387402    0.000777571   0.00107681       10     
end_path:ana:AnalyzeEvents         0.0926736     0.120442      0.137338      0.120136      0.0115161       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.9 MB
  Peak resident set size usage (VmHWM): 1536.34 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:09:05 UTC       justIN version: 01.06.00