justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 257918.61@dunegpschedd02.fnal.gov

Jobsub ID257918.61@dunegpschedd02.fnal.gov
Workflow ID11027
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 11:33:40
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 13:17:34
From worker nodeHostnamedunegli-7988749-0-fnpc18001.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:27:05
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T032156Z_gen_004995_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (42608s)
CPU time11h (41944s = 98%)
Max RSS bytes3026448384 (2886 MiB)
Outputting started2025-12-06 13:17:15
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11027/1/001/analysisLowE_20251206T012708Z.root
Finished2025-12-06 13:17:34
Saved logsjustin-logs:257918.61-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

lassifier summary: 
Output 0: 0.0774088, 
Output 1: 0.0651929, 0.0679433, 0.0789593, 0.787905, 
Output 2: 0.042681, 0.216474, 0.701353, 0.0394923, 
Output 3: 0.96141, 0.0177758, 0.00523354, 0.0155806, 
Output 4: 0.869499, 0.110602, 0.0160464, 0.00385185, 
Output 5: 0.610347, 0.239762, 0.111443, 0.0384477, 
Output 6: 0.0169649, 0.0441497, 0.056455, 0.88243, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 49950 at 06-Dec-2025 12:27:15 UTC
Boundary wire vector sizes: 6829, 6809, 6697
minwire 0: 14
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.106928, 
Output 1: 0.0433708, 0.0634432, 0.128752, 0.764434, 
Output 2: 0.175504, 0.211492, 0.569559, 0.043444, 
Output 3: 0.975054, 0.0205748, 0.00118478, 0.0031863, 
Output 4: 0.34581, 0.623011, 0.0291145, 0.00206478, 
Output 5: 0.618843, 0.334933, 0.0359243, 0.0102994, 
Output 6: 0.0248422, 0.075758, 0.0797158, 0.819684, 

06-Dec-2025 13:15:53 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 13:15:53 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/bb/bb/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T032156Z_gen_004995_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2912.42       4219.76       5827.82       4263.5        896.512        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00824994     0.0144161     0.0355324     0.0113601    0.00758523       10     
reco:pandora:StandardPandora                            2908.88       4215.52       5814.64       4260.51       894.777        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00113584     0.0554799      0.3229      0.00776402     0.0951285       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000488792    0.0108799     0.0333815    0.00659683     0.0113849       10     
reco:pandoracalo:Calorimetry                          0.000609219    0.0193261     0.0666401    0.00952259     0.0223872       10     
reco:pandorapid:Chi2ParticleID                        0.000121579   0.000997791    0.0036133    0.000367839    0.0011339       10     
reco:cvnmap:CVNMapper                                  0.0540176     0.0924259     0.146981      0.0837666     0.0261624       10     
reco:cvneva:CVNEvaluator                                2.00878       3.33595       11.3175       2.52638       2.68336        10     
reco:energyrecnumu:EnergyReco                          0.0180893     0.0978195     0.258956      0.0993729     0.0677224       10     
reco:energyrecnue:EnergyReco                          0.00222234     0.0095425     0.0198819     0.0107647    0.00580575       10     
reco:energyrecnc:EnergyReco                            0.0105409     0.0456251     0.135363      0.0145262     0.0499689       10     
[art]:TriggerResults:TriggerResultInserter             2.658e-05    4.60348e-05   0.000153319   3.1354e-05    3.66574e-05      10     
end_path:out1:RootOutput                              1.0359e-05    1.86472e-05   4.4655e-05    1.18625e-05   1.27936e-05      10     
end_path:out1:RootOutput(write)                        0.394727      0.554697       1.04974      0.512671      0.190513        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21750.8 MB
  Peak resident set size usage (VmHWM): 3026.45 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 108.442 | hit correction : 1.19092
hit initial : 108.315 | hit correction : 1.19092
hit initial : 212.846 | hit correction : 1.19089
 *** Total Charge : 3922.86
 Looking at view: 1 | Number of hits in view: 26
hit initial : 38.482 | hit correction : 1.19065
hit initial : 77.0286 | hit correction : 1.20015
hit initial : 6.42346 | hit correction : 1.19102
hit initial : 209.699 | hit correction : 1.20004
hit initial : 100.885 | hit correction : 1.19986
hit initial : 529.153 | hit correction : 1.19763
hit initial : 191.466 | hit correction : 1.1975
hit initial : 318.568 | hit correction : 1.1964
hit initial : 901.63 | hit correction : 1.19503
hit initial : 175.908 | hit correction : 1.19484
hit initial : 629.689 | hit correction : 1.19251
hit initial : 348.04 | hit correction : 1.19174
hit initial : 191.631 | hit correction : 1.1912
hit initial : 107.069 | hit correction : 1.19098
hit initial : 258.295 | hit correction : 1.19094
hit initial : 184.133 | hit correction : 1.19089
hit initial : 134.442 | hit correction : 1.19083
 *** Total Charge : 5258.88
 Looking at view: 2 | Number of hits in view: 17
Begin processing the 9th record. run: 5027 subRun: 0 event: 49949 at 06-Dec-2025 13:17:06 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 5.95591
Completed MCParticle Loop
True Neutrino Energy: 13.7437
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 49950 at 06-Dec-2025 13:17:10 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  35
Added hit list length: 35 | Max was set to: -3.40282e+38
True Neutron Energy: 939.567
True Electron Energy: 20.0225
Completed MCParticle Loop
True Neutrino Energy: 23.7498
 Size of all hits: 35
hit initial : 207.369 | hit correction : 1.13543
hit initial : 75.3335 | hit correction : 1.13537
hit initial : 209.287 | hit correction : 1.13552
hit initial : 74.7513 | hit correction : 1.13569
hit initial : 42.6457 | hit correction : 1.13583
hit initial : 25.3437 | hit correction : 1.1365
hit initial : 95.2968 | hit correction : 1.13642
hit initial : 67.6459 | hit correction : 1.13647
hit initial : 139.849 | hit correction : 1.13773
hit initial : 323.063 | hit correction : 1.13774
hit initial : 153.312 | hit correction : 1.13772
hit initial : 34.2759 | hit correction : 1.13875
hit initial : 40.3372 | hit correction : 1.13872
 *** Total Charge : 1692.01
 Looking at view: 0 | Number of hits in view: 13
hit initial : 144.927 | hit correction : 1.13538
hit initial : 237.936 | hit correction : 1.13546
hit initial : 219.025 | hit correction : 1.13557
hit initial : 150.784 | hit correction : 1.13575
hit initial : 150.177 | hit correction : 1.13637
hit initial : 232.17 | hit correction : 1.13646
hit initial : 130.799 | hit correction : 1.13663
hit initial : 44.5001 | hit correction : 1.13768
hit initial : 398.221 | hit correction : 1.13764
hit initial : 298.124 | hit correction : 1.13775
hit initial : 56.4257 | hit correction : 1.13788
hit initial : 15.9201 | hit correction : 1.1387
hit initial : 23.7548 | hit correction : 1.13871
 *** Total Charge : 2390.1
 Looking at view: 1 | Number of hits in view: 13
hit initial : 231.836 | hit correction : 1.13716
hit initial : 70.836 | hit correction : 1.13546
hit initial : 722.379 | hit correction : 1.13552
hit initial : 305.275 | hit correction : 1.13628
hit initial : 290.542 | hit correction : 1.13662
hit initial : 152.568 | hit correction : 1.13768
hit initial : 532.293 | hit correction : 1.13769
hit initial : 176.306 | hit correction : 1.13797
hit initial : 80.4273 | hit correction : 1.13869
 *** Total Charge : 2912.83
 Looking at view: 2 | Number of hits in view: 9
06-Dec-2025 13:17:14 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0936725     0.126965      0.246589      0.111119      0.0451272       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000566799   0.00105847    0.00404484    0.000717338   0.00100173       10     
end_path:ana:AnalyzeEvents         0.0925513     0.125595      0.245578       0.11018      0.0447901       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.2 MB
  Peak resident set size usage (VmHWM): 1537.32 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:10:24 UTC       justIN version: 01.06.00