justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263750.72@dunegpschedd01.fnal.gov

Jobsub ID263750.72@dunegpschedd01.fnal.gov
Workflow ID11025
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 10:59:40
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 08:27:10
From worker nodeHostnamedunegli-7988957-0-fnpc18006.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-05 23:09:25
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T005514Z_gen_002826_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time9h (33423s)
CPU time9h (32704s = 97%)
Max RSS bytes3038208000 (2897 MiB)
Outputting started2025-12-06 08:26:29
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11025/1/001/analysisLowE_20251205T230927Z.root
Finished2025-12-06 08:27:10
Saved logsjustin-logs:263750.72-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

tput 2: 0.0528635, 0.17857, 0.743926, 0.0246406, 
Output 3: 0.977962, 0.0157685, 0.00174345, 0.00452618, 
Output 4: 0.592702, 0.36095, 0.0405129, 0.00583476, 
Output 5: 0.38417, 0.43345, 0.145686, 0.0366936, 
Output 6: 0.0242802, 0.0766732, 0.0854702, 0.813576, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 28260 at 06-Dec-2025 07:30:48 UTC
Boundary wire vector sizes: 6813, 6775, 6782
minwire 0: 26
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2351, 2850
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0938435, 
Output 1: 0.0608679, 0.103582, 0.147816, 0.687733, 
Output 2: 0.0374809, 0.248317, 0.70061, 0.0135918, 
Output 3: 0.935359, 0.0532567, 0.00592369, 0.00546069, 
Output 4: 0.334195, 0.529951, 0.123391, 0.0124635, 
Output 5: 0.549378, 0.408297, 0.0385793, 0.0037456, 
Output 6: 0.0146451, 0.0583423, 0.0766131, 0.850399, 

06-Dec-2025 08:24:46 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 08:24:46 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/56/83/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T005514Z_gen_002826_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3087.05       3305.43       3434.06       3332.89       108.14         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00203749     0.0110203     0.0255863     0.0100523    0.00600037       10     
reco:pandora:StandardPandora                            3082.62       3300.69       3429.82       3326.57       108.089        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00198986     0.0401047     0.155989      0.0133497     0.0466076       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000712233   0.00948253     0.0557551    0.00395714     0.0156012       10     
reco:pandoracalo:Calorimetry                          0.000745075    0.0255973     0.063854      0.011043      0.0265085       10     
reco:pandorapid:Chi2ParticleID                        0.00014854    0.000752032   0.00503509    0.000253904   0.00143527       10     
reco:cvnmap:CVNMapper                                  0.0612521     0.0779955     0.123106      0.0737164     0.0174214       10     
reco:cvneva:CVNEvaluator                                3.08123       3.76545       6.95146       3.4135        1.07989        10     
reco:energyrecnumu:EnergyReco                         0.00619877     0.0939143     0.153212      0.131844      0.0601218       10     
reco:energyrecnue:EnergyReco                          0.00242006    0.00980676     0.0176797    0.00929802    0.00681076       10     
reco:energyrecnc:EnergyReco                            0.0150142     0.0676373     0.173961      0.0187568     0.063085        10     
[art]:TriggerResults:TriggerResultInserter            3.4164e-05    5.91361e-05   0.000187414    4.543e-05    4.30725e-05      10     
end_path:out1:RootOutput                              1.2183e-05    1.95899e-05   5.7007e-05    1.52335e-05   1.26732e-05      10     
end_path:out1:RootOutput(write)                        0.593518      0.637843      0.794697      0.619474      0.0547425       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21780.5 MB
  Peak resident set size usage (VmHWM): 3038.21 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 378.333 | hit correction : 1.24054
hit initial : 185.272 | hit correction : 1.24188
hit initial : 451.465 | hit correction : 1.24239
hit initial : 443.691 | hit correction : 1.24349
hit initial : 101.977 | hit correction : 1.24354
 *** Total Charge : 4300.98
 Looking at view: 0 | Number of hits in view: 20
hit initial : 61.4851 | hit correction : 1.24476
hit initial : 320.527 | hit correction : 1.24447
hit initial : 80.3535 | hit correction : 1.24479
hit initial : 45.9222 | hit correction : 1.23661
hit initial : 55.9009 | hit correction : 1.23663
hit initial : 23.3772 | hit correction : 1.23665
hit initial : 166.112 | hit correction : 1.23863
hit initial : 271.255 | hit correction : 1.23876
hit initial : 517.154 | hit correction : 1.23954
hit initial : 112.018 | hit correction : 1.23968
hit initial : 111.641 | hit correction : 1.23976
hit initial : 117.488 | hit correction : 1.24067
hit initial : 75.317 | hit correction : 1.24057
hit initial : 121.161 | hit correction : 1.24054
hit initial : 317.235 | hit correction : 1.24189
hit initial : 403.002 | hit correction : 1.24317
hit initial : 69.2331 | hit correction : 1.24352
hit initial : 49.4719 | hit correction : 1.24408
 *** Total Charge : 3622.46
 Looking at view: 1 | Number of hits in view: 18
Begin processing the 9th record. run: 5027 subRun: 0 event: 28259 at 06-Dec-2025 08:26:17 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 4.13406
Completed MCParticle Loop
True Neutrino Energy: 7.41817
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 28260 at 06-Dec-2025 08:26:23 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  32
Added hit list length: 32 | Max was set to: -3.40282e+38
True Neutron Energy: 939.565
True Electron Energy: 15.527
Completed MCParticle Loop
True Neutrino Energy: 18.8183
 Size of all hits: 32
hit initial : 129.932 | hit correction : 1.104
hit initial : 62.8473 | hit correction : 1.11565
hit initial : 62.9313 | hit correction : 1.11563
hit initial : 133.998 | hit correction : 1.10696
hit initial : 239.526 | hit correction : 1.10687
hit initial : 33.6054 | hit correction : 1.10675
hit initial : 50.371 | hit correction : 1.10571
hit initial : 183.379 | hit correction : 1.10557
hit initial : 252.494 | hit correction : 1.10537
hit initial : 45.7753 | hit correction : 1.10415
hit initial : 61.5249 | hit correction : 1.10404
hit initial : 51.644 | hit correction : 1.10402
 *** Total Charge : 1447.43
 Looking at view: 0 | Number of hits in view: 12
hit initial : 29.4524 | hit correction : 1.10404
hit initial : 176.253 | hit correction : 1.10404
hit initial : 98.3606 | hit correction : 1.10398
hit initial : 31.4657 | hit correction : 1.10868
hit initial : 30.465 | hit correction : 1.10871
hit initial : 98.4173 | hit correction : 1.10712
hit initial : 276.463 | hit correction : 1.10686
hit initial : 376.015 | hit correction : 1.10618
hit initial : 217.765 | hit correction : 1.10552
hit initial : 314.499 | hit correction : 1.10503
hit initial : 105.943 | hit correction : 1.10473
 *** Total Charge : 1940.57
 Looking at view: 1 | Number of hits in view: 11
hit initial : 41.613 | hit correction : 1.10254
hit initial : 17.1052 | hit correction : 1.10732
hit initial : 293.454 | hit correction : 1.10706
hit initial : 94.784 | hit correction : 1.10614
hit initial : 609.863 | hit correction : 1.1059
hit initial : 282.42 | hit correction : 1.10519
hit initial : 254.783 | hit correction : 1.10456
hit initial : 128.483 | hit correction : 1.10402
hit initial : 231.008 | hit correction : 1.10399
 *** Total Charge : 2159.41
 Looking at view: 2 | Number of hits in view: 9
06-Dec-2025 08:26:28 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.147766      0.185088      0.290003      0.174326      0.0373327       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000709307   0.00127102    0.00449488    0.00100148    0.00108644       10     
end_path:ana:AnalyzeEvents         0.146374      0.183385       0.28402      0.172939      0.0360074       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19474.7 MB
  Peak resident set size usage (VmHWM): 1532.64 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:11:01 UTC       justIN version: 01.06.00