justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258387.2@dunegpschedd02.fnal.gov

Jobsub ID258387.2@dunegpschedd02.fnal.gov
Workflow ID11023
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 04:17:33
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 14:34:43
From worker nodeHostnamedunegli-7832230-0-fnpc18004.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 04:18:28
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T021410Z_gen_003764_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time10h (36956s)
CPU time9h (35817s = 96%)
Max RSS bytes3047833600 (2906 MiB)
Outputting started2025-12-06 14:34:24
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11023/1/001/analysisLowE_20251206T041830Z.root
Finished2025-12-06 14:34:43
Saved logsjustin-logs:258387.2-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

summary: 
Output 0: 0.108982, 
Output 1: 0.1149, 0.113337, 0.0976038, 0.674159, 
Output 2: 0.265021, 0.294582, 0.383293, 0.0571049, 
Output 3: 0.981495, 0.0114047, 0.000720406, 0.00638012, 
Output 4: 0.62078, 0.364444, 0.0133131, 0.00146257, 
Output 5: 0.841268, 0.149048, 0.00684134, 0.00284189, 
Output 6: 0.0132436, 0.042178, 0.0602138, 0.884365, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 37640 at 06-Dec-2025 13:46:16 UTC
Boundary wire vector sizes: 6681, 6761, 6661
minwire 0: 49
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0399174, 
Output 1: 0.0446395, 0.0220573, 0.0371799, 0.896123, 
Output 2: 0.115705, 0.356744, 0.490251, 0.0372997, 
Output 3: 0.842206, 0.12605, 0.0169746, 0.0147699, 
Output 4: 0.806563, 0.183489, 0.00892562, 0.00102171, 
Output 5: 0.155602, 0.77306, 0.0676913, 0.00364616, 
Output 6: 0.0231135, 0.145857, 0.136024, 0.695006, 

06-Dec-2025 14:33:01 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 14:33:01 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/75/e1/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T021410Z_gen_003764_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2799.09       3660.29       4356.23       3868.07       614.535        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00228338    0.00876244     0.0223086    0.00763183    0.00513922       10     
reco:pandora:StandardPandora                            2794.79       3614.55       4277.64       3801.8        582.044        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00348956     0.0466743     0.229581      0.0153502     0.0650939       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00188853     0.0120163     0.0745931    0.00423106     0.0211003       10     
reco:pandoracalo:Calorimetry                          0.00046023    0.00870371     0.0632751    0.000947575    0.0188296       10     
reco:pandorapid:Chi2ParticleID                        0.000141387   0.000895549   0.00692102    0.00023071    0.00201024       10     
reco:cvnmap:CVNMapper                                  0.0434744     0.0735559     0.129483      0.0715387     0.024637        10     
reco:cvneva:CVNEvaluator                                3.37267       4.36229       9.2575        3.7552        1.66148        10     
reco:energyrecnumu:EnergyReco                         0.00593201      21.1102       74.2751      0.0265392      32.3138        10     
reco:energyrecnue:EnergyReco                          0.00225155    0.00422281     0.0147404    0.00310536    0.00357175       10     
reco:energyrecnc:EnergyReco                            0.0146537      19.4441       67.3603      0.111838       29.6419        10     
[art]:TriggerResults:TriggerResultInserter            3.0508e-05    5.48757e-05   0.000215898   3.3263e-05    5.43787e-05      10     
end_path:out1:RootOutput                               8.276e-06    1.72739e-05   5.9172e-05    1.32755e-05   1.41652e-05      10     
end_path:out1:RootOutput(write)                        0.553535      0.662879       1.00034       0.61428      0.133148        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21784.6 MB
  Peak resident set size usage (VmHWM): 3047.83 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 240.868 | hit correction : 1.36449
hit initial : 55.9672 | hit correction : 1.3685
hit initial : 83.3293 | hit correction : 1.36095
hit initial : 96.5073 | hit correction : 1.36151
hit initial : 57.6187 | hit correction : 1.36184
hit initial : 269.494 | hit correction : 1.36184
hit initial : 48.8855 | hit correction : 1.3625
hit initial : 35.592 | hit correction : 1.36254
hit initial : 138.801 | hit correction : 1.36328
hit initial : 374.574 | hit correction : 1.36346
hit initial : 549.552 | hit correction : 1.3637
hit initial : 701.307 | hit correction : 1.36409
 *** Total Charge : 5460.87
 Looking at view: 0 | Number of hits in view: 16
hit initial : 27.8611 | hit correction : 1.36432
hit initial : 27.0316 | hit correction : 1.36427
hit initial : 94.8372 | hit correction : 1.36108
hit initial : 287.833 | hit correction : 1.36105
hit initial : 240.94 | hit correction : 1.36092
hit initial : 126.447 | hit correction : 1.36101
hit initial : 187.055 | hit correction : 1.36161
hit initial : 60.6729 | hit correction : 1.36106
hit initial : 78.1629 | hit correction : 1.36219
hit initial : 66.5194 | hit correction : 1.36209
hit initial : 118.649 | hit correction : 1.36246
hit initial : 104.653 | hit correction : 1.36334
hit initial : 340.128 | hit correction : 1.36342
hit initial : 423.507 | hit correction : 1.36359
hit initial : 431.25 | hit correction : 1.36386
hit initial : 345.612 | hit correction : 1.36407
hit initial : 257.618 | hit correction : 1.36422
hit initial : 224.015 | hit correction : 1.36439
hit initial : 222.829 | hit correction : 1.36452
hit initial : 207.332 | hit correction : 1.36457
hit initial : 95.5044 | hit correction : 1.3646
 *** Total Charge : 5409.63
 Looking at view: 1 | Number of hits in view: 21
Begin processing the 10th record. run: 5027 subRun: 0 event: 37640 at 06-Dec-2025 14:34:18 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  29
Added hit list length: 29 | Max was set to: -3.40282e+38
True Neutron Energy: 939.571
True Electron Energy: 22.052
Completed MCParticle Loop
True Neutrino Energy: 39.327
 Size of all hits: 29
hit initial : 179.625 | hit correction : 1.41816
hit initial : 310.852 | hit correction : 1.41809
hit initial : 293.086 | hit correction : 1.41797
hit initial : 164.978 | hit correction : 1.41789
hit initial : 45.1006 | hit correction : 1.4179
hit initial : 238.582 | hit correction : 1.41705
hit initial : 305.714 | hit correction : 1.4167
hit initial : 317.061 | hit correction : 1.41633
hit initial : 188.494 | hit correction : 1.41619
hit initial : 46.2501 | hit correction : 1.41609
 *** Total Charge : 2961.7
 Looking at view: 0 | Number of hits in view: 10
hit initial : 80.3211 | hit correction : 1.4161
hit initial : 31.9433 | hit correction : 1.4182
hit initial : 212.867 | hit correction : 1.41806
hit initial : 412.912 | hit correction : 1.41806
hit initial : 295.808 | hit correction : 1.41796
hit initial : 223.875 | hit correction : 1.41727
hit initial : 233.317 | hit correction : 1.41693
hit initial : 202.241 | hit correction : 1.4166
hit initial : 225.527 | hit correction : 1.4163
hit initial : 211.636 | hit correction : 1.41617
 *** Total Charge : 3019.39
 Looking at view: 1 | Number of hits in view: 10
hit initial : 34.2857 | hit correction : 1.41869
hit initial : 179.999 | hit correction : 1.41818
hit initial : 79.6333 | hit correction : 1.41825
hit initial : 53.9972 | hit correction : 1.41798
hit initial : 278.635 | hit correction : 1.41796
hit initial : 425.205 | hit correction : 1.41792
hit initial : 379.751 | hit correction : 1.41692
hit initial : 442.085 | hit correction : 1.41639
hit initial : 232.349 | hit correction : 1.41616
 *** Total Charge : 2984.7
 Looking at view: 2 | Number of hits in view: 9
06-Dec-2025 14:34:24 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.142147       0.16264      0.201048      0.155567      0.0166219       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000516686   0.000803976   0.00182147    0.000692904   0.000356452      10     
end_path:ana:AnalyzeEvents         0.141202      0.161551      0.198424      0.154542      0.0162168       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19474.6 MB
  Peak resident set size usage (VmHWM): 1532.99 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:08:59 UTC       justIN version: 01.06.00