justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261048.1@dunegpschedd02.fnal.gov

Jobsub ID261048.1@dunegpschedd02.fnal.gov
Workflow ID11113
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 14:30:12
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 01:29:17
From worker nodeHostnamedunegli-8029139-0-fnpc19104.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 14:30:46
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T130242Z_gen_000103_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time10h (39479s)
CPU time9h (33633s = 85%)
Max RSS bytes2919899136 (2784 MiB)
Outputting started2025-12-12 01:28:46
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11113/1/001/analysisLowE_20251211T143049Z.root
Finished2025-12-12 01:29:17
Saved logsjustin-logs:261048.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

4: 0.575829, 0.375628, 0.0390524, 0.00949038, 
Output 5: 0.263668, 0.435629, 0.213363, 0.0873392, 
Output 6: 0.175382, 0.287437, 0.133093, 0.404088, 

Begin processing the 10th record. run: 4696 subRun: 0 event: 1030 at 12-Dec-2025 00:58:45 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 01:27:06 UTC run: 4696 subRun: 0 event: 1030
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6747, 6698, 6618
minwire 0: 49
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.118693, 
Output 1: 0.0724961, 0.152216, 0.183509, 0.591779, 
Output 2: 0.0537353, 0.191573, 0.738691, 0.0160004, 
Output 3: 0.933054, 0.0553217, 0.00519365, 0.00643027, 
Output 4: 0.36094, 0.548862, 0.0803494, 0.00984823, 
Output 5: 0.254107, 0.623614, 0.108356, 0.0139232, 
Output 6: 0.0478749, 0.124257, 0.118236, 0.709633, 

12-Dec-2025 01:27:09 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 01:27:09 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/14/fa/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T130242Z_gen_000103_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1698.89       3887.63       6697.65       3467.36       1641.81        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00467046     0.0159234     0.037628      0.012288      0.0106617       10     
reco:pandora:StandardPandora                            1696.63       3883.98       6684.45        3465         1639.78        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000510286    0.0876809      0.57723     0.00882041     0.173657        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000382154    0.014203      0.0991197    0.00241763     0.0290126       10     
reco:pandoracalo:Calorimetry                          0.000260703    0.0115265     0.0393922     0.0011014     0.0148601       10     
reco:pandorapid:Chi2ParticleID                        7.8831e-05    0.00101014     0.0062357    0.000173171   0.00190496       10     
reco:cvnmap:CVNMapper                                  0.035385      0.0909686     0.238894      0.0631319     0.0629322       10     
reco:cvneva:CVNEvaluator                                1.41424       2.8371        11.3608       1.81981       2.8591         10     
reco:energyrecnumu:EnergyReco                          0.0134071     0.100537       0.32434      0.101973      0.0873459       10     
reco:energyrecnue:EnergyReco                          0.00125922    0.00671278     0.0180997    0.00704166    0.00519393       10     
reco:energyrecnc:EnergyReco                           0.00683359     0.0572538      0.15388      0.0225317     0.0561602       10     
[art]:TriggerResults:TriggerResultInserter             2.091e-05    5.95955e-05   0.000283762   3.1451e-05    7.61567e-05      10     
end_path:out1:RootOutput                               9.62e-06     2.38291e-05   8.9061e-05    1.4455e-05    2.33312e-05      10     
end_path:out1:RootOutput(write)                        0.273385      0.429472      0.653348      0.415912      0.107731        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21693.6 MB
  Peak resident set size usage (VmHWM): 2919.9 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 441.381 | hit correction : 1.14567
hit initial : 549.473 | hit correction : 1.14499
hit initial : 258.174 | hit correction : 1.14458
hit initial : 57.5846 | hit correction : 1.14451
hit initial : 398.345 | hit correction : 1.14449
 *** Total Charge : 6632.31
 Looking at view: 2 | Number of hits in view: 28
Begin processing the 8th record. run: 4696 subRun: 0 event: 1028 at 12-Dec-2025 01:28:30 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 3.67248
Completed MCParticle Loop
True Neutrino Energy: 8.50749
 Size of all hits: 0
Begin processing the 9th record. run: 4696 subRun: 0 event: 1029 at 12-Dec-2025 01:28:35 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 1.35321
Completed MCParticle Loop
True Neutrino Energy: 4.63675
 Size of all hits: 0
Begin processing the 10th record. run: 4696 subRun: 0 event: 1030 at 12-Dec-2025 01:28:40 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  43
Added hit list length: 43 | Max was set to: -3.40282e+38
This pfp has size:  21
True Neutron Energy: 939.567
True Neutron Energy: 940.183
True Electron Energy: 50.9331
Completed MCParticle Loop
True Neutrino Energy: 66.5494
 Size of all hits: 43
hit initial : 10.0018 | hit correction : 1.34012
hit initial : 220.403 | hit correction : 1.34076
hit initial : 60.883 | hit correction : 1.34306
hit initial : 59.2092 | hit correction : 1.34446
hit initial : 43.7889 | hit correction : 1.33675
hit initial : 47.4468 | hit correction : 1.33678
hit initial : 72.6416 | hit correction : 1.34076
hit initial : 116.1 | hit correction : 1.34313
hit initial : 1461.81 | hit correction : 1.34348
hit initial : 99.4596 | hit correction : 1.34426
hit initial : 269.885 | hit correction : 1.34439
 *** Total Charge : 3306.03
 Looking at view: 0 | Number of hits in view: 11
hit initial : 125.91 | hit correction : 1.34036
hit initial : 278.735 | hit correction : 1.3407
hit initial : 301.625 | hit correction : 1.34115
hit initial : 311.636 | hit correction : 1.34203
hit initial : 408.116 | hit correction : 1.34281
hit initial : 367.497 | hit correction : 1.34332
hit initial : 457.105 | hit correction : 1.34402
hit initial : 208.187 | hit correction : 1.34425
hit initial : 154.279 | hit correction : 1.34433
hit initial : 237.855 | hit correction : 1.34458
hit initial : 88.2972 | hit correction : 1.34468
 *** Total Charge : 3947.07
 Looking at view: 1 | Number of hits in view: 11
hit initial : 14.1552 | hit correction : 1.34297
hit initial : 37.8773 | hit correction : 1.34291
hit initial : 53.6609 | hit correction : 1.34557
hit initial : 95.6113 | hit correction : 1.34559
hit initial : 484.156 | hit correction : 1.34454
hit initial : 33.363 | hit correction : 1.34701
hit initial : 318.963 | hit correction : 1.34607
hit initial : 200.139 | hit correction : 1.34678
hit initial : 71.8292 | hit correction : 1.34014
hit initial : 274.268 | hit correction : 1.34058
hit initial : 273.776 | hit correction : 1.34102
hit initial : 218.91 | hit correction : 1.34164
hit initial : 243.331 | hit correction : 1.34233
hit initial : 340.532 | hit correction : 1.34285
hit initial : 238.927 | hit correction : 1.34327
hit initial : 310.182 | hit correction : 1.34386
hit initial : 158.191 | hit correction : 1.34411
hit initial : 160.864 | hit correction : 1.34433
hit initial : 179.843 | hit correction : 1.34428
hit initial : 252.933 | hit correction : 1.34463
hit initial : 58.6706 | hit correction : 1.34477
 *** Total Charge : 5401.65
 Looking at view: 2 | Number of hits in view: 21
12-Dec-2025 01:28:45 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.109918      0.138753      0.179075      0.142008      0.0236603       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000948818   0.00348225     0.0117899    0.00173647    0.00377132       10     
end_path:ana:AnalyzeEvents         0.107698      0.134787      0.168641      0.140577      0.020824        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19477.3 MB
  Peak resident set size usage (VmHWM): 1535.35 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:58:10 UTC       justIN version: 01.06.00