justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267995.1@dunegpschedd01.fnal.gov

Jobsub ID267995.1@dunegpschedd01.fnal.gov
Workflow ID11176
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 10:48:32
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-13 18:59:22
From worker nodeHostnamedunegli-8047088-0-fnpc17005.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 10:50:03
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T001707Z_gen_002216_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time8h (29346s)
CPU time8h (28914s = 98%)
Max RSS bytes2795134976 (2665 MiB)
Outputting started2025-12-13 18:59:10
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11176/1/001/analysisLowE_20251213T105005Z.root
Finished2025-12-13 18:59:22
Saved logsjustin-logs:267995.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

odularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 18:57:21 UTC run: 5027 subRun: 0 event: 22160
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 18:57:21 UTC run: 5027 subRun: 0 event: 22160
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6740, 6754, 6721
minwire 0: 56
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.107128, 
Output 1: 0.0436675, 0.0320735, 0.0964796, 0.827779, 
Output 2: 0.0935792, 0.218502, 0.648434, 0.0394846, 
Output 3: 0.966668, 0.0202963, 0.00323224, 0.00980291, 
Output 4: 0.479087, 0.486016, 0.0319523, 0.00294449, 
Output 5: 0.34955, 0.53932, 0.0958936, 0.0152357, 
Output 6: 0.0152363, 0.0477504, 0.0624509, 0.874562, 

13-Dec-2025 18:57:28 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 18:57:28 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/2e/7e/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T001707Z_gen_002216_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1895.62       2898.24       4281.1        2703.65       724.026        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000839768   0.00374275     0.0130701    0.00160357    0.00454847       10     
reco:pandora:StandardPandora                            1893.13       2888.09       4207.09       2701.13       710.705        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.0646067     0.106773      0.149273      0.108663      0.0311622       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00225654     0.010552      0.0369511    0.00752838    0.00919949       10     
reco:pandoracalo:Calorimetry                          0.000518234   0.00219733     0.0124771    0.00117814    0.00344525       10     
reco:pandorapid:Chi2ParticleID                        0.000121536   0.000681872   0.00434963    0.000198038   0.00124726       10     
reco:cvnmap:CVNMapper                                  0.0632534     0.117244       0.21211      0.121125      0.0407231       10     
reco:cvneva:CVNEvaluator                                1.38974       2.16535       5.88144       1.75494       1.24865        10     
reco:energyrecnumu:EnergyReco                          0.0798679      7.22921       71.2828      0.108949       21.3512        10     
reco:energyrecnue:EnergyReco                          0.00213406    0.00305488    0.00478018    0.00259563    0.00090007       10     
reco:energyrecnc:EnergyReco                           0.00832451     0.0123645     0.0175083     0.0118869    0.00347321       10     
[art]:TriggerResults:TriggerResultInserter             2.315e-05    4.97498e-05   0.000204993    2.864e-05    5.25232e-05      10     
end_path:out1:RootOutput                               8.83e-06     1.70374e-05   5.8212e-05    1.16245e-05   1.44625e-05      10     
end_path:out1:RootOutput(write)                        0.338178      0.497727      0.856421       0.51319      0.152337        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11905.4 MB
  Peak resident set size usage (VmHWM): 2795.13 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 67.1221 | hit correction : 1.43071
hit initial : 34.5329 | hit correction : 1.44354
hit initial : 26.6867 | hit correction : 1.43796
hit initial : 36.9669 | hit correction : 1.43791
hit initial : 76.4821 | hit correction : 1.44091
hit initial : 363.446 | hit correction : 1.44114
hit initial : 313.865 | hit correction : 1.44141
hit initial : 226.576 | hit correction : 1.44154
hit initial : 768.102 | hit correction : 1.44177
hit initial : 433.129 | hit correction : 1.44172
hit initial : 497.609 | hit correction : 1.44179
hit initial : 241.062 | hit correction : 1.44168
hit initial : 192.007 | hit correction : 1.44164
hit initial : 181.75 | hit correction : 1.44159
hit initial : 17.6714 | hit correction : 1.44159
hit initial : 126.943 | hit correction : 1.44154
 *** Total Charge : 5874.46
 Looking at view: 2 | Number of hits in view: 22
Begin processing the 10th record. run: 5027 subRun: 0 event: 22160 at 13-Dec-2025 18:58:55 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  47
Added hit list length: 47 | Max was set to: -3.40282e+38
This pfp has size:  5
True Neutron Energy: 939.566
True Electron Energy: 33.5328
Completed MCParticle Loop
True Neutrino Energy: 37.3
 Size of all hits: 47
hit initial : 29.8431 | hit correction : 1.01042
hit initial : 55.1412 | hit correction : 1.01259
hit initial : 40.3921 | hit correction : 1.01672
hit initial : 439.011 | hit correction : 1.01384
hit initial : 34.1003 | hit correction : 1.01309
hit initial : 351.825 | hit correction : 1.01395
hit initial : 301.522 | hit correction : 1.01244
hit initial : 130.825 | hit correction : 1.0141
hit initial : 937.922 | hit correction : 1.01204
 *** Total Charge : 2350.58
 Looking at view: 0 | Number of hits in view: 9
hit initial : 33.7726 | hit correction : 1.01043
hit initial : 34.8027 | hit correction : 1.00821
hit initial : 27.2642 | hit correction : 1.01674
hit initial : 84.1843 | hit correction : 1.01261
hit initial : 26.2502 | hit correction : 1.01675
hit initial : 80.5078 | hit correction : 1.01389
hit initial : 133.999 | hit correction : 1.01309
hit initial : 130.514 | hit correction : 1.01291
hit initial : 451.24 | hit correction : 1.01381
hit initial : 323.557 | hit correction : 1.014
hit initial : 240.291 | hit correction : 1.01243
hit initial : 115.86 | hit correction : 1.01411
hit initial : 276.479 | hit correction : 1.01214
hit initial : 279.733 | hit correction : 1.01175
hit initial : 298.389 | hit correction : 1.01142
hit initial : 317.383 | hit correction : 1.01128
hit initial : 249.679 | hit correction : 1.01114
hit initial : 227.891 | hit correction : 1.01106
 *** Total Charge : 3373.26
 Looking at view: 1 | Number of hits in view: 18
hit initial : 60.1596 | hit correction : 1.01041
hit initial : 55.6066 | hit correction : 1.0082
hit initial : 61.981 | hit correction : 1.01676
hit initial : 130.008 | hit correction : 1.01261
hit initial : 36.5409 | hit correction : 1.01256
hit initial : 11.1954 | hit correction : 1.01669
hit initial : 138.757 | hit correction : 1.01388
hit initial : 538.419 | hit correction : 1.0131
hit initial : 129.8 | hit correction : 1.01376
hit initial : 959.915 | hit correction : 1.01394
hit initial : 286.411 | hit correction : 1.01247
hit initial : 20.0457 | hit correction : 1.01203
hit initial : 260.982 | hit correction : 1.01217
hit initial : 283.034 | hit correction : 1.0118
hit initial : 220.263 | hit correction : 1.01148
hit initial : 305.994 | hit correction : 1.01132
hit initial : 188.247 | hit correction : 1.01121
hit initial : 171.384 | hit correction : 1.01111
hit initial : 149.924 | hit correction : 1.01105
hit initial : 160.032 | hit correction : 1.01104
 *** Total Charge : 4221.01
 Looking at view: 2 | Number of hits in view: 20
13-Dec-2025 18:59:01 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.117517      0.377338      0.926822      0.245991      0.254903        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000439408   0.00730183     0.0670081    0.00071371     0.0199024       10     
end_path:ana:AnalyzeEvents         0.116835      0.369788      0.859056      0.244989      0.240894        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9812.63 MB
  Peak resident set size usage (VmHWM): 1536.49 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:22:30 UTC       justIN version: 01.06.00