justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266043.18@dunegpschedd01.fnal.gov

Jobsub ID266043.18@dunegpschedd01.fnal.gov
Workflow ID11087
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 13:59:01
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 16:03:35
From worker nodeHostnamedunegli-7872307-0-fnpc17007.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 08:39:25
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T202132Z_gen_002772_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (26633s)
CPU time7h (26262s = 98%)
Max RSS bytes3048898560 (2907 MiB)
Outputting started2025-12-11 16:03:19
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11087/1/001/analysisLowE_20251211T083927Z.root
Finished2025-12-11 16:03:35
Saved logsjustin-logs:266043.18-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

212311, 0.124146, 0.584151, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 27720 at 11-Dec-2025 15:24:44 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 16:02:06 UTC run: 5026 subRun: 0 event: 27720
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6818, 6798, 6716
minwire 0: 10
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2228, 2727
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.115622, 
Output 1: 0.0472171, 0.0512276, 0.175724, 0.725832, 
Output 2: 0.0623684, 0.151817, 0.757697, 0.028118, 
Output 3: 0.963764, 0.0270103, 0.00328725, 0.00593826, 
Output 4: 0.253447, 0.686519, 0.0559118, 0.00412283, 
Output 5: 0.461137, 0.393952, 0.113731, 0.03118, 
Output 6: 0.0227415, 0.0732182, 0.0794236, 0.824617, 

11-Dec-2025 16:02:09 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 16:02:09 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/fd/28/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T202132Z_gen_002772_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2022.88       2619.72       5273.67       2256.58       908.466        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00643969     0.011541      0.0204713    0.00880824    0.00492842       10     
reco:pandora:StandardPandora                            2020.48       2609.7        5196.39       2254.08       886.628        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00224147     0.0597933     0.421656     0.00919783     0.122175        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00252154    0.00983799     0.0506722    0.00514367     0.0136957       10     
reco:pandoracalo:Calorimetry                          0.000371854   0.00877488     0.0403583     0.0011427     0.0121925       10     
reco:pandorapid:Chi2ParticleID                        8.1802e-05    0.000689853   0.00572746    0.000129929   0.00167948       10     
reco:cvnmap:CVNMapper                                  0.0491929     0.0700131      0.14426      0.0624593     0.0268706       10     
reco:cvneva:CVNEvaluator                                1.61301       2.41385       8.26189       1.76523       1.95084        10     
reco:energyrecnumu:EnergyReco                         0.00907408     0.0766574     0.117319      0.102445      0.0438596       10     
reco:energyrecnue:EnergyReco                          0.00185728     0.0050312     0.0118699    0.00200945    0.00420096       10     
reco:energyrecnc:EnergyReco                            0.0103801      6.78936       67.456       0.011902       20.2223        10     
[art]:TriggerResults:TriggerResultInserter            2.0773e-05    3.80195e-05   0.000161434   2.4557e-05    4.12379e-05      10     
end_path:out1:RootOutput                               7.09e-06     1.40177e-05   4.7158e-05    8.5195e-06    1.17923e-05      10     
end_path:out1:RootOutput(write)                        0.511535      0.570496      0.819022      0.540431      0.0872368       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12116.8 MB
  Peak resident set size usage (VmHWM): 3048.9 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 289.763 | hit correction : 1.33683
hit initial : 346.113 | hit correction : 1.33774
hit initial : 333.608 | hit correction : 1.33866
hit initial : 211.517 | hit correction : 1.33908
 *** Total Charge : 3467.44
 Looking at view: 0 | Number of hits in view: 11
hit initial : 66.5515 | hit correction : 1.33451
hit initial : 207.27 | hit correction : 1.33453
hit initial : 137.804 | hit correction : 1.3345
hit initial : 184.243 | hit correction : 1.33528
hit initial : 259.665 | hit correction : 1.33544
hit initial : 217.536 | hit correction : 1.3358
hit initial : 209.318 | hit correction : 1.33625
hit initial : 213.257 | hit correction : 1.33664
hit initial : 227.449 | hit correction : 1.33718
hit initial : 229.426 | hit correction : 1.33782
hit initial : 248.116 | hit correction : 1.3385
hit initial : 231.881 | hit correction : 1.33891
hit initial : 136.621 | hit correction : 1.33921
 *** Total Charge : 3434.05
 Looking at view: 1 | Number of hits in view: 13
hit initial : 236.647 | hit correction : 1.33596
hit initial : 8.94428 | hit correction : 1.33476
hit initial : 777.874 | hit correction : 1.33646
hit initial : 132.861 | hit correction : 1.33547
hit initial : 6.91124 | hit correction : 1.33436
hit initial : 203.81 | hit correction : 1.33519
hit initial : 185.996 | hit correction : 1.33443
hit initial : 159.917 | hit correction : 1.33456
hit initial : 416.95 | hit correction : 1.33815
hit initial : 328.724 | hit correction : 1.33896
hit initial : 77.5697 | hit correction : 1.33925
 *** Total Charge : 3390.06
 Looking at view: 2 | Number of hits in view: 11
Begin processing the 10th record. run: 5026 subRun: 0 event: 27720 at 11-Dec-2025 16:03:14 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  32
Added hit list length: 32 | Max was set to: -3.40282e+38
True Neutron Energy: 939.574
True Electron Energy: 48.0468
Completed MCParticle Loop
True Neutrino Energy: 65.2783
 Size of all hits: 32
hit initial : 95.1983 | hit correction : 1.36371
hit initial : 253.247 | hit correction : 1.36377
hit initial : 172.798 | hit correction : 1.36459
hit initial : 345.71 | hit correction : 1.36671
hit initial : 374.364 | hit correction : 1.36641
hit initial : 88.6682 | hit correction : 1.36565
hit initial : 148.843 | hit correction : 1.36853
 *** Total Charge : 2019.8
 Looking at view: 0 | Number of hits in view: 7
hit initial : 48.7405 | hit correction : 1.3674
hit initial : 58.5682 | hit correction : 1.36739
hit initial : 118.496 | hit correction : 1.36872
hit initial : 111.063 | hit correction : 1.3646
hit initial : 184.571 | hit correction : 1.36827
hit initial : 254.501 | hit correction : 1.36451
hit initial : 55.0967 | hit correction : 1.36374
hit initial : 46.9001 | hit correction : 1.3674
hit initial : 44.6987 | hit correction : 1.36463
hit initial : 117.338 | hit correction : 1.36375
hit initial : 30.8254 | hit correction : 1.36458
hit initial : 118.189 | hit correction : 1.36373
hit initial : 106.186 | hit correction : 1.36772
hit initial : 40.18 | hit correction : 1.36881
 *** Total Charge : 1824.05
 Looking at view: 1 | Number of hits in view: 14
hit initial : 159.438 | hit correction : 1.36373
hit initial : 107.938 | hit correction : 1.3688
hit initial : 372.368 | hit correction : 1.36384
hit initial : 226.693 | hit correction : 1.36461
hit initial : 66.0518 | hit correction : 1.36708
hit initial : 51.9275 | hit correction : 1.36459
hit initial : 66.4648 | hit correction : 1.36587
hit initial : 10.2547 | hit correction : 1.36636
hit initial : 614.5 | hit correction : 1.36631
hit initial : 186.347 | hit correction : 1.36835
hit initial : 32.1519 | hit correction : 1.36894
 *** Total Charge : 2586.92
 Looking at view: 2 | Number of hits in view: 11
11-Dec-2025 16:03:18 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.107369      0.141168      0.166257      0.146872      0.019067        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000541558   0.000709539   0.00123053    0.000638537   0.000195796      10     
end_path:ana:AnalyzeEvents         0.106637      0.140256      0.164424      0.145902      0.0189057       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9812.48 MB
  Peak resident set size usage (VmHWM): 1540.18 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:29:00 UTC       justIN version: 01.06.00