justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260270.0@dunegpschedd02.fnal.gov

Jobsub ID260270.0@dunegpschedd02.fnal.gov
Workflow ID11087
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 14:07:00
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-11 17:15:46
From worker nodeHostnamedunegli-8028789-0-fnpc9003.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 05:45:47
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T171326Z_gen_000899_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (41375s)
CPU time11h (40645s = 98%)
Max RSS bytes3046244352 (2905 MiB)
Outputting started2025-12-11 17:15:22
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11087/1/001/analysisLowE_20251211T054549Z.root
Finished2025-12-11 17:15:46
Saved logsjustin-logs:260270.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

, 0.138293, 
Output 6: 0.0960109, 0.200803, 0.133708, 0.569479, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 8990 at 11-Dec-2025 16:33:31 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 17:14:05 UTC run: 5026 subRun: 0 event: 8990
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6756, 6699, 6618
minwire 0: 69
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2371, 2870
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.105453, 
Output 1: 0.0510249, 0.0978845, 0.115314, 0.735776, 
Output 2: 0.075168, 0.280267, 0.610701, 0.0338638, 
Output 3: 0.946992, 0.0432146, 0.00454309, 0.00525004, 
Output 4: 0.557028, 0.386825, 0.0505985, 0.00554792, 
Output 5: 0.504628, 0.4097, 0.0734993, 0.0121734, 
Output 6: 0.0249247, 0.0775471, 0.0888735, 0.808655, 

11-Dec-2025 17:14:08 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 17:14:08 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/d1/3b/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T171326Z_gen_000899_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2432.65       4095.85       6024.27       3891.21       1340.26        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.010987      0.0188991     0.0333827     0.0177955    0.00639869       10     
reco:pandora:StandardPandora                            2430.62       4056.51       5937.1        3855.29       1305.18        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000902651    0.115287       0.48983      0.0718398     0.133525        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00138291     0.0134899     0.0938404    0.00451858     0.0269595       10     
reco:pandoracalo:Calorimetry                          0.000394987   0.00311339     0.0210603    0.000931731    0.006031        10     
reco:pandorapid:Chi2ParticleID                        0.000112082   0.00108175    0.00864349    0.000228894   0.00252367       10     
reco:cvnmap:CVNMapper                                  0.0719634     0.127719      0.253436      0.108709      0.0605237       10     
reco:cvneva:CVNEvaluator                                1.27341       2.97971       12.8385       1.83902       3.3343         10     
reco:energyrecnumu:EnergyReco                         0.00241748      7.45585       74.3075      0.0181614      22.2839        10     
reco:energyrecnue:EnergyReco                          0.00164912    0.00370243    0.00661445    0.00338932     0.0017263       10     
reco:energyrecnc:EnergyReco                            0.0178781      27.9847       74.3337      0.153254       34.2349        10     
[art]:TriggerResults:TriggerResultInserter            2.3612e-05    7.31234e-05   0.000259216   4.1157e-05    7.40151e-05      10     
end_path:out1:RootOutput                               8.622e-06    2.09469e-05    7.936e-05    1.50105e-05   1.98406e-05      10     
end_path:out1:RootOutput(write)                        0.395529      0.639413       1.07798      0.638667      0.232555        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12109 MB
  Peak resident set size usage (VmHWM): 3046.24 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 Looking at view: 2 | Number of hits in view: 11
Begin processing the 9th record. run: 5026 subRun: 0 event: 8989 at 11-Dec-2025 17:15:13 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  39
Added hit list length: 39 | Max was set to: -3.40282e+38
True Neutron Energy: 940.835
True Electron Energy: 25.6092
Completed MCParticle Loop
True Neutrino Energy: 38.2406
 Size of all hits: 39
hit initial : 86.7426 | hit correction : 1.27601
hit initial : 96.5656 | hit correction : 1.276
hit initial : 86.8248 | hit correction : 1.27636
hit initial : 206.512 | hit correction : 1.27638
hit initial : 226.372 | hit correction : 1.27631
hit initial : 52.769 | hit correction : 1.27488
hit initial : 227.018 | hit correction : 1.2762
hit initial : 155.56 | hit correction : 1.27499
hit initial : 157.06 | hit correction : 1.27617
hit initial : 139.213 | hit correction : 1.27517
hit initial : 54.8151 | hit correction : 1.27617
hit initial : 171.379 | hit correction : 1.27542
hit initial : 169.377 | hit correction : 1.27554
hit initial : 236.781 | hit correction : 1.27562
hit initial : 212.919 | hit correction : 1.27563
hit initial : 98.3717 | hit correction : 1.27556
 *** Total Charge : 3034.23
 Looking at view: 0 | Number of hits in view: 16
hit initial : 78.4442 | hit correction : 1.276
hit initial : 204.407 | hit correction : 1.27611
hit initial : 400.078 | hit correction : 1.27624
hit initial : 258.549 | hit correction : 1.27627
hit initial : 81.9483 | hit correction : 1.27633
hit initial : 467.25 | hit correction : 1.27536
hit initial : 154.201 | hit correction : 1.27519
hit initial : 480.444 | hit correction : 1.27556
 *** Total Charge : 2711.49
 Looking at view: 1 | Number of hits in view: 8
hit initial : 167.012 | hit correction : 1.27637
hit initial : 217.134 | hit correction : 1.27638
hit initial : 152.609 | hit correction : 1.27627
hit initial : 123.828 | hit correction : 1.27617
hit initial : 205.63 | hit correction : 1.27614
hit initial : 147.828 | hit correction : 1.27615
hit initial : 30.1383 | hit correction : 1.2762
hit initial : 141.337 | hit correction : 1.2749
hit initial : 170.429 | hit correction : 1.27508
hit initial : 183.435 | hit correction : 1.27534
hit initial : 152.485 | hit correction : 1.27562
hit initial : 142.932 | hit correction : 1.27564
hit initial : 238.464 | hit correction : 1.27548
hit initial : 93.5523 | hit correction : 1.27565
hit initial : 192.068 | hit correction : 1.27557
 *** Total Charge : 3009.41
 Looking at view: 2 | Number of hits in view: 15
Begin processing the 10th record. run: 5026 subRun: 0 event: 8990 at 11-Dec-2025 17:15:18 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  12
Added hit list length: 12 | Max was set to: -3.40282e+38
True Neutron Energy: 939.571
True Electron Energy: 7.75122
Completed MCParticle Loop
True Neutrino Energy: 13.129
 Size of all hits: 12
hit initial : 57.9543 | hit correction : 1.11564
hit initial : 165.39 | hit correction : 1.11566
hit initial : 77.3345 | hit correction : 1.11184
hit initial : 39.0914 | hit correction : 1.11186
hit initial : 142.036 | hit correction : 1.11584
hit initial : 316.899 | hit correction : 1.1158
hit initial : 250.664 | hit correction : 1.11574
 *** Total Charge : 1170.38
 Looking at view: 0 | Number of hits in view: 7
hit initial : 121.704 | hit correction : 1.11583
hit initial : 326.103 | hit correction : 1.1158
hit initial : 292.968 | hit correction : 1.11574
hit initial : 160.289 | hit correction : 1.11566
hit initial : 51.644 | hit correction : 1.11564
 *** Total Charge : 1062.99
 Looking at view: 1 | Number of hits in view: 5
11-Dec-2025 17:15:22 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.101187       0.14787      0.303515      0.112913      0.0623738       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000665117   0.00551043     0.0387251    0.000781996    0.0114292       10     
end_path:ana:AnalyzeEvents         0.100126      0.142079      0.302591      0.112002      0.060745        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9805.18 MB
  Peak resident set size usage (VmHWM): 1530.57 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:30:07 UTC       justIN version: 01.06.00