justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267086.1@dunegpschedd01.fnal.gov

Jobsub ID267086.1@dunegpschedd01.fnal.gov
Workflow ID11092
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:48:40
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 03:59:17
From worker nodeHostnamedunegli-7878622-0-fnpc9079.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:49:35
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T021458Z_gen_003789_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (18564s)
CPU time5h (18409s = 99%)
Max RSS bytes3030962176 (2890 MiB)
Outputting started2025-12-12 03:59:00
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11092/1/001/analysisLowE_20251211T224936Z.root
Finished2025-12-12 03:59:17
Saved logsjustin-logs:267086.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

tput 5: 0.25394, 0.614, 0.118925, 0.0131349, 
Output 6: 0.0329676, 0.0975599, 0.10635, 0.763123, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 37890 at 12-Dec-2025 03:21:29 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 03:57:39 UTC run: 5027 subRun: 0 event: 37890
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6533, 6557, 6693
minwire 0: 48
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2379, 2878
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.228068, 
Output 1: 0.10332, 0.156368, 0.231872, 0.50844, 
Output 2: 0.0318663, 0.176606, 0.754318, 0.0372103, 
Output 3: 0.976801, 0.0129989, 0.00367917, 0.00652113, 
Output 4: 0.517258, 0.407511, 0.0670876, 0.0081435, 
Output 5: 0.25472, 0.32916, 0.314894, 0.101225, 
Output 6: 0.0552394, 0.118259, 0.109149, 0.717353, 

12-Dec-2025 03:57:43 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 03:57:43 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/4b/bc/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T021458Z_gen_003789_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1430.38       1831.59       2167.44       1820.67       286.097        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00157723    0.00727161     0.0184678    0.00688525    0.00461737       10     
reco:pandora:StandardPandora                            1428.26       1828.75       2164.76       1818.08       286.328        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00579397     0.0450693     0.118049      0.033301      0.0357205       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00203936     0.0979749      0.45554      0.0108505      0.16742        10     
reco:pandoracalo:Calorimetry                          0.000394061   0.00465056     0.0282089    0.000629875   0.00823884       10     
reco:pandorapid:Chi2ParticleID                        0.000106128   0.000338486   0.00106884    0.000169637   0.00034649       10     
reco:cvnmap:CVNMapper                                  0.0444378     0.0678886     0.128009      0.0596359     0.0223496       10     
reco:cvneva:CVNEvaluator                                1.10383       1.92172       3.78565       1.80609      0.655147        10     
reco:energyrecnumu:EnergyReco                         0.00451377     0.0616974     0.168995      0.0180905     0.0606059       10     
reco:energyrecnue:EnergyReco                          0.00106291    0.00455615      0.01169     0.00168519    0.00457165       10     
reco:energyrecnc:EnergyReco                            0.0113254     0.0879303     0.202234      0.0934106     0.0721213       10     
[art]:TriggerResults:TriggerResultInserter            1.5494e-05    3.44406e-05   0.000117018   2.5734e-05    2.78802e-05      10     
end_path:out1:RootOutput                               6.92e-06     1.2929e-05    4.6929e-05    8.8215e-06    1.14816e-05      10     
end_path:out1:RootOutput(write)                        0.356943      0.542108      0.650371      0.566129      0.0813753       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12084.2 MB
  Peak resident set size usage (VmHWM): 3030.96 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
True Neutron Energy: 942.113
True Electron Energy: 41.2371
Completed MCParticle Loop
True Neutrino Energy: 61.3789
 Size of all hits: 42
hit initial : 79.7786 | hit correction : 1.31875
hit initial : 39.2634 | hit correction : 1.32055
hit initial : 110.346 | hit correction : 1.31981
hit initial : 179.098 | hit correction : 1.31879
hit initial : 50.7047 | hit correction : 1.31806
hit initial : 265.296 | hit correction : 1.32051
hit initial : 426.714 | hit correction : 1.32074
hit initial : 387.622 | hit correction : 1.32117
hit initial : 154.307 | hit correction : 1.32121
hit initial : 190.468 | hit correction : 1.31804
hit initial : 469.615 | hit correction : 1.31707
hit initial : 126.371 | hit correction : 1.31694
hit initial : 213.371 | hit correction : 1.31593
hit initial : 196.097 | hit correction : 1.31586
hit initial : 41.843 | hit correction : 1.31453
 *** Total Charge : 3865.41
 Looking at view: 0 | Number of hits in view: 15
hit initial : 51.4028 | hit correction : 1.31731
hit initial : 57.7081 | hit correction : 1.31732
hit initial : 27.4855 | hit correction : 1.3145
hit initial : 38.382 | hit correction : 1.31452
hit initial : 38.7933 | hit correction : 1.3181
hit initial : 65.0599 | hit correction : 1.31705
hit initial : 147.391 | hit correction : 1.31867
hit initial : 139.517 | hit correction : 1.31807
hit initial : 99.9707 | hit correction : 1.31586
hit initial : 244.539 | hit correction : 1.31887
hit initial : 149.251 | hit correction : 1.31587
hit initial : 273.176 | hit correction : 1.3195
hit initial : 58.115 | hit correction : 1.31589
hit initial : 45.9579 | hit correction : 1.32065
hit initial : 343.897 | hit correction : 1.32014
hit initial : 63.595 | hit correction : 1.32135
hit initial : 329.964 | hit correction : 1.32058
hit initial : 74.1249 | hit correction : 1.32127
hit initial : 35.2046 | hit correction : 1.32055
hit initial : 216.501 | hit correction : 1.32111
hit initial : 112.984 | hit correction : 1.3211
hit initial : 460.954 | hit correction : 1.31803
hit initial : 112.609 | hit correction : 1.31803
hit initial : 315.166 | hit correction : 1.3168
hit initial : 238.629 | hit correction : 1.31619
hit initial : 148.503 | hit correction : 1.31574
hit initial : 97.0854 | hit correction : 1.31539
 *** Total Charge : 5255.11
 Looking at view: 1 | Number of hits in view: 27
Begin processing the 10th record. run: 5027 subRun: 0 event: 37890 at 12-Dec-2025 03:58:53 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  17
Added hit list length: 17 | Max was set to: -3.40282e+38
True Neutron Energy: 939.569
True Electron Energy: 15.0392
Completed MCParticle Loop
True Neutrino Energy: 18.3329
 Size of all hits: 17
hit initial : 85.3898 | hit correction : 1.24578
hit initial : 363.635 | hit correction : 1.24569
hit initial : 126.726 | hit correction : 1.24661
hit initial : 245.483 | hit correction : 1.24586
hit initial : 192.715 | hit correction : 1.24656
hit initial : 45.4524 | hit correction : 1.24665
hit initial : 103.236 | hit correction : 1.2443
hit initial : 335.173 | hit correction : 1.24437
hit initial : 141.07 | hit correction : 1.24415
 *** Total Charge : 2041.11
 Looking at view: 1 | Number of hits in view: 9
hit initial : 95.3511 | hit correction : 1.2443
hit initial : 155.118 | hit correction : 1.24584
hit initial : 199.806 | hit correction : 1.24498
hit initial : 296.323 | hit correction : 1.24405
hit initial : 363.593 | hit correction : 1.24566
hit initial : 43.7774 | hit correction : 1.24401
hit initial : 407.991 | hit correction : 1.24648
hit initial : 50.4755 | hit correction : 1.24663
 *** Total Charge : 2008.14
 Looking at view: 2 | Number of hits in view: 8
12-Dec-2025 03:58:59 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          0.10007      0.164335      0.259897      0.162565      0.0478483       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00043085    0.00984235     0.0726252    0.000639074    0.0213974       10     
end_path:ana:AnalyzeEvents         0.0994508     0.154284      0.259005      0.149136      0.0428895       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9812.34 MB
  Peak resident set size usage (VmHWM): 1535.25 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:28:55 UTC       justIN version: 01.06.00