justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261327.1@dunegpschedd02.fnal.gov

Jobsub ID261327.1@dunegpschedd02.fnal.gov
Workflow ID11114
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:46:40
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 03:51:42
From worker nodeHostnamedunegli-7878640-0-fnpc17009.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:48:03
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T025138Z_gen_004273_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (18200s)
CPU time5h (18036s = 99%)
Max RSS bytes2935861248 (2799 MiB)
Outputting started2025-12-12 03:51:24
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11114/1/001/analysisLowE_20251211T224804Z.root
Finished2025-12-12 03:51:42
Saved logsjustin-logs:261327.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

1241, 0.0512642, 0.0728654, 0.857746, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 42730 at 12-Dec-2025 03:16:54 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 03:50:02 UTC run: 5027 subRun: 0 event: 42730
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6615, 6596, 6586
minwire 0: 50
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1669, 2168
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0942665, 
Output 1: 0.0701213, 0.0747539, 0.118172, 0.736953, 
Output 2: 0.0759446, 0.279809, 0.612283, 0.0319634, 
Output 3: 0.969783, 0.0178025, 0.00254989, 0.00986454, 
Output 4: 0.365321, 0.575347, 0.0550564, 0.00427557, 
Output 5: 0.830354, 0.1533, 0.0130437, 0.00330237, 
Output 6: 0.00835138, 0.0276255, 0.0448282, 0.919195, 

12-Dec-2025 03:50:06 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 03:50:06 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/a2/c1/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T025138Z_gen_004273_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1483.2        1794.56       2054.33       1770.69       176.488        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00140735    0.00939773     0.0214779     0.0057079    0.00735072       10     
reco:pandora:StandardPandora                            1481.33       1792.03       2051.96       1768.31       176.049        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00153378     0.0185261     0.101131     0.00896872     0.0291805       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00155977    0.00665497     0.0182853    0.00421484    0.00567361       10     
reco:pandoracalo:Calorimetry                          0.000250377   0.00271908     0.0171959    0.000450705   0.00499058       10     
reco:pandorapid:Chi2ParticleID                        8.7445e-05    0.00031174    0.00180827    0.000139043   0.000500535      10     
reco:cvnmap:CVNMapper                                  0.0352744     0.0755561     0.266663      0.0437858     0.0675772       10     
reco:cvneva:CVNEvaluator                                1.10087       1.80421       4.13509       1.63977       0.7981         10     
reco:energyrecnumu:EnergyReco                         0.00565845     0.0548801     0.161116      0.0144584     0.0563699       10     
reco:energyrecnue:EnergyReco                          0.00127851    0.00334306     0.0107963    0.00148462    0.00354784       10     
reco:energyrecnc:EnergyReco                            0.0100165     0.0679745     0.115954      0.100374      0.0470886       10     
[art]:TriggerResults:TriggerResultInserter            1.9767e-05    3.14873e-05   9.2248e-05    2.5119e-05    2.03933e-05      10     
end_path:out1:RootOutput                               6.142e-06       9e-06      2.9149e-05    6.8585e-06    6.73062e-06      10     
end_path:out1:RootOutput(write)                        0.327517       0.48784      0.582867      0.502802      0.0669086       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12015.9 MB
  Peak resident set size usage (VmHWM): 2935.86 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 111.681 | hit correction : 1.00623
hit initial : 135.928 | hit correction : 1.00574
hit initial : 128.06 | hit correction : 1.00571
hit initial : 34.3268 | hit correction : 1.0057
hit initial : 211.356 | hit correction : 1.00647
hit initial : 374.184 | hit correction : 1.00649
hit initial : 104.978 | hit correction : 1.00651
hit initial : 207.215 | hit correction : 1.00683
hit initial : 55.4532 | hit correction : 1.00769
hit initial : 456.526 | hit correction : 1.00769
hit initial : 440.016 | hit correction : 1.00801
hit initial : 335.649 | hit correction : 1.00842
hit initial : 342.256 | hit correction : 1.00879
hit initial : 363.56 | hit correction : 1.00909
hit initial : 341.565 | hit correction : 1.00943
hit initial : 312.454 | hit correction : 1.0098
hit initial : 270.134 | hit correction : 1.01007
 *** Total Charge : 4390.99
 Looking at view: 1 | Number of hits in view: 18
hit initial : 470.063 | hit correction : 1.00573
hit initial : 239.25 | hit correction : 1.00621
hit initial : 11.114 | hit correction : 1.00562
hit initial : 667.61 | hit correction : 1.00647
hit initial : 195.182 | hit correction : 1.00661
hit initial : 104.986 | hit correction : 1.00657
hit initial : 327.212 | hit correction : 1.00707
hit initial : 340.951 | hit correction : 1.00759
hit initial : 397.182 | hit correction : 1.00789
hit initial : 503.534 | hit correction : 1.0083
hit initial : 378.113 | hit correction : 1.00879
hit initial : 538.573 | hit correction : 1.0092
hit initial : 301.495 | hit correction : 1.00967
hit initial : 565.003 | hit correction : 1.0101
 *** Total Charge : 5079.92
 Looking at view: 2 | Number of hits in view: 14
Begin processing the 9th record. run: 5027 subRun: 0 event: 42729 at 12-Dec-2025 03:51:14 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 11.5144
Completed MCParticle Loop
True Neutrino Energy: 16.8956
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 42730 at 12-Dec-2025 03:51:18 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  23
Added hit list length: 23 | Max was set to: -3.40282e+38
True Neutron Energy: 939.575
True Neutron Energy: 940.328
True Electron Energy: 35.2778
Completed MCParticle Loop
True Neutrino Energy: 47.8841
 Size of all hits: 23
hit initial : 67.4792 | hit correction : 1.29519
hit initial : 300.696 | hit correction : 1.29526
hit initial : 339.792 | hit correction : 1.29588
hit initial : 318.66 | hit correction : 1.29642
hit initial : 95.6338 | hit correction : 1.29659
hit initial : 40.83 | hit correction : 1.29645
hit initial : 34.6179 | hit correction : 1.29646
hit initial : 476.359 | hit correction : 1.29535
hit initial : 362.17 | hit correction : 1.29554
 *** Total Charge : 2638.39
 Looking at view: 0 | Number of hits in view: 9
hit initial : 56.5405 | hit correction : 1.29675
hit initial : 203.142 | hit correction : 1.29659
hit initial : 293.225 | hit correction : 1.29618
hit initial : 135.309 | hit correction : 1.2952
hit initial : 376.189 | hit correction : 1.29531
hit initial : 522.92 | hit correction : 1.29542
hit initial : 353.013 | hit correction : 1.29563
 *** Total Charge : 2514.1
 Looking at view: 1 | Number of hits in view: 7
hit initial : 21.2244 | hit correction : 1.29679
hit initial : 245.905 | hit correction : 1.29665
hit initial : 39.8686 | hit correction : 1.29643
hit initial : 104.917 | hit correction : 1.29531
hit initial : 447.807 | hit correction : 1.29527
hit initial : 989.235 | hit correction : 1.29561
hit initial : 166.51 | hit correction : 1.29562
 *** Total Charge : 2611.39
 Looking at view: 2 | Number of hits in view: 7
12-Dec-2025 03:51:24 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.112429      0.207608      0.499286      0.160956       0.11207        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000442912    0.0370354     0.350544     0.000548366    0.104569        10     
end_path:ana:AnalyzeEvents         0.111709      0.170391      0.320105      0.150175      0.0564987       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9807.94 MB
  Peak resident set size usage (VmHWM): 1534.14 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:59:40 UTC       justIN version: 01.06.00