justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265406.1@dunegpschedd01.fnal.gov

Jobsub ID265406.1@dunegpschedd01.fnal.gov
Workflow ID11088
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-09 14:23:49
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 03:53:44
From worker nodeHostnamedunegli-7867875-0-fnpc8002.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-10 12:40:06
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T172251Z_gen_001112_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time15h (54755s)
CPU time14h (53717s = 98%)
Max RSS bytes3033427968 (2892 MiB)
Outputting started2025-12-11 03:52:42
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11088/1/001/analysisLowE_20251210T124007Z.root
Finished2025-12-11 03:53:44
Saved logsjustin-logs:265406.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

egin processing the 10th record. run: 5026 subRun: 0 event: 11120 at 11-Dec-2025 01:49:45 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 03:49:40 UTC run: 5026 subRun: 0 event: 11120
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6697, 6636, 6646
minwire 0: 44
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 86, 585
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.144839, 
Output 1: 0.0861389, 0.102336, 0.12025, 0.691276, 
Output 2: 0.0478166, 0.200641, 0.721438, 0.0301043, 
Output 3: 0.974171, 0.0163551, 0.00252643, 0.00694756, 
Output 4: 0.596881, 0.35096, 0.0456769, 0.00648266, 
Output 5: 0.27589, 0.432955, 0.231076, 0.060079, 
Output 6: 0.0489737, 0.102267, 0.103129, 0.745631, 

11-Dec-2025 03:49:49 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 03:49:49 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/24/ce/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T172251Z_gen_001112_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1951.49       5425.44       7193.6        5714.39       1564.26        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00281717     0.0193741     0.0282869     0.0215309    0.00707594       10     
reco:pandora:StandardPandora                            1945.44       5420.52       7188.61       5710.02       1564.49        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000974288    0.0727763      0.19775      0.0354459     0.0769327       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000862883    0.0174803     0.0348516     0.0189421    0.00900452       10     
reco:pandoracalo:Calorimetry                          0.000659922    0.0136044      0.11248     0.00218149     0.0329913       10     
reco:pandorapid:Chi2ParticleID                        0.000192377   0.000588857    0.0021323    0.000471119   0.000526424      10     
reco:cvnmap:CVNMapper                                  0.0993801     0.167855      0.207864      0.177618      0.0303319       10     
reco:cvneva:CVNEvaluator                                2.95457       3.56504       4.71377       3.57842       0.49118        10     
reco:energyrecnumu:EnergyReco                          0.0129461     0.0561542     0.161304      0.0346484     0.0489866       10     
reco:energyrecnue:EnergyReco                          0.00320148    0.00810759     0.019925     0.00581412    0.00592882       10     
reco:energyrecnc:EnergyReco                            0.0190356     0.205854      0.903246      0.152255      0.239482        10     
[art]:TriggerResults:TriggerResultInserter            4.6708e-05    7.61309e-05   0.000142212   6.2902e-05    2.86868e-05      10     
end_path:out1:RootOutput                              1.6119e-05    2.37267e-05   4.3509e-05    2.0528e-05    7.57046e-06      10     
end_path:out1:RootOutput(write)                        0.752076      0.788242      0.865902      0.774538      0.0383122       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11048.9 MB
  Peak resident set size usage (VmHWM): 3033.43 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 228.189 | hit correction : 1.25466
hit initial : 416.574 | hit correction : 1.2542
hit initial : 539.816 | hit correction : 1.25448
hit initial : 197.567 | hit correction : 1.25414
hit initial : 237.688 | hit correction : 1.25413
hit initial : 185.223 | hit correction : 1.25407
hit initial : 246.9 | hit correction : 1.25402
hit initial : 190.447 | hit correction : 1.25394
hit initial : 325.139 | hit correction : 1.25387
hit initial : 278.964 | hit correction : 1.25386
hit initial : 337.861 | hit correction : 1.2538
hit initial : 192.634 | hit correction : 1.25375
hit initial : 197.117 | hit correction : 1.25355
hit initial : 214.872 | hit correction : 1.25318
hit initial : 219.89 | hit correction : 1.25337
hit initial : 208.291 | hit correction : 1.25293
hit initial : 147.724 | hit correction : 1.2527
hit initial : 46.1368 | hit correction : 1.2526
 *** Total Charge : 6689.32
 Looking at view: 1 | Number of hits in view: 24
Begin processing the 10th record. run: 5026 subRun: 0 event: 11120 at 11-Dec-2025 03:52:32 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  47
Added hit list length: 47 | Max was set to: -3.40282e+38
This pfp has size:  28
True Neutron Energy: 939.57
True Electron Energy: 48.3357
Completed MCParticle Loop
True Neutrino Energy: 53.7319
 Size of all hits: 47
hit initial : 105.219 | hit correction : 1.02114
hit initial : 118.091 | hit correction : 1.01801
hit initial : 38.2302 | hit correction : 1.02114
hit initial : 38.2942 | hit correction : 1.01949
hit initial : 220.864 | hit correction : 1.01799
hit initial : 15.6917 | hit correction : 1.02019
hit initial : 20.6545 | hit correction : 1.01799
hit initial : 32.5066 | hit correction : 1.01732
hit initial : 32.63 | hit correction : 1.01877
hit initial : 26.2185 | hit correction : 1.01685
hit initial : 25.7515 | hit correction : 1.01687
hit initial : 141.437 | hit correction : 1.02022
hit initial : 76.909 | hit correction : 1.02403
hit initial : 25.5413 | hit correction : 1.02403
hit initial : 203.345 | hit correction : 1.02077
hit initial : 384.664 | hit correction : 1.02063
hit initial : 251.131 | hit correction : 1.02032
hit initial : 255.064 | hit correction : 1.01924
hit initial : 147.779 | hit correction : 1.01687
hit initial : 103.835 | hit correction : 1.01633
hit initial : 91.7722 | hit correction : 1.01619
 *** Total Charge : 2401.41
 Looking at view: 0 | Number of hits in view: 21
hit initial : 246.936 | hit correction : 1.02022
hit initial : 315.842 | hit correction : 1.02109
hit initial : 72.2374 | hit correction : 1.01685
hit initial : 47.9332 | hit correction : 1.01681
hit initial : 316.375 | hit correction : 1.01812
hit initial : 318.673 | hit correction : 1.01767
hit initial : 190.381 | hit correction : 1.01548
hit initial : 185.182 | hit correction : 1.01538
hit initial : 367.11 | hit correction : 1.0153
hit initial : 195.41 | hit correction : 1.01513
hit initial : 417.662 | hit correction : 1.01501
hit initial : 217.382 | hit correction : 1.01489
hit initial : 75.4965 | hit correction : 1.01644
hit initial : 166.943 | hit correction : 1.01478
hit initial : 182.589 | hit correction : 1.01463
hit initial : 149.716 | hit correction : 1.01447
hit initial : 561.374 | hit correction : 1.02063
hit initial : 186.595 | hit correction : 1.02021
hit initial : 429.584 | hit correction : 1.01965
hit initial : 249.1 | hit correction : 1.01915
hit initial : 314.836 | hit correction : 1.01864
hit initial : 295.112 | hit correction : 1.01714
hit initial : 279.883 | hit correction : 1.01661
hit initial : 393.553 | hit correction : 1.01615
hit initial : 215.08 | hit correction : 1.01576
hit initial : 156.371 | hit correction : 1.01561
 *** Total Charge : 6661.14
 Looking at view: 2 | Number of hits in view: 26
11-Dec-2025 03:52:40 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.162242      0.266123      0.430897      0.266079      0.0644663       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)             0.0013955     0.007484      0.0470932    0.00164595     0.0137286       10     
end_path:ana:AnalyzeEvents         0.160315      0.258039      0.381747      0.263656      0.0543312       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8740.18 MB
  Peak resident set size usage (VmHWM): 1537.15 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:28:15 UTC       justIN version: 01.06.00