justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 259787.0@dunegpschedd02.fnal.gov

Jobsub ID259787.0@dunegpschedd02.fnal.gov
Workflow ID11085
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-09 18:22:01
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 07:31:36
From worker nodeHostnamedunegli-7867875-0-fnpc8002.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-10 13:52:47
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T014113Z_gen_003399_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time17h (63476s)
CPU time17h (61651s = 97%)
Max RSS bytes3035586560 (2894 MiB)
Outputting started2025-12-11 07:30:44
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11085/1/001/analysisLowE_20251210T135248Z.root
Finished2025-12-11 07:31:36
Saved logsjustin-logs:259787.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

dd data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 07:26:32 UTC run: 5026 subRun: 0 event: 33990
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6547, 6526, 6546
minwire 0: 18
minwire 1: 1
minwire 2: 2
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 270, 769
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.133295, 
Output 1: 0.106981, 0.12908, 0.191675, 0.572263, 
Output 2: 0.0673184, 0.18917, 0.71471, 0.0288009, 
Output 3: 0.973987, 0.017545, 0.00225063, 0.00621778, 
Output 4: 0.33752, 0.586947, 0.0684043, 0.00712807, 
Output 5: 0.638769, 0.281415, 0.0589684, 0.0208479, 
Output 6: 0.0585242, 0.116321, 0.102093, 0.723062, 

11-Dec-2025 07:27:53 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 07:27:53 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/66/30/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T014113Z_gen_003399_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              5318.46       6295.48       7164.5        6293.55       624.107        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0134756     0.035449      0.0954797     0.0346779     0.0225965       10     
reco:pandora:StandardPandora                            5235.22       6221.45       7092.78       6218.06       625.005        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.0124008      0.11118       0.43859      0.0415478     0.126357        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00540415     0.0430884     0.202847      0.0256367     0.0557451       10     
reco:pandoracalo:Calorimetry                          0.000874586    0.0439734     0.169338      0.0113328     0.0628787       10     
reco:pandorapid:Chi2ParticleID                        0.000200937   0.00137661    0.00540697    0.000388649   0.00189267       10     
reco:cvnmap:CVNMapper                                  0.158168      0.206241      0.256381      0.211849      0.0252072       10     
reco:cvneva:CVNEvaluator                                3.05409       4.42244       12.0455       3.70269       2.55875        10     
reco:energyrecnumu:EnergyReco                          0.0134929      40.6422       72.4477       64.8443       33.2206        10     
reco:energyrecnue:EnergyReco                          0.00532911     0.0146333     0.0252734     0.0149027    0.00798341       10     
reco:energyrecnc:EnergyReco                            0.0200411      27.6485       73.3441      0.0345441      33.9742        10     
[art]:TriggerResults:TriggerResultInserter            5.9491e-05    0.000105047   0.000276954   9.10235e-05   6.11496e-05      10     
end_path:out1:RootOutput                              1.9964e-05    3.02208e-05   8.4843e-05    2.28725e-05   1.88318e-05      10     
end_path:out1:RootOutput(write)                        0.769208      0.857984      0.950781      0.855232      0.052907        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11013.7 MB
  Peak resident set size usage (VmHWM): 3035.59 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 12.8473 | hit correction : 1.38375
hit initial : 61.6798 | hit correction : 1.38862
hit initial : 174.059 | hit correction : 1.38322
hit initial : 420.134 | hit correction : 1.38369
hit initial : 410.953 | hit correction : 1.38476
hit initial : 329.169 | hit correction : 1.38591
hit initial : 272.26 | hit correction : 1.38667
hit initial : 255.047 | hit correction : 1.38726
hit initial : 219.53 | hit correction : 1.38813
hit initial : 168.033 | hit correction : 1.38853
 *** Total Charge : 4682.66
 Looking at view: 0 | Number of hits in view: 23
hit initial : 25.5653 | hit correction : 1.38245
hit initial : 37.4255 | hit correction : 1.3825
hit initial : 66.4967 | hit correction : 1.38249
hit initial : 225.111 | hit correction : 1.38382
hit initial : 15.5359 | hit correction : 1.38315
hit initial : 103.202 | hit correction : 1.38241
hit initial : 243.123 | hit correction : 1.3811
hit initial : 152.725 | hit correction : 1.38371
hit initial : 98.3334 | hit correction : 1.38099
hit initial : 101.77 | hit correction : 1.38406
hit initial : 63.2801 | hit correction : 1.38651
hit initial : 77.6525 | hit correction : 1.38106
hit initial : 16.8442 | hit correction : 1.38196
hit initial : 57.2874 | hit correction : 1.38473
hit initial : 31.9071 | hit correction : 1.38537
hit initial : 347.468 | hit correction : 1.3865
hit initial : 479.424 | hit correction : 1.3869
hit initial : 84.2104 | hit correction : 1.38861
hit initial : 196.513 | hit correction : 1.3884
 *** Total Charge : 3356.68
 Looking at view: 1 | Number of hits in view: 19
hit initial : 24.412 | hit correction : 1.38253
hit initial : 41.7632 | hit correction : 1.38248
hit initial : 221.862 | hit correction : 1.38248
hit initial : 40.9017 | hit correction : 1.38102
hit initial : 70.6838 | hit correction : 1.38091
hit initial : 296.818 | hit correction : 1.38106
hit initial : 110.768 | hit correction : 1.38148
hit initial : 170.538 | hit correction : 1.38318
hit initial : 218.836 | hit correction : 1.38371
hit initial : 242.992 | hit correction : 1.38437
hit initial : 169.88 | hit correction : 1.38497
hit initial : 150.421 | hit correction : 1.38549
hit initial : 159.951 | hit correction : 1.38595
hit initial : 177.869 | hit correction : 1.38639
hit initial : 237.534 | hit correction : 1.38684
hit initial : 268.028 | hit correction : 1.38738
hit initial : 162.786 | hit correction : 1.38851
hit initial : 196.167 | hit correction : 1.38848
 *** Total Charge : 4101.98
 Looking at view: 2 | Number of hits in view: 18
Begin processing the 7th record. run: 5026 subRun: 0 event: 33987 at 11-Dec-2025 07:30:12 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 16.3749
Completed MCParticle Loop
True Neutrino Energy: 21.7545
 Size of all hits: 0
Begin processing the 8th record. run: 5026 subRun: 0 event: 33988 at 11-Dec-2025 07:30:20 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 31.5165
Completed MCParticle Loop
True Neutrino Energy: 48.7796
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 33989 at 11-Dec-2025 07:30:27 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 18.4406
Completed MCParticle Loop
True Neutrino Energy: 21.7365
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 33990 at 11-Dec-2025 07:30:35 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Neutron Energy: 939.577
True Electron Energy: 17.0333
Completed MCParticle Loop
True Neutrino Energy: 22.4223
 Size of all hits: 0
11-Dec-2025 07:30:42 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.187781      0.246172      0.343733       0.24434      0.0529237       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00124697    0.00650923     0.0190191     0.0017592    0.00672273       10     
end_path:ana:AnalyzeEvents         0.185377      0.239097      0.324308       0.24222      0.0477694       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8743.07 MB
  Peak resident set size usage (VmHWM): 1539.12 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:29:01 UTC       justIN version: 01.06.00