justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261356.0@dunegpschedd02.fnal.gov

Jobsub ID261356.0@dunegpschedd02.fnal.gov
Workflow ID11094
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 23:34:43
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 01:21:00
From worker nodeHostnamedunegli-7878636-0-fnpc22025.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 23:36:03
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T232038Z_gen_001481_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time1h (6286s)
CPU time1h (6215s = 98%)
Max RSS bytes3062337536 (2920 MiB)
Outputting started2025-12-12 01:20:50
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11094/1/001/analysisLowE_20251211T233603Z.root
Finished2025-12-12 01:21:00
Saved logsjustin-logs:261356.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.0932619, 0.804248, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 14810 at 12-Dec-2025 01:09:52 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 01:20:17 UTC run: 5027 subRun: 0 event: 14810
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 01:20:17 UTC run: 5027 subRun: 0 event: 14810
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6921, 6888, 6817
minwire 0: 41
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.171388, 
Output 1: 0.104382, 0.0911315, 0.138138, 0.666349, 
Output 2: 0.091963, 0.267083, 0.602033, 0.0389213, 
Output 3: 0.977755, 0.0133076, 0.0018723, 0.0070651, 
Output 4: 0.444673, 0.500176, 0.0498954, 0.00525509, 
Output 5: 0.458208, 0.456819, 0.0708416, 0.0141313, 
Output 6: 0.0264533, 0.0703501, 0.0861634, 0.817033, 

12-Dec-2025 01:20:19 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 01:20:19 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/a5/a6/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T232038Z_gen_001481_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              610.912       619.023       625.588       619.08        4.68986        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0012718    0.00809067     0.0336397     0.0042322    0.00955903       10     
reco:pandora:StandardPandora                            609.899       617.891       624.567       617.707       4.70549        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00182517     0.0101468     0.0477207    0.00396204     0.0138297       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00279103    0.00586889     0.0195564    0.00375185    0.00502444       10     
reco:pandoracalo:Calorimetry                          0.000138622   0.00636666     0.0172592    0.00124702    0.00719618       10     
reco:pandorapid:Chi2ParticleID                        3.5998e-05    0.000194633   0.000538497   0.000146192   0.000171049      10     
reco:cvnmap:CVNMapper                                  0.0150281     0.0206044     0.0311948     0.0198547    0.00419168       10     
reco:cvneva:CVNEvaluator                               0.677069      0.791722       1.77777      0.683373      0.328701        10     
reco:energyrecnumu:EnergyReco                         0.00372654     0.0670759     0.120456      0.0735966     0.0364115       10     
reco:energyrecnue:EnergyReco                          0.000763543   0.00245342    0.00477348    0.00126716    0.00183535       10     
reco:energyrecnc:EnergyReco                           0.00453786     0.0154097     0.0658711    0.00463034     0.0218351       10     
[art]:TriggerResults:TriggerResultInserter             7.324e-06    1.32711e-05   4.9233e-05     9.182e-06    1.20713e-05      10     
end_path:out1:RootOutput                               4.228e-06    7.2307e-06    2.4927e-05     5.125e-06    5.95919e-06      10     
end_path:out1:RootOutput(write)                        0.194986      0.204294       0.24417      0.200245      0.0137938       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21780.7 MB
  Peak resident set size usage (VmHWM): 3062.34 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.571
True Electron Energy: 5.35892
Completed MCParticle Loop
True Neutrino Energy: 10.7372
 Size of all hits: 0
Begin processing the 7th record. run: 5027 subRun: 0 event: 14807 at 12-Dec-2025 01:20:41 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 943.655
True Neutron Energy: 942.12
True Neutron Energy: 940.508
True Neutron Energy: 939.589
True Electron Energy: 17.2989
Completed MCParticle Loop
True Neutrino Energy: 32.7981
 Size of all hits: 0
Begin processing the 8th record. run: 5027 subRun: 0 event: 14808 at 12-Dec-2025 01:20:43 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
True Electron Energy: 42.4086
Completed MCParticle Loop
True Neutrino Energy: 62.5637
 Size of all hits: 0
Begin processing the 9th record. run: 5027 subRun: 0 event: 14809 at 12-Dec-2025 01:20:45 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  34
Added hit list length: 34 | Max was set to: -3.40282e+38
True Electron Energy: 50.1247
Completed MCParticle Loop
True Neutrino Energy: 55.6078
 Size of all hits: 34
hit initial : 61.2501 | hit correction : 1.36271
hit initial : 50.5272 | hit correction : 1.36272
hit initial : 47.2368 | hit correction : 1.35311
hit initial : 250.39 | hit correction : 1.35021
hit initial : 228.659 | hit correction : 1.3499
hit initial : 188.481 | hit correction : 1.34982
hit initial : 60.6523 | hit correction : 1.3498
hit initial : 24.9255 | hit correction : 1.34874
hit initial : 19.7482 | hit correction : 1.34882
hit initial : 479.948 | hit correction : 1.35259
hit initial : 845.173 | hit correction : 1.35477
hit initial : 881.676 | hit correction : 1.35597
hit initial : 622.762 | hit correction : 1.35728
hit initial : 60.8319 | hit correction : 1.35737
hit initial : 129.877 | hit correction : 1.35935
hit initial : 263.923 | hit correction : 1.36069
hit initial : 82.8476 | hit correction : 1.36075
 *** Total Charge : 5825.47
 Looking at view: 0 | Number of hits in view: 17
hit initial : 47.0603 | hit correction : 1.36272
hit initial : 164.556 | hit correction : 1.3606
hit initial : 77.469 | hit correction : 1.35929
hit initial : 55.9055 | hit correction : 1.35312
hit initial : 148.102 | hit correction : 1.3554
hit initial : 31.7325 | hit correction : 1.35389
hit initial : 15.2155 | hit correction : 1.35312
hit initial : 189.142 | hit correction : 1.35106
hit initial : 306.999 | hit correction : 1.35462
hit initial : 60.9886 | hit correction : 1.35383
hit initial : 308.096 | hit correction : 1.35216
hit initial : 31.1226 | hit correction : 1.35384
hit initial : 203.892 | hit correction : 1.35313
hit initial : 84.7211 | hit correction : 1.35684
hit initial : 135.163 | hit correction : 1.35779
hit initial : 757.28 | hit correction : 1.35796
hit initial : 68.7845 | hit correction : 1.36073
 *** Total Charge : 3642.29
 Looking at view: 1 | Number of hits in view: 17
Begin processing the 10th record. run: 5027 subRun: 0 event: 14810 at 12-Dec-2025 01:20:47 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Neutron Energy: 939.575
True Neutron Energy: 943.296
True Neutron Energy: 940.281
True Electron Energy: 12.0944
Completed MCParticle Loop
True Neutrino Energy: 24.6825
 Size of all hits: 0
12-Dec-2025 01:20:49 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0456787     0.0652979     0.0939691     0.063012      0.0169394       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000316197   0.00206392    0.00953111    0.000382919   0.00303969       10     
end_path:ana:AnalyzeEvents         0.0452529     0.0630856     0.0934986     0.0574589     0.0167258       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19479 MB
  Peak resident set size usage (VmHWM): 1537.57 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:29:00 UTC       justIN version: 01.06.00