justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261269.1@dunegpschedd02.fnal.gov

Jobsub ID261269.1@dunegpschedd02.fnal.gov
Workflow ID11092
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:14:38
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 00:59:15
From worker nodeHostnamedunegli-7878600-0-fnpc22008.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:15:23
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T125253Z_gen_000025_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time2h (9815s)
CPU time2h (9715s = 98%)
Max RSS bytes3021234176 (2881 MiB)
Outputting started2025-12-12 00:58:58
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11092/1/001/analysisLowE_20251211T221523Z.root
Finished2025-12-12 00:59:15
Saved logsjustin-logs:261269.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ermination failure: 0, 499
Classifier summary: 
Output 0: 0.0842407, 
Output 1: 0.0716145, 0.127551, 0.180665, 0.62017, 
Output 2: 0.0578129, 0.114564, 0.814642, 0.0129803, 
Output 3: 0.953988, 0.0413419, 0.00192859, 0.00274169, 
Output 4: 0.407622, 0.533868, 0.0512868, 0.00722319, 
Output 5: 0.356941, 0.480478, 0.125439, 0.0371428, 
Output 6: 0.0726736, 0.187542, 0.129877, 0.609908, 

Begin processing the 10th record. run: 4696 subRun: 0 event: 250 at 12-Dec-2025 00:40:40 UTC
Boundary wire vector sizes: 6786, 6700, 6656
minwire 0: 35
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0772485, 
Output 1: 0.0596218, 0.164697, 0.237503, 0.538177, 
Output 2: 0.018895, 0.0861257, 0.888498, 0.00648089, 
Output 3: 0.926729, 0.0618397, 0.00595654, 0.00547501, 
Output 4: 0.448495, 0.444803, 0.0900837, 0.016618, 
Output 5: 0.309746, 0.48495, 0.171486, 0.0338183, 
Output 6: 0.0469075, 0.107094, 0.0918923, 0.754106, 

12-Dec-2025 00:58:13 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 00:58:13 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/2c/07/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T125253Z_gen_000025_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              745.126       967.589       1098.43       1036.32       125.733        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00148284     0.0124097     0.0602688    0.00455964     0.0168672       10     
reco:pandora:StandardPandora                            743.695       965.95        1095.14       1034.84       125.495        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00416219     0.021049      0.0929031     0.0128434     0.0253369       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000851911   0.00506802     0.0128346     0.0046774    0.00301726       10     
reco:pandoracalo:Calorimetry                          0.000247989   0.00441573     0.0181818    0.000969264   0.00681765       10     
reco:pandorapid:Chi2ParticleID                         6.34e-05     0.000264977   0.000965427    8.989e-05    0.000336641      10     
reco:cvnmap:CVNMapper                                  0.0166831     0.0257663     0.0365265     0.0251077    0.00515561       10     
reco:cvneva:CVNEvaluator                               0.730016       1.15394       2.63712       1.02493      0.502742        10     
reco:energyrecnumu:EnergyReco                         0.00282149     0.0229938     0.0799695    0.00826652     0.0284969       10     
reco:energyrecnue:EnergyReco                          0.000767982   0.00250349    0.00822772    0.00117282    0.00283798       10     
reco:energyrecnc:EnergyReco                           0.00795578     0.0682823     0.108636      0.0751828     0.033726        10     
[art]:TriggerResults:TriggerResultInserter            1.2173e-05    2.3268e-05    9.7083e-05    1.4768e-05    2.4768e-05       10     
end_path:out1:RootOutput                               5.35e-06     9.6722e-06    3.1409e-05     6.818e-06    7.40664e-06      10     
end_path:out1:RootOutput(write)                         0.20979      0.322224      0.427352      0.324131      0.0546239       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21781.2 MB
  Peak resident set size usage (VmHWM): 3021.23 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
This pfp has size:  69
Added hit list length: 69 | Max was set to: -3.40282e+38
True Neutron Energy: 941.099
True Electron Energy: 47.426
Completed MCParticle Loop
True Neutrino Energy: 52.8741
 Size of all hits: 69
hit initial : 142.607 | hit correction : 1.27553
hit initial : 77.3748 | hit correction : 1.27664
hit initial : 192.763 | hit correction : 1.27539
hit initial : 180.845 | hit correction : 1.27535
hit initial : 94.6505 | hit correction : 1.27559
hit initial : 73.5992 | hit correction : 1.27525
hit initial : 37.9943 | hit correction : 1.27525
hit initial : 21.2225 | hit correction : 1.27797
hit initial : 430.767 | hit correction : 1.27672
hit initial : 525.513 | hit correction : 1.27674
hit initial : 430.738 | hit correction : 1.27647
hit initial : 380.414 | hit correction : 1.2757
hit initial : 386.06 | hit correction : 1.27531
hit initial : 402.84 | hit correction : 1.27472
hit initial : 488.906 | hit correction : 1.27401
hit initial : 314.182 | hit correction : 1.27352
hit initial : 125.847 | hit correction : 1.27263
hit initial : 204.047 | hit correction : 1.27277
 *** Total Charge : 5752.07
 Looking at view: 0 | Number of hits in view: 18
hit initial : 96.6122 | hit correction : 1.27518
hit initial : 255.953 | hit correction : 1.27529
hit initial : 51.8753 | hit correction : 1.27653
hit initial : 279.094 | hit correction : 1.2755
hit initial : 214.71 | hit correction : 1.27581
hit initial : 193.681 | hit correction : 1.27662
hit initial : 415.688 | hit correction : 1.27661
hit initial : 360.635 | hit correction : 1.27675
hit initial : 342.215 | hit correction : 1.27679
hit initial : 405.069 | hit correction : 1.2763
hit initial : 470.519 | hit correction : 1.27554
hit initial : 530.875 | hit correction : 1.27515
hit initial : 396.412 | hit correction : 1.27449
hit initial : 395.849 | hit correction : 1.2739
hit initial : 395.894 | hit correction : 1.2733
hit initial : 259.242 | hit correction : 1.27274
hit initial : 63.4775 | hit correction : 1.27258
 *** Total Charge : 6539.47
 Looking at view: 1 | Number of hits in view: 17
hit initial : 173.743 | hit correction : 1.27513
hit initial : 232.785 | hit correction : 1.27527
hit initial : 211.085 | hit correction : 1.27552
hit initial : 227.237 | hit correction : 1.27576
hit initial : 85.8963 | hit correction : 1.27523
hit initial : 50.3375 | hit correction : 1.27523
hit initial : 131.474 | hit correction : 1.27617
hit initial : 162.252 | hit correction : 1.27649
hit initial : 370.88 | hit correction : 1.27664
hit initial : 227.526 | hit correction : 1.27669
hit initial : 116.531 | hit correction : 1.27684
hit initial : 124.334 | hit correction : 1.27685
hit initial : 125.697 | hit correction : 1.2769
hit initial : 122.596 | hit correction : 1.27686
hit initial : 132.455 | hit correction : 1.2767
hit initial : 122.808 | hit correction : 1.27647
hit initial : 127.947 | hit correction : 1.27625
hit initial : 123.998 | hit correction : 1.27603
hit initial : 123.607 | hit correction : 1.27579
hit initial : 146.248 | hit correction : 1.27557
hit initial : 155.39 | hit correction : 1.27543
hit initial : 223.989 | hit correction : 1.27532
hit initial : 124.28 | hit correction : 1.27502
hit initial : 113.587 | hit correction : 1.27485
hit initial : 114.237 | hit correction : 1.2747
hit initial : 123.628 | hit correction : 1.27453
hit initial : 138.141 | hit correction : 1.27432
hit initial : 139.011 | hit correction : 1.27409
hit initial : 151.721 | hit correction : 1.27388
hit initial : 172.384 | hit correction : 1.2736
hit initial : 169.855 | hit correction : 1.27335
hit initial : 144.187 | hit correction : 1.27299
hit initial : 157.43 | hit correction : 1.27266
hit initial : 121.938 | hit correction : 1.27244
 *** Total Charge : 6617.97
 Looking at view: 2 | Number of hits in view: 34
12-Dec-2025 00:58:57 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0726096     0.0942351     0.117791      0.0950822     0.0117347       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000322621   0.000497378   0.000804291   0.000419043   0.000172192      10     
end_path:ana:AnalyzeEvents         0.0719976     0.0935542     0.116506      0.0945955     0.0116089       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19472.3 MB
  Peak resident set size usage (VmHWM): 1532.73 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:28:55 UTC       justIN version: 01.06.00