justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258174.1@dunegpschedd02.fnal.gov

Jobsub ID258174.1@dunegpschedd02.fnal.gov
Workflow ID11022
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 21:21:09
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 07:56:12
From worker nodeHostnamedunegli-7988741-0-fnpc19129.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:36:57
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T234806Z_gen_001727_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (22745s)
CPU time6h (22537s = 99%)
Max RSS bytes3066507264 (2924 MiB)
Outputting started2025-12-06 07:56:03
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11022/1/001/analysisLowE_20251206T013658Z.root
Finished2025-12-06 07:56:12
Saved logsjustin-logs:258174.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

utput 2: 0.0545755, 0.170749, 0.747453, 0.0272226, 
Output 3: 0.963207, 0.0242521, 0.00416248, 0.00837808, 
Output 4: 0.519062, 0.417472, 0.0555399, 0.00792699, 
Output 5: 0.463313, 0.396624, 0.111688, 0.0283752, 
Output 6: 0.0583547, 0.0998769, 0.0885278, 0.753241, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 17270 at 06-Dec-2025 07:30:14 UTC
Boundary wire vector sizes: 6878, 6834, 6709
minwire 0: 25
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0949967, 
Output 1: 0.0706592, 0.114196, 0.175809, 0.639336, 
Output 2: 0.0342251, 0.0801519, 0.877093, 0.00852998, 
Output 3: 0.982657, 0.0142295, 0.000824532, 0.00228847, 
Output 4: 0.470069, 0.470546, 0.0505317, 0.00885328, 
Output 5: 0.272846, 0.493008, 0.179517, 0.0546287, 
Output 6: 0.065037, 0.145149, 0.106134, 0.68368, 

06-Dec-2025 07:55:24 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 07:55:24 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/c7/34/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T234806Z_gen_001727_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1457.42       2255.26       3395.57       2342.99       671.372        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00247014    0.00780318     0.0284492    0.00468507    0.00760334       10     
reco:pandora:StandardPandora                            1455.8        2253.1        3390.47       2340.98       670.714        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.0041788     0.0398582     0.184697      0.0174432     0.0534204       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00128003    0.00523322     0.0207533    0.00386872    0.00546191       10     
reco:pandoracalo:Calorimetry                          0.000389074   0.00351446     0.0239061    0.000628952   0.00697537       10     
reco:pandorapid:Chi2ParticleID                        7.2631e-05    0.000324881   0.00203252    0.000127652   0.000570645      10     
reco:cvnmap:CVNMapper                                  0.0246561     0.0403754     0.065812      0.0391784     0.0137443       10     
reco:cvneva:CVNEvaluator                                1.04174       1.55946       4.09331       1.25672      0.855412        10     
reco:energyrecnumu:EnergyReco                         0.00426772     0.0594028     0.116428      0.0668238     0.0456295       10     
reco:energyrecnue:EnergyReco                          0.00098081    0.00228363    0.00750969    0.00186203    0.00182126       10     
reco:energyrecnc:EnergyReco                           0.00743108     0.0537525     0.141081      0.0437784     0.046051        10     
[art]:TriggerResults:TriggerResultInserter             1.649e-05    3.49312e-05   0.000142642    2.456e-05    3.61011e-05      10     
end_path:out1:RootOutput                               8.28e-06     1.33831e-05    4.13e-05      9.76e-06     9.49849e-06      10     
end_path:out1:RootOutput(write)                        0.285245      0.388231      0.521475      0.415993      0.0796453       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21792.5 MB
  Peak resident set size usage (VmHWM): 3066.51 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 82.2297 | hit correction : 1.20028
hit initial : 135.632 | hit correction : 1.20547
hit initial : 128.325 | hit correction : 1.20546
hit initial : 59.621 | hit correction : 1.20547
hit initial : 46.3354 | hit correction : 1.20479
hit initial : 88.4235 | hit correction : 1.20402
hit initial : 188.503 | hit correction : 1.204
hit initial : 194.127 | hit correction : 1.20392
hit initial : 77.516 | hit correction : 1.20391
hit initial : 36.5995 | hit correction : 1.20019
hit initial : 38.4403 | hit correction : 1.19287
hit initial : 80.0078 | hit correction : 1.1899
hit initial : 254.288 | hit correction : 1.18991
hit initial : 372.905 | hit correction : 1.18988
hit initial : 331.794 | hit correction : 1.18962
hit initial : 184.587 | hit correction : 1.18933
hit initial : 193.461 | hit correction : 1.18905
hit initial : 61.922 | hit correction : 1.1888
hit initial : 277.877 | hit correction : 1.18883
hit initial : 106.826 | hit correction : 1.18863
hit initial : 310.949 | hit correction : 1.18791
hit initial : 63.9386 | hit correction : 1.18784
hit initial : 353.122 | hit correction : 1.18678
hit initial : 339.454 | hit correction : 1.18621
hit initial : 45.959 | hit correction : 1.18624
hit initial : 42.0128 | hit correction : 1.18547
hit initial : 84.165 | hit correction : 1.18544
hit initial : 38.5178 | hit correction : 1.18454
hit initial : 45.5763 | hit correction : 1.18453
 *** Total Charge : 5552.63
 Looking at view: 0 | Number of hits in view: 33
hit initial : 42.9922 | hit correction : 1.18453
hit initial : 38.3109 | hit correction : 1.18452
hit initial : 14.191 | hit correction : 1.18389
hit initial : 87.4853 | hit correction : 1.2055
hit initial : 150.277 | hit correction : 1.20548
hit initial : 74.217 | hit correction : 1.20544
hit initial : 41.4514 | hit correction : 1.2054
hit initial : 65.587 | hit correction : 1.20475
hit initial : 61.9974 | hit correction : 1.20403
hit initial : 234.656 | hit correction : 1.204
hit initial : 225.018 | hit correction : 1.20394
hit initial : 76.1367 | hit correction : 1.20389
hit initial : 138.208 | hit correction : 1.19291
hit initial : 82.9823 | hit correction : 1.19291
hit initial : 257.777 | hit correction : 1.18986
hit initial : 568.806 | hit correction : 1.18981
hit initial : 559.091 | hit correction : 1.18942
hit initial : 101.006 | hit correction : 1.18885
hit initial : 185.439 | hit correction : 1.1888
hit initial : 389.624 | hit correction : 1.18838
hit initial : 421.904 | hit correction : 1.18739
hit initial : 371.343 | hit correction : 1.18642
hit initial : 182.9 | hit correction : 1.18567
 *** Total Charge : 5212.19
 Looking at view: 1 | Number of hits in view: 23
hit initial : 30.2976 | hit correction : 1.19172
hit initial : 59.1277 | hit correction : 1.19175
hit initial : 221.204 | hit correction : 1.19289
hit initial : 51.4527 | hit correction : 1.19294
hit initial : 44.54 | hit correction : 1.18453
hit initial : 45.6765 | hit correction : 1.18389
hit initial : 23.0751 | hit correction : 1.19485
hit initial : 44.158 | hit correction : 1.19483
hit initial : 135.509 | hit correction : 1.1959
hit initial : 46.7497 | hit correction : 1.20555
hit initial : 233.945 | hit correction : 1.20549
hit initial : 219.406 | hit correction : 1.20528
hit initial : 131.261 | hit correction : 1.20494
hit initial : 169.064 | hit correction : 1.20402
hit initial : 522.168 | hit correction : 1.20399
hit initial : 29.7361 | hit correction : 1.19594
hit initial : 338.816 | hit correction : 1.18991
hit initial : 140.735 | hit correction : 1.1899
hit initial : 201.81 | hit correction : 1.18957
hit initial : 326.423 | hit correction : 1.18887
hit initial : 49.9553 | hit correction : 1.18865
hit initial : 1354.77 | hit correction : 1.18724
hit initial : 523.266 | hit correction : 1.18667
hit initial : 95.3007 | hit correction : 1.18457
 *** Total Charge : 6010.26
 Looking at view: 2 | Number of hits in view: 24
06-Dec-2025 07:56:02 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0734832     0.0894125     0.112349      0.0873441    0.00995573       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000335763   0.00045045    0.000565996   0.000439265   6.80283e-05      10     
end_path:ana:AnalyzeEvents         0.0730066     0.0887824     0.111329      0.0866925    0.00982999       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19479 MB
  Peak resident set size usage (VmHWM): 1542.25 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:09:04 UTC       justIN version: 01.06.00