justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 257910.20@dunegpschedd02.fnal.gov

Jobsub ID257910.20@dunegpschedd02.fnal.gov
Workflow ID11024
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 11:23:41
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2025-12-06 08:14:24
From worker nodeHostnamedunegli-48727-0-cmswn5027.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-05 23:59:24
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T014300Z_gen_003154_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time8h (29685s)
CPU time8h (29205s = 98%)
Max RSS bytes3033759744 (2893 MiB)
Outputting started2025-12-06 08:14:10
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11024/1/001/analysisLowE_20251205T235926Z.root
Finished2025-12-06 08:14:24
Saved logsjustin-logs:257910.20-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.0778198, 0.211632, 0.670519, 0.0400299, 
Output 3: 0.937967, 0.0446676, 0.00772866, 0.00963706, 
Output 4: 0.396005, 0.538692, 0.0595548, 0.00574862, 
Output 5: 0.389515, 0.474092, 0.11582, 0.0205728, 
Output 6: 0.0269181, 0.0760725, 0.0841862, 0.812823, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 31540 at 06-Dec-2025 08:03:22 UTC
Boundary wire vector sizes: 6699, 6604, 6665
minwire 0: 44
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.11754, 
Output 1: 0.045585, 0.0263279, 0.123245, 0.804842, 
Output 2: 0.144365, 0.250611, 0.556538, 0.0484855, 
Output 3: 0.962133, 0.0281892, 0.00312842, 0.00654985, 
Output 4: 0.205815, 0.739275, 0.052029, 0.00288106, 
Output 5: 0.669799, 0.299203, 0.0259624, 0.00503568, 
Output 6: 0.0138985, 0.0471961, 0.0628762, 0.876029, 

06-Dec-2025 08:13:42 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 08:13:42 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/8f/92/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T014300Z_gen_003154_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              614.044       2937.38       6069.98       2414.38       2212.29        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00480625     0.0142926     0.0385704     0.0116818     0.0103605       10     
reco:pandora:StandardPandora                            613.057       2907.26       5995.85       2413.02       2179.11        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.015102      0.0900732     0.516178      0.036799      0.144829        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000751314   0.00602588     0.0201908    0.00143045    0.00745228       10     
reco:pandoracalo:Calorimetry                          0.000223624   0.00150684    0.00602971    0.000331623   0.00194089       10     
reco:pandorapid:Chi2ParticleID                        8.2406e-05    0.000603884   0.00317486    0.000124641   0.000951148      10     
reco:cvnmap:CVNMapper                                  0.0190787     0.0768714     0.246023      0.0522517     0.0696385       10     
reco:cvneva:CVNEvaluator                                0.67367       2.11471       11.7543      0.872208       3.24531        10     
reco:energyrecnumu:EnergyReco                         0.00312772      20.5264       73.3624     0.00913158      31.4871        10     
reco:energyrecnue:EnergyReco                          0.000755271   0.00460457     0.0222013    0.00104527    0.00650441       10     
reco:energyrecnc:EnergyReco                           0.00514915      6.87322       68.3596      0.0568285      20.4955        10     
[art]:TriggerResults:TriggerResultInserter            1.4127e-05    9.09543e-05   0.000499597   3.09685e-05   0.000141291      10     
end_path:out1:RootOutput                               6.602e-06    3.22871e-05   0.000162458   1.3215e-05    4.49252e-05      10     
end_path:out1:RootOutput(write)                        0.202514      0.409067       1.04283      0.250791      0.273479        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21749 MB
  Peak resident set size usage (VmHWM): 3033.76 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 36.6967 | hit correction : 1.02486
hit initial : 166.072 | hit correction : 1.02486
hit initial : 144.025 | hit correction : 1.02485
hit initial : 64.9423 | hit correction : 1.02438
hit initial : 34.6109 | hit correction : 1.02391
hit initial : 12.4369 | hit correction : 1.0239
hit initial : 65.3691 | hit correction : 1.02384
hit initial : 36.3215 | hit correction : 1.02343
hit initial : 53.9721 | hit correction : 1.02295
hit initial : 35.7875 | hit correction : 1.02295
hit initial : 103.851 | hit correction : 1.02294
hit initial : 124.193 | hit correction : 1.02182
hit initial : 215.843 | hit correction : 1.02176
hit initial : 97.4336 | hit correction : 1.02169
hit initial : 13.9947 | hit correction : 1.02074
hit initial : 121.613 | hit correction : 1.02071
hit initial : 61.2521 | hit correction : 1.02008
hit initial : 23.546 | hit correction : 1.01948
hit initial : 93.2615 | hit correction : 1.01948
hit initial : 67.6439 | hit correction : 1.01839
hit initial : 496.458 | hit correction : 1.01836
hit initial : 83.7085 | hit correction : 1.01757
hit initial : 180.689 | hit correction : 1.01674
 *** Total Charge : 3140.56
 Looking at view: 0 | Number of hits in view: 28
hit initial : 156.508 | hit correction : 1.03466
hit initial : 151.676 | hit correction : 1.03463
hit initial : 151.601 | hit correction : 1.02485
hit initial : 401.378 | hit correction : 1.02487
hit initial : 164.673 | hit correction : 1.02485
hit initial : 127.073 | hit correction : 1.02416
hit initial : 52.7104 | hit correction : 1.02386
hit initial : 64.8212 | hit correction : 1.02379
hit initial : 60.8865 | hit correction : 1.02295
hit initial : 76.6207 | hit correction : 1.02291
hit initial : 52.1188 | hit correction : 1.02293
hit initial : 46.4497 | hit correction : 1.02183
hit initial : 143.98 | hit correction : 1.02182
hit initial : 128.766 | hit correction : 1.02183
hit initial : 247.255 | hit correction : 1.02177
hit initial : 57.9555 | hit correction : 1.02078
hit initial : 419.634 | hit correction : 1.02053
hit initial : 526.295 | hit correction : 1.01963
hit initial : 57.2889 | hit correction : 1.01949
hit initial : 15.774 | hit correction : 1.01948
hit initial : 474.985 | hit correction : 1.01893
hit initial : 26.3946 | hit correction : 1.01842
hit initial : 477.59 | hit correction : 1.0182
hit initial : 63.1197 | hit correction : 1.01756
hit initial : 424.025 | hit correction : 1.01746
hit initial : 268.002 | hit correction : 1.01674
hit initial : 104.998 | hit correction : 1.01658
 *** Total Charge : 5048.15
 Looking at view: 1 | Number of hits in view: 27
hit initial : 44.2106 | hit correction : 1.02006
hit initial : 41.086 | hit correction : 1.01883
hit initial : 58.581 | hit correction : 1.03661
hit initial : 65.0746 | hit correction : 1.03663
hit initial : 223.42 | hit correction : 1.02497
hit initial : 201.389 | hit correction : 1.02492
hit initial : 227.583 | hit correction : 1.02468
hit initial : 199.379 | hit correction : 1.02472
hit initial : 52.1536 | hit correction : 1.02395
hit initial : 466.704 | hit correction : 1.02389
hit initial : 134.824 | hit correction : 1.02326
hit initial : 209.106 | hit correction : 1.02285
hit initial : 255.957 | hit correction : 1.0228
hit initial : 491.146 | hit correction : 1.02196
hit initial : 456.83 | hit correction : 1.02162
hit initial : 226.394 | hit correction : 1.02096
hit initial : 225.688 | hit correction : 1.02058
hit initial : 220.091 | hit correction : 1.02018
hit initial : 260.132 | hit correction : 1.0198
hit initial : 384.256 | hit correction : 1.0194
hit initial : 240.779 | hit correction : 1.01888
hit initial : 362.468 | hit correction : 1.01843
hit initial : 313.93 | hit correction : 1.01794
hit initial : 342.863 | hit correction : 1.01748
hit initial : 259.069 | hit correction : 1.01695
hit initial : 240.684 | hit correction : 1.01655
 *** Total Charge : 6335.61
 Looking at view: 2 | Number of hits in view: 26
06-Dec-2025 08:14:09 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0539896     0.0584191     0.0700191     0.057006     0.00507804       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000382264   0.000446674   0.000505627   0.000461034   4.3069e-05       10     
end_path:ana:AnalyzeEvents         0.053379      0.0577599     0.0694502     0.0563583    0.00502879       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19513.6 MB
  Peak resident set size usage (VmHWM): 1572.02 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:10:25 UTC       justIN version: 01.06.00