justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 47384.44@dunegpschedd01.fnal.gov

Jobsub ID47384.44@dunegpschedd01.fnal.gov
Workflow ID2501
Stage ID1
User namepgranger@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-17 07:06:53
SiteUK_Bristol
EntryCMSHTPC_T2_UK_SGrid_Bristol_lcgce02
Last heartbeat2025-09-17 07:17:50
From worker nodeHostnamehd88.dice.priv
cpuinfoAMD EPYC 7713 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit259200 (72 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-17 07:08:08
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6452759_528_20231207T075249Z_gen_g4_detsim_hitreco__20240510T022705Z_reco2.root
JobscriptExit code0
Real time7m (475s)
CPU time5m (312s = 65%)
Max RSS bytes1945554944 (1855 MiB)
Outputting started2025-09-17 07:16:05
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250917T070818Z.root
Finished2025-09-17 07:17:50
Saved logsjustin-logs:47384.44-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.5054        3.42238       50.5027       2.35932       5.45755        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0236408      0.05489       0.4751       0.0465495     0.0501851       100    
reco:pandora:StandardPandora                            1.02387       2.05006       46.8843       1.13966       4.87923        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000102034   0.00428484     0.0575344    0.00110294    0.00833716       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.00014201     0.0316716      1.93712     0.00242585     0.193397        100    
reco:pandoracalo:Calorimetry                           8.927e-05     0.0112615     0.238664     0.000794463    0.0317556       100    
reco:pandorapid:Chi2ParticleID                         3.142e-05    0.000122308    0.0010011    9.18095e-05   0.000114996      100    
reco:cvnmap:CVNMapper                                 1.8335e-05     0.0799392      6.78173      0.0165117     0.673626        100    
reco:cvneva:CVNEvaluator                              1.6491e-05     0.249923       1.6065       0.329461      0.203799        100    
reco:energyrecnumu:EnergyReco                         0.000235158    0.0728227      1.01829      0.0174947      0.12515        100    
reco:energyrecnue:EnergyReco                          0.000117775   0.00154038     0.0198744    0.000479047   0.00280848       100    
reco:energyrecnc:EnergyReco                           0.00158977     0.116204      0.273555      0.143547      0.0768401       100    
reco:energyrecnumurange:EnergyReco                    0.000190423    0.0297403     0.865371     0.00176442     0.103314        100    
reco:energyrecnumumcs:EnergyReco                      0.000463303    0.0302326     0.858531     0.00206421     0.102583        100    
reco:energyrecnumumcsllhd:EnergyReco                  0.000322444    0.0302746     0.858331     0.00205884     0.102512        100    
reco:opdec:Deconvolution                               0.0822878     0.219587      0.373051      0.223376      0.057976        100    
reco:ophitspe:OpHitFinderDeco                          0.205056      0.232151       2.4208       0.210112      0.219978        100    
reco:opflash:OpFlashFinder                            0.000188269    0.0009778    0.00337584    0.000931249   0.000474542      100    
reco:opslicer:OpSlicer                                0.000364244    0.187343      0.593401      0.175364      0.143013        100    
reco:rns:RandomNumberSaver                            1.7483e-05    3.09715e-05   0.000352802   2.5078e-05    3.32715e-05      100    
reco:anglereconue:NuAngularReco                       0.000139226   0.000876347    0.0113744    0.000309334   0.00157808       100    
reco:anglereconumu:NuAngularReco                      6.3521e-05    0.000736256    0.0110077    0.00017584     0.0015508       100    
reco:anglereconuepfps:NuAngularReco                   9.6814e-05    0.000821663    0.0110518    0.000255101   0.00153953       100    
reco:anglereconumupfps:NuAngularReco                  8.5974e-05    0.000782637    0.0111954    0.000225674   0.00155196       100    
reco:anglerecohits:NuAngularReco                      0.000272669   0.00125722     0.0141989    0.000573939   0.00198545       100    
[art]:TriggerResults:TriggerResultInserter             8.887e-06    1.15725e-05   4.8102e-05    1.0254e-05    5.7394e-06       100    
end_path:cafmaker:CAFMaker                            0.00105016     0.0138937     0.233565     0.00321764     0.0315538       100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3651.85 MB
  Peak resident set size usage (VmHWM): 1945.55 MB
====================================================================================================
lar exit code 0
=== Start last 100 lines of lar log file ===
Boundary wire vector sizes: 135, 99, 95
minwire 0: 2285
minwire 1: 1260
minwire 2: 1910
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.00252666, 0.889244, 0.108229, 
Output 1: 0.885135, 0.112957, 0.00174129, 0.000166978, 
Output 2: 0.995263, 0.00459581, 0.000125733, 1.5803e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1556!
Begin processing the 92nd record. run: 6452759 subRun: 1 event: 52892 at 17-Sep-2025 07:15:35 UTC

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 362!
Begin processing the 93rd record. run: 6452759 subRun: 1 event: 52893 at 17-Sep-2025 07:15:37 UTC

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 222!
Begin processing the 94th record. run: 6452759 subRun: 1 event: 52894 at 17-Sep-2025 07:15:39 UTC

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 594!
Begin processing the 95th record. run: 6452759 subRun: 1 event: 52895 at 17-Sep-2025 07:15:41 UTC
Boundary wire vector sizes: 75, 94, 87
minwire 0: 1913
minwire 1: 1176
minwire 2: 1507
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.000229148, 0.998534, 0.00123695, 
Output 1: 0.751681, 0.247016, 0.00124774, 5.57554e-05, 
Output 2: 0.998595, 0.0013828, 2.14852e-05, 8.53639e-07, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1613!
Begin processing the 96th record. run: 6452759 subRun: 1 event: 52896 at 17-Sep-2025 07:15:44 UTC
Boundary wire vector sizes: 1204, 1396, 779
minwire 0: 112
minwire 1: 2278
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.129264, 0.764063, 0.106674, 
Output 1: 0.383262, 0.565581, 0.0412633, 0.00989319, 
Output 2: 0.195531, 0.569862, 0.19324, 0.0413668, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1635!
Begin processing the 97th record. run: 6452759 subRun: 1 event: 52897 at 17-Sep-2025 07:15:54 UTC

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 487!
Begin processing the 98th record. run: 6452759 subRun: 1 event: 52898 at 17-Sep-2025 07:15:55 UTC

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 800!
Begin processing the 99th record. run: 6452759 subRun: 1 event: 52899 at 17-Sep-2025 07:15:57 UTC
Boundary wire vector sizes: 523, 720, 627
minwire 0: 2542
minwire 1: 531
minwire 2: 2415
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.148077, 0.696252, 0.155671, 
Output 1: 0.983927, 0.014862, 0.000690497, 0.00052034, 
Output 2: 0.642589, 0.343165, 0.0126034, 0.00164337, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1688!
Begin processing the 100th record. run: 6452759 subRun: 1 event: 52900 at 17-Sep-2025 07:16:00 UTC
Boundary wire vector sizes: 197, 199, 183
minwire 0: 1188
minwire 1: 2258
minwire 2: 580
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.000338279, 0.997791, 0.0018704, 
Output 1: 0.772589, 0.222067, 0.00509972, 0.000244269, 
Output 2: 0.994081, 0.00583293, 8.3076e-05, 2.77589e-06, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1973!
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
processed files
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/dc/89/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6452759_528_20231207T075249Z_gen_g4_detsim_hitreco__20240510T022705Z_reco2.root
.:
total 4938
-rw-r--r-- 1 dnpil001 users 1951529 Sep 17 07:16 flatcaf.root
-rw-r--r-- 1 dnpil001 users 1498293 Sep 17 07:16 caf.root
-rw-r--r-- 1 dnpil001 users 1498293 Sep 17 07:16 caf_fd_hd_atmo_2501_20250917T070818Z.root
-rw-r--r-- 1 dnpil001 users   71717 Sep 17 07:16 caf_20250917T070818Z.log
-rw-r--r-- 1 dnpil001 users   30836 Sep 17 07:16 jobscript.log
-rw-r--r-- 1 dnpil001 users     186 Sep 17 07:16 caf_20250917T070818Z.file
-rw-r--r-- 1 dnpil001 users     186 Sep 17 07:16 caf_20250917T070818Z.pfns
-rw-r--r-- 1 dnpil001 users     186 Sep 17 07:08 file.list
-rw-r--r-- 1 dnpil001 users     186 Sep 17 07:16 justin-processed-pfns.txt
-rw-r--r-- 1 dnpil001 users     137 Sep 17 07:08 all-input-dids.txt
-rw-r--r-- 1 dnpil001 users     137 Sep 17 07:16 caf_20250917T070818Z.did
-rw-r--r-- 1 dnpil001 users     137 Sep 17 07:08 did.list
-rw-r--r-- 1 dnpil001 users       0 Sep 17 07:08 debugprod.log
justIN time: 2025-09-18 19:25:02 UTC       justIN version: 01.05.00