justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 47404.87@dunegpschedd01.fnal.gov

Jobsub ID47404.87@dunegpschedd01.fnal.gov
Workflow ID2501
Stage ID1
User namepgranger@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-17 07:52:57
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep208
Last heartbeat2025-09-17 08:03:06
From worker nodeHostnameheplnc168.pp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-17 07:53:35
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6374820_377_20231201T084638Z_gen_g4_detsim_hitreco__20240507T203706Z_reco2.root
JobscriptExit code0
Real time7m (433s)
CPU time5m (316s = 72%)
Max RSS bytes1928159232 (1838 MiB)
Outputting started2025-09-17 08:00:50
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250917T075344Z.root
Finished2025-09-17 08:03:06
Saved logsjustin-logs:47404.87-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

=======================================================================
Full event                                              1.09836       2.90778       54.571        1.93071       6.16924        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00920913     0.0187084     0.0437295     0.0181041    0.00894018       100    
reco:pandora:StandardPandora                           0.897027       1.97051       49.4642       1.05752       5.55848        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000107091   0.00532283     0.129124     0.00101891     0.0178804       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000141386   0.00902687     0.184903      0.0024097     0.0213169       100    
reco:pandoracalo:Calorimetry                          8.9838e-05     0.0196711     0.934693     0.000774594    0.108468        100    
reco:pandorapid:Chi2ParticleID                        3.0367e-05    0.000130583   0.00107117    9.6291e-05    0.000134181      100    
reco:cvnmap:CVNMapper                                 1.7523e-05    0.00585321     0.0367486    0.00668568    0.00501153       100    
reco:cvneva:CVNEvaluator                              1.3776e-05      0.27479       1.66433      0.344226      0.220348        100    
reco:energyrecnumu:EnergyReco                         0.000235652    0.0392379     0.616862      0.012127      0.081606        100    
reco:energyrecnue:EnergyReco                          0.000126798   0.00232886     0.0602089    0.00053563    0.00769772       100    
reco:energyrecnc:EnergyReco                           0.00153576     0.0384915     0.161314      0.0457908     0.029985        100    
reco:energyrecnumurange:EnergyReco                    0.00022377     0.0199509     0.522419     0.00195849     0.0706874       100    
reco:energyrecnumumcs:EnergyReco                      0.000473679    0.0201939      0.47971     0.00314883     0.0674502       100    
reco:energyrecnumumcsllhd:EnergyReco                  0.000327795    0.0197983     0.472952     0.00317383     0.0668174       100    
reco:opdec:Deconvolution                               0.0464103     0.164341       0.32744      0.168284      0.061195        100    
reco:ophitspe:OpHitFinderDeco                          0.0780445     0.0831421     0.0929313     0.0826731    0.00308281       100    
reco:opflash:OpFlashFinder                            0.000255499   0.00116635    0.00544428    0.00100826    0.000756787      100    
reco:opslicer:OpSlicer                                0.000676839    0.192585      0.737382      0.149905      0.166711        100    
reco:rns:RandomNumberSaver                            1.7834e-05    3.40279e-05   0.000409348   2.7667e-05    3.86184e-05      100    
reco:anglereconue:NuAngularReco                        0.0001337    0.00122276     0.029491     0.000325671   0.00400278       100    
reco:anglereconumu:NuAngularReco                      6.5323e-05    0.00106001     0.028723     0.000188574   0.00402153       100    
reco:anglereconuepfps:NuAngularReco                   9.8595e-05    0.00115789     0.0286061    0.000261144   0.00396598       100    
reco:anglereconumupfps:NuAngularReco                  8.8056e-05    0.00110587     0.0286827    0.000230748   0.00396226       100    
reco:anglerecohits:NuAngularReco                      0.000283342   0.00160666     0.031688     0.000588574   0.00437221       100    
[art]:TriggerResults:TriggerResultInserter             9.177e-06    1.21777e-05   4.0105e-05    1.0645e-05    4.99775e-06      100    
end_path:cafmaker:CAFMaker                             0.0010488     0.0152099     0.373451     0.00358703     0.0486765       100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3650.28 MB
  Peak resident set size usage (VmHWM): 1928.16 MB
====================================================================================================
lar exit code 0
=== Start last 100 lines of lar log file ===
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.0164841, 0.955268, 0.0282477, 
Output 1: 0.203367, 0.305579, 0.179642, 0.311412, 
Output 2: 0.0242441, 0.0732817, 0.254893, 0.647581, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3265!
Begin processing the 94th record. run: 6374820 subRun: 1 event: 37794 at 17-Sep-2025 09:00:26 BST
Boundary wire vector sizes: 2193, 2862, 2211
minwire 0: 531
minwire 1: 1223
minwire 2: 587
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.382841, 0.412492, 0.204667, 
Output 1: 0.034783, 0.129604, 0.208175, 0.627438, 
Output 2: 0.137303, 0.348421, 0.300204, 0.214073, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2491!
Begin processing the 95th record. run: 6374820 subRun: 1 event: 37795 at 17-Sep-2025 09:00:31 BST
Boundary wire vector sizes: 2938, 1719, 1479
minwire 0: 2368
minwire 1: 155
minwire 2: 2169
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.0225443, 0.940877, 0.0365788, 
Output 1: 0.662205, 0.322316, 0.0141867, 0.00129206, 
Output 2: 0.149434, 0.717904, 0.12237, 0.0102919, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2449!
Begin processing the 96th record. run: 6374820 subRun: 1 event: 37796 at 17-Sep-2025 09:00:36 BST
Boundary wire vector sizes: 1710, 1794, 1662
minwire 0: 1467
minwire 1: 832
minwire 2: 1097
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.0168486, 0.722234, 0.260917, 
Output 1: 0.496904, 0.44893, 0.0413697, 0.0127962, 
Output 2: 0.100395, 0.258823, 0.358544, 0.282237, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3029!
Begin processing the 97th record. run: 6374820 subRun: 1 event: 37797 at 17-Sep-2025 09:00:40 BST
Boundary wire vector sizes: 551, 592, 628
minwire 0: 1714
minwire 1: 1361
minwire 2: 1279
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.996353, 0.000518959, 0.00312814, 
Output 1: 0.00614025, 0.988112, 0.0056109, 0.000136779, 
Output 2: 0.993198, 0.00667273, 0.000126622, 2.33232e-06, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2792!
Begin processing the 98th record. run: 6374820 subRun: 1 event: 37798 at 17-Sep-2025 09:00:43 BST

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 719!
Begin processing the 99th record. run: 6374820 subRun: 1 event: 37799 at 17-Sep-2025 09:00:44 BST

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1351!
Begin processing the 100th record. run: 6374820 subRun: 1 event: 37800 at 17-Sep-2025 09:00:46 BST
Boundary wire vector sizes: 570, 551, 502
minwire 0: 737
minwire 1: 914
minwire 2: 784
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.00372564, 0.945133, 0.0511415, 
Output 1: 0.0885683, 0.137678, 0.1852, 0.588553, 
Output 2: 0.142733, 0.414043, 0.283257, 0.159967, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2357!
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
processed files
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/23/e8/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6374820_377_20231201T084638Z_gen_g4_detsim_hitreco__20240507T203706Z_reco2.root
.:
total 4580
-rw-r--r-- 1 pltdune04 pltdune 1804324 Sep 17 09:00 flatcaf.root
-rw-r--r-- 1 pltdune04 pltdune 1369464 Sep 17 09:00 caf.root
-rw-r--r-- 1 pltdune04 pltdune 1369464 Sep 17 09:00 caf_fd_hd_atmo_2501_20250917T075344Z.root
-rw-r--r-- 1 pltdune04 pltdune   72182 Sep 17 09:00 caf_20250917T075344Z.log
-rw-r--r-- 1 pltdune04 pltdune   33357 Sep 17 09:00 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune     218 Sep 17 09:00 caf_20250917T075344Z.file
-rw-r--r-- 1 pltdune04 pltdune     218 Sep 17 09:00 caf_20250917T075344Z.pfns
-rw-r--r-- 1 pltdune04 pltdune     218 Sep 17 08:53 file.list
-rw-r--r-- 1 pltdune04 pltdune     218 Sep 17 09:00 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune04 pltdune     137 Sep 17 08:53 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune     137 Sep 17 09:00 caf_20250917T075344Z.did
-rw-r--r-- 1 pltdune04 pltdune     137 Sep 17 08:53 did.list
-rw-r--r-- 1 pltdune04 pltdune       0 Sep 17 08:53 debugprod.log
justIN time: 2025-09-18 23:45:55 UTC       justIN version: 01.05.00