justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 46859.6@dunegpschedd01.fnal.gov

Jobsub ID46859.6@dunegpschedd01.fnal.gov
Workflow ID2501
Stage ID1
User namepgranger@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-16 00:30:18
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_brug
Last heartbeat2025-09-16 01:23:30
From worker nodeHostnamewn-snel-023.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-16 00:30:58
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_287_20231204T001713Z_gen_g4_detsim_hitreco__20240509T204132Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74540126_317_20231207T050239Z_gen_g4_detsim_hitreco__20240510T052306Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74496296_294_20231201T212729Z_gen_g4_detsim_hitreco__20240508T045135Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50604274_262_20231207T004641Z_gen_g4_detsim_hitreco__20240510T044156Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258005_242_20231121T153754Z_gen_g4_detsim_hitreco__20240503T054258Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571149_1133_20231202T192620Z_gen_g4_detsim_hitreco__20240508T060206Z_reco2.root
JobscriptExit code0
Real time51m (3101s)
CPU time43m (2586s = 83%)
Max RSS bytes2156908544 (2056 MiB)
Outputting started2025-09-16 01:22:41
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/001/caf_fd_hd_atmo_2501_20250916T003107Z.root
Finished2025-09-16 01:23:30
Saved logsjustin-logs:46859.6-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

00243494     0.0218474       700    
reco:pandoracalo:Calorimetry                           7.991e-05     0.0215299      1.8685      0.000824008    0.102584        700    
reco:pandorapid:Chi2ParticleID                        2.9976e-05    0.000123354   0.00115922     9.355e-05    0.000102065      700    
reco:cvnmap:CVNMapper                                 1.8655e-05    0.00780319     0.0353573    0.00861779    0.00560088       700    
reco:cvneva:CVNEvaluator                              1.3415e-05     0.232541       1.56762      0.306484      0.148158        700    
reco:energyrecnumu:EnergyReco                         0.000215984    0.0639163      1.8827       0.0113074     0.139364        700    
reco:energyrecnue:EnergyReco                          0.000119524   0.00206576     0.0853604    0.000417752   0.00594231       700    
reco:energyrecnc:EnergyReco                           0.00188565     0.0868093     0.397876      0.0965992     0.0618345       700    
reco:energyrecnumurange:EnergyReco                    0.000173024    0.0317648      1.78267     0.00234597     0.123768        700    
reco:energyrecnumumcs:EnergyReco                      0.00045379     0.0320985      1.77271     0.00288859      0.12241        700    
reco:energyrecnumumcsllhd:EnergyReco                  0.000370814    0.0318105      1.80866     0.00277967     0.122706        700    
reco:opdec:Deconvolution                               0.0467085     0.234559      0.472076      0.235083      0.0695893       700    
reco:ophitspe:OpHitFinderDeco                          0.127563      0.141018       0.18339      0.134783      0.0161994       700    
reco:opflash:OpFlashFinder                            0.000140584    0.0012347    0.00784753     0.0011682    0.00058319       700    
reco:opslicer:OpSlicer                                5.2167e-05     0.234542      0.830003      0.191183       0.17932        700    
reco:rns:RandomNumberSaver                            1.7222e-05    2.75626e-05   0.000253855   2.90245e-05   9.81765e-06      700    
reco:anglereconue:NuAngularReco                       0.000109996   0.00146273     0.0691383    0.000354268   0.00450783       700    
reco:anglereconumu:NuAngularReco                      7.1925e-05    0.00130298     0.0699408    0.000195526   0.00450372       700    
reco:anglereconuepfps:NuAngularReco                   0.000111739   0.00139138     0.0688514    0.000298945   0.00447961       700    
reco:anglereconumupfps:NuAngularReco                  0.000103894   0.00136024     0.0706573    0.000257117   0.00453071       700    
reco:anglerecohits:NuAngularReco                      0.000110998   0.00190271     0.0738184    0.000623007   0.00497337       700    
[art]:TriggerResults:TriggerResultInserter             9.217e-06    1.19498e-05   4.1447e-05    1.1737e-05    1.83706e-06      700    
end_path:cafmaker:CAFMaker                            0.00139657     0.0190025     0.820743     0.00424783     0.058244        700    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3814.83 MB
  Peak resident set size usage (VmHWM): 2156.91 MB
====================================================================================================
lar exit code 0
=== Start last 100 lines of lar log file ===
Boundary wire vector sizes: 289, 306, 271
minwire 0: 1359
minwire 1: 341
minwire 2: 788
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.0265699, 0.0454909, 0.927939, 
Output 1: 0.276487, 0.703129, 0.018996, 0.00138782, 
Output 2: 0.0774338, 0.91274, 0.00975665, 6.92196e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2018!
Begin processing the 695th record. run: 50571149 subRun: 1 event: 113395 at 16-Sep-2025 03:22:20 CEST
Boundary wire vector sizes: 101, 90, 83
minwire 0: 903
minwire 1: 2936
minwire 2: 203
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.0111041, 0.956128, 0.0327684, 
Output 1: 0.0180454, 0.818775, 0.153593, 0.00958671, 
Output 2: 0.334847, 0.652082, 0.0129779, 9.24395e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1152!
Begin processing the 696th record. run: 50571149 subRun: 1 event: 113396 at 16-Sep-2025 03:22:23 CEST
Boundary wire vector sizes: 64, 42, 34
minwire 0: 953
minwire 1: 1562
minwire 2: 1054
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.985776, 0.00110334, 0.0131204, 
Output 1: 0.0241664, 0.373345, 0.573942, 0.0285471, 
Output 2: 0.952658, 0.0456231, 0.00168239, 3.6781e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1030!
Begin processing the 697th record. run: 50571149 subRun: 1 event: 113397 at 16-Sep-2025 03:22:26 CEST
Boundary wire vector sizes: 398, 623, 441
minwire 0: 1861
minwire 1: 1402
minwire 2: 1474
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.976603, 0.00515038, 0.0182462, 
Output 1: 0.40792, 0.577189, 0.0144742, 0.000417709, 
Output 2: 0.0753545, 0.796691, 0.124775, 0.00317952, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2424!
Begin processing the 698th record. run: 50571149 subRun: 1 event: 113398 at 16-Sep-2025 03:22:30 CEST

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1770!
Begin processing the 699th record. run: 50571149 subRun: 1 event: 113399 at 16-Sep-2025 03:22:33 CEST
Boundary wire vector sizes: 36, 88, 43
minwire 0: 2292
minwire 1: 515
minwire 2: 2403
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.995144, 0.000714218, 0.0041418, 
Output 1: 0.0881268, 0.907783, 0.00397872, 0.000111829, 
Output 2: 0.996542, 0.00339033, 6.61079e-05, 1.60397e-06, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 888!
Begin processing the 700th record. run: 50571149 subRun: 1 event: 113400 at 16-Sep-2025 03:22:36 CEST
Boundary wire vector sizes: 83, 91, 93
minwire 0: 783
minwire 1: 2039
minwire 2: 571
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.00781454, 0.00197042, 0.990215, 
Output 1: 0.0462381, 0.141792, 0.796532, 0.0154379, 
Output 2: 0.975033, 0.0234582, 0.00147743, 3.08724e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1402!
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
processed files
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/cd/8b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_287_20231204T001713Z_gen_g4_detsim_hitreco__20240509T204132Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/46/be/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74540126_317_20231207T050239Z_gen_g4_detsim_hitreco__20240510T052306Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/9c/d6/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74496296_294_20231201T212729Z_gen_g4_detsim_hitreco__20240508T045135Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/2d/6c/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50604274_262_20231207T004641Z_gen_g4_detsim_hitreco__20240510T044156Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/25/58/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258005_242_20231121T153754Z_gen_g4_detsim_hitreco__20240503T054258Z_reco2.root
root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/f0/b6/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571149_1133_20231202T192620Z_gen_g4_detsim_hitreco__20240508T060206Z_reco2.root
.:
total 33700
-rw-r--r--. 1 dune012 dune 12683983 Sep 16 03:22 flatcaf.root
-rw-r--r--. 1 dune012 dune 10590284 Sep 16 03:22 caf.root
-rw-r--r--. 1 dune012 dune 10590284 Sep 16 03:22 caf_fd_hd_atmo_2501_20250916T003107Z.root
-rw-r--r--. 1 dune012 dune   424833 Sep 16 03:22 caf_20250916T003107Z.log
-rw-r--r--. 1 dune012 dune   166590 Sep 16 03:22 jobscript.log
-rw-r--r--. 1 dune012 dune     1142 Sep 16 03:22 caf_20250916T003107Z.file
-rw-r--r--. 1 dune012 dune     1142 Sep 16 03:22 caf_20250916T003107Z.pfns
-rw-r--r--. 1 dune012 dune     1142 Sep 16 02:31 file.list
-rw-r--r--. 1 dune012 dune     1142 Sep 16 03:22 justin-processed-pfns.txt
-rw-r--r--. 1 dune012 dune      828 Sep 16 02:31 all-input-dids.txt
-rw-r--r--. 1 dune012 dune      828 Sep 16 03:22 caf_20250916T003107Z.did
-rw-r--r--. 1 dune012 dune      828 Sep 16 02:31 did.list
-rw-r--r--. 1 dune012 dune        0 Sep 16 02:31 debugprod.log
justIN time: 2025-09-18 16:07:13 UTC       justIN version: 01.05.00