justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 47692.1@dunegpschedd01.fnal.gov

Jobsub ID47692.1@dunegpschedd01.fnal.gov
Workflow ID2501
Stage ID1
User namepgranger@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-17 17:55:29
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk
Last heartbeat2025-09-17 18:15:06
From worker nodeHostnamewn-snel-028.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-17 17:56:46
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6457551_121_20231207T141809Z_gen_g4_detsim_hitreco__20240510T060719Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_676_20231204T023227Z_gen_g4_detsim_hitreco__20240509T220430Z_reco2.root
JobscriptExit code0
Real time17m (1079s)
CPU time15m (921s = 85%)
Max RSS bytes2099273728 (2002 MiB)
Outputting started2025-09-17 18:14:46
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250917T175655Z.root
Finished2025-09-17 18:15:06
Saved logsjustin-logs:47692.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

---------------------------------------------------
source:RootInput(read)                                 0.0148189     0.0437848     0.902802      0.0295946     0.0898587       200    
reco:pandora:StandardPandora                           0.0951123      3.41716       87.389        1.59036       9.6536         200    
reco:pandoraTrack:LArPandoraTrackCreation             0.000112892   0.00772957     0.180104      0.0012576     0.0214101       200    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000158668    0.0130892     0.345219     0.00283574     0.0398398       200    
reco:pandoracalo:Calorimetry                          9.3195e-05     0.031475       1.21014     0.000876996    0.127883        200    
reco:pandorapid:Chi2ParticleID                        3.4495e-05    0.000136713    0.001042     0.000105402   0.000117221      200    
reco:cvnmap:CVNMapper                                 1.8685e-05     0.0086046     0.0361462     0.0100527    0.00672213       200    
reco:cvneva:CVNEvaluator                              1.4498e-05     0.218238       2.08365       0.28125      0.186313        200    
reco:energyrecnumu:EnergyReco                         0.000231604    0.0782261      2.56684      0.0154738     0.210998        200    
reco:energyrecnue:EnergyReco                          0.000121207   0.00269207     0.0625442    0.000473985   0.00742727       200    
reco:energyrecnc:EnergyReco                           0.00220763     0.0802167     0.330497      0.0947707     0.0587758       200    
reco:energyrecnumurange:EnergyReco                    0.00015991     0.0473577      2.37206     0.00234239     0.197222        200    
reco:energyrecnumumcs:EnergyReco                      0.000609484    0.0473195      2.37798     0.00308338      0.1967         200    
reco:energyrecnumumcsllhd:EnergyReco                  0.000491532    0.0469149      2.36571      0.0030371     0.195847        200    
reco:opdec:Deconvolution                               0.0525764     0.218318      0.445317      0.220161      0.0702912       200    
reco:ophitspe:OpHitFinderDeco                          0.127573      0.132651      0.155845      0.132417     0.00276059       200    
reco:opflash:OpFlashFinder                            0.000219271    0.0011511    0.00543077    0.00104827    0.000611519      200    
reco:opslicer:OpSlicer                                0.000204904    0.226056       0.75228      0.181824      0.178897        200    
reco:rns:RandomNumberSaver                            1.8845e-05    2.67247e-05   0.000401754   2.3624e-05    2.68559e-05      200    
reco:anglereconue:NuAngularReco                       0.000101481   0.00189128     0.0477079    0.000343088   0.00565391       200    
reco:anglereconumu:NuAngularReco                      7.3488e-05    0.00174456     0.0480119    0.000212459   0.00564991       200    
reco:anglereconuepfps:NuAngularReco                   0.000118513    0.0018459     0.0478278    0.000313628    0.0056461       200    
reco:anglereconumupfps:NuAngularReco                  0.00010645    0.00181105     0.0478846    0.000273764    0.0056947       200    
reco:anglerecohits:NuAngularReco                      0.000129272   0.00253046     0.0523372    0.000632006    0.0066421       200    
[art]:TriggerResults:TriggerResultInserter             9.888e-06    1.23173e-05   5.5424e-05    1.1943e-05    3.30562e-06      200    
end_path:cafmaker:CAFMaker                            0.00170592     0.0267692      0.74763     0.00437941     0.0809298       200    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3757.24 MB
  Peak resident set size usage (VmHWM): 2099.27 MB
====================================================================================================
lar exit code 0
=== Start last 100 lines of lar log file ===
minwire 2: 799
Used alternate method to get min and max wires due to vertex determination failure: 836, 1135
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max wires due to vertex determination failure: 605, 904
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max wires due to vertex determination failure: 652, 951
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.00498476, 0.00208287, 0.992932, 
Output 1: 0.746001, 0.244407, 0.00890504, 0.00068672, 
Output 2: 0.997927, 0.00197912, 8.72378e-05, 6.89516e-06, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2275!
Begin processing the 195th record. run: 50577113 subRun: 1 event: 67695 at 17-Sep-2025 20:14:19 CEST
Boundary wire vector sizes: 5036, 3473, 2781
minwire 0: 477
minwire 1: 667
minwire 2: 460
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.00115841, 0.987598, 0.0112438, 
Output 1: 0.356158, 0.438098, 0.123974, 0.0817702, 
Output 2: 0.210831, 0.432842, 0.254991, 0.101336, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3200!
Begin processing the 196th record. run: 50577113 subRun: 1 event: 67696 at 17-Sep-2025 20:14:30 CEST
Boundary wire vector sizes: 609, 809, 622
minwire 0: 825
minwire 1: 1585
minwire 2: 270
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.994791, 0.0003586, 0.00485079, 
Output 1: 0.0922837, 0.905399, 0.00222345, 9.34939e-05, 
Output 2: 0.903013, 0.0943288, 0.00260853, 5.01491e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2449!
Begin processing the 197th record. run: 50577113 subRun: 1 event: 67697 at 17-Sep-2025 20:14:33 CEST
Boundary wire vector sizes: 1361, 1060, 1432
minwire 0: 163
minwire 1: 1559
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.997532, 0.000497413, 0.0019702, 
Output 1: 0.056828, 0.928864, 0.0137245, 0.000583619, 
Output 2: 0.996959, 0.00293911, 9.78904e-05, 3.59084e-06, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2153!
Begin processing the 198th record. run: 50577113 subRun: 1 event: 67698 at 17-Sep-2025 20:14:37 CEST
Boundary wire vector sizes: 133, 103, 78
minwire 0: 1840
minwire 1: 834
minwire 2: 2036
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.0003634, 0.99867, 0.000966432, 
Output 1: 0.00343051, 0.992712, 0.00374299, 0.00011465, 
Output 2: 0.998298, 0.00165461, 4.55496e-05, 1.36968e-06, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1170!
Begin processing the 199th record. run: 50577113 subRun: 1 event: 67699 at 17-Sep-2025 20:14:40 CEST
Boundary wire vector sizes: 334, 169, 176
minwire 0: 2328
minwire 1: 656
minwire 2: 2443
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.997606, 0.000388812, 0.00200544, 
Output 1: 0.00259943, 0.0965507, 0.880709, 0.0201408, 
Output 2: 0.974368, 0.0245353, 0.0010829, 1.34208e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1547!
Begin processing the 200th record. run: 50577113 subRun: 1 event: 67700 at 17-Sep-2025 20:14:42 CEST

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 354!
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
processed files
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/59/9f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6457551_121_20231207T141809Z_gen_g4_detsim_hitreco__20240510T060719Z_reco2.root
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/3b/7c/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_676_20231204T023227Z_gen_g4_detsim_hitreco__20240509T220430Z_reco2.root
.:
total 11672
-rw-r--r--. 1 dune012 dune 4462932 Sep 17 20:14 flatcaf.root
-rw-r--r--. 1 dune012 dune 3622383 Sep 17 20:14 caf.root
-rw-r--r--. 1 dune012 dune 3622383 Sep 17 20:14 caf_fd_hd_atmo_2501_20250917T175655Z.root
-rw-r--r--. 1 dune012 dune  133715 Sep 17 20:14 caf_20250917T175655Z.log
-rw-r--r--. 1 dune012 dune   53385 Sep 17 20:14 jobscript.log
-rw-r--r--. 1 dune012 dune     373 Sep 17 20:14 caf_20250917T175655Z.file
-rw-r--r--. 1 dune012 dune     373 Sep 17 20:14 caf_20250917T175655Z.pfns
-rw-r--r--. 1 dune012 dune     373 Sep 17 19:56 file.list
-rw-r--r--. 1 dune012 dune     373 Sep 17 20:14 justin-processed-pfns.txt
-rw-r--r--. 1 dune012 dune     275 Sep 17 19:56 all-input-dids.txt
-rw-r--r--. 1 dune012 dune     275 Sep 17 20:14 caf_20250917T175655Z.did
-rw-r--r--. 1 dune012 dune     275 Sep 17 19:56 did.list
-rw-r--r--. 1 dune012 dune       0 Sep 17 19:57 debugprod.log
justIN time: 2025-09-18 21:14:39 UTC       justIN version: 01.05.00