justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 213366.1@dunegpschedd01.fnal.gov

Jobsub ID213366.1@dunegpschedd01.fnal.gov
Workflow ID2501
Stage ID1
User namepgranger@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-27 04:01:19
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce16-multicore
Last heartbeat2025-09-27 04:15:16
From worker nodeHostnametds440.pic.es
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-27 04:02:01
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6420853_296_20231204T033908Z_gen_g4_detsim_hitreco__20240509T204545Z_reco2.root
JobscriptExit code0
Real time12m (763s)
CPU time8m (508s = 66%)
Max RSS bytes1974448128 (1882 MiB)
Outputting started2025-09-27 04:14:45
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250927T040213Z.root
Finished2025-09-27 04:15:16
Saved logsjustin-logs:213366.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

=================================================================================================================
Full event                                              0.89292       5.42012       81.6619       3.60218       9.23123        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0371137     0.067445      0.102391      0.0611345     0.019104        100    
reco:pandora:StandardPandora                           0.227246       3.40451       77.5132       1.86885       8.42996        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000121971   0.00758205     0.140697     0.00179714     0.0185388       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000207343    0.0163539     0.139621     0.00404963     0.0276955       100    
reco:pandoracalo:Calorimetry                          0.000100781    0.0239912      0.73265     0.00147157     0.0917236       100    
reco:pandorapid:Chi2ParticleID                        3.7771e-05    0.000211745   0.00305189    0.000153527   0.000313075      100    
reco:cvnmap:CVNMapper                                  2.452e-05     0.010345      0.0549698     0.0114537    0.00854503       100    
reco:cvneva:CVNEvaluator                               1.759e-05     0.442483       4.3644       0.533049      0.462895        100    
reco:energyrecnumu:EnergyReco                         0.000337084    0.102683       1.33553      0.0410753      0.17169        100    
reco:energyrecnue:EnergyReco                          0.000191182   0.00288647     0.0524914     0.0009322     0.0065566       100    
reco:energyrecnc:EnergyReco                           0.00309538     0.116282      0.351679      0.159128      0.0891842       100    
reco:energyrecnumurange:EnergyReco                    0.000383604    0.0362554     0.900483     0.00354717     0.129898        100    
reco:energyrecnumumcs:EnergyReco                      0.000796758    0.0355996     0.833566     0.00400297     0.120584        100    
reco:energyrecnumumcsllhd:EnergyReco                  0.000680097    0.0362323      0.86681     0.00416967     0.123508        100    
reco:opdec:Deconvolution                               0.111237      0.344426      0.607116       0.34199      0.0971357       100    
reco:ophitspe:OpHitFinderDeco                          0.327136      0.335487      0.352779      0.334791     0.00421017       100    
reco:opflash:OpFlashFinder                            0.000142522   0.00155457    0.00829867    0.00144421    0.000942491      100    
reco:opslicer:OpSlicer                                4.5131e-05      0.30884       1.16976      0.223413      0.260274        100    
reco:rns:RandomNumberSaver                            2.2441e-05    4.10533e-05   0.000488256   3.40755e-05   4.57009e-05      100    
reco:anglereconue:NuAngularReco                       0.000219272   0.00173621     0.0371348    0.000459325   0.00455931       100    
reco:anglereconumu:NuAngularReco                      9.4231e-05    0.00157862     0.0371005    0.000274548   0.00458768       100    
reco:anglereconuepfps:NuAngularReco                   0.000141952   0.00171665     0.0369866    0.000405054   0.00456704       100    
reco:anglereconumupfps:NuAngularReco                  0.000129661    0.0016649     0.0378641    0.000389684   0.00463815       100    
reco:anglerecohits:NuAngularReco                      0.000111732   0.00253535      0.04214     0.000887779   0.00546418       100    
[art]:TriggerResults:TriggerResultInserter              1.1e-05     1.61767e-05   8.5571e-05    1.4835e-05    7.99674e-06      100    
end_path:cafmaker:CAFMaker                            0.00167054     0.116065       9.38636     0.00557077     0.933443        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3673.31 MB
  Peak resident set size usage (VmHWM): 1974.45 MB
====================================================================================================
lar exit code 0
=== Start last 100 lines of lar log file ===
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 875!
Begin processing the 95th record. run: 6420853 subRun: 1 event: 29695 at 27-Sep-2025 06:14:17 CEST
Boundary wire vector sizes: 54, 64, 38
minwire 0: 2543
minwire 1: 366
minwire 2: 2656
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max wires due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.00403601, 0.00194251, 0.994021, 
Output 1: 0.12201, 0.872756, 0.00508, 0.000153213, 
Output 2: 0.997459, 0.00243125, 0.000105052, 4.99936e-06, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1033!
Begin processing the 96th record. run: 6420853 subRun: 1 event: 29696 at 27-Sep-2025 06:14:21 CEST
Boundary wire vector sizes: 153, 219, 172
minwire 0: 844
minwire 1: 1777
minwire 2: 755
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.994174, 0.000679954, 0.00514577, 
Output 1: 0.00417931, 0.138593, 0.826674, 0.0305535, 
Output 2: 0.957155, 0.0409141, 0.0018967, 3.37635e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1576!
Begin processing the 97th record. run: 6420853 subRun: 1 event: 29697 at 27-Sep-2025 06:14:25 CEST
Boundary wire vector sizes: 249, 227, 205
minwire 0: 1103
minwire 1: 1097
minwire 2: 1323
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.296698, 0.202022, 0.50128, 
Output 1: 0.0405772, 0.938946, 0.0200055, 0.000471252, 
Output 2: 0.324376, 0.589962, 0.082927, 0.0027354, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1534!
Begin processing the 98th record. run: 6420853 subRun: 1 event: 29698 at 27-Sep-2025 06:14:30 CEST
Boundary wire vector sizes: 144, 127, 106
minwire 0: 2010
minwire 1: 344
minwire 2: 2215
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.0546478, 0.00598245, 0.93937, 
Output 1: 0.0435148, 0.29543, 0.575057, 0.0859989, 
Output 2: 0.0694289, 0.58425, 0.325165, 0.0211563, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1308!
Begin processing the 99th record. run: 6420853 subRun: 1 event: 29699 at 27-Sep-2025 06:14:34 CEST
Boundary wire vector sizes: 140, 190, 161
minwire 0: 1501
minwire 1: 904
minwire 2: 1666
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.996403, 0.000339339, 0.00325811, 
Output 1: 0.978725, 0.0211232, 0.000109923, 4.188e-05, 
Output 2: 0.998497, 0.00146484, 3.1753e-05, 6.87744e-06, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1249!
Begin processing the 100th record. run: 6420853 subRun: 1 event: 29700 at 27-Sep-2025 06:14:38 CEST
Boundary wire vector sizes: 356, 490, 443
minwire 0: 1811
minwire 1: 1207
minwire 2: 1430
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.00126384, 0.996178, 0.0025577, 
Output 1: 0.00722475, 0.0485332, 0.492012, 0.45223, 
Output 2: 0.985256, 0.0136197, 0.00101321, 0.000110576, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2720!
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
processed files
root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/0a/a1/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6420853_296_20231204T033908Z_gen_g4_detsim_hitreco__20240509T204545Z_reco2.root
.:
total 4668
-rw-r--r-- 1 dune001 dune 1830478 Sep 27 06:14 flatcaf.root
-rw-r--r-- 1 dune001 dune 1395539 Sep 27 06:14 caf.root
-rw-r--r-- 1 dune001 dune 1395539 Sep 27 06:14 caf_fd_hd_atmo_2501_20250927T040213Z.root
-rw-r--r-- 1 dune001 dune   75959 Sep 27 06:14 caf_20250927T040213Z.log
-rw-r--r-- 1 dune001 dune   36655 Sep 27 06:14 jobscript.log
-rw-r--r-- 1 dune001 dune     200 Sep 27 06:14 caf_20250927T040213Z.file
-rw-r--r-- 1 dune001 dune     200 Sep 27 06:14 caf_20250927T040213Z.pfns
-rw-r--r-- 1 dune001 dune     200 Sep 27 06:02 file.list
-rw-r--r-- 1 dune001 dune     200 Sep 27 06:14 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune     137 Sep 27 06:02 all-input-dids.txt
-rw-r--r-- 1 dune001 dune     137 Sep 27 06:14 caf_20250927T040213Z.did
-rw-r--r-- 1 dune001 dune     137 Sep 27 06:02 did.list
-rw-r--r-- 1 dune001 dune       0 Sep 27 06:02 debugprod.log
justIN time: 2025-11-05 09:42:48 UTC       justIN version: 01.05.01