justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 40931.1@dunegpschedd02.fnal.gov

Jobsub ID40931.1@dunegpschedd02.fnal.gov
Workflow ID2501
Stage ID1
User namepgranger@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-17 11:09:07
SiteBR_CBPF
EntryDUNE_BR_CBPF_ce04
Last heartbeat2025-09-17 12:14:45
From worker nodeHostnamewn120
cpuinfoAMD EPYC 7713P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-17 11:11:06
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207207_296_20231120T133410Z_gen_g4_detsim_hitreco__20240503T061703Z_reco2.root
JobscriptExit code0
Real time50m (3031s)
CPU time14m (840s = 27%)
Max RSS bytes1948921856 (1858 MiB)
Outputting started2025-09-17 12:01:38
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250917T111122Z.root
Finished2025-09-17 12:14:45
Saved logsjustin-logs:40931.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Median          RMS         nEvts   
========================================================================================================================================
Full event                                              4.32949       8.82769       79.0549       7.65538       6.64815        200    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                  0.16527      0.248758      0.340157      0.171449      0.082373        200    
reco:pandora:StandardPandora                            1.00129       3.92313       69.6843       2.95272       5.87131        200    
reco:pandoraTrack:LArPandoraTrackCreation             0.000131074   0.00624622     0.0726616    0.00228335     0.0105155       200    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000180906    0.0154044     0.162804     0.00473728     0.027491        200    
reco:pandoracalo:Calorimetry                          0.000116414    0.0139558     0.417791     0.00166967     0.0442078       200    
reco:pandorapid:Chi2ParticleID                        4.1281e-05    0.000215777   0.00249727    0.000181716   0.000199291      200    
reco:cvnmap:CVNMapper                                 2.1971e-05     0.0393217     0.202449      0.0367765     0.0351174       200    
reco:cvneva:CVNEvaluator                              1.7921e-05     0.398116       4.20672      0.472433      0.353733        200    
reco:energyrecnumu:EnergyReco                         0.000269888     0.27933       1.37722      0.0178631     0.426504        200    
reco:energyrecnue:EnergyReco                          0.000128324   0.00216395     0.0186085    0.000844725   0.00344916       200    
reco:energyrecnc:EnergyReco                            0.0017623     0.924802       6.9288       0.998978      0.730965        200    
reco:energyrecnumurange:EnergyReco                    0.00031964     0.0314765     0.954877     0.00367262     0.102774        200    
reco:energyrecnumumcs:EnergyReco                      0.000776742    0.0322561     0.991579     0.00425531     0.104746        200    
reco:energyrecnumumcsllhd:EnergyReco                  0.000583358    0.0307416     0.822005      0.0042686     0.0963762       200    
reco:opdec:Deconvolution                               0.513844       1.05097       3.03175      0.991122      0.369707        200    
reco:ophitspe:OpHitFinderDeco                           1.47947       1.49298       2.01916       1.48886      0.0378356       200    
reco:opflash:OpFlashFinder                            0.00030836    0.00174341    0.00510332    0.00169687    0.000760564      200    
reco:opslicer:OpSlicer                                6.7862e-05     0.302887       1.05785      0.223289      0.250488        200    
reco:rns:RandomNumberSaver                            2.7191e-05    5.37366e-05   0.000538144   4.9517e-05    3.74498e-05      200    
reco:anglereconue:NuAngularReco                       0.000228637   0.00135702     0.0127666    0.000623548   0.00213913       200    
reco:anglereconumu:NuAngularReco                      9.0403e-05    0.00105023     0.0136141    0.000298624   0.00211802       200    
reco:anglereconuepfps:NuAngularReco                   0.000144264   0.00121059     0.0121819    0.000447024   0.00213606       200    
reco:anglereconumupfps:NuAngularReco                  0.000118914   0.00113738     0.012523     0.000355566   0.00213432       200    
reco:anglerecohits:NuAngularReco                      0.000185996   0.00184596     0.0147143    0.000935543    0.0025066       200    
[art]:TriggerResults:TriggerResultInserter             1.02e-05     1.98605e-05   7.5222e-05    1.8736e-05    8.13833e-06      200    
end_path:cafmaker:CAFMaker                             0.0021899     0.0244709      1.4919      0.00725826     0.107444        200    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3654.89 MB
  Peak resident set size usage (VmHWM): 1948.92 MB
====================================================================================================
lar exit code 0
=== Start last 100 lines of lar log file ===
Boundary wire vector sizes: 376, 411, 292
minwire 0: 951
minwire 1: 1531
minwire 2: 984
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.00374801, 0.985687, 0.010565, 
Output 1: 0.242405, 0.628417, 0.122965, 0.00621289, 
Output 2: 0.767754, 0.22355, 0.00845858, 0.000236598, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1887!
Begin processing the 195th record. run: 6207207 subRun: 1 event: 59395 at 17-Sep-2025 09:00:12 -03
Boundary wire vector sizes: 54, 81, 74
minwire 0: 2736
minwire 1: 524
minwire 2: 2727
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.984584, 0.000649636, 0.0147664, 
Output 1: 0.0221001, 0.975552, 0.00227296, 7.53158e-05, 
Output 2: 0.975157, 0.0243337, 0.000499669, 9.63934e-06, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 998!
Begin processing the 196th record. run: 6207207 subRun: 1 event: 59396 at 17-Sep-2025 09:00:26 -03
Boundary wire vector sizes: 615, 706, 544
minwire 0: 1308
minwire 1: 570
minwire 2: 1312
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.000291578, 0.998757, 0.000951296, 
Output 1: 0.00383641, 0.992165, 0.00387838, 0.000120086, 
Output 2: 0.998365, 0.00159189, 4.14891e-05, 1.21735e-06, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2761!
Begin processing the 197th record. run: 6207207 subRun: 1 event: 59397 at 17-Sep-2025 09:00:42 -03
Boundary wire vector sizes: 1441, 1695, 1717
minwire 0: 50
minwire 1: 1214
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.990568, 0.000342807, 0.00908898, 
Output 1: 0.825539, 0.140726, 0.0218066, 0.0119284, 
Output 2: 0.333612, 0.592344, 0.0647396, 0.00930417, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2011!
Begin processing the 198th record. run: 6207207 subRun: 1 event: 59398 at 17-Sep-2025 09:00:58 -03
Boundary wire vector sizes: 2255, 2444, 1209
minwire 0: 937
minwire 1: 1185
minwire 2: 970
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.996426, 0.000597726, 0.00297602, 
Output 1: 0.505737, 0.485853, 0.00585245, 0.00255754, 
Output 2: 0.180768, 0.736287, 0.075702, 0.00724369, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3320!
Begin processing the 199th record. run: 6207207 subRun: 1 event: 59399 at 17-Sep-2025 09:01:16 -03
Boundary wire vector sizes: 109, 127, 81
minwire 0: 2331
minwire 1: 53
minwire 2: 2488
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299
Classifier summary: 
Output 0: 0.0215259, 0.00290601, 0.975568, 
Output 1: 0.75136, 0.234855, 0.0129485, 0.000836959, 
Output 2: 0.0587174, 0.934239, 0.00699744, 4.6589e-05, 


Running Ophitfinder with InputDigiType = 'recob'
Found hits: 809!
Begin processing the 200th record. run: 6207207 subRun: 1 event: 59400 at 17-Sep-2025 09:01:27 -03

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 306!
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
processed files
root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/37/92/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207207_296_20231120T133410Z_gen_g4_detsim_hitreco__20240503T061703Z_reco2.root
.:
total 7912
-rw-r--r-- 1 nobody nobody 3054418 Sep 17 09:01 flatcaf.root
-rw-r--r-- 1 nobody nobody 2413564 Sep 17 09:01 caf.root
-rw-r--r-- 1 nobody nobody 2413564 Sep 17 09:01 caf_fd_hd_atmo_2501_20250917T111122Z.root
-rw-r--r-- 1 nobody nobody  132806 Sep 17 09:01 caf_20250917T111122Z.log
-rw-r--r-- 1 nobody nobody   45271 Sep 17 09:01 jobscript.log
-rw-r--r-- 1 nobody nobody     200 Sep 17 09:01 caf_20250917T111122Z.file
-rw-r--r-- 1 nobody nobody     200 Sep 17 09:01 caf_20250917T111122Z.pfns
-rw-r--r-- 1 nobody nobody     200 Sep 17 08:11 file.list
-rw-r--r-- 1 nobody nobody     200 Sep 17 09:01 justin-processed-pfns.txt
-rw-r--r-- 1 nobody nobody     137 Sep 17 08:11 all-input-dids.txt
-rw-r--r-- 1 nobody nobody     137 Sep 17 09:01 caf_20250917T111122Z.did
-rw-r--r-- 1 nobody nobody     137 Sep 17 08:11 did.list
-rw-r--r-- 1 nobody nobody       0 Sep 17 08:11 debugprod.log
justIN time: 2025-09-18 21:54:09 UTC       justIN version: 01.05.00