Jobsub ID 40363.7@dunegpschedd02.fnal.gov
| Jobsub ID | 40363.7@dunegpschedd02.fnal.gov | |
| Workflow ID | 2501 | |
| Stage ID | 1 | |
| User name | pgranger@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2025-09-16 08:14:42 | |
| Site | NL_SURFsara | |
| Entry | DUNE_SurfSARA_arc02 | |
| Last heartbeat | 2025-09-16 08:53:51 | |
| From worker node | Hostname | wn-la-19.gina.surf.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 129600 (36 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-16 08:16:07 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6457551_681_20231207T150554Z_gen_g4_detsim_hitreco__20240510T062159Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1793_304_20231027T175443Z_gen_g4_detsim_hitreco__20240503T040310Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_750_20231203T132606Z_gen_g4_detsim_hitreco__20240508T052429Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 36m (2208s) | |
| CPU time | 31m (1886s = 85%) | |
| Max RSS bytes | 2303148032 (2196 MiB) | |
| Outputting started | 2025-09-16 08:52:56 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/001/caf_fd_hd_atmo_2501_20250916T081622Z.root | |
| Finished | 2025-09-16 08:53:51 | |
| Saved logs | justin-logs:40363.7-dunegpschedd02.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
---------------------------------------------------------------------- source:RootInput(read) 0.0162445 0.0370834 0.148817 0.0387431 0.0140701 400 reco:pandora:StandardPandora 0.104117 3.45032 103.124 1.7828 8.39082 400 reco:pandoraTrack:LArPandoraTrackCreation 0.000132167 0.00970451 0.345094 0.00203659 0.0265934 400 reco:pandoraShower:LArPandoraModularShowerCreation 0.00018153 0.017833 0.258717 0.00382294 0.0369861 400 reco:pandoracalo:Calorimetry 0.000110525 0.034889 2.04252 0.00149663 0.150763 400 reco:pandorapid:Chi2ParticleID 3.7946e-05 0.000187371 0.00101245 0.000143278 0.000149113 400 reco:cvnmap:CVNMapper 2.3525e-05 0.00802065 0.0431052 0.00855008 0.0056938 400 reco:cvneva:CVNEvaluator 1.9429e-05 0.318916 2.34746 0.40509 0.203194 400 reco:energyrecnumu:EnergyReco 0.000297152 0.0766209 2.58976 0.0222105 0.186178 400 reco:energyrecnue:EnergyReco 0.000141712 0.00340612 0.127065 0.000737634 0.00983892 400 reco:energyrecnc:EnergyReco 0.00186456 0.0901486 1.19774 0.0882154 0.0862327 400 reco:energyrecnumurange:EnergyReco 0.000271255 0.0379523 2.13166 0.00244503 0.150663 400 reco:energyrecnumumcs:EnergyReco 0.000692592 0.0384822 2.00463 0.00295129 0.146864 400 reco:energyrecnumumcsllhd:EnergyReco 0.00052383 0.0389678 2.26848 0.0029247 0.155454 400 reco:opdec:Deconvolution 0.0563334 0.254044 1.24182 0.252901 0.0956037 400 reco:ophitspe:OpHitFinderDeco 0.14028 0.170776 0.221109 0.18029 0.0203459 400 reco:opflash:OpFlashFinder 0.000209492 0.00146423 0.00390457 0.00137465 0.000653698 400 reco:opslicer:OpSlicer 4.0841e-05 0.284001 1.05145 0.224525 0.234649 400 reco:rns:RandomNumberSaver 2.4224e-05 4.03426e-05 0.00039675 3.7651e-05 1.97945e-05 400 reco:anglereconue:NuAngularReco 0.000183554 0.00182949 0.0780003 0.000480025 0.00529896 400 reco:anglereconumu:NuAngularReco 6.4927e-05 0.00163538 0.0900056 0.000226903 0.00576572 400 reco:anglereconuepfps:NuAngularReco 0.000113549 0.00175594 0.0860658 0.00036641 0.0056222 400 reco:anglereconumupfps:NuAngularReco 8.8853e-05 0.00170855 0.0886412 0.00029894 0.0057342 400 reco:anglerecohits:NuAngularReco 8.1371e-05 0.00238231 0.0833815 0.000744684 0.00594565 400 [art]:TriggerResults:TriggerResultInserter 1.1368e-05 1.56771e-05 5.9989e-05 1.4151e-05 5.24584e-06 400 end_path:cafmaker:CAFMaker 0.00144717 0.0285523 2.42972 0.00515576 0.136029 400 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3972.01 MB Peak resident set size usage (VmHWM): 2303.15 MB ==================================================================================================== lar exit code 0 === Start last 100 lines of lar log file === Running Ophitfinder with InputDigiType = 'recob' Found hits: 463! Begin processing the 395th record. run: 50574832 subRun: 1 event: 75095 at 16-Sep-2025 10:52:32 CEST Boundary wire vector sizes: 156, 120, 128 minwire 0: 346 minwire 1: 2578 minwire 2: 29 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0132248, 0.0193806, 0.967395, Output 1: 0.609015, 0.384929, 0.00582524, 0.000230773, Output 2: 0.993157, 0.00668333, 0.000152812, 6.93484e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 959! Begin processing the 396th record. run: 50574832 subRun: 1 event: 75096 at 16-Sep-2025 10:52:35 CEST Boundary wire vector sizes: 1226, 1162, 1180 minwire 0: 668 minwire 1: 1905 minwire 2: 296 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.972167, 0.00192491, 0.0259079, Output 1: 0.919717, 0.0777071, 0.00234118, 0.000234429, Output 2: 0.0780473, 0.849159, 0.0697791, 0.00301412, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2657! Begin processing the 397th record. run: 50574832 subRun: 1 event: 75097 at 16-Sep-2025 10:52:40 CEST Boundary wire vector sizes: 218, 209, 127 minwire 0: 1135 minwire 1: 2235 minwire 2: 562 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0137726, 0.0107777, 0.97545, Output 1: 0.298615, 0.632749, 0.0636529, 0.00498331, Output 2: 0.990678, 0.00889276, 0.000406982, 2.25527e-05, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1996! Begin processing the 398th record. run: 50574832 subRun: 1 event: 75098 at 16-Sep-2025 10:52:43 CEST Boundary wire vector sizes: 264, 158, 229 minwire 0: 1830 minwire 1: 1231 minwire 2: 1716 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.947483, 0.0111487, 0.0413685, Output 1: 0.788162, 0.20783, 0.00383012, 0.000178196, Output 2: 0.205987, 0.778812, 0.01505, 0.000150649, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1994! Begin processing the 399th record. run: 50574832 subRun: 1 event: 75099 at 16-Sep-2025 10:52:47 CEST Boundary wire vector sizes: 33, 47, 43 minwire 0: 919 minwire 1: 2072 minwire 2: 699 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00327917, 0.00169341, 0.995027, Output 1: 0.108521, 0.88535, 0.0059828, 0.000146494, Output 2: 0.998161, 0.00175437, 8.08476e-05, 3.60851e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1391! Begin processing the 400th record. run: 50574832 subRun: 1 event: 75100 at 16-Sep-2025 10:52:50 CEST Boundary wire vector sizes: 706, 802, 748 minwire 0: 274 minwire 1: 2108 minwire 2: 0 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.942863, 0.0390215, 0.0181159, Output 1: 0.935703, 0.062948, 0.00126209, 8.68796e-05, Output 2: 0.12363, 0.831395, 0.0435566, 0.00141904, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1667! Art has completed and will exit with status 0. === End last 100 lines of lar log file === processed files root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/02/7d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6457551_681_20231207T150554Z_gen_g4_detsim_hitreco__20240510T062159Z_reco2.root root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/7a/db/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1793_304_20231027T175443Z_gen_g4_detsim_hitreco__20240503T040310Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/26/7d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_750_20231203T132606Z_gen_g4_detsim_hitreco__20240508T052429Z_reco2.root .: total 21788 -rw-r--r--. 1 dune003 dune 8224522 Sep 16 10:52 flatcaf.root -rw-r--r--. 1 dune003 dune 6828410 Sep 16 10:52 caf.root -rw-r--r--. 1 dune003 dune 6828410 Sep 16 10:52 caf_fd_hd_atmo_2501_20250916T081622Z.root -rw-r--r--. 1 dune003 dune 256563 Sep 16 10:52 caf_20250916T081622Z.log -rw-r--r--. 1 dune003 dune 106103 Sep 16 10:52 jobscript.log -rw-r--r--. 1 dune003 dune 576 Sep 16 10:52 caf_20250916T081622Z.file -rw-r--r--. 1 dune003 dune 576 Sep 16 10:52 caf_20250916T081622Z.pfns -rw-r--r--. 1 dune003 dune 576 Sep 16 10:16 file.list -rw-r--r--. 1 dune003 dune 576 Sep 16 10:52 justin-processed-pfns.txt -rw-r--r--. 1 dune003 dune 409 Sep 16 10:16 all-input-dids.txt -rw-r--r--. 1 dune003 dune 409 Sep 16 10:52 caf_20250916T081622Z.did -rw-r--r--. 1 dune003 dune 409 Sep 16 10:16 did.list -rw-r--r--. 1 dune003 dune 0 Sep 16 10:16 debugprod.log