Jobsub ID 39985.23@dunegpschedd02.fnal.gov
| Jobsub ID | 39985.23@dunegpschedd02.fnal.gov | |
| Workflow ID | 2501 | |
| Stage ID | 1 | |
| User name | pgranger@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2025-09-15 12:21:41 | |
| Site | US_UCSD | |
| Entry | CMSHTPC_T2_US_UCSD_gw6 | |
| Last heartbeat | 2025-09-15 13:25:40 | |
| From worker node | Hostname | mh-7763-12.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7763 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-15 12:23:02 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_703_20231208T054026Z_gen_g4_detsim_hitreco__20240510T065517Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419766_386_20231203T180537Z_gen_g4_detsim_hitreco__20240509T214944Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_771_20231204T045535Z_gen_g4_detsim_hitreco__20240509T210806Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 1h (3732s) | |
| CPU time | 21m (1297s = 34%) | |
| Max RSS bytes | 1780400128 (1697 MiB) | |
| Outputting started | 2025-09-15 13:25:16 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/001/caf_fd_hd_atmo_2501_20250915T122403Z.root | |
| Finished | 2025-09-15 13:25:40 | |
| Saved logs | justin-logs:39985.23-dunegpschedd02.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
------------- source:RootInput(read) 0.153126 0.263915 1.04803 0.29254 0.0941224 300 reco:pandora:StandardPandora 0.930308 3.79264 175.617 2.41019 11.0296 300 reco:pandoraTrack:LArPandoraTrackCreation 0.000151088 0.00674053 0.156151 0.00155237 0.0178376 300 reco:pandoraShower:LArPandoraModularShowerCreation 0.000199247 0.0158714 0.424744 0.00349032 0.0386985 300 reco:pandoracalo:Calorimetry 0.000118989 0.0229468 0.926313 0.00125449 0.100073 300 reco:pandorapid:Chi2ParticleID 3.569e-05 0.000206429 0.00187766 0.000167223 0.000172132 300 reco:cvnmap:CVNMapper 2.572e-05 0.0113352 0.0614811 0.0100209 0.0106878 300 reco:cvneva:CVNEvaluator 2.137e-05 0.370761 4.03263 0.500205 0.31604 300 reco:energyrecnumu:EnergyReco 0.000296306 0.272715 1.54133 0.0209445 0.380789 300 reco:energyrecnue:EnergyReco 0.000160408 0.00263843 0.0543744 0.000748622 0.0061801 300 reco:energyrecnc:EnergyReco 0.00178661 0.598564 2.02923 0.640862 0.43065 300 reco:energyrecnumurange:EnergyReco 0.000392106 0.0432244 1.25119 0.00345858 0.150282 300 reco:energyrecnumumcs:EnergyReco 0.000824021 0.0448759 1.31934 0.00410565 0.156549 300 reco:energyrecnumumcsllhd:EnergyReco 0.000594263 0.0448956 1.38512 0.00391861 0.158572 300 reco:opdec:Deconvolution 0.468932 0.849547 1.78761 0.825707 0.216425 300 reco:ophitspe:OpHitFinderDeco 1.28481 1.3867 1.77353 1.37879 0.0503977 300 reco:opflash:OpFlashFinder 0.000192668 0.00176796 0.00826775 0.00167188 0.000934646 300 reco:opslicer:OpSlicer 5.154e-05 0.302935 1.29712 0.248315 0.251667 300 reco:rns:RandomNumberSaver 2.268e-05 6.73455e-05 0.000618993 6.18045e-05 3.78614e-05 300 reco:anglereconue:NuAngularReco 0.000184438 0.0016604 0.0391284 0.000510849 0.00436799 300 reco:anglereconumu:NuAngularReco 9.7559e-05 0.00135129 0.0374968 0.000285792 0.00412037 300 reco:anglereconuepfps:NuAngularReco 0.000140908 0.0015166 0.038011 0.000412425 0.00422776 300 reco:anglereconumupfps:NuAngularReco 0.000113959 0.00146129 0.0366819 0.000352736 0.00426303 300 reco:anglerecohits:NuAngularReco 0.000129579 0.00227246 0.0436876 0.000853465 0.00512439 300 [art]:TriggerResults:TriggerResultInserter 1.03e-05 2.03923e-05 0.000352456 1.6974e-05 2.17538e-05 300 end_path:cafmaker:CAFMaker 0.00148142 0.0705953 14.0737 0.00809263 0.812311 300 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3650.49 MB Peak resident set size usage (VmHWM): 1780.4 MB ==================================================================================================== lar exit code 0 === Start last 100 lines of lar log file === Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.000610975, 0.993129, 0.00625978, Output 1: 0.0039779, 0.991033, 0.00484608, 0.000143168, Output 2: 0.99737, 0.00255285, 7.44711e-05, 2.89819e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1300! Begin processing the 294th record. run: 50579427 subRun: 1 event: 77194 at 15-Sep-2025 06:23:45 PDT Boundary wire vector sizes: 3200, 4088, 2415 minwire 0: 1332 minwire 1: 921 minwire 2: 1127 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00392845, 0.988812, 0.00725968, Output 1: 0.0432108, 0.375142, 0.42034, 0.161307, Output 2: 0.0614203, 0.360379, 0.460833, 0.117368, Running Ophitfinder with InputDigiType = 'recob' Found hits: 3384! Begin processing the 295th record. run: 50579427 subRun: 1 event: 77195 at 15-Sep-2025 06:24:17 PDT Boundary wire vector sizes: 654, 347, 476 minwire 0: 650 minwire 1: 1621 minwire 2: 485 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.996976, 0.000369955, 0.00265359, Output 1: 0.986445, 0.0129463, 0.000329748, 0.000279301, Output 2: 0.998411, 0.00151884, 5.18857e-05, 1.84894e-05, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2757! Begin processing the 296th record. run: 50579427 subRun: 1 event: 77196 at 15-Sep-2025 06:24:29 PDT Running Ophitfinder with InputDigiType = 'recob' Found hits: 1224! Begin processing the 297th record. run: 50579427 subRun: 1 event: 77197 at 15-Sep-2025 06:24:37 PDT Boundary wire vector sizes: 308, 202, 235 minwire 0: 1745 minwire 1: 719 minwire 2: 1655 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00347334, 0.0446565, 0.95187, Output 1: 0.956069, 0.0427568, 0.00105355, 0.000120404, Output 2: 0.992644, 0.00721234, 0.000129091, 1.40808e-05, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1745! Begin processing the 298th record. run: 50579427 subRun: 1 event: 77198 at 15-Sep-2025 06:24:47 PDT Running Ophitfinder with InputDigiType = 'recob' Found hits: 516! Begin processing the 299th record. run: 50579427 subRun: 1 event: 77199 at 15-Sep-2025 06:24:54 PDT Boundary wire vector sizes: 135, 170, 89 minwire 0: 1500 minwire 1: 1889 minwire 2: 1143 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.994243, 0.000400658, 0.00535666, Output 1: 0.0176864, 0.76823, 0.210168, 0.00391497, Output 2: 0.990985, 0.0087388, 0.000271585, 4.75294e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2309! Begin processing the 300th record. run: 50579427 subRun: 1 event: 77200 at 15-Sep-2025 06:25:03 PDT Boundary wire vector sizes: 246, 217, 237 minwire 0: 1386 minwire 1: 1290 minwire 2: 845 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0118372, 0.00183686, 0.986326, Output 1: 0.037538, 0.207943, 0.45583, 0.298689, Output 2: 0.65106, 0.326787, 0.0213423, 0.000811602, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2584! Art has completed and will exit with status 0. === End last 100 lines of lar log file === processed files root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/a8/91/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_703_20231208T054026Z_gen_g4_detsim_hitreco__20240510T065517Z_reco2.root root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/cb/6a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419766_386_20231203T180537Z_gen_g4_detsim_hitreco__20240509T214944Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/9a/b2/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_771_20231204T045535Z_gen_g4_detsim_hitreco__20240509T210806Z_reco2.root .: total 13152 -rw-r--r-- 1 cuser cuser 4983086 Sep 15 06:25 flatcaf.root -rw-r--r-- 1 cuser cuser 4061279 Sep 15 06:25 caf.root -rw-r--r-- 1 cuser cuser 4061279 Sep 15 06:25 caf_fd_hd_atmo_2501_20250915T122403Z.root -rw-r--r-- 1 cuser cuser 188020 Sep 15 06:25 caf_20250915T122403Z.log -rw-r--r-- 1 cuser cuser 75237 Sep 15 06:25 jobscript.log -rw-r--r-- 1 cuser cuser 572 Sep 15 06:25 caf_20250915T122403Z.file -rw-r--r-- 1 cuser cuser 572 Sep 15 06:25 caf_20250915T122403Z.pfns -rw-r--r-- 1 cuser cuser 572 Sep 15 05:24 file.list -rw-r--r-- 1 cuser cuser 572 Sep 15 06:25 justin-processed-pfns.txt -rw-r--r-- 1 cuser cuser 413 Sep 15 05:24 all-input-dids.txt -rw-r--r-- 1 cuser cuser 413 Sep 15 06:25 caf_20250915T122403Z.did -rw-r--r-- 1 cuser cuser 413 Sep 15 05:24 did.list -rw-r--r-- 1 cuser cuser 0 Sep 15 05:24 debugprod.log