Jobsub ID 40626.82@dunegpschedd02.fnal.gov
| Jobsub ID | 40626.82@dunegpschedd02.fnal.gov | |
| Workflow ID | 2501 | |
| Stage ID | 1 | |
| User name | pgranger@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2025-09-16 21:50:24 | |
| Site | US_Wisconsin | |
| Entry | HCCHTPC_US_Wisconsin_osg01_rhel7 | |
| Last heartbeat | 2025-09-16 23:13:07 | |
| From worker node | Hostname | e2473 |
| cpuinfo | AMD EPYC 7452 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 82800 (23 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-16 21:51:17 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_465_20231122T080948Z_gen_g4_detsim_hitreco__20240503T060008Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6416859_137_20231203T072617Z_gen_g4_detsim_hitreco__20240509T203552Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6208838_310_20231122T053641Z_gen_g4_detsim_hitreco__20240507T182137Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74552530_176_20231207T114417Z_gen_g4_detsim_hitreco__20240510T054550Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 1h (4893s) | |
| CPU time | 35m (2111s = 43%) | |
| Max RSS bytes | 2123968512 (2025 MiB) | |
| Outputting started | 2025-09-16 23:12:51 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250916T215123Z.root | |
| Finished | 2025-09-16 23:13:07 | |
| Saved logs | justin-logs:40626.82-dunegpschedd02.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
600 reco:pandoraTrack:LArPandoraTrackCreation 0.000112952 0.00678477 0.320645 0.00130264 0.0237299 600 reco:pandoraShower:LArPandoraModularShowerCreation 0.00015959 0.0112657 0.307092 0.00255147 0.0268496 600 reco:pandoracalo:Calorimetry 9.0481e-05 0.0209513 1.81916 0.000910089 0.112812 600 reco:pandorapid:Chi2ParticleID 3.4575e-05 0.000149486 0.00221402 0.000112367 0.000146132 600 reco:cvnmap:CVNMapper 1.6181e-05 0.0111133 0.0585139 0.0123614 0.00914615 600 reco:cvneva:CVNEvaluator 1.6251e-05 0.27089 2.40779 0.348458 0.203496 600 reco:energyrecnumu:EnergyReco 0.000232618 0.219303 2.76126 0.0190149 0.30735 600 reco:energyrecnue:EnergyReco 0.000124474 0.00242334 0.104319 0.000633879 0.00771915 600 reco:energyrecnc:EnergyReco 0.0018747 0.46673 1.2839 0.565379 0.329892 600 reco:energyrecnumurange:EnergyReco 0.000222018 0.0293529 1.75419 0.00244957 0.122055 600 reco:energyrecnumumcs:EnergyReco 0.000529517 0.0295885 1.69085 0.00309078 0.119893 600 reco:energyrecnumumcsllhd:EnergyReco 0.000338056 0.0293789 1.62747 0.0031452 0.11973 600 reco:opdec:Deconvolution 0.328047 0.57255 1.1844 0.578501 0.112669 600 reco:ophitspe:OpHitFinderDeco 0.972365 0.983185 1.01956 0.979605 0.00936075 600 reco:opflash:OpFlashFinder 0.000149612 0.0012932 0.00635205 0.00124234 0.000611198 600 reco:opslicer:OpSlicer 4.2259e-05 0.210054 0.797794 0.168404 0.176311 600 reco:rns:RandomNumberSaver 1.8525e-05 3.98761e-05 0.000451791 3.42295e-05 2.24398e-05 600 reco:anglereconue:NuAngularReco 0.000144272 0.00150739 0.0640608 0.000402849 0.00512176 600 reco:anglereconumu:NuAngularReco 6.343e-05 0.0013147 0.062857 0.000188049 0.0051304 600 reco:anglereconuepfps:NuAngularReco 0.000107213 0.00141271 0.0631694 0.000294705 0.00508538 600 reco:anglereconumupfps:NuAngularReco 9.0922e-05 0.00138068 0.0639216 0.000245949 0.00515164 600 reco:anglerecohits:NuAngularReco 7.2436e-05 0.00196661 0.0676304 0.000685551 0.00563677 600 [art]:TriggerResults:TriggerResultInserter 8.085e-06 1.30562e-05 7.5793e-05 1.1987e-05 4.71734e-06 600 end_path:cafmaker:CAFMaker 0.00141938 0.0206705 0.901741 0.00549901 0.0675471 600 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3792.4 MB Peak resident set size usage (VmHWM): 2123.97 MB ==================================================================================================== lar exit code 0 === Start last 100 lines of lar log file === Running Ophitfinder with InputDigiType = 'recob' Found hits: 257! Begin processing the 592nd record. run: 74552530 subRun: 1 event: 17692 at 16-Sep-2025 18:11:47 CDT Boundary wire vector sizes: 122, 95, 100 minwire 0: 1192 minwire 1: 672 minwire 2: 1385 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0660923, 0.106432, 0.827476, Output 1: 0.152754, 0.518489, 0.275286, 0.053471, Output 2: 0.583109, 0.398658, 0.0177214, 0.00051153, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1581! Begin processing the 593rd record. run: 74552530 subRun: 1 event: 17693 at 16-Sep-2025 18:11:54 CDT Running Ophitfinder with InputDigiType = 'recob' Found hits: 737! Begin processing the 594th record. run: 74552530 subRun: 1 event: 17694 at 16-Sep-2025 18:12:00 CDT Boundary wire vector sizes: 74, 72, 61 minwire 0: 977 minwire 1: 1404 minwire 2: 632 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max wires due to vertex determination failure: 640, 939 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00333355, 0.00188661, 0.99478, Output 1: 0.0691481, 0.921446, 0.00896706, 0.000438971, Output 2: 0.997504, 0.00238109, 0.000108927, 6.38781e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2334! Begin processing the 595th record. run: 74552530 subRun: 1 event: 17695 at 16-Sep-2025 18:12:07 CDT Running Ophitfinder with InputDigiType = 'recob' Found hits: 219! Begin processing the 596th record. run: 74552530 subRun: 1 event: 17696 at 16-Sep-2025 18:12:12 CDT Boundary wire vector sizes: 430, 425, 123 minwire 0: 392 minwire 1: 2225 minwire 2: 307 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.997385, 0.000633931, 0.00198064, Output 1: 0.00444453, 0.986948, 0.00840266, 0.000204896, Output 2: 0.997087, 0.00283609, 7.5146e-05, 1.59633e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1570! Begin processing the 597th record. run: 74552530 subRun: 1 event: 17697 at 16-Sep-2025 18:12:19 CDT Boundary wire vector sizes: 1040, 980, 797 minwire 0: 455 minwire 1: 1437 minwire 2: 36 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0264027, 0.140955, 0.832642, Output 1: 0.0302527, 0.071921, 0.105085, 0.792742, Output 2: 0.12468, 0.254519, 0.317162, 0.30364, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2690! Begin processing the 598th record. run: 74552530 subRun: 1 event: 17698 at 16-Sep-2025 18:12:27 CDT Running Ophitfinder with InputDigiType = 'recob' Found hits: 194! Begin processing the 599th record. run: 74552530 subRun: 1 event: 17699 at 16-Sep-2025 18:12:33 CDT Boundary wire vector sizes: 2436, 2454, 1316 minwire 0: 1807 minwire 1: 536 minwire 2: 2164 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.668181, 0.24283, 0.0889892, Output 1: 0.37043, 0.537793, 0.0658867, 0.02589, Output 2: 0.112828, 0.354926, 0.325784, 0.206463, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2583! Begin processing the 600th record. run: 74552530 subRun: 1 event: 17700 at 16-Sep-2025 18:12:43 CDT Running Ophitfinder with InputDigiType = 'recob' Found hits: 889! Art has completed and will exit with status 0. === End last 100 lines of lar log file === processed files root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/c5/39/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_465_20231122T080948Z_gen_g4_detsim_hitreco__20240503T060008Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/13/e6/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6416859_137_20231203T072617Z_gen_g4_detsim_hitreco__20240509T203552Z_reco2.root root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/80/2f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6208838_310_20231122T053641Z_gen_g4_detsim_hitreco__20240507T182137Z_reco2.root root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/2d/a2/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74552530_176_20231207T114417Z_gen_g4_detsim_hitreco__20240510T054550Z_reco2.root .: total 28952 -rw-r--r-- 1 slot1_2 slot1_2 10923945 Sep 16 18:12 flatcaf.root -rw-r--r-- 1 slot1_2 slot1_2 9093454 Sep 16 18:12 caf.root -rw-r--r-- 1 slot1_2 slot1_2 9093454 Sep 16 18:12 caf_fd_hd_atmo_2501_20250916T215123Z.root -rw-r--r-- 1 slot1_2 slot1_2 353510 Sep 16 18:12 caf_20250916T215123Z.log -rw-r--r-- 1 slot1_2 slot1_2 126563 Sep 16 18:12 jobscript.log -rw-r--r-- 1 slot1_2 slot1_2 838 Sep 16 18:12 caf_20250916T215123Z.file -rw-r--r-- 1 slot1_2 slot1_2 838 Sep 16 18:12 caf_20250916T215123Z.pfns -rw-r--r-- 1 slot1_2 slot1_2 838 Sep 16 16:51 file.list -rw-r--r-- 1 slot1_2 slot1_2 838 Sep 16 18:12 justin-processed-pfns.txt -rw-r--r-- 1 slot1_2 slot1_2 550 Sep 16 16:51 all-input-dids.txt -rw-r--r-- 1 slot1_2 slot1_2 550 Sep 16 18:12 caf_20250916T215123Z.did -rw-r--r-- 1 slot1_2 slot1_2 550 Sep 16 16:51 did.list -rw-r--r-- 1 slot1_2 slot1_2 0 Sep 16 16:51 debugprod.log