Jobsub ID 40202.16@dunegpschedd02.fnal.gov
| Jobsub ID | 40202.16@dunegpschedd02.fnal.gov | |
| Workflow ID | 2501 | |
| Stage ID | 1 | |
| User name | pgranger@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2025-09-15 17:51:56 | |
| Site | UK_Lancaster | |
| Entry | UBoone_UK_Lancaster_HEC_grendel_ce02 | |
| Last heartbeat | 2025-09-15 18:59:38 | |
| From worker node | Hostname | comp23-08 |
| cpuinfo | Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 257400 (71 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-15 17:53:26 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74551443_138_20231207T110132Z_gen_g4_detsim_hitreco__20240510T053154Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413290_674_20231203T030908Z_gen_g4_detsim_hitreco__20240508T062638Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6411871_866_20231203T123335Z_gen_g4_detsim_hitreco__20240509T201223Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50546594_562_20231202T075816Z_gen_g4_detsim_hitreco__20240507T195516Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_310_20231202T102617Z_gen_g4_detsim_hitreco__20240507T210752Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 44m (2653s) | |
| CPU time | 30m (1837s = 69%) | |
| Max RSS bytes | 2246160384 (2142 MiB) | |
| Outputting started | 2025-09-15 18:37:39 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/001/caf_fd_hd_atmo_2501_20250915T175336Z.root | |
| Finished | 2025-09-15 18:59:38 | |
| Saved logs | justin-logs:40202.16-dunegpschedd02.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
49013 0.0119278 0.587238 0.00232144 0.0370839 500 reco:pandoracalo:Calorimetry 9.2716e-05 0.0264636 1.90609 0.000844127 0.131112 500 reco:pandorapid:Chi2ParticleID 3.1551e-05 0.000138612 0.00165038 9.98615e-05 0.000135372 500 reco:cvnmap:CVNMapper 1.9341e-05 0.0148233 0.0986515 0.0179641 0.0111662 500 reco:cvneva:CVNEvaluator 1.4421e-05 0.166721 3.98912 0.21484 0.199581 500 reco:energyrecnumu:EnergyReco 0.000228984 0.108375 3.57347 0.0234022 0.221678 500 reco:energyrecnue:EnergyReco 0.000128569 0.0031304 0.236218 0.000622282 0.0128962 500 reco:energyrecnc:EnergyReco 0.00184764 0.150695 0.547578 0.179302 0.114274 500 reco:energyrecnumurange:EnergyReco 0.000288418 0.0376189 2.98717 0.002253 0.180375 500 reco:energyrecnumumcs:EnergyReco 0.000589543 0.0382339 2.99287 0.00282688 0.180702 500 reco:energyrecnumumcsllhd:EnergyReco 0.00043963 0.0382494 3.0806 0.00261599 0.182964 500 reco:opdec:Deconvolution 0.037285 0.312085 0.888402 0.307426 0.0950377 500 reco:ophitspe:OpHitFinderDeco 0.11895 0.201445 0.571619 0.190293 0.0486855 500 reco:opflash:OpFlashFinder 0.000269274 0.00172042 0.0134002 0.00164851 0.000769203 500 reco:opslicer:OpSlicer 9.0088e-05 0.210697 1.12918 0.168369 0.180992 500 reco:rns:RandomNumberSaver 1.9077e-05 2.97355e-05 0.000446318 2.5916e-05 2.02944e-05 500 reco:anglereconue:NuAngularReco 0.000143037 0.001873 0.119787 0.000321753 0.0072702 500 reco:anglereconumu:NuAngularReco 6.5348e-05 0.00169019 0.115987 0.000179437 0.00708501 500 reco:anglereconuepfps:NuAngularReco 0.000100667 0.00177032 0.114732 0.000259687 0.00703705 500 reco:anglereconumupfps:NuAngularReco 8.7335e-05 0.00175207 0.11442 0.000234989 0.00706171 500 reco:anglerecohits:NuAngularReco 0.000115527 0.00232467 0.120816 0.00056802 0.00772386 500 [art]:TriggerResults:TriggerResultInserter 8.976e-06 1.22256e-05 0.000108156 1.13295e-05 4.96313e-06 500 end_path:cafmaker:CAFMaker 0.00132586 0.024776 1.56957 0.00402229 0.0985861 500 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3928.55 MB Peak resident set size usage (VmHWM): 2246.16 MB ==================================================================================================== lar exit code 0 === Start last 100 lines of lar log file === Classifier summary: Output 0: 0.0173423, 0.657661, 0.324997, Output 1: 0.538431, 0.330092, 0.0740669, 0.0574102, Output 2: 0.140254, 0.308127, 0.279133, 0.272487, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2994! Begin processing the 494th record. run: 6402377 subRun: 1 event: 31094 at 15-Sep-2025 19:36:47 BST Running Ophitfinder with InputDigiType = 'recob' Found hits: 1576! Begin processing the 495th record. run: 6402377 subRun: 1 event: 31095 at 15-Sep-2025 19:36:50 BST Boundary wire vector sizes: 899, 647, 758 minwire 0: 1068 minwire 1: 201 minwire 2: 644 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0633604, 0.750764, 0.185875, Output 1: 0.00679129, 0.0622414, 0.14156, 0.789408, Output 2: 0.138085, 0.365932, 0.304665, 0.191318, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1768! Begin processing the 496th record. run: 6402377 subRun: 1 event: 31096 at 15-Sep-2025 19:36:54 BST Boundary wire vector sizes: 186, 116, 163 minwire 0: 2215 minwire 1: 592 minwire 2: 2105 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0110441, 0.00263341, 0.986322, Output 1: 0.85581, 0.134911, 0.00824056, 0.00103852, Output 2: 0.0492043, 0.939736, 0.010934, 0.00012537, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1877! Begin processing the 497th record. run: 6402377 subRun: 1 event: 31097 at 15-Sep-2025 19:36:57 BST Running Ophitfinder with InputDigiType = 'recob' Found hits: 43! Begin processing the 498th record. run: 6402377 subRun: 1 event: 31098 at 15-Sep-2025 19:37:00 BST Boundary wire vector sizes: 302, 229, 273 minwire 0: 1743 minwire 1: 1769 minwire 2: 1284 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.000381631, 0.99829, 0.00132843, Output 1: 0.00382747, 0.992577, 0.0034858, 0.000109899, Output 2: 0.997746, 0.00218598, 6.57166e-05, 2.09844e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2547! Begin processing the 499th record. run: 6402377 subRun: 1 event: 31099 at 15-Sep-2025 19:37:03 BST Boundary wire vector sizes: 47, 43, 36 minwire 0: 2626 minwire 1: 551 minwire 2: 2371 Used alternate method to get min and max wires due to vertex determination failure: 24, 323 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max wires due to vertex determination failure: 245, 544 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max wires due to vertex determination failure: 44, 343 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00854638, 0.0022454, 0.989208, Output 1: 0.499703, 0.473057, 0.0260742, 0.0011657, Output 2: 0.99773, 0.00215115, 0.000111991, 6.58389e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1229! Begin processing the 500th record. run: 6402377 subRun: 1 event: 31100 at 15-Sep-2025 19:37:06 BST Boundary wire vector sizes: 6983, 6606, 3541 minwire 0: 1993 minwire 1: 382 minwire 2: 1958 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00762525, 0.962841, 0.0295339, Output 1: 0.165435, 0.253031, 0.209527, 0.372007, Output 2: 0.0398486, 0.113415, 0.29787, 0.548867, Running Ophitfinder with InputDigiType = 'recob' Found hits: 3437! Art has completed and will exit with status 0. === End last 100 lines of lar log file === processed files root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/59/ff/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74551443_138_20231207T110132Z_gen_g4_detsim_hitreco__20240510T053154Z_reco2.root root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/90/32/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413290_674_20231203T030908Z_gen_g4_detsim_hitreco__20240508T062638Z_reco2.root root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/22/96/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6411871_866_20231203T123335Z_gen_g4_detsim_hitreco__20240509T201223Z_reco2.root root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/8f/55/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50546594_562_20231202T075816Z_gen_g4_detsim_hitreco__20240507T195516Z_reco2.root root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/49/87/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_310_20231202T102617Z_gen_g4_detsim_hitreco__20240507T210752Z_reco2.root .: total 23280 -rw-r--r-- 1 pltdune002 pltdune 8781970 Sep 15 19:37 flatcaf.root -rw-r--r-- 1 pltdune002 pltdune 7293379 Sep 15 19:37 caf.root -rw-r--r-- 1 pltdune002 pltdune 7293379 Sep 15 19:37 caf_fd_hd_atmo_2501_20250915T175336Z.root -rw-r--r-- 1 pltdune002 pltdune 302906 Sep 15 19:37 caf_20250915T175336Z.log -rw-r--r-- 1 pltdune002 pltdune 114473 Sep 15 19:37 jobscript.log -rw-r--r-- 1 pltdune002 pltdune 992 Sep 15 19:37 caf_20250915T175336Z.file -rw-r--r-- 1 pltdune002 pltdune 992 Sep 15 19:37 caf_20250915T175336Z.pfns -rw-r--r-- 1 pltdune002 pltdune 992 Sep 15 18:53 file.list -rw-r--r-- 1 pltdune002 pltdune 992 Sep 15 19:37 justin-processed-pfns.txt -rw-r--r-- 1 pltdune002 pltdune 687 Sep 15 18:53 all-input-dids.txt -rw-r--r-- 1 pltdune002 pltdune 687 Sep 15 19:37 caf_20250915T175336Z.did -rw-r--r-- 1 pltdune002 pltdune 687 Sep 15 18:53 did.list -rw-r--r-- 1 pltdune002 pltdune 0 Sep 15 18:53 debugprod.log