Jobsub ID 47248.4@dunegpschedd01.fnal.gov
| Jobsub ID | 47248.4@dunegpschedd01.fnal.gov | |
| Workflow ID | 2501 | |
| Stage ID | 1 | |
| User name | pgranger@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2025-09-17 00:12:30 | |
| Site | ES_PIC | |
| Entry | DUNE_T1_ES_PIC_ce15-multicore | |
| Last heartbeat | 2025-09-17 01:43:09 | |
| From worker node | Hostname | hnode73.pic.es |
| cpuinfo | AMD EPYC 7443P 24-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 216000 (60 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-17 00:33:34 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_53_20231204T050652Z_gen_g4_detsim_hitreco__20240509T213243Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419482_1111_20231203T235745Z_gen_g4_detsim_hitreco__20240509T212443Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74568471_160_20231207T152642Z_gen_g4_detsim_hitreco__20240510T030109Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515154_346_20231201T073824Z_gen_g4_detsim_hitreco__20240507T183950Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472782_102_20231208T091548Z_gen_g4_detsim_hitreco__20240510T063315Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419113_880_20231203T161347Z_gen_g4_detsim_hitreco__20240508T060423Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 1h (4154s) | |
| CPU time | 24m (1490s = 35%) | |
| Max RSS bytes | 2110828544 (2013 MiB) | |
| Outputting started | 2025-09-17 01:42:50 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250917T003748Z.root | |
| Finished | 2025-09-17 01:43:09 | |
| Saved logs | justin-logs:47248.4-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
0.00787491 0.333885 0.00177986 0.0213237 600 reco:pandoracalo:Calorimetry 6.7872e-05 0.0168424 1.12886 0.000573637 0.0842969 600 reco:pandorapid:Chi2ParticleID 2.4731e-05 9.2334e-05 0.00118982 7.38715e-05 7.90102e-05 600 reco:cvnmap:CVNMapper 1.218e-05 0.00632991 0.0373732 0.00613914 0.00583017 600 reco:cvneva:CVNEvaluator 1.148e-05 0.188908 1.51052 0.249288 0.12672 600 reco:energyrecnumu:EnergyReco 0.000167834 0.0845059 1.14324 0.0126288 0.125169 600 reco:energyrecnue:EnergyReco 8.9931e-05 0.00135127 0.0550066 0.000324532 0.00394755 600 reco:energyrecnc:EnergyReco 0.00104661 0.156218 0.56188 0.201721 0.113976 600 reco:energyrecnumurange:EnergyReco 0.000128623 0.0204537 0.995836 0.00125808 0.0851712 600 reco:energyrecnumumcs:EnergyReco 0.000276206 0.0206875 0.998896 0.00154188 0.0841251 600 reco:energyrecnumumcsllhd:EnergyReco 0.000246336 0.0207396 1.00926 0.00146116 0.0846915 600 reco:opdec:Deconvolution 0.131851 0.269606 0.52253 0.281026 0.0595743 600 reco:ophitspe:OpHitFinderDeco 0.379852 0.440632 0.483347 0.446053 0.0266514 600 reco:opflash:OpFlashFinder 0.000126823 0.000773907 0.0022629 0.000758496 0.000334184 600 reco:opslicer:OpSlicer 2.986e-05 0.345317 120.722 0.119889 4.91989 600 reco:rns:RandomNumberSaver 1.269e-05 2.02675e-05 0.000385628 1.9645e-05 1.54168e-05 600 reco:anglereconue:NuAngularReco 8.2812e-05 0.000809716 0.0321588 0.000238731 0.00233728 600 reco:anglereconumu:NuAngularReco 4.8701e-05 0.000686633 0.0317169 0.000122482 0.00230224 600 reco:anglereconuepfps:NuAngularReco 7.5821e-05 0.000751493 0.031733 0.000187994 0.00231553 600 reco:anglereconumupfps:NuAngularReco 6.6111e-05 0.000726891 0.0321418 0.000157099 0.00233159 600 reco:anglerecohits:NuAngularReco 5.7501e-05 0.00107476 0.0355735 0.000382913 0.0026832 600 [art]:TriggerResults:TriggerResultInserter 6.78e-06 8.37823e-06 4.0711e-05 7.8605e-06 2.43932e-06 600 end_path:cafmaker:CAFMaker 0.000808887 0.00989229 0.365012 0.00248739 0.0286573 600 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3775.25 MB Peak resident set size usage (VmHWM): 2110.83 MB ==================================================================================================== lar exit code 0 === Start last 100 lines of lar log file === Running Ophitfinder with InputDigiType = 'recob' Found hits: 2129! Begin processing the 595th record. run: 6419113 subRun: 1 event: 88095 at 17-Sep-2025 03:42:26 CEST Boundary wire vector sizes: 1016, 699, 999 minwire 0: 901 minwire 1: 1530 minwire 2: 611 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.993523, 0.00104619, 0.00543084, Output 1: 0.548738, 0.419609, 0.0285212, 0.00313212, Output 2: 0.350729, 0.633869, 0.0150851, 0.000316362, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2539! Begin processing the 596th record. run: 6419113 subRun: 1 event: 88096 at 17-Sep-2025 03:42:30 CEST Boundary wire vector sizes: 74, 72, 72 minwire 0: 2541 minwire 1: 286 minwire 2: 2723 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.488691, 0.32153, 0.189779, Output 1: 0.224054, 0.631589, 0.13728, 0.00707712, Output 2: 0.893557, 0.103267, 0.00308589, 9.04348e-05, Running Ophitfinder with InputDigiType = 'recob' Found hits: 950! Begin processing the 597th record. run: 6419113 subRun: 1 event: 88097 at 17-Sep-2025 03:42:33 CEST Boundary wire vector sizes: 231, 163, 129 minwire 0: 1503 minwire 1: 1454 minwire 2: 1160 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0125764, 0.912948, 0.074476, Output 1: 0.0742328, 0.879497, 0.0441155, 0.00215482, Output 2: 0.776157, 0.219754, 0.00402301, 6.65687e-05, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2081! Begin processing the 598th record. run: 6419113 subRun: 1 event: 88098 at 17-Sep-2025 03:42:36 CEST Boundary wire vector sizes: 290, 388, 299 minwire 0: 1234 minwire 1: 501 minwire 2: 652 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.000711312, 0.994709, 0.00457964, Output 1: 0.079982, 0.652998, 0.259235, 0.0077855, Output 2: 0.925428, 0.0725495, 0.00198641, 3.63801e-05, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2619! Begin processing the 599th record. run: 6419113 subRun: 1 event: 88099 at 17-Sep-2025 03:42:40 CEST Boundary wire vector sizes: 1416, 1096, 917 minwire 0: 22 minwire 1: 2327 minwire 2: 0 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.665995, 0.178683, 0.155322, Output 1: 0.432313, 0.486459, 0.0546552, 0.0265731, Output 2: 0.0177081, 0.0634295, 0.20465, 0.714213, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1652! Begin processing the 600th record. run: 6419113 subRun: 1 event: 88100 at 17-Sep-2025 03:42:44 CEST Boundary wire vector sizes: 906, 822, 879 minwire 0: 1578 minwire 1: 643 minwire 2: 1466 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0221307, 0.654792, 0.323077, Output 1: 0.13279, 0.755509, 0.10771, 0.00399136, Output 2: 0.201609, 0.659894, 0.132479, 0.00601848, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2764! Art has completed and will exit with status 0. === End last 100 lines of lar log file === processed files root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/47/62/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_53_20231204T050652Z_gen_g4_detsim_hitreco__20240509T213243Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/cc/84/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419482_1111_20231203T235745Z_gen_g4_detsim_hitreco__20240509T212443Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/d2/0a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74568471_160_20231207T152642Z_gen_g4_detsim_hitreco__20240510T030109Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/ec/11/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515154_346_20231201T073824Z_gen_g4_detsim_hitreco__20240507T183950Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/c1/f7/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472782_102_20231208T091548Z_gen_g4_detsim_hitreco__20240510T063315Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/c5/36/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419113_880_20231203T161347Z_gen_g4_detsim_hitreco__20240508T060423Z_reco2.root .: total 27560 -rw-r--r-- 1 dune001 dune 10400737 Sep 17 03:42 flatcaf.root -rw-r--r-- 1 dune001 dune 8633093 Sep 17 03:42 caf.root -rw-r--r-- 1 dune001 dune 8633093 Sep 17 03:42 caf_fd_hd_atmo_2501_20250917T003748Z.root -rw-r--r-- 1 dune001 dune 364311 Sep 17 03:42 caf_20250917T003748Z.log -rw-r--r-- 1 dune001 dune 135545 Sep 17 03:42 jobscript.log -rw-r--r-- 1 dune001 dune 1151 Sep 17 03:42 caf_20250917T003748Z.file -rw-r--r-- 1 dune001 dune 1151 Sep 17 03:42 caf_20250917T003748Z.pfns -rw-r--r-- 1 dune001 dune 1151 Sep 17 02:35 file.list -rw-r--r-- 1 dune001 dune 1151 Sep 17 03:42 justin-processed-pfns.txt -rw-r--r-- 1 dune001 dune 825 Sep 17 02:35 all-input-dids.txt -rw-r--r-- 1 dune001 dune 825 Sep 17 03:42 caf_20250917T003748Z.did -rw-r--r-- 1 dune001 dune 825 Sep 17 02:35 did.list -rw-r--r-- 1 dune001 dune 0 Sep 17 02:42 debugprod.log