Jobsub ID 47384.30@dunegpschedd01.fnal.gov
| Jobsub ID | 47384.30@dunegpschedd01.fnal.gov | |
| Workflow ID | 2501 | |
| Stage ID | 1 | |
| User name | pgranger@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2025-09-17 07:06:53 | |
| Site | ES_PIC | |
| Entry | DUNE_T1_ES_PIC_ce15-multicore | |
| Last heartbeat | 2025-09-17 07:47:00 | |
| From worker node | Hostname | hnode70.pic.es |
| cpuinfo | AMD EPYC 7443P 24-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 216000 (60 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-17 07:08:07 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50557588_743_20231202T105003Z_gen_g4_detsim_hitreco__20240507T200825Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6455553_193_20231207T113616Z_gen_g4_detsim_hitreco__20240510T053211Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74511854_1065_20231203T222654Z_gen_g4_detsim_hitreco__20240509T192801Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 38m (2309s) | |
| CPU time | 15m (957s = 41%) | |
| Max RSS bytes | 2162905088 (2062 MiB) | |
| Outputting started | 2025-09-17 07:46:37 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250917T070817Z.root | |
| Finished | 2025-09-17 07:47:00 | |
| Saved logs | justin-logs:47384.30-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
------------------------------------------------------------------ source:RootInput(read) 0.0414493 0.088136 0.722138 0.0836875 0.0564429 300 reco:pandora:StandardPandora 0.249821 3.79414 429.059 1.18693 25.8213 300 reco:pandoraTrack:LArPandoraTrackCreation 8.8442e-05 0.00508201 0.198541 0.00125306 0.014914 300 reco:pandoraShower:LArPandoraModularShowerCreation 0.000117323 0.410945 121.086 0.00231641 6.97881 300 reco:pandoracalo:Calorimetry 7.4082e-05 0.0254656 1.63649 0.000810395 0.124105 300 reco:pandorapid:Chi2ParticleID 2.601e-05 0.000111621 0.00178121 8.6837e-05 0.000123167 300 reco:cvnmap:CVNMapper 1.35e-05 0.00538285 0.0337986 0.00598346 0.00380756 300 reco:cvneva:CVNEvaluator 1.2871e-05 0.255776 1.58812 0.2942 0.171368 300 reco:energyrecnumu:EnergyReco 0.000172225 0.0848902 1.38587 0.00824198 0.141929 300 reco:energyrecnue:EnergyReco 9.4283e-05 0.00200006 0.111522 0.000450141 0.00734068 300 reco:energyrecnc:EnergyReco 0.00119189 0.178275 0.628971 0.192012 0.12843 300 reco:energyrecnumurange:EnergyReco 0.000153174 0.0276324 1.24394 0.00180884 0.107703 300 reco:energyrecnumumcs:EnergyReco 0.000540504 0.0277097 1.2284 0.00281483 0.105828 300 reco:energyrecnumumcsllhd:EnergyReco 0.00040404 0.0271503 1.03552 0.00274254 0.0988844 300 reco:opdec:Deconvolution 0.136009 0.303149 0.610494 0.293837 0.0856496 300 reco:ophitspe:OpHitFinderDeco 0.365913 0.439646 1.01748 0.389679 0.12691 300 reco:opflash:OpFlashFinder 0.000183285 0.00103893 0.00555389 0.000969165 0.000550631 300 reco:opslicer:OpSlicer 0.000345909 0.189297 1.04732 0.155395 0.15903 300 reco:rns:RandomNumberSaver 1.3861e-05 2.47868e-05 0.00038487 2.1595e-05 2.15577e-05 300 reco:anglereconue:NuAngularReco 0.000116393 0.00126068 0.0879553 0.000301843 0.00547811 300 reco:anglereconumu:NuAngularReco 5.6322e-05 0.00113095 0.0884189 0.000181749 0.00548073 300 reco:anglereconuepfps:NuAngularReco 8.3882e-05 0.00121869 0.0890786 0.000263656 0.0055338 300 reco:anglereconumupfps:NuAngularReco 7.2562e-05 0.00117495 0.0873684 0.000227061 0.0054259 300 reco:anglerecohits:NuAngularReco 5.8951e-05 0.00163279 0.0922477 0.000544124 0.00583706 300 [art]:TriggerResults:TriggerResultInserter 6.591e-06 9.86291e-06 6.1792e-05 8.6805e-06 4.06691e-06 300 end_path:cafmaker:CAFMaker 0.000856682 0.0142292 0.678805 0.00295403 0.0488539 300 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3823.52 MB Peak resident set size usage (VmHWM): 2162.91 MB ==================================================================================================== lar exit code 0 === Start last 100 lines of lar log file === Output 0: 0.00246617, 0.0274619, 0.970072, Output 1: 0.994382, 0.00522299, 0.000297195, 9.77569e-05, Output 2: 0.991991, 0.00789419, 9.44318e-05, 1.98461e-05, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1553! Begin processing the 293rd record. run: 74511854 subRun: 1 event: 106593 at 17-Sep-2025 09:38:34 CEST Boundary wire vector sizes: 432, 453, 224 minwire 0: 2396 minwire 1: 283 minwire 2: 2312 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00136475, 0.9781, 0.020535, Output 1: 0.0898549, 0.70676, 0.195313, 0.00807225, Output 2: 0.919794, 0.0780853, 0.0020674, 5.28981e-05, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1327! Begin processing the 294th record. run: 74511854 subRun: 1 event: 106594 at 17-Sep-2025 09:38:38 CEST Running Ophitfinder with InputDigiType = 'recob' Found hits: 273! Begin processing the 295th record. run: 74511854 subRun: 1 event: 106595 at 17-Sep-2025 09:38:42 CEST Boundary wire vector sizes: 15696, 16092, 9660 minwire 0: 1321 minwire 1: 276 minwire 2: 1254 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00534669, 0.981958, 0.0126952, Output 1: 0.233698, 0.31193, 0.155056, 0.299316, Output 2: 0.0355742, 0.110394, 0.315846, 0.538186, Running Ophitfinder with InputDigiType = 'recob' Found hits: 4049! Begin processing the 296th record. run: 74511854 subRun: 1 event: 106596 at 17-Sep-2025 09:46:06 CEST Running Ophitfinder with InputDigiType = 'recob' Found hits: 1208! Begin processing the 297th record. run: 74511854 subRun: 1 event: 106597 at 17-Sep-2025 09:46:09 CEST Boundary wire vector sizes: 263, 379, 345 minwire 0: 2560 minwire 1: 522 minwire 2: 2360 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.000430635, 0.997204, 0.00236506, Output 1: 0.0161601, 0.967167, 0.0161098, 0.000563135, Output 2: 0.99733, 0.00259293, 7.50388e-05, 2.33915e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1819! Begin processing the 298th record. run: 74511854 subRun: 1 event: 106598 at 17-Sep-2025 09:46:13 CEST Boundary wire vector sizes: 617, 700, 339 minwire 0: 1076 minwire 1: 404 minwire 2: 762 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.315338, 0.67462, 0.0100418, Output 1: 0.0107974, 0.983719, 0.00527307, 0.000210838, Output 2: 0.803297, 0.189756, 0.00679268, 0.000154623, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2040! Begin processing the 299th record. run: 74511854 subRun: 1 event: 106599 at 17-Sep-2025 09:46:17 CEST Running Ophitfinder with InputDigiType = 'recob' Found hits: 1344! Begin processing the 300th record. run: 74511854 subRun: 1 event: 106600 at 17-Sep-2025 09:46:20 CEST Boundary wire vector sizes: 6170, 3797, 3558 minwire 0: 1068 minwire 1: 483 minwire 2: 1089 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0177129, 0.937421, 0.0448657, Output 1: 0.27951, 0.390126, 0.154989, 0.175375, Output 2: 0.0186118, 0.0654311, 0.255899, 0.660058, Running Ophitfinder with InputDigiType = 'recob' Found hits: 3027! Art has completed and will exit with status 0. === End last 100 lines of lar log file === processed files root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/03/b4/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50557588_743_20231202T105003Z_gen_g4_detsim_hitreco__20240507T200825Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/9a/10/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6455553_193_20231207T113616Z_gen_g4_detsim_hitreco__20240510T053211Z_reco2.root root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/b4/dd/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74511854_1065_20231203T222654Z_gen_g4_detsim_hitreco__20240509T192801Z_reco2.root .: total 15548 -rw-r--r-- 1 dune001 dune 5893599 Sep 17 09:46 flatcaf.root -rw-r--r-- 1 dune001 dune 4851761 Sep 17 09:46 caf.root -rw-r--r-- 1 dune001 dune 4851761 Sep 17 09:46 caf_fd_hd_atmo_2501_20250917T070817Z.root -rw-r--r-- 1 dune001 dune 194644 Sep 17 09:46 caf_20250917T070817Z.log -rw-r--r-- 1 dune001 dune 81821 Sep 17 09:46 jobscript.log -rw-r--r-- 1 dune001 dune 625 Sep 17 09:46 caf_20250917T070817Z.file -rw-r--r-- 1 dune001 dune 625 Sep 17 09:46 caf_20250917T070817Z.pfns -rw-r--r-- 1 dune001 dune 625 Sep 17 09:08 file.list -rw-r--r-- 1 dune001 dune 625 Sep 17 09:46 justin-processed-pfns.txt -rw-r--r-- 1 dune001 dune 414 Sep 17 09:08 all-input-dids.txt -rw-r--r-- 1 dune001 dune 414 Sep 17 09:46 caf_20250917T070817Z.did -rw-r--r-- 1 dune001 dune 414 Sep 17 09:08 did.list -rw-r--r-- 1 dune001 dune 0 Sep 17 09:08 debugprod.log