Jobsub ID 51530.1@dunegpschedd01.fnal.gov
| Jobsub ID | 51530.1@dunegpschedd01.fnal.gov | |
| Workflow ID | 2501 | |
| Stage ID | 1 | |
| User name | pgranger@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2025-09-21 17:50:29 | |
| Site | NL_NIKHEF | |
| Entry | VIRGO_NL_NIKHEF_dissel | |
| Last heartbeat | 2025-09-21 18:32:50 | |
| From worker node | Hostname | wn-lot-018.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7702P 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 129600 (36 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Started | 2025-09-21 17:51:05 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50598687_580_20231204T223216Z_gen_g4_detsim_hitreco__20240509T221711Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1500_291_20231028T032900Z_gen_g4_detsim_hitreco__20240503T044656Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419113_640_20231203T151708Z_gen_g4_detsim_hitreco__20240508T054537Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74494003_787_20231201T170354Z_gen_g4_detsim_hitreco__20240507T201522Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 41m (2484s) | |
| CPU time | 34m (2061s = 82%) | |
| Max RSS bytes | 2149822464 (2050 MiB) | |
| Outputting started | 2025-09-21 18:32:31 | |
| Output files | ||
| Finished | 2025-09-21 18:32:50 | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
.0157524 500 reco:pandora:StandardPandora 0.0970962 3.15663 201.658 1.66092 12.5436 500 reco:pandoraTrack:LArPandoraTrackCreation 0.000117941 0.00601315 0.29766 0.00128701 0.0204921 500 reco:pandoraShower:LArPandoraModularShowerCreation 0.000165139 0.0108006 0.240295 0.00258275 0.0248569 500 reco:pandoracalo:Calorimetry 9.595e-05 0.0228351 2.26781 0.000868185 0.140735 500 reco:pandorapid:Chi2ParticleID 3.5546e-05 0.000131978 0.00120798 0.000107031 0.000107554 500 reco:cvnmap:CVNMapper 1.9947e-05 0.00926319 0.040372 0.0114692 0.00613759 500 reco:cvneva:CVNEvaluator 1.6942e-05 0.25534 2.40658 0.337661 0.179253 500 reco:energyrecnumu:EnergyReco 0.000242935 0.063922 2.28619 0.0102971 0.193949 500 reco:energyrecnue:EnergyReco 0.00013359 0.00212027 0.111311 0.000486862 0.00740003 500 reco:energyrecnc:EnergyReco 0.001738 0.0883046 0.381882 0.0960509 0.0587392 500 reco:energyrecnumurange:EnergyReco 0.00019228 0.0353304 2.13939 0.00221608 0.181208 500 reco:energyrecnumumcs:EnergyReco 0.000427309 0.035938 2.13614 0.00283956 0.18 500 reco:energyrecnumumcsllhd:EnergyReco 0.00028313 0.0359907 2.1388 0.00278051 0.180755 500 reco:opdec:Deconvolution 0.051251 0.222807 0.492024 0.221905 0.070301 500 reco:ophitspe:OpHitFinderDeco 0.128616 0.141528 0.174441 0.134527 0.0149211 500 reco:opflash:OpFlashFinder 0.000183944 0.00114671 0.00469477 0.00109779 0.000475393 500 reco:opslicer:OpSlicer 5.2588e-05 0.223855 1.06955 0.17932 0.175733 500 reco:rns:RandomNumberSaver 2.0137e-05 2.8141e-05 0.0003794 2.7817e-05 1.60422e-05 500 reco:anglereconue:NuAngularReco 0.000158787 0.0015153 0.0894423 0.000353332 0.00577861 500 reco:anglereconumu:NuAngularReco 6.928e-05 0.00135119 0.0871982 0.000199163 0.005734 500 reco:anglereconuepfps:NuAngularReco 0.000119764 0.00145375 0.0902594 0.00029687 0.00579181 500 reco:anglereconumupfps:NuAngularReco 9.6491e-05 0.00141322 0.091131 0.00025912 0.00582794 500 reco:anglerecohits:NuAngularReco 0.000125364 0.0019982 0.0969461 0.000662966 0.00642012 500 [art]:TriggerResults:TriggerResultInserter 9.278e-06 1.25294e-05 6.4221e-05 1.20775e-05 2.8747e-06 500 end_path:cafmaker:CAFMaker 0.0013825 0.0212585 1.16176 0.00429588 0.0842054 500 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3810.05 MB Peak resident set size usage (VmHWM): 2149.82 MB ==================================================================================================== lar exit code 0 === Start last 100 lines of lar log file === Boundary wire vector sizes: 185, 273, 220 minwire 0: 2555 minwire 1: 798 minwire 2: 2285 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00724914, 0.0342577, 0.958493, Output 1: 0.895651, 0.0925846, 0.00788535, 0.00387918, Output 2: 0.981217, 0.0179203, 0.000721836, 0.000141128, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1675! Begin processing the 495th record. run: 74494003 subRun: 1 event: 78795 at 21-Sep-2025 20:32:10 CEST Boundary wire vector sizes: 572, 629, 426 minwire 0: 740 minwire 1: 2561 minwire 2: 65 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.016215, 0.857521, 0.126264, Output 1: 0.0421309, 0.726092, 0.222143, 0.00963448, Output 2: 0.232489, 0.668817, 0.0955306, 0.00316315, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2075! Begin processing the 496th record. run: 74494003 subRun: 1 event: 78796 at 21-Sep-2025 20:32:13 CEST Boundary wire vector sizes: 1779, 754, 1472 minwire 0: 1197 minwire 1: 538 minwire 2: 1405 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.996619, 0.000572959, 0.00280851, Output 1: 0.882447, 0.116402, 0.000888232, 0.000262611, Output 2: 0.996215, 0.00365531, 0.000111952, 1.80703e-05, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2270! Begin processing the 497th record. run: 74494003 subRun: 1 event: 78797 at 21-Sep-2025 20:32:17 CEST Boundary wire vector sizes: 566, 645, 498 minwire 0: 2183 minwire 1: 248 minwire 2: 2015 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00897599, 0.117998, 0.873026, Output 1: 0.708591, 0.277884, 0.0118485, 0.00167725, Output 2: 0.176746, 0.598804, 0.195298, 0.0291521, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2132! Begin processing the 498th record. run: 74494003 subRun: 1 event: 78798 at 21-Sep-2025 20:32:20 CEST Boundary wire vector sizes: 1104, 1140, 907 minwire 0: 149 minwire 1: 1779 minwire 2: 0 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.113989, 0.0199056, 0.866106, Output 1: 0.345705, 0.478636, 0.115412, 0.0602481, Output 2: 0.040755, 0.128258, 0.388376, 0.442611, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2527! Begin processing the 499th record. run: 74494003 subRun: 1 event: 78799 at 21-Sep-2025 20:32:24 CEST Boundary wire vector sizes: 115, 192, 165 minwire 0: 753 minwire 1: 1655 minwire 2: 738 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.000371861, 0.996727, 0.0029006, Output 1: 0.00620772, 0.98089, 0.01253, 0.000372554, Output 2: 0.997933, 0.00200788, 5.76643e-05, 1.83565e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1135! Begin processing the 500th record. run: 74494003 subRun: 1 event: 78800 at 21-Sep-2025 20:32:27 CEST Running Ophitfinder with InputDigiType = 'recob' Found hits: 925! Art has completed and will exit with status 0. === End last 100 lines of lar log file === processed files root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/a9/ea/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50598687_580_20231204T223216Z_gen_g4_detsim_hitreco__20240509T221711Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/2f/55/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1500_291_20231028T032900Z_gen_g4_detsim_hitreco__20240503T044656Z_reco2.root root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d6/10/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419113_640_20231203T151708Z_gen_g4_detsim_hitreco__20240508T054537Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/ad/94/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74494003_787_20231201T170354Z_gen_g4_detsim_hitreco__20240507T201522Z_reco2.root .: total 25728 -rw-r--r--. 1 dune012 dune 9710391 Sep 21 20:32 flatcaf.root -rw-r--r--. 1 dune012 dune 8079507 Sep 21 20:32 caf.root -rw-r--r--. 1 dune012 dune 8079507 Sep 21 20:32 caf_fd_hd_atmo_2501_20250921T175115Z.root -rw-r--r--. 1 dune012 dune 310323 Sep 21 20:32 caf_20250921T175115Z.log -rw-r--r--. 1 dune012 dune 112747 Sep 21 20:32 jobscript.log -rw-r--r--. 1 dune012 dune 763 Sep 21 20:32 caf_20250921T175115Z.file -rw-r--r--. 1 dune012 dune 763 Sep 21 20:32 caf_20250921T175115Z.pfns -rw-r--r--. 1 dune012 dune 763 Sep 21 19:51 file.list -rw-r--r--. 1 dune012 dune 763 Sep 21 20:32 justin-processed-pfns.txt -rw-r--r--. 1 dune012 dune 547 Sep 21 19:51 all-input-dids.txt -rw-r--r--. 1 dune012 dune 547 Sep 21 20:32 caf_20250921T175115Z.did -rw-r--r--. 1 dune012 dune 547 Sep 21 19:51 did.list -rw-r--r--. 1 dune012 dune 0 Sep 21 19:51 debugprod.log