Jobsub ID 42051.0@dunegpschedd02.fnal.gov
| Jobsub ID | 42051.0@dunegpschedd02.fnal.gov | |
| Workflow ID | 2501 | |
| Stage ID | 1 | |
| User name | pgranger@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2025-09-18 12:56:27 | |
| Site | ES_PIC | |
| Entry | DUNE_T1_ES_PIC_ce15-multicore | |
| Last heartbeat | 2025-09-18 14:22:32 | |
| From worker node | Hostname | hnode59.pic.es |
| cpuinfo | AMD EPYC 7402P 24-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 216000 (60 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-18 12:57:02 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_931_20231202T113802Z_gen_g4_detsim_hitreco__20240507T212327Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74511302_602_20231203T141918Z_gen_g4_detsim_hitreco__20240508T080128Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_56_20231206T230207Z_gen_g4_detsim_hitreco__20240510T031902Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_24_20231208T040205Z_gen_g4_detsim_hitreco__20240510T065328Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6422672_77_20231204T080606Z_gen_g4_detsim_hitreco__20240509T220853Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50584512_173_20231204T060235Z_gen_g4_detsim_hitreco__20240509T214745Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 1h (5090s) | |
| CPU time | 1h (3901s = 76%) | |
| Max RSS bytes | 1998168064 (1905 MiB) | |
| Outputting started | 2025-09-18 14:21:54 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250918T125718Z.root | |
| Finished | 2025-09-18 14:22:32 | |
| Saved logs | justin-logs:42051.0-dunegpschedd02.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
0.137178 600 reco:pandorapid:Chi2ParticleID 3.6801e-05 0.000275614 0.00462672 0.000207777 0.000285748 600 reco:cvnmap:CVNMapper 2.203e-05 0.0226918 0.107289 0.0251702 0.0158499 600 reco:cvneva:CVNEvaluator 1.7731e-05 0.409379 4.33461 0.470103 0.306059 600 reco:energyrecnumu:EnergyReco 0.000281969 0.198361 22.114 0.0210812 1.21236 600 reco:energyrecnue:EnergyReco 0.000129034 0.00467959 0.25872 0.000914221 0.0178313 600 reco:energyrecnc:EnergyReco 0.00210084 0.168444 0.744627 0.204717 0.11326 600 reco:energyrecnumurange:EnergyReco 0.000383463 0.104411 18.4033 0.0035925 0.870187 600 reco:energyrecnumumcs:EnergyReco 0.000513267 0.100198 17.2482 0.00431474 0.799278 600 reco:energyrecnumumcsllhd:EnergyReco 0.000333001 0.105305 19.3313 0.00463052 0.886368 600 reco:opdec:Deconvolution 0.135159 0.373245 0.716619 0.374256 0.103746 600 reco:ophitspe:OpHitFinderDeco 0.364827 0.414174 0.471009 0.420145 0.0375668 600 reco:opflash:OpFlashFinder 0.00031099 0.00232825 0.0171152 0.00197286 0.00144874 600 reco:opslicer:OpSlicer 4.3561e-05 0.315884 1.16046 0.249304 0.257347 600 reco:rns:RandomNumberSaver 2.4771e-05 6.37041e-05 0.000565129 4.8871e-05 4.13421e-05 600 reco:anglereconue:NuAngularReco 0.000205117 0.00270227 0.110636 0.000737604 0.00890696 600 reco:anglereconumu:NuAngularReco 7.0232e-05 0.00231107 0.116548 0.00029062 0.00856763 600 reco:anglereconuepfps:NuAngularReco 0.000120314 0.00254497 0.121121 0.000475021 0.00913046 600 reco:anglereconumupfps:NuAngularReco 9.6463e-05 0.00244868 0.140382 0.000359872 0.00912621 600 reco:anglerecohits:NuAngularReco 0.000105203 0.00340472 0.145167 0.0010246 0.0096651 600 [art]:TriggerResults:TriggerResultInserter 1.003e-05 2.67218e-05 0.000235938 1.94355e-05 2.05633e-05 600 end_path:cafmaker:CAFMaker 0.00239472 0.0340543 1.50773 0.00861666 0.104705 600 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3663.12 MB Peak resident set size usage (VmHWM): 1998.17 MB ==================================================================================================== lar exit code 0 === Start last 100 lines of lar log file === Classifier summary: Output 0: 0.405072, 0.0150029, 0.579925, Output 1: 0.545332, 0.438108, 0.0158987, 0.000661709, Output 2: 0.603801, 0.390462, 0.00565015, 8.72026e-05, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1236! Begin processing the 594th record. run: 50584512 subRun: 1 event: 17394 at 18-Sep-2025 16:20:53 CEST Boundary wire vector sizes: 218, 130, 180 minwire 0: 198 minwire 1: 2100 minwire 2: 228 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.000285075, 0.998701, 0.00101366, Output 1: 0.00303998, 0.992852, 0.00398279, 0.000125077, Output 2: 0.998351, 0.00160568, 4.22929e-05, 1.28162e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 778! Begin processing the 595th record. run: 50584512 subRun: 1 event: 17395 at 18-Sep-2025 16:20:58 CEST Running Ophitfinder with InputDigiType = 'recob' Found hits: 1003! Begin processing the 596th record. run: 50584512 subRun: 1 event: 17396 at 18-Sep-2025 16:21:01 CEST Boundary wire vector sizes: 238, 332, 188 minwire 0: 779 minwire 1: 2253 minwire 2: 43 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00150383, 0.995393, 0.00310351, Output 1: 0.0232126, 0.361534, 0.55342, 0.0618341, Output 2: 0.923324, 0.0721398, 0.00440064, 0.000135332, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1589! Begin processing the 597th record. run: 50584512 subRun: 1 event: 17397 at 18-Sep-2025 16:21:07 CEST Boundary wire vector sizes: 1928, 1593, 1153 minwire 0: 1835 minwire 1: 758 minwire 2: 1866 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00168219, 0.988753, 0.00956512, Output 1: 0.161188, 0.308107, 0.361596, 0.169109, Output 2: 0.763407, 0.220017, 0.0154528, 0.00112266, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2801! Begin processing the 598th record. run: 50584512 subRun: 1 event: 17398 at 18-Sep-2025 16:21:16 CEST Boundary wire vector sizes: 5998, 4914, 4243 minwire 0: 420 minwire 1: 465 minwire 2: 103 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0264272, 0.43816, 0.535413, Output 1: 0.462419, 0.40235, 0.0938596, 0.0413717, Output 2: 0.289924, 0.430431, 0.203388, 0.0762565, Running Ophitfinder with InputDigiType = 'recob' Found hits: 3464! Begin processing the 599th record. run: 50584512 subRun: 1 event: 17399 at 18-Sep-2025 16:21:44 CEST Running Ophitfinder with InputDigiType = 'recob' Found hits: 866! Begin processing the 600th record. run: 50584512 subRun: 1 event: 17400 at 18-Sep-2025 16:21:48 CEST Boundary wire vector sizes: 38, 41, 31 minwire 0: 635 minwire 1: 2201 minwire 2: 412 Used alternate method to get min and max wires due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max wires due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max wires due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00536168, 0.00345731, 0.991181, Output 1: 0.989887, 0.00984424, 0.000123215, 0.000146009, Output 2: 0.998697, 0.00127396, 2.18609e-05, 6.91052e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 943! Art has completed and will exit with status 0. === End last 100 lines of lar log file === processed files root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/79/b0/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_931_20231202T113802Z_gen_g4_detsim_hitreco__20240507T212327Z_reco2.root root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/39/c0/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74511302_602_20231203T141918Z_gen_g4_detsim_hitreco__20240508T080128Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/ca/8b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_56_20231206T230207Z_gen_g4_detsim_hitreco__20240510T031902Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/30/9d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_24_20231208T040205Z_gen_g4_detsim_hitreco__20240510T065328Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/df/8c/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6422672_77_20231204T080606Z_gen_g4_detsim_hitreco__20240509T220853Z_reco2.root root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/d1/0e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50584512_173_20231204T060235Z_gen_g4_detsim_hitreco__20240509T214745Z_reco2.root .: total 33524 -rw-r--r-- 1 dune001 dune 12608404 Sep 18 16:21 flatcaf.root -rw-r--r-- 1 dune001 dune 10571375 Sep 18 16:21 caf.root -rw-r--r-- 1 dune001 dune 10571375 Sep 18 16:21 caf_fd_hd_atmo_2501_20250918T125718Z.root -rw-r--r-- 1 dune001 dune 365729 Sep 18 16:21 caf_20250918T125718Z.log -rw-r--r-- 1 dune001 dune 158939 Sep 18 16:21 jobscript.log -rw-r--r-- 1 dune001 dune 1210 Sep 18 16:21 caf_20250918T125718Z.file -rw-r--r-- 1 dune001 dune 1210 Sep 18 16:21 caf_20250918T125718Z.pfns -rw-r--r-- 1 dune001 dune 1210 Sep 18 14:57 file.list -rw-r--r-- 1 dune001 dune 1210 Sep 18 16:21 justin-processed-pfns.txt -rw-r--r-- 1 dune001 dune 822 Sep 18 14:57 all-input-dids.txt -rw-r--r-- 1 dune001 dune 822 Sep 18 16:21 caf_20250918T125718Z.did -rw-r--r-- 1 dune001 dune 822 Sep 18 14:57 did.list -rw-r--r-- 1 dune001 dune 0 Sep 18 14:57 debugprod.log