Jobsub ID 40418.16@dunegpschedd02.fnal.gov
| Jobsub ID | 40418.16@dunegpschedd02.fnal.gov | |
| Workflow ID | 2501 | |
| Stage ID | 1 | |
| User name | pgranger@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2025-09-16 14:37:03 | |
| Site | US_FNAL-T1 | |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole | |
| Last heartbeat | 2025-09-16 16:00:34 | |
| From worker node | Hostname | dunegli-45851-0-cmswn7029.fnal.gov |
| cpuinfo | AMD EPYC 9534 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-16 14:38:28 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6420853_963_20231204T041315Z_gen_g4_detsim_hitreco__20240509T212140Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50256571_105_20231120T135807Z_gen_g4_detsim_hitreco__20240503T052647Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_99_20231207T160617Z_gen_g4_detsim_hitreco__20240510T055811Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_192_20231122T061207Z_gen_g4_detsim_hitreco__20240503T053430Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 1h (4682s) | |
| CPU time | 36m (2170s = 46%) | |
| Max RSS bytes | 2383327232 (2272 MiB) | |
| Outputting started | 2025-09-16 15:56:30 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250916T143833Z.root | |
| Finished | 2025-09-16 16:00:34 | |
| Saved logs | justin-logs:40418.16-dunegpschedd02.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
00 reco:pandora:StandardPandora 0.640441 3.3433 298.057 2.18099 13.8959 600 reco:pandoraTrack:LArPandoraTrackCreation 0.000110887 0.00939904 1.18204 0.00155398 0.0590221 600 reco:pandoraShower:LArPandoraModularShowerCreation 0.0001528 0.0104865 0.338356 0.00250915 0.0265387 600 reco:pandoracalo:Calorimetry 9.7748e-05 0.0168576 2.28748 0.00101866 0.112314 600 reco:pandorapid:Chi2ParticleID 3.6915e-05 0.000163514 0.00378069 0.000126716 0.000189897 600 reco:cvnmap:CVNMapper 2.0351e-05 0.00611295 0.0531033 0.00684516 0.00524763 600 reco:cvneva:CVNEvaluator 1.8077e-05 0.197329 2.27943 0.265899 0.150361 600 reco:energyrecnumu:EnergyReco 0.000243527 0.191217 12.6184 0.0159179 0.59256 600 reco:energyrecnue:EnergyReco 8.5599e-05 0.00289445 0.339782 0.000559268 0.0187835 600 reco:energyrecnc:EnergyReco 0.00129973 0.3378 1.35964 0.441113 0.236546 600 reco:energyrecnumurange:EnergyReco 0.000289427 0.036433 5.69068 0.0020463 0.308024 600 reco:energyrecnumumcs:EnergyReco 0.000571832 0.0366835 5.18197 0.00245168 0.299651 600 reco:energyrecnumumcsllhd:EnergyReco 0.000264869 0.0363767 5.37241 0.0023944 0.297388 600 reco:opdec:Deconvolution 0.319211 0.517203 0.914003 0.540574 0.0944762 600 reco:ophitspe:OpHitFinderDeco 0.921438 0.97639 1.00699 0.980321 0.0238356 600 reco:opflash:OpFlashFinder 0.000161464 0.0012101 0.00893819 0.00116118 0.000583724 600 reco:opslicer:OpSlicer 3.8518e-05 0.192225 0.884954 0.158809 0.156706 600 reco:rns:RandomNumberSaver 2.3004e-05 3.96121e-05 0.000645022 3.7001e-05 2.56908e-05 600 reco:anglereconue:NuAngularReco 0.000200963 0.00129771 0.0995989 0.000452512 0.00584201 600 reco:anglereconumu:NuAngularReco 6.6019e-05 0.0010509 0.109039 0.000181313 0.00617954 600 reco:anglereconuepfps:NuAngularReco 0.000123396 0.00117059 0.104197 0.00030504 0.00620768 600 reco:anglereconumupfps:NuAngularReco 8.1913e-05 0.00111318 0.110448 0.000232796 0.00641899 600 reco:anglerecohits:NuAngularReco 7.5804e-05 0.0016808 0.114117 0.000667901 0.00679325 600 [art]:TriggerResults:TriggerResultInserter 9.684e-06 1.4096e-05 7.2108e-05 1.3505e-05 3.58156e-06 600 end_path:cafmaker:CAFMaker 0.00208559 0.0162235 1.15605 0.00506586 0.064844 600 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 4049.24 MB Peak resident set size usage (VmHWM): 2383.33 MB ==================================================================================================== lar exit code 0 === Start last 100 lines of lar log file === Boundary wire vector sizes: 695, 506, 439 minwire 0: 2112 minwire 1: 1196 minwire 2: 1739 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.000274109, 0.99865, 0.00107537, Output 1: 0.022621, 0.947868, 0.0282549, 0.00125591, Output 2: 0.995555, 0.00433381, 0.000108056, 3.08255e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2878! Begin processing the 595th record. run: 50258586 subRun: 1 event: 38595 at 16-Sep-2025 15:55:41 UTC Boundary wire vector sizes: 2193, 1821, 2092 minwire 0: 2324 minwire 1: 230 minwire 2: 2480 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.992632, 0.00175276, 0.00561494, Output 1: 0.00257878, 0.99466, 0.00268888, 7.20992e-05, Output 2: 0.988399, 0.0113756, 0.000221486, 3.81855e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1945! Begin processing the 596th record. run: 50258586 subRun: 1 event: 38596 at 16-Sep-2025 15:55:55 UTC Boundary wire vector sizes: 238, 190, 181 minwire 0: 1306 minwire 1: 996 minwire 2: 934 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0187894, 0.464009, 0.517202, Output 1: 0.925487, 0.0709176, 0.00329817, 0.00029675, Output 2: 0.852915, 0.144072, 0.0028744, 0.000138592, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2500! Begin processing the 597th record. run: 50258586 subRun: 1 event: 38597 at 16-Sep-2025 15:56:01 UTC Boundary wire vector sizes: 69, 68, 41 minwire 0: 1357 minwire 1: 1490 minwire 2: 1313 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00611582, 0.988239, 0.00564501, Output 1: 0.15751, 0.603167, 0.2236, 0.0157235, Output 2: 0.98358, 0.015792, 0.000604076, 2.36652e-05, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1291! Begin processing the 598th record. run: 50258586 subRun: 1 event: 38598 at 16-Sep-2025 15:56:07 UTC Boundary wire vector sizes: 4016, 2954, 3832 minwire 0: 440 minwire 1: 506 minwire 2: 18 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.992011, 0.00175989, 0.00622955, Output 1: 0.29423, 0.403615, 0.161746, 0.140409, Output 2: 0.0251795, 0.114309, 0.356561, 0.50395, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2935! Begin processing the 599th record. run: 50258586 subRun: 1 event: 38599 at 16-Sep-2025 15:56:17 UTC Running Ophitfinder with InputDigiType = 'recob' Found hits: 1048! Begin processing the 600th record. run: 50258586 subRun: 1 event: 38600 at 16-Sep-2025 15:56:23 UTC Boundary wire vector sizes: 48, 81, 56 minwire 0: 956 minwire 1: 1532 minwire 2: 1076 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.107972, 0.0108896, 0.881139, Output 1: 0.00557313, 0.0225373, 0.072233, 0.899657, Output 2: 0.957704, 0.0404403, 0.00165437, 0.000201393, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2013! Art has completed and will exit with status 0. === End last 100 lines of lar log file === processed files root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/1d/fe/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6420853_963_20231204T041315Z_gen_g4_detsim_hitreco__20240509T212140Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/d6/69/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50256571_105_20231120T135807Z_gen_g4_detsim_hitreco__20240503T052647Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/f4/98/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50640579_99_20231207T160617Z_gen_g4_detsim_hitreco__20240510T055811Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/e6/1b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_192_20231122T061207Z_gen_g4_detsim_hitreco__20240503T053430Z_reco2.root .: total 24832 -rw-r--r-- 1 dunegli fnalgrid 9379006 Sep 16 15:56 flatcaf.root -rw-r--r-- 1 dunegli fnalgrid 7758047 Sep 16 15:56 caf.root -rw-r--r-- 1 dunegli fnalgrid 7758047 Sep 16 15:56 caf_fd_hd_atmo_2501_20250916T143833Z.root -rw-r--r-- 1 dunegli fnalgrid 358240 Sep 16 15:56 caf_20250916T143833Z.log -rw-r--r-- 1 dunegli fnalgrid 130114 Sep 16 15:56 jobscript.log -rw-r--r-- 1 dunegli fnalgrid 746 Sep 16 15:56 caf_20250916T143833Z.file -rw-r--r-- 1 dunegli fnalgrid 746 Sep 16 15:56 caf_20250916T143833Z.pfns -rw-r--r-- 1 dunegli fnalgrid 746 Sep 16 14:38 file.list -rw-r--r-- 1 dunegli fnalgrid 746 Sep 16 15:56 justin-processed-pfns.txt -rw-r--r-- 1 dunegli fnalgrid 550 Sep 16 14:38 all-input-dids.txt -rw-r--r-- 1 dunegli fnalgrid 550 Sep 16 15:56 caf_20250916T143833Z.did -rw-r--r-- 1 dunegli fnalgrid 550 Sep 16 14:38 did.list -rw-r--r-- 1 dunegli fnalgrid 0 Sep 16 14:38 debugprod.log