Jobsub ID 47444.10@dunegpschedd01.fnal.gov
| Jobsub ID | 47444.10@dunegpschedd01.fnal.gov | |
| Workflow ID | 2501 | |
| Stage ID | 1 | |
| User name | pgranger@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2025-09-17 10:57:06 | |
| Site | US_FNAL-FermiGrid | |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly | |
| Last heartbeat | 2025-09-17 11:47:11 | |
| From worker node | Hostname | dunegli-6878159-0-fnpc17131.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 172800 (48 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-17 10:58:22 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_216_20231202T053153Z_gen_g4_detsim_hitreco__20240508T033843Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6468412_382_20231207T075344Z_gen_g4_detsim_hitreco__20240510T060009Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66027687_604_20231207T010053Z_gen_g4_detsim_hitreco__20240510T061403Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 48m (2916s) | |
| CPU time | 25m (1532s = 52%) | |
| Max RSS bytes | 2066292736 (1970 MiB) | |
| Outputting started | 2025-09-17 11:46:58 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250917T105825Z.root | |
| Finished | 2025-09-17 11:47:11 | |
| Saved logs | justin-logs:47444.10-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
---------------------------------------------------------------------------------------------- source:RootInput(read) 0.108931 0.177628 0.654266 0.144192 0.0634776 300 reco:pandora:StandardPandora 0.660694 4.1571 195.384 2.5094 13.1154 300 reco:pandoraTrack:LArPandoraTrackCreation 0.000143374 0.0105579 0.555309 0.00186049 0.0380707 300 reco:pandoraShower:LArPandoraModularShowerCreation 0.000177195 0.0237108 0.674544 0.00365859 0.0751476 300 reco:pandoracalo:Calorimetry 0.000109509 0.0464043 3.56756 0.00130714 0.29737 300 reco:pandorapid:Chi2ParticleID 3.8527e-05 0.000199995 0.00212108 0.000142904 0.000200883 300 reco:cvnmap:CVNMapper 1.9724e-05 0.0172676 0.0858834 0.0220767 0.012713 300 reco:cvneva:CVNEvaluator 1.7698e-05 0.321012 2.95807 0.353721 0.265061 300 reco:energyrecnumu:EnergyReco 0.000293531 0.248795 4.17646 0.0227931 0.39384 300 reco:energyrecnue:EnergyReco 0.00015686 0.00373948 0.205475 0.000774762 0.0138192 300 reco:energyrecnc:EnergyReco 0.00203279 0.521397 1.40202 0.664288 0.347436 300 reco:energyrecnumurange:EnergyReco 0.000258983 0.0588964 3.92602 0.00334724 0.298195 300 reco:energyrecnumumcs:EnergyReco 0.000792373 0.0601895 3.92676 0.00395557 0.299194 300 reco:energyrecnumumcsllhd:EnergyReco 0.000712682 0.0593482 3.91632 0.00389046 0.297063 300 reco:opdec:Deconvolution 0.327734 0.651408 1.26456 0.647651 0.152937 300 reco:ophitspe:OpHitFinderDeco 0.971377 0.983455 1.00506 0.983234 0.00505578 300 reco:opflash:OpFlashFinder 0.000136807 0.00166295 0.00911576 0.00157839 0.000904601 300 reco:opslicer:OpSlicer 3.9374e-05 0.328585 1.68865 0.246222 0.291448 300 reco:rns:RandomNumberSaver 1.9628e-05 3.68247e-05 0.000708653 3.4582e-05 3.95347e-05 300 reco:anglereconue:NuAngularReco 0.00015491 0.0025634 0.159003 0.000466484 0.0103133 300 reco:anglereconumu:NuAngularReco 7.4902e-05 0.002372 0.156958 0.000274216 0.0101818 300 reco:anglereconuepfps:NuAngularReco 0.00011904 0.00250406 0.158527 0.000387138 0.0102849 300 reco:anglereconumupfps:NuAngularReco 0.000100507 0.00247759 0.15754 0.000370725 0.0102436 300 reco:anglerecohits:NuAngularReco 8.7999e-05 0.00323573 0.168531 0.000886109 0.0110762 300 [art]:TriggerResults:TriggerResultInserter 1.0902e-05 1.6149e-05 9.7919e-05 1.6026e-05 5.56148e-06 300 end_path:cafmaker:CAFMaker 0.00140509 0.0318698 2.13187 0.00556264 0.135239 300 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3732.21 MB Peak resident set size usage (VmHWM): 2066.29 MB ==================================================================================================== lar exit code 0 === Start last 100 lines of lar log file === Running Ophitfinder with InputDigiType = 'recob' Found hits: 2930! Begin processing the 292nd record. run: 66027687 subRun: 1 event: 60492 at 17-Sep-2025 11:45:55 UTC Boundary wire vector sizes: 104, 183, 146 minwire 0: 1310 minwire 1: 1349 minwire 2: 970 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.17339, 0.0575119, 0.769098, Output 1: 0.605054, 0.35949, 0.0333755, 0.00208046, Output 2: 0.0902471, 0.628749, 0.259112, 0.0218927, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2200! Begin processing the 293rd record. run: 66027687 subRun: 1 event: 60493 at 17-Sep-2025 11:46:02 UTC Boundary wire vector sizes: 426, 329, 328 minwire 0: 516 minwire 1: 1803 minwire 2: 421 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00390397, 0.907163, 0.0889327, Output 1: 0.245948, 0.741728, 0.011906, 0.000418104, Output 2: 0.987828, 0.0119605, 0.000204274, 7.41652e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1296! Begin processing the 294th record. run: 66027687 subRun: 1 event: 60494 at 17-Sep-2025 11:46:10 UTC Running Ophitfinder with InputDigiType = 'recob' Found hits: 734! Begin processing the 295th record. run: 66027687 subRun: 1 event: 60495 at 17-Sep-2025 11:46:16 UTC Boundary wire vector sizes: 97, 73, 81 minwire 0: 2676 minwire 1: 387 minwire 2: 2785 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0109697, 0.0635045, 0.925526, Output 1: 0.721029, 0.26889, 0.00970018, 0.00038055, Output 2: 0.988441, 0.0113169, 0.000231112, 1.12715e-05, Running Ophitfinder with InputDigiType = 'recob' Found hits: 742! Begin processing the 296th record. run: 66027687 subRun: 1 event: 60496 at 17-Sep-2025 11:46:23 UTC Running Ophitfinder with InputDigiType = 'recob' Found hits: 760! Begin processing the 297th record. run: 66027687 subRun: 1 event: 60497 at 17-Sep-2025 11:46:29 UTC Boundary wire vector sizes: 385, 639, 410 minwire 0: 1000 minwire 1: 1089 minwire 2: 1034 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00993983, 0.782879, 0.207182, Output 1: 0.0957568, 0.44646, 0.364444, 0.0933395, Output 2: 0.0501249, 0.449799, 0.404303, 0.0957725, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2243! Begin processing the 298th record. run: 66027687 subRun: 1 event: 60498 at 17-Sep-2025 11:46:37 UTC Boundary wire vector sizes: 193, 124, 56 minwire 0: 2377 minwire 1: 1272 minwire 2: 2115 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.99555, 0.000495851, 0.0039545, Output 1: 0.00436062, 0.985685, 0.00970388, 0.000250996, Output 2: 0.996275, 0.00362751, 9.56225e-05, 2.19059e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1960! Begin processing the 299th record. run: 66027687 subRun: 1 event: 60499 at 17-Sep-2025 11:46:45 UTC Running Ophitfinder with InputDigiType = 'recob' Found hits: 53! Begin processing the 300th record. run: 66027687 subRun: 1 event: 60500 at 17-Sep-2025 11:46:51 UTC Running Ophitfinder with InputDigiType = 'recob' Found hits: 404! Art has completed and will exit with status 0. === End last 100 lines of lar log file === processed files root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/ce/e6/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_216_20231202T053153Z_gen_g4_detsim_hitreco__20240508T033843Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/0d/46/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6468412_382_20231207T075344Z_gen_g4_detsim_hitreco__20240510T060009Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/61/e4/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66027687_604_20231207T010053Z_gen_g4_detsim_hitreco__20240510T061403Z_reco2.root .: total 14280 -rw-r--r-- 1 dunegli fnalgrid 5431217 Sep 17 11:46 flatcaf.root -rw-r--r-- 1 dunegli fnalgrid 4442899 Sep 17 11:46 caf.root -rw-r--r-- 1 dunegli fnalgrid 4442899 Sep 17 11:46 caf_fd_hd_atmo_2501_20250917T105825Z.root -rw-r--r-- 1 dunegli fnalgrid 187662 Sep 17 11:46 caf_20250917T105825Z.log -rw-r--r-- 1 dunegli fnalgrid 72307 Sep 17 11:46 jobscript.log -rw-r--r-- 1 dunegli fnalgrid 560 Sep 17 11:46 caf_20250917T105825Z.file -rw-r--r-- 1 dunegli fnalgrid 560 Sep 17 11:46 caf_20250917T105825Z.pfns -rw-r--r-- 1 dunegli fnalgrid 560 Sep 17 10:58 file.list -rw-r--r-- 1 dunegli fnalgrid 560 Sep 17 11:46 justin-processed-pfns.txt -rw-r--r-- 1 dunegli fnalgrid 413 Sep 17 10:58 all-input-dids.txt -rw-r--r-- 1 dunegli fnalgrid 413 Sep 17 11:46 caf_20250917T105825Z.did -rw-r--r-- 1 dunegli fnalgrid 413 Sep 17 10:58 did.list -rw-r--r-- 1 dunegli fnalgrid 0 Sep 17 10:58 debugprod.log