Jobsub ID 47877.11@dunegpschedd01.fnal.gov
| Jobsub ID | 47877.11@dunegpschedd01.fnal.gov | |
| Workflow ID | 2501 | |
| Stage ID | 1 | |
| User name | pgranger@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2025-09-17 23:13:45 | |
| Site | US_UCSD | |
| Entry | CMSHTPC_T2_US_UCSD_gw7 | |
| Last heartbeat | 2025-09-18 00:28:41 | |
| From worker node | Hostname | mh-7763-19.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7763 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-17 23:14:28 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6209058_451_20231122T125951Z_gen_g4_detsim_hitreco__20240503T064142Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50253389_354_20231120T134828Z_gen_g4_detsim_hitreco__20240503T060940Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 1h (4424s) | |
| CPU time | 26m (1592s = 35%) | |
| Max RSS bytes | 2044084224 (1949 MiB) | |
| Outputting started | 2025-09-18 00:28:13 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250917T231441Z.root | |
| Finished | 2025-09-18 00:28:41 | |
| Saved logs | justin-logs:47877.11-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
3.26017 7.4598 234.215 5.98015 12.5029 400 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.145112 0.239405 0.74423 0.241588 0.0822019 400 reco:pandora:StandardPandora 0.871296 3.46914 222.959 2.2903 11.5267 400 reco:pandoraTrack:LArPandoraTrackCreation 0.000109549 0.00631109 0.167728 0.00148784 0.0168114 400 reco:pandoraShower:LArPandoraModularShowerCreation 0.000152759 0.0164841 0.324442 0.00320486 0.0432599 400 reco:pandoracalo:Calorimetry 9.1739e-05 0.0206728 1.1441 0.00110018 0.0934303 400 reco:pandorapid:Chi2ParticleID 3.446e-05 0.00019613 0.00171321 0.000162873 0.00015124 400 reco:cvnmap:CVNMapper 2.137e-05 0.0114822 0.071548 0.00995192 0.0104621 400 reco:cvneva:CVNEvaluator 1.571e-05 0.353006 2.48048 0.461568 0.241652 400 reco:energyrecnumu:EnergyReco 0.000284287 0.249765 7.07864 0.0180806 0.473302 400 reco:energyrecnue:EnergyReco 0.000134479 0.00234233 0.0576322 0.000641133 0.00574725 400 reco:energyrecnc:EnergyReco 0.00183172 0.489037 2.5699 0.612954 0.366955 400 reco:energyrecnumurange:EnergyReco 0.000297216 0.0526247 6.51441 0.00324172 0.367379 400 reco:energyrecnumumcs:EnergyReco 0.000481325 0.0523469 6.22311 0.00367682 0.355346 400 reco:energyrecnumumcsllhd:EnergyReco 0.000505524 0.0534204 6.38857 0.00368097 0.362459 400 reco:opdec:Deconvolution 0.440007 0.794837 2.12502 0.773035 0.217766 400 reco:ophitspe:OpHitFinderDeco 1.28967 1.34232 1.76558 1.36425 0.0581402 400 reco:opflash:OpFlashFinder 0.000218147 0.0015876 0.00698329 0.00146802 0.000787368 400 reco:opslicer:OpSlicer 5.644e-05 0.273465 0.98473 0.207473 0.22404 400 reco:rns:RandomNumberSaver 2.1969e-05 6.29941e-05 0.000478384 5.8979e-05 3.23579e-05 400 reco:anglereconue:NuAngularReco 0.000176468 0.00145536 0.0415674 0.000487499 0.00376111 400 reco:anglereconumu:NuAngularReco 7.4719e-05 0.00121076 0.0408054 0.000263482 0.00374951 400 reco:anglereconuepfps:NuAngularReco 0.000106699 0.00134265 0.040591 0.00037737 0.00363815 400 reco:anglereconumupfps:NuAngularReco 9.2939e-05 0.00124283 0.0410457 0.000321301 0.00349186 400 reco:anglerecohits:NuAngularReco 8.0349e-05 0.0019914 0.0454432 0.00084314 0.00415687 400 [art]:TriggerResults:TriggerResultInserter 9.05e-06 1.62831e-05 8.0219e-05 1.5395e-05 7.04795e-06 400 end_path:cafmaker:CAFMaker 0.00119828 0.0223799 0.747304 0.00824139 0.0612275 400 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3651.03 MB Peak resident set size usage (VmHWM): 2044.08 MB ==================================================================================================== lar exit code 0 === Start last 100 lines of lar log file === Classifier summary: Output 0: 0.994071, 0.000540261, 0.00538894, Output 1: 0.756174, 0.242846, 0.00095003, 3.07158e-05, Output 2: 0.995088, 0.00482069, 8.82868e-05, 3.2056e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1215! Begin processing the 394th record. run: 50253389 subRun: 1 event: 70994 at 17-Sep-2025 17:27:13 PDT Boundary wire vector sizes: 650, 605, 374 minwire 0: 1361 minwire 1: 515 minwire 2: 1392 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.978335, 0.00328132, 0.0183838, Output 1: 0.535965, 0.382593, 0.0702352, 0.0112065, Output 2: 0.818699, 0.168219, 0.0121681, 0.000913866, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2165! Begin processing the 395th record. run: 50253389 subRun: 1 event: 70995 at 17-Sep-2025 17:27:24 PDT Boundary wire vector sizes: 43, 45, 41 minwire 0: 1902 minwire 1: 359 minwire 2: 1743 Used alternate method to get min and max wires due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max wires due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max wires due to vertex determination failure: 485, 784 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00250365, 0.00183528, 0.995661, Output 1: 0.95234, 0.0471757, 0.000405644, 7.89133e-05, Output 2: 0.998537, 0.00143081, 2.8421e-05, 3.50976e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1108! Begin processing the 396th record. run: 50253389 subRun: 1 event: 70996 at 17-Sep-2025 17:27:32 PDT Running Ophitfinder with InputDigiType = 'recob' Found hits: 719! Begin processing the 397th record. run: 50253389 subRun: 1 event: 70997 at 17-Sep-2025 17:27:39 PDT Running Ophitfinder with InputDigiType = 'recob' Found hits: 286! Begin processing the 398th record. run: 50253389 subRun: 1 event: 70998 at 17-Sep-2025 17:27:46 PDT Boundary wire vector sizes: 67, 96, 87 minwire 0: 333 minwire 1: 2446 minwire 2: 34 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00472521, 0.00198774, 0.993287, Output 1: 0.0805868, 0.771223, 0.141641, 0.00654936, Output 2: 0.990766, 0.00878249, 0.000434677, 1.71215e-05, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1062! Begin processing the 399th record. run: 50253389 subRun: 1 event: 70999 at 17-Sep-2025 17:27:55 PDT Boundary wire vector sizes: 71, 78, 72 minwire 0: 704 minwire 1: 2285 minwire 2: 358 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00378157, 0.736248, 0.259971, Output 1: 0.545292, 0.406547, 0.0460326, 0.00212872, Output 2: 0.994592, 0.0052991, 0.000102965, 5.57297e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1411! Begin processing the 400th record. run: 50253389 subRun: 1 event: 71000 at 17-Sep-2025 17:28:03 PDT Boundary wire vector sizes: 361, 250, 272 minwire 0: 62 minwire 1: 2482 minwire 2: 0 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0185979, 0.956617, 0.0247847, Output 1: 0.00844576, 0.981402, 0.00987959, 0.00027321, Output 2: 0.988117, 0.0116003, 0.000275132, 7.09957e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 983! Art has completed and will exit with status 0. === End last 100 lines of lar log file === processed files root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/15/3e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6209058_451_20231122T125951Z_gen_g4_detsim_hitreco__20240503T064142Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/ff/7c/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50253389_354_20231120T134828Z_gen_g4_detsim_hitreco__20240503T060940Z_reco2.root .: total 16484 -rw-r--r-- 1 cuser cuser 6242593 Sep 17 17:28 flatcaf.root -rw-r--r-- 1 cuser cuser 5105816 Sep 17 17:28 caf.root -rw-r--r-- 1 cuser cuser 5105816 Sep 17 17:28 caf_fd_hd_atmo_2501_20250917T231441Z.root -rw-r--r-- 1 cuser cuser 248325 Sep 17 17:28 caf_20250917T231441Z.log -rw-r--r-- 1 cuser cuser 79754 Sep 17 17:28 jobscript.log -rw-r--r-- 1 cuser cuser 375 Sep 17 17:28 caf_20250917T231441Z.file -rw-r--r-- 1 cuser cuser 375 Sep 17 17:28 caf_20250917T231441Z.pfns -rw-r--r-- 1 cuser cuser 375 Sep 17 16:14 file.list -rw-r--r-- 1 cuser cuser 375 Sep 17 17:28 justin-processed-pfns.txt -rw-r--r-- 1 cuser cuser 275 Sep 17 16:14 all-input-dids.txt -rw-r--r-- 1 cuser cuser 275 Sep 17 17:28 caf_20250917T231441Z.did -rw-r--r-- 1 cuser cuser 275 Sep 17 16:14 did.list -rw-r--r-- 1 cuser cuser 0 Sep 17 16:15 debugprod.log