Jobsub ID 47830.9@dunegpschedd01.fnal.gov
| Jobsub ID | 47830.9@dunegpschedd01.fnal.gov | |
| Workflow ID | 2501 | |
| Stage ID | 1 | |
| User name | pgranger@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2025-09-17 22:53:44 | |
| Site | NL_SURFsara | |
| Entry | DUNE_SurfSARA_arc02 | |
| Last heartbeat | 2025-09-17 23:10:45 | |
| From worker node | Hostname | wn-lb-10.gina.surf.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 129600 (36 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-09-17 22:55:14 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74530544_253_20231207T010706Z_gen_g4_detsim_hitreco__20240510T035518Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6403947_569_20231202T121253Z_gen_g4_detsim_hitreco__20240507T212413Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 14m (890s) | |
| CPU time | 12m (722s = 81%) | |
| Max RSS bytes | 2158682112 (2058 MiB) | |
| Outputting started | 2025-09-17 23:10:05 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pgranger/cafs/fnal/02501/1/002/caf_fd_hd_atmo_2501_20250917T225525Z.root | |
| Finished | 2025-09-17 23:10:45 | |
| Saved logs | justin-logs:47830.9-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
------------------------------------------------------------------------------------------------ source:RootInput(read) 0.0161196 0.0417961 0.318222 0.0412059 0.0232384 200 reco:pandora:StandardPandora 0.0977822 2.35039 55.6087 1.64862 4.8676 200 reco:pandoraTrack:LArPandoraTrackCreation 0.000123986 0.00599029 0.17032 0.00160622 0.0150533 200 reco:pandoraShower:LArPandoraModularShowerCreation 0.000174563 0.0141973 0.203082 0.0032421 0.029562 200 reco:pandoracalo:Calorimetry 0.000105909 0.0173796 1.38384 0.0011217 0.101851 200 reco:pandorapid:Chi2ParticleID 3.5092e-05 0.000159725 0.00168596 0.000126695 0.000151149 200 reco:cvnmap:CVNMapper 1.966e-05 0.0059834 0.0402312 0.0068105 0.00469008 200 reco:cvneva:CVNEvaluator 1.7426e-05 0.274392 2.6637 0.318994 0.240323 200 reco:energyrecnumu:EnergyReco 0.000296486 0.0682489 4.81507 0.0135426 0.34586 200 reco:energyrecnue:EnergyReco 0.000114011 0.00204912 0.0617771 0.000593755 0.00545873 200 reco:energyrecnc:EnergyReco 0.00158402 0.067892 0.286669 0.0743242 0.0459357 200 reco:energyrecnumurange:EnergyReco 0.000310807 0.0416964 4.12501 0.00237028 0.297237 200 reco:energyrecnumumcs:EnergyReco 0.000568094 0.0428663 4.21143 0.00279008 0.303046 200 reco:energyrecnumumcsllhd:EnergyReco 0.000394474 0.042268 4.09487 0.00274121 0.295076 200 reco:opdec:Deconvolution 0.0449488 0.220841 0.501276 0.218328 0.0798308 200 reco:ophitspe:OpHitFinderDeco 0.135311 0.14835 0.196155 0.146533 0.00890168 200 reco:opflash:OpFlashFinder 0.000141322 0.00126078 0.00476874 0.00118631 0.000587779 200 reco:opslicer:OpSlicer 3.7387e-05 0.246173 0.762133 0.199275 0.190995 200 reco:rns:RandomNumberSaver 2.3244e-05 3.84002e-05 0.00040662 3.54485e-05 2.7007e-05 200 reco:anglereconue:NuAngularReco 0.000170567 0.00120379 0.0378442 0.000403678 0.00313077 200 reco:anglereconumu:NuAngularReco 6.4226e-05 0.0010019 0.0375565 0.000201333 0.00313047 200 reco:anglereconuepfps:NuAngularReco 0.000109975 0.00112089 0.0382833 0.000304873 0.00315801 200 reco:anglereconumupfps:NuAngularReco 8.3776e-05 0.0010578 0.036475 0.000256167 0.00306174 200 reco:anglerecohits:NuAngularReco 6.9005e-05 0.00161405 0.0414116 0.000673683 0.00351483 200 [art]:TriggerResults:TriggerResultInserter 9.563e-06 1.37122e-05 6.4627e-05 1.30145e-05 5.11907e-06 200 end_path:cafmaker:CAFMaker 0.00136247 0.0243313 2.02897 0.00414069 0.146841 200 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3828.37 MB Peak resident set size usage (VmHWM): 2158.68 MB ==================================================================================================== lar exit code 0 === Start last 100 lines of lar log file === Begin processing the 192nd record. run: 6403947 subRun: 1 event: 56992 at 18-Sep-2025 01:09:39 CEST Running Ophitfinder with InputDigiType = 'recob' Found hits: 1201! Begin processing the 193rd record. run: 6403947 subRun: 1 event: 56993 at 18-Sep-2025 01:09:41 CEST Boundary wire vector sizes: 39, 35, 30 minwire 0: 238 minwire 1: 1820 minwire 2: 248 Used alternate method to get min and max wires due to vertex determination failure: 114, 413 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max wires due to vertex determination failure: 2, 301 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max wires due to vertex determination failure: 186, 485 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00246897, 0.0016799, 0.995851, Output 1: 0.952371, 0.0472764, 0.000267272, 8.53741e-05, Output 2: 0.999294, 0.000687632, 1.52379e-05, 2.81181e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 639! Begin processing the 194th record. run: 6403947 subRun: 1 event: 56994 at 18-Sep-2025 01:09:44 CEST Boundary wire vector sizes: 257, 349, 215 minwire 0: 2328 minwire 1: 777 minwire 2: 2227 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00101511, 0.981632, 0.0173534, Output 1: 0.00367983, 0.990759, 0.00539762, 0.000163129, Output 2: 0.995649, 0.00422656, 0.000119904, 4.50944e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1973! Begin processing the 195th record. run: 6403947 subRun: 1 event: 56995 at 18-Sep-2025 01:09:47 CEST Running Ophitfinder with InputDigiType = 'recob' Found hits: 909! Begin processing the 196th record. run: 6403947 subRun: 1 event: 56996 at 18-Sep-2025 01:09:49 CEST Running Ophitfinder with InputDigiType = 'recob' Found hits: 10! Begin processing the 197th record. run: 6403947 subRun: 1 event: 56997 at 18-Sep-2025 01:09:51 CEST Running Ophitfinder with InputDigiType = 'recob' Found hits: 863! Begin processing the 198th record. run: 6403947 subRun: 1 event: 56998 at 18-Sep-2025 01:09:53 CEST Boundary wire vector sizes: 476, 298, 357 minwire 0: 602 minwire 1: 2141 minwire 2: 444 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00137076, 0.956392, 0.0422368, Output 1: 0.0269226, 0.968252, 0.00470785, 0.000117248, Output 2: 0.998751, 0.00120775, 3.90528e-05, 1.98593e-06, Running Ophitfinder with InputDigiType = 'recob' Found hits: 1766! Begin processing the 199th record. run: 6403947 subRun: 1 event: 56999 at 18-Sep-2025 01:09:56 CEST Boundary wire vector sizes: 1147, 923, 835 minwire 0: 606 minwire 1: 1610 minwire 2: 229 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00249289, 0.969134, 0.028373, Output 1: 0.0456519, 0.121262, 0.219548, 0.613538, Output 2: 0.0646085, 0.16705, 0.331711, 0.436631, Running Ophitfinder with InputDigiType = 'recob' Found hits: 3163! Begin processing the 200th record. run: 6403947 subRun: 1 event: 57000 at 18-Sep-2025 01:10:00 CEST Boundary wire vector sizes: 127, 189, 171 minwire 0: 1665 minwire 1: 790 minwire 2: 1140 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0949167, 0.00279748, 0.902286, Output 1: 0.0837552, 0.869973, 0.0436806, 0.00259127, Output 2: 0.102909, 0.888169, 0.00887026, 5.17822e-05, Running Ophitfinder with InputDigiType = 'recob' Found hits: 2044! Art has completed and will exit with status 0. === End last 100 lines of lar log file === processed files root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/5f/a8/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74530544_253_20231207T010706Z_gen_g4_detsim_hitreco__20240510T035518Z_reco2.root root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/2a/07/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6403947_569_20231202T121253Z_gen_g4_detsim_hitreco__20240507T212413Z_reco2.root .: total 9388 -rw-r--r--. 1 dune003 dune 3603011 Sep 18 01:10 flatcaf.root -rw-r--r--. 1 dune003 dune 2892048 Sep 18 01:10 caf.root -rw-r--r--. 1 dune003 dune 2892048 Sep 18 01:10 caf_fd_hd_atmo_2501_20250917T225525Z.root -rw-r--r--. 1 dune003 dune 132827 Sep 18 01:10 caf_20250917T225525Z.log -rw-r--r--. 1 dune003 dune 50801 Sep 18 01:10 jobscript.log -rw-r--r--. 1 dune003 dune 373 Sep 18 01:10 caf_20250917T225525Z.file -rw-r--r--. 1 dune003 dune 373 Sep 18 01:10 caf_20250917T225525Z.pfns -rw-r--r--. 1 dune003 dune 373 Sep 18 00:55 file.list -rw-r--r--. 1 dune003 dune 373 Sep 18 01:10 justin-processed-pfns.txt -rw-r--r--. 1 dune003 dune 275 Sep 18 00:55 all-input-dids.txt -rw-r--r--. 1 dune003 dune 275 Sep 18 01:10 caf_20250917T225525Z.did -rw-r--r--. 1 dune003 dune 275 Sep 18 00:55 did.list -rw-r--r--. 1 dune003 dune 0 Sep 18 00:55 debugprod.log