Jobsub ID 23733.151@dunegpschedd01.fnal.gov
| Jobsub ID | 23733.151@dunegpschedd01.fnal.gov | |
| Workflow ID | 825 | |
| Stage ID | 1 | |
| User name | ichong@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-08-13 15:55:30 | |
| Site | US_UCSD | |
| Entry | CMSHTPC_T2_US_UCSD_gw7 | |
| Last heartbeat | 2025-08-13 19:19:35 | |
| From worker node | Hostname | sdsc-84.t2.ucsd.edu |
| cpuinfo | Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-08-13 16:23:20 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_270_20231028T043141Z_gen_g4_detsim_hitreco__20240503T045251Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 2h (10552s) | |
| CPU time | 22m (1334s = 12%) | |
| Max RSS bytes | 2122760192 (2024 MiB) | |
| Outputting started | 2025-08-13 19:19:13 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ichong/fnal/00825/1/002/caf_truthvtx_2025-08-13T_191634Z_caf.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ichong/fnal/00825/1/002/anatree_truthvtx_2025-08-13T_162324Z.root | |
| Finished | 2025-08-13 19:19:35 | |
| Saved logs | justin-logs:23733.151-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
a: NuAngularReco:anglereconumu@BeginModule 13-Aug-2025 12:18:17 PDT run: 1794 subRun: 1 event: 54200 Please note: accessing PFParticle showers through this method is not the recommended workflow. Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower. %MSG %MSG-w DUNEAna: NuAngularReco:anglereconuepfps@BeginModule 13-Aug-2025 12:18:17 PDT run: 1794 subRun: 1 event: 54200 Please note: accessing PFParticle tracks through this method is not the recommended workflow. Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack. %MSG %MSG-w DUNEAna: NuAngularReco:anglereconuepfps@BeginModule 13-Aug-2025 12:18:17 PDT run: 1794 subRun: 1 event: 54200 Please note: accessing PFParticle showers through this method is not the recommended workflow. Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower. %MSG %MSG-w DUNEAna: NuAngularReco:anglereconumupfps@BeginModule 13-Aug-2025 12:18:17 PDT run: 1794 subRun: 1 event: 54200 Please note: accessing PFParticle tracks through this method is not the recommended workflow. Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack. %MSG %MSG-w DUNEAna: NuAngularReco:anglereconumupfps@BeginModule 13-Aug-2025 12:18:17 PDT run: 1794 subRun: 1 event: 54200 Please note: accessing PFParticle showers through this method is not the recommended workflow. Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower. %MSG %MSG-w DUNEAna: NuAngularReco:anglereconumupfps@BeginModule 13-Aug-2025 12:18:17 PDT run: 1794 subRun: 1 event: 54200 Please note: accessing PFParticle tracks through this method is not the recommended workflow. Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack. %MSG %MSG-i CAFMaker: CAFMaker:cafmaker@BeginModule 13-Aug-2025 12:18:17 PDT run: 1794 subRun: 1 event: 54200 Geo name is: dune10kt_v5_1x2x6 %MSG %MSG-i CAFMaker: CAFMaker:cafmaker@BeginModule 13-Aug-2025 12:18:17 PDT run: 1794 subRun: 1 event: 54200 Assuming the FD HD detector %MSG %MSG-w CAFMaker: CAFMaker:cafmaker@BeginModule 13-Aug-2025 12:18:17 PDT run: 1794 subRun: 1 event: 54200 InputTag: label = 'regcnneval', instance = 'regcnnresult' does not correspond to a valid RegCNNResult product %MSG 13-Aug-2025 12:18:19 PDT Closed output file "caf_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_270_20231028T043141Z_gen_g4_detsim_hitreco__20240503T045251Z_reco2_truthvtx_2025-08-13T_191634Z.root" 13-Aug-2025 12:18:19 PDT Closed input file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_270_20231028T043141Z_gen_g4_detsim_hitreco__20240503T045251Z_reco2_truthvtx_2025-08-13T_162324Z.root" %MSG-i NuRandomService: RootOutput:out@EndJob 13-Aug-2025 12:18:19 PDT ModuleEndJob Summary of seeds computed by the NuRandomService Random policy: 'perEvent' algorithm version: EventTimestamp_v1 %MSG TrigReport ---------- Event summary ------------- TrigReport Events total = 200 passed = 200 failed = 0 TrigReport ---------- Modules in End-path ---------- TrigReport Run Success Error Name TrigReport 200 200 0 cafmaker TrigReport 200 200 0 out TimeReport ---------- Time summary [sec] ------- TimeReport CPU = 68.782455 Real = 77.201173 MemReport ---------- Memory summary [base-10 MB] ------ MemReport VmPeak = 12931.8 VmHWM = 1121.05 Art has completed and will exit with status 0. === End last 100 lines of lar log file === === Start last 100 lines of third lar log file === Analysing. Warning: there was no track found for track-like PFParticle with ID 8 Begin processing the 181st record. run: 1794 subRun: 1 event: 54181 at 13-Aug-2025 12:19:09 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 6 Begin processing the 182nd record. run: 1794 subRun: 1 event: 54182 at 13-Aug-2025 12:19:10 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 2 Begin processing the 183rd record. run: 1794 subRun: 1 event: 54183 at 13-Aug-2025 12:19:10 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 4 Begin processing the 184th record. run: 1794 subRun: 1 event: 54184 at 13-Aug-2025 12:19:10 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 6 Begin processing the 185th record. run: 1794 subRun: 1 event: 54185 at 13-Aug-2025 12:19:10 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 4 Begin processing the 186th record. run: 1794 subRun: 1 event: 54186 at 13-Aug-2025 12:19:10 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 1 Begin processing the 187th record. run: 1794 subRun: 1 event: 54187 at 13-Aug-2025 12:19:10 PDT Analysing. Begin processing the 188th record. run: 1794 subRun: 1 event: 54188 at 13-Aug-2025 12:19:10 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 2 Begin processing the 189th record. run: 1794 subRun: 1 event: 54189 at 13-Aug-2025 12:19:10 PDT Analysing. Begin processing the 190th record. run: 1794 subRun: 1 event: 54190 at 13-Aug-2025 12:19:10 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 1 Begin processing the 191st record. run: 1794 subRun: 1 event: 54191 at 13-Aug-2025 12:19:10 PDT Analysing. Begin processing the 192nd record. run: 1794 subRun: 1 event: 54192 at 13-Aug-2025 12:19:10 PDT Analysing. Begin processing the 193rd record. run: 1794 subRun: 1 event: 54193 at 13-Aug-2025 12:19:10 PDT Analysing. Warning: there was no vertex found for PFParticle with ID 14 Warning: there was no track found for track-like PFParticle with ID 14 Warning: there was no track found for track-like PFParticle with ID 16 Begin processing the 194th record. run: 1794 subRun: 1 event: 54194 at 13-Aug-2025 12:19:11 PDT Analysing. Begin processing the 195th record. run: 1794 subRun: 1 event: 54195 at 13-Aug-2025 12:19:11 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 2 Begin processing the 196th record. run: 1794 subRun: 1 event: 54196 at 13-Aug-2025 12:19:11 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 4 Begin processing the 197th record. run: 1794 subRun: 1 event: 54197 at 13-Aug-2025 12:19:11 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 3 Begin processing the 198th record. run: 1794 subRun: 1 event: 54198 at 13-Aug-2025 12:19:11 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 1 Begin processing the 199th record. run: 1794 subRun: 1 event: 54199 at 13-Aug-2025 12:19:11 PDT Analysing. Begin processing the 200th record. run: 1794 subRun: 1 event: 54200 at 13-Aug-2025 12:19:11 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 3 13-Aug-2025 12:19:12 PDT Closed output file "anaout.root" 13-Aug-2025 12:19:12 PDT Closed input file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_270_20231028T043141Z_gen_g4_detsim_hitreco__20240503T045251Z_reco2_truthvtx_2025-08-13T_162324Z.root" ======================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================== Full event 0.00611899 0.0464617 1.72503 0.0148068 0.142426 200 ------------------------------------------------------------------------------------------------------------------------ source:RootInput(read) 0.000415808 0.00069875 0.00115697 0.000698246 0.000172808 200 end_path:analysistree:AnalysisTree 0.00443604 0.0444813 1.72296 0.0127557 0.142423 200 end_path:out:RootOutput 3.489e-06 4.90955e-06 2.373e-05 4.5535e-06 2.17713e-06 200 end_path:out:RootOutput(write) 0.000865934 0.00110789 0.00240389 0.000976066 0.000235967 200 ======================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 12822.5 MB Peak resident set size usage (VmHWM): 1098.01 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of third lar log file === === Generated output files === 23733.151_dunegpschedd01.fnal.gov.logs.tgz anaout.root anatree_truthvtx_2025-08-13T_162324Z.root atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_270_20231028T043141Z_gen_g4_detsim_hitreco__20240503T045251Z_reco2_truthvtx_2025-08-13T_162324Z.log atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_270_20231028T043141Z_gen_g4_detsim_hitreco__20240503T045251Z_reco2_truthvtx_2025-08-13T_162324Z.root caf_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_270_20231028T043141Z_gen_g4_detsim_hitreco__20240503T045251Z_reco2_truthvtx_2025-08-13T_191634Z.log caf_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_270_20231028T043141Z_gen_g4_detsim_hitreco__20240503T045251Z_reco2_truthvtx_2025-08-13T_191634Z.root caf_truthvtx_2025-08-13T_191634Z_caf.root debugprod.log flatcaf.root jobscript.log justin-processed-pfns.txt reco_hist.root third_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_270_20231028T043141Z_gen_g4_detsim_hitreco__20240503T045251Z_reco2_truthvtx_2025-08-13T_162324Z.log