Jobsub ID 23733.153@dunegpschedd01.fnal.gov
| Jobsub ID | 23733.153@dunegpschedd01.fnal.gov | |
| Workflow ID | 825 | |
| Stage ID | 1 | |
| User name | ichong@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-08-13 15:55:30 | |
| Site | US_UCSD | |
| Entry | CMSHTPC_T2_US_UCSD_gw7 | |
| Last heartbeat | 2025-08-13 19:30:48 | |
| From worker node | Hostname | sdsc-84.t2.ucsd.edu |
| cpuinfo | Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-08-13 16:22:36 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207014_49_20231120T132541Z_gen_g4_detsim_hitreco__20240503T062148Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 3h (11266s) | |
| CPU time | 27m (1676s = 14%) | |
| Max RSS bytes | 2187649024 (2086 MiB) | |
| Outputting started | 2025-08-13 19:30:23 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ichong/fnal/00825/1/002/caf_truthvtx_2025-08-13T_192721Z_caf.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ichong/fnal/00825/1/002/anatree_truthvtx_2025-08-13T_162245Z.root | |
| Finished | 2025-08-13 19:30:48 | |
| Saved logs | justin-logs:23733.153-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
ticleUtils::GetTrack. %MSG %MSG-w DUNEAna: NuAngularReco:anglereconuepfps@BeginModule 13-Aug-2025 12:29:15 PDT run: 6207014 subRun: 1 event: 10000 Please note: accessing PFParticle showers through this method is not the recommended workflow. Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower. %MSG %MSG-w DUNEAna: NuAngularReco:anglereconumupfps@BeginModule 13-Aug-2025 12:29:15 PDT run: 6207014 subRun: 1 event: 10000 Please note: accessing PFParticle tracks through this method is not the recommended workflow. Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack. %MSG %MSG-w DUNEAna: NuAngularReco:anglereconumupfps@BeginModule 13-Aug-2025 12:29:15 PDT run: 6207014 subRun: 1 event: 10000 Please note: accessing PFParticle showers through this method is not the recommended workflow. Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower. %MSG %MSG-w DUNEAna: NuAngularReco:anglereconumupfps@BeginModule 13-Aug-2025 12:29:15 PDT run: 6207014 subRun: 1 event: 10000 Please note: accessing PFParticle tracks through this method is not the recommended workflow. Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack. %MSG %MSG-i CAFMaker: CAFMaker:cafmaker@BeginModule 13-Aug-2025 12:29:15 PDT run: 6207014 subRun: 1 event: 10000 Geo name is: dune10kt_v5_1x2x6 %MSG %MSG-i CAFMaker: CAFMaker:cafmaker@BeginModule 13-Aug-2025 12:29:15 PDT run: 6207014 subRun: 1 event: 10000 Assuming the FD HD detector %MSG %MSG-w CAFMaker: CAFMaker:cafmaker@BeginModule 13-Aug-2025 12:29:15 PDT run: 6207014 subRun: 1 event: 10000 InputTag: label = 'regcnneval', instance = 'regcnnresult' does not correspond to a valid RegCNNResult product %MSG 13-Aug-2025 12:29:16 PDT Closed output file "caf_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207014_49_20231120T132541Z_gen_g4_detsim_hitreco__20240503T062148Z_reco2_truthvtx_2025-08-13T_192721Z.root" 13-Aug-2025 12:29:16 PDT Closed input file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207014_49_20231120T132541Z_gen_g4_detsim_hitreco__20240503T062148Z_reco2_truthvtx_2025-08-13T_162245Z.root" %MSG-i NuRandomService: RootOutput:out@EndJob 13-Aug-2025 12:29:16 PDT ModuleEndJob Summary of seeds computed by the NuRandomService Random policy: 'perEvent' algorithm version: EventTimestamp_v1 %MSG TrigReport ---------- Event summary ------------- TrigReport Events total = 200 passed = 200 failed = 0 TrigReport ---------- Modules in End-path ---------- TrigReport Run Success Error Name TrigReport 200 200 0 cafmaker TrigReport 200 200 0 out TimeReport ---------- Time summary [sec] ------- TimeReport CPU = 80.629683 Real = 88.403587 MemReport ---------- Memory summary [base-10 MB] ------ MemReport VmPeak = 13078.2 VmHWM = 1266.77 Art has completed and will exit with status 0. === End last 100 lines of lar log file === === Start last 100 lines of third lar log file === Analysing. Warning: there was no track found for track-like PFParticle with ID 1 Begin processing the 186th record. run: 6207014 subRun: 1 event: 9986 at 13-Aug-2025 12:30:17 PDT Analysing. Warning: there was no vertex found for PFParticle with ID 0 Warning: there was no track found for track-like PFParticle with ID 0 Warning: there was no track found for track-like PFParticle with ID 1 Begin processing the 187th record. run: 6207014 subRun: 1 event: 9987 at 13-Aug-2025 12:30:18 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 5 Begin processing the 188th record. run: 6207014 subRun: 1 event: 9988 at 13-Aug-2025 12:30:18 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 3 Begin processing the 189th record. run: 6207014 subRun: 1 event: 9989 at 13-Aug-2025 12:30:18 PDT Analysing. Begin processing the 190th record. run: 6207014 subRun: 1 event: 9990 at 13-Aug-2025 12:30:18 PDT Analysing. Warning: there were 11 reconstructed PFParticle clusters; only the first 10 being stored in tree Warning: there was no vertex found for PFParticle with ID 5 Warning: there was no track found for track-like PFParticle with ID 5 Warning: there was no vertex found for PFParticle with ID 7 Warning: there was no track found for track-like PFParticle with ID 7 Warning: there was no track found for track-like PFParticle with ID 8 %MSG-e AnalysisTree:limits: AnalysisTree:analysistree@BeginModule 13-Aug-2025 12:30:19 PDT run: 6207014 subRun: 1 event: 9990 the pandoraTrack track #0 has 2401 hits on calorimetry plane #2, only 2000 stored in tree %MSG %MSG-e AnalysisTree:limits: AnalysisTree:analysistree@BeginModule 13-Aug-2025 12:30:19 PDT run: 6207014 subRun: 1 event: 9990 the pandoraTrack track #0 has 2738 hits on calorimetry plane #1, only 2000 stored in tree %MSG %MSG-e AnalysisTree:limits: AnalysisTree:analysistree@BeginModule 13-Aug-2025 12:30:19 PDT run: 6207014 subRun: 1 event: 9990 the pandoraTrack track #0 has 2188 hits on calorimetry plane #0, only 2000 stored in tree %MSG Begin processing the 191st record. run: 6207014 subRun: 1 event: 9991 at 13-Aug-2025 12:30:19 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 1 Begin processing the 192nd record. run: 6207014 subRun: 1 event: 9992 at 13-Aug-2025 12:30:19 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 4 Begin processing the 193rd record. run: 6207014 subRun: 1 event: 9993 at 13-Aug-2025 12:30:19 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 3 Begin processing the 194th record. run: 6207014 subRun: 1 event: 9994 at 13-Aug-2025 12:30:19 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 3 Begin processing the 195th record. run: 6207014 subRun: 1 event: 9995 at 13-Aug-2025 12:30:20 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 1 Begin processing the 196th record. run: 6207014 subRun: 1 event: 9996 at 13-Aug-2025 12:30:20 PDT Analysing. Warning: there was no vertex found for PFParticle with ID 2 Warning: there was no track found for track-like PFParticle with ID 2 Warning: there was no track found for track-like PFParticle with ID 3 Begin processing the 197th record. run: 6207014 subRun: 1 event: 9997 at 13-Aug-2025 12:30:20 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 1 Begin processing the 198th record. run: 6207014 subRun: 1 event: 9998 at 13-Aug-2025 12:30:20 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 4 Begin processing the 199th record. run: 6207014 subRun: 1 event: 9999 at 13-Aug-2025 12:30:20 PDT Analysing. Begin processing the 200th record. run: 6207014 subRun: 1 event: 10000 at 13-Aug-2025 12:30:20 PDT Analysing. Warning: there was no track found for track-like PFParticle with ID 2 13-Aug-2025 12:30:21 PDT Closed output file "anaout.root" 13-Aug-2025 12:30:21 PDT Closed input file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207014_49_20231120T132541Z_gen_g4_detsim_hitreco__20240503T062148Z_reco2_truthvtx_2025-08-13T_162245Z.root" ======================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================== Full event 0.00644681 0.0576333 1.31769 0.017246 0.149937 200 ------------------------------------------------------------------------------------------------------------------------ source:RootInput(read) 0.000470762 0.000878687 0.00163495 0.00084897 0.000201013 200 end_path:analysistree:AnalysisTree 0.00452924 0.0550528 1.31426 0.0148327 0.149849 200 end_path:out:RootOutput 3.601e-06 5.61577e-06 3.1856e-05 5.445e-06 2.19621e-06 200 end_path:out:RootOutput(write) 0.000940049 0.00149542 0.00328969 0.00147545 0.000310823 200 ======================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 12955.4 MB Peak resident set size usage (VmHWM): 1229.01 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of third lar log file === === Generated output files === 23733.153_dunegpschedd01.fnal.gov.logs.tgz anaout.root anatree_truthvtx_2025-08-13T_162245Z.root atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207014_49_20231120T132541Z_gen_g4_detsim_hitreco__20240503T062148Z_reco2_truthvtx_2025-08-13T_162245Z.log atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207014_49_20231120T132541Z_gen_g4_detsim_hitreco__20240503T062148Z_reco2_truthvtx_2025-08-13T_162245Z.root caf_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207014_49_20231120T132541Z_gen_g4_detsim_hitreco__20240503T062148Z_reco2_truthvtx_2025-08-13T_192721Z.log caf_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207014_49_20231120T132541Z_gen_g4_detsim_hitreco__20240503T062148Z_reco2_truthvtx_2025-08-13T_192721Z.root caf_truthvtx_2025-08-13T_192721Z_caf.root debugprod.log flatcaf.root jobscript.log justin-processed-pfns.txt reco_hist.root third_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6207014_49_20231120T132541Z_gen_g4_detsim_hitreco__20240503T062148Z_reco2_truthvtx_2025-08-13T_162245Z.log