Jobsub ID 208681.45@dunegpschedd02.fnal.gov
| Jobsub ID | 208681.45@dunegpschedd02.fnal.gov |
| Workflow ID | 8191 |
| Stage ID | 1 |
| User name | epennacc@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-09-28 22:57:38 |
| Site | UK_Bristol |
| Entry | CMSHTPC_T2_UK_SGrid_Bristol_lcgce02 |
| Last heartbeat | 2025-09-29 00:27:03 |
| From worker node | Hostname | hd89.dice.priv |
| cpuinfo | AMD EPYC 7713 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 259200 (72 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | aborted |
| Started | 2025-09-28 22:59:14 |
| Input files | monte-carlo-008191-009421
|
| Outputting started | 2025-09-29 00:13:22 |
| Output files | |
| Finished | 2025-09-29 00:27:03 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
] Timer: WireCell::Gen::Digitizer : 0.82 sec
[00:07:55.888] I [ timer ] Timer: WireCell::Gen::DepoBagger : 0.81 sec
[00:07:55.970] I [ timer ] Timer: WireCell::Gen::Reframer : 0.77 sec
[00:07:56.072] I [ timer ] Timer: WireCell::Gen::Reframer : 0.77 sec
[00:07:56.143] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.75 sec
[00:07:56.157] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.75 sec
[00:07:56.166] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.75 sec
[00:07:56.428] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.74 sec
[00:07:56.835] I [ timer ] Timer: WireCell::Gen::Reframer : 0.72 sec
[00:07:56.963] I [ timer ] Timer: WireCell::Gen::Reframer : 0.71 sec
[00:07:57.070] I [ timer ] Timer: WireCell::Gen::Reframer : 0.7 sec
[00:07:57.237] I [ timer ] Timer: WireCell::Gen::DepoSetFanout : 0.7 sec
[00:07:57.387] I [ timer ] Timer: WireCell::Gen::Reframer : 0.68 sec
[00:07:57.531] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.68 sec
[00:07:57.587] I [ timer ] Timer: WireCell::Gen::Reframer : 0.68 sec
[00:07:57.894] I [ timer ] Timer: wcls::FrameSaver : 0.68 sec
[00:07:58.367] I [ timer ] Timer: WireCell::Gen::Reframer : 0.68 sec
[00:07:58.590] I [ timer ] Timer: WireCell::Gen::Reframer : 0.67 sec
[00:07:58.921] I [ timer ] Timer: WireCell::Gen::Drifter : 0.66 sec
[00:07:59.082] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.66 sec
[00:07:59.248] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.65 sec
[00:07:59.703] I [ timer ] Timer: WireCell::Gen::Reframer : 0.62 sec
[00:08:00.195] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0.59 sec
[00:08:00.398] I [ timer ] Timer: WireCell::Gen::Retagger : 0.58 sec
[00:08:00.497] I [ timer ] Timer: WireCell::Gen::Reframer : 0.51 sec
[00:08:00.994] I [ timer ] Timer: wcls::SimDepoSource : 0.24 sec
[00:08:01.058] I [ timer ] Timer: Total node execution : 206.77000103890896 sec
wclsFrameSaver: saving raw::RawDigits tagged "daq"
Begin processing the 10th record. run: 8191 subRun: 0 event: 94210 at 29-Sep-2025 00:08:15 UTC
SimDepoSource got 137890 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 137890 depos spanning: [-2245.6, 2245.82]us
Retagger: tagging trace set: daq with 30720 traces, 0 summary
[00:12:09.294] I [ timer ] Timer: WireCell::Gen::DepoTransform : 18.54 sec
[00:12:09.335] I [ timer ] Timer: WireCell::Gen::DepoTransform : 18.42 sec
[00:12:09.374] I [ timer ] Timer: WireCell::Gen::DepoTransform : 16.02 sec
[00:12:09.814] I [ timer ] Timer: WireCell::Gen::DepoTransform : 14.09 sec
[00:12:10.016] I [ timer ] Timer: WireCell::Gen::DepoTransform : 13.11 sec
[00:12:10.116] I [ timer ] Timer: WireCell::Gen::DepoTransform : 12.86 sec
[00:12:10.183] I [ timer ] Timer: WireCell::Gen::DepoTransform : 11.59 sec
[00:12:10.279] I [ timer ] Timer: WireCell::Gen::DepoTransform : 11.15 sec
[00:12:10.302] I [ timer ] Timer: WireCell::Gen::DepoTransform : 9.32 sec
[00:12:10.311] I [ timer ] Timer: WireCell::Gen::DepoTransform : 7.44 sec
[00:12:10.320] I [ timer ] Timer: WireCell::Gen::DepoTransform : 7.19 sec
[00:12:10.325] I [ timer ] Timer: WireCell::Gen::DepoTransform : 6.87 sec
[00:12:10.473] I [ timer ] Timer: wcls::SimChannelSink : 1.41 sec
[00:12:10.663] I [ timer ] Timer: WireCell::Gen::Reframer : 0.96 sec
[00:12:11.943] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.94 sec
[00:12:12.661] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.94 sec
[00:12:12.876] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.91 sec
[00:12:13.494] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.89 sec
[00:12:13.645] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.88 sec
[00:12:14.055] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.87 sec
[00:12:14.193] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.84 sec
[00:12:14.208] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.83 sec
[00:12:14.465] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.83 sec
[00:12:14.701] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.83 sec
[00:12:15.285] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.83 sec
[00:12:15.385] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.82 sec
[00:12:15.459] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.81 sec
[00:12:15.770] I [ timer ] Timer: WireCell::Gen::Reframer : 0.8 sec
[00:12:15.986] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.79 sec
[00:12:16.096] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.79 sec
[00:12:16.221] I [ timer ] Timer: WireCell::Gen::Reframer : 0.79 sec
[00:12:16.243] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.78 sec
[00:12:16.396] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.77 sec
[00:12:16.456] I [ timer ] Timer: WireCell::Gen::Drifter : 0.76 sec
[00:12:16.467] I [ timer ] Timer: WireCell::Gen::Reframer : 0.76 sec
[00:12:16.673] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.75 sec
[00:12:17.152] I [ timer ] Timer: WireCell::Gen::DepoBagger : 0.75 sec
[00:12:17.748] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.75 sec
[00:12:18.079] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.75 sec
[00:12:18.243] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.75 sec
[00:12:18.523] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.73 sec
[00:12:19.139] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.73 sec
[00:12:19.323] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.72 sec
[00:12:19.499] I [ timer ] Timer: WireCell::Gen::Reframer : 0.71 sec
[00:12:19.691] I [ timer ] Timer: WireCell::Gen::Retagger : 0.71 sec
[00:12:19.698] I [ timer ] Timer: WireCell::Gen::Reframer : 0.68 sec
[00:12:19.754] I [ timer ] Timer: WireCell::Gen::Reframer : 0.66 sec
[00:12:19.966] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.66 sec
[00:12:20.037] I [ timer ] Timer: WireCell::Gen::Reframer : 0.64 sec
[00:12:20.323] I [ timer ] Timer: WireCell::Gen::Reframer : 0.63 sec
[00:12:20.840] I [ timer ] Timer: WireCell::Gen::Reframer : 0.6 sec
[00:12:20.958] I [ timer ] Timer: WireCell::Gen::Reframer : 0.6 sec
[00:12:21.020] I [ timer ] Timer: WireCell::Gen::Reframer : 0.58 sec
[00:12:21.151] I [ timer ] Timer: WireCell::Gen::DepoSetFanout : 0.58 sec
[00:12:21.945] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0.57 sec
[00:12:22.556] I [ timer ] Timer: wcls::FrameSaver : 0.54 sec
[00:12:22.654] I [ timer ] Timer: wcls::SimDepoSource : 0.13 sec
[00:12:23.000] I [ timer ] Timer: Total node execution : 180.650000333786 sec
wclsFrameSaver: saving raw::RawDigits tagged "daq"
29-Sep-2025 00:12:53 UTC Closed output file "prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T225927Z_gen_009421_supernova_g4_detsim.root"
29-Sep-2025 00:12:54 UTC Closed input file "prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T225927Z_gen_009421_supernova_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 260.114 285.55 313.662 281.789 18.6947 10
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0287605 0.514766 1.28371 0.425561 0.379435 10
simulate:tpcrawdecoder:WireCellToolkit 246.398 271.516 297.441 268.487 17.9492 10
simulate:opdigi:OpDetDigitizerDUNE 2.35595 2.47762 2.79551 2.44441 0.117747 10
simulate:rns:RandomNumberSaver 3.7782e-05 8.86128e-05 0.000366758 5.33515e-05 9.43234e-05 10
[art]:TriggerResults:TriggerResultInserter 1.3326e-05 2.34815e-05 5.0726e-05 1.9226e-05 1.1475e-05 10
end_path:out1:RootOutput 5.952e-06 1.14758e-05 3.174e-05 6.4675e-06 8.14175e-06 10
end_path:out1:RootOutput(write) 9.74552 11.0417 13.2888 11.0633 0.950006 10
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5231.52 MB
Peak resident set size usage (VmHWM): 3526.25 MB
====================================================================================================
Art has completed and will exit with status 0.
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T225927Z_gen_009421.root 21939100
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T225927Z_gen_009421_supernova_g4.root 180094438
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T225927Z_gen_009421_supernova_g4_detsim.root 2350808915
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T225927Z_gen_009421_supernova_g4_detsim.root.ext.json 1561
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T225927Z_gen_009421_supernova_g4_detsim.root.json 1827
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T225927Z_gen_009421_supernova_g4_detsim.root.temp.json 1827
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T225927Z_gen_009421_supernova_g4_detsim_hist.root 519
