Jobsub ID 273549.3@dunegpschedd02.fnal.gov
| Jobsub ID | 273549.3@dunegpschedd02.fnal.gov |
| Workflow ID | 11977 |
| Stage ID | 3 |
| User name | usher@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 28800 (8 hours) |
| Submitted time | 2026-01-15 21:52:21 |
| Site | UK_QMUL |
| Entry | DUNE_UK_London_QMUL_arcce02 |
| Last heartbeat | 2026-01-15 22:24:28 |
| From worker node | Hostname | cn067.htc.esc.qmul |
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2026-01-15 21:52:36 |
| Input files | usertests:mpvmpr_monte-carlo-011977-000023_gen_g4.root
|
| Outputting started | 2026-01-15 22:24:28 |
| Output files | |
| Finished | 2026-01-16 09:03:53 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
4002e+06 n=256684 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 10th record. run: 200023 subRun: 0 event: 10 at 15-Jan-2026 22:07:56 GMT
SimDepoSetSource got 163904 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 163904 depos spanning: [7.78255, 8.6435]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=2.61392e+06 n=169771 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=2.8217e+06 n=158368 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 11th record. run: 200023 subRun: 0 event: 11 at 15-Jan-2026 22:09:51 GMT
SimDepoSetSource got 45980 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 45980 depos spanning: [3.87273, 7.29389]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=1.33617e+06 n=135915 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.48031e+06 n=117827 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 12th record. run: 200023 subRun: 0 event: 12 at 15-Jan-2026 22:11:17 GMT
SimDepoSetSource got 115215 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 115215 depos spanning: [5.26911, 7.938]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=2.56066e+06 n=241577 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=2.79127e+06 n=219211 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 13th record. run: 200023 subRun: 0 event: 13 at 15-Jan-2026 22:12:46 GMT
SimDepoSetSource got 37824 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 37824 depos spanning: [7.01804, 9.57444]us
Retagger: tagging trace set: wiener with 20480 traces, 20480 summary
Retagger: tagging trace set: gauss with 20480 traces, 0 summary
wclsFrameSaver: saving 20480 traces tagged "gauss"
FrameSaver: q=1.17916e+06 n=141742 tag=gauss
wclsFrameSaver: saving 20480 traces tagged "wiener"
FrameSaver: q=1.31616e+06 n=119060 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 14th record. run: 200023 subRun: 0 event: 14 at 15-Jan-2026 22:14:46 GMT
SimDepoSetSource got 94868 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 94868 depos spanning: [3.05908, 3.86055]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=2.38115e+06 n=185778 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=2.64815e+06 n=168157 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 15th record. run: 200023 subRun: 0 event: 15 at 15-Jan-2026 22:16:13 GMT
SimDepoSetSource got 70637 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 70637 depos spanning: [7.42345, 13.958]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=1.80031e+06 n=203916 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=1.93351e+06 n=180904 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 16th record. run: 200023 subRun: 0 event: 16 at 15-Jan-2026 22:17:58 GMT
SimDepoSetSource got 80626 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 80626 depos spanning: [0.954841, 5.50817]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=2.21572e+06 n=175071 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=2.58714e+06 n=157047 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 17th record. run: 200023 subRun: 0 event: 17 at 15-Jan-2026 22:19:17 GMT
SimDepoSetSource got 28746 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 28746 depos spanning: [8.77343, 9.28482]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=989383 n=116777 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=1.05696e+06 n=108315 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 18th record. run: 200023 subRun: 0 event: 18 at 15-Jan-2026 22:20:19 GMT
SimDepoSetSource got 54087 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 54087 depos spanning: [2.97959, 5.56576]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=1.59673e+06 n=178659 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=1.76626e+06 n=163584 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 19th record. run: 200023 subRun: 0 event: 19 at 15-Jan-2026 22:22:06 GMT
SimDepoSetSource got 33179 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 33179 depos spanning: [6.57803, 8.35545]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=929270 n=99958 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=999404 n=84748 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 20th record. run: 200023 subRun: 0 event: 20 at 15-Jan-2026 22:23:50 GMT
SimDepoSetSource got 114610 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 114610 depos spanning: [2.4519, 2.58274]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=2.01655e+06 n=111565 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=2.26827e+06 n=104511 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
15-Jan-2026 22:24:28 GMT Closed output file "mpvmpr_monte-carlo-011977-000023_gen_g4_detsim.root"
15-Jan-2026 22:24:28 GMT Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/usertests/7a/cd/mpvmpr_monte-carlo-011977-000023_gen_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 21.2931 90.5408 185.71 92.9864 34.1208 20
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000981048 0.00387216 0.0091694 0.00345174 0.00217048 20
simulate:tpcrawdecoder:WireCellToolkit 20.8368 89.2592 183.805 91.0669 33.9274 20
simulate:opdigi:OpDetDigitizerDUNE 0.297265 0.693435 1.2292 0.629091 0.269988 20
simulate:rns:RandomNumberSaver 2.0717e-05 4.40582e-05 0.000298174 2.8556e-05 5.88401e-05 20
[art]:TriggerResults:TriggerResultInserter 9.689e-06 1.48851e-05 4.7928e-05 1.3298e-05 7.99219e-06 20
end_path:out1:RootOutput 2.837e-06 4.8932e-06 2.335e-05 3.51e-06 4.40353e-06 20
end_path:out1:RootOutput(write) 0.153518 0.583521 1.40173 0.495224 0.325262 20
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3985.2 MB
Peak resident set size usage (VmHWM): 2286.32 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 pildune22 pildune 556M Jan 15 22:24 mpvmpr_monte-carlo-011977-000023_gen_g4_detsim.root
Wrote processed DID: usertests:mpvmpr_monte-carlo-011977-000023_gen_g4.root
=== DETSIM job completed successfully ===
