Jobsub ID 273549.5@dunegpschedd02.fnal.gov
| Jobsub ID | 273549.5@dunegpschedd02.fnal.gov |
| Workflow ID | 11977 |
| Stage ID | 3 |
| User name | usher@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 28800 (8 hours) |
| Submitted time | 2026-01-15 21:52:21 |
| Site | UK_QMUL |
| Entry | DUNE_UK_London_QMUL_arcce03 |
| Last heartbeat | 2026-01-15 22:23:03 |
| From worker node | Hostname | cn094.htc.esc.qmul |
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2026-01-15 21:53:00 |
| Input files | usertests:mpvmpr_monte-carlo-011977-000010_gen_g4.root
|
| Outputting started | 2026-01-15 22:21:15 |
| Output files | |
| Finished | 2026-01-16 09:03:53 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Saver: q=807163 n=76858 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 10th record. run: 200010 subRun: 0 event: 10 at 15-Jan-2026 22:05:15 GMT
SimDepoSetSource got 60023 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 60023 depos spanning: [7.30071, 9.15222]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=1.27918e+06 n=120160 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.40564e+06 n=109204 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 11th record. run: 200010 subRun: 0 event: 11 at 15-Jan-2026 22:06:45 GMT
SimDepoSetSource got 255000 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 255000 depos spanning: [3.53308, 8.12724]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=5.68081e+06 n=448912 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=6.20614e+06 n=406982 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 12th record. run: 200010 subRun: 0 event: 12 at 15-Jan-2026 22:09:05 GMT
SimDepoSetSource got 45147 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 45147 depos spanning: [8.17229, 10.3727]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=1.4066e+06 n=170482 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=1.52079e+06 n=144345 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 13th record. run: 200010 subRun: 0 event: 13 at 15-Jan-2026 22:10:39 GMT
SimDepoSetSource got 56472 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 56472 depos spanning: [6.95803, 9.95061]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=1.6151e+06 n=169254 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=1.75114e+06 n=147216 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 14th record. run: 200010 subRun: 0 event: 14 at 15-Jan-2026 22:12:20 GMT
SimDepoSetSource got 56502 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 56502 depos spanning: [3.86392, 7.30918]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=1.63688e+06 n=184158 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=1.76611e+06 n=165859 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 15th record. run: 200010 subRun: 0 event: 15 at 15-Jan-2026 22:13:00 GMT
SimDepoSetSource got 201690 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 201690 depos spanning: [4.8939, 7.83948]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=3.81951e+06 n=254999 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=4.20266e+06 n=230724 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 16th record. run: 200010 subRun: 0 event: 16 at 15-Jan-2026 22:14:41 GMT
SimDepoSetSource got 124577 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 124577 depos spanning: [5.30265, 7.65103]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=2.38018e+06 n=178229 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=2.63503e+06 n=162794 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 17th record. run: 200010 subRun: 0 event: 17 at 15-Jan-2026 22:16:21 GMT
SimDepoSetSource got 31618 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 31618 depos spanning: [4.90501, 8.40785]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=996047 n=115682 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=1.08198e+06 n=101951 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 18th record. run: 200010 subRun: 0 event: 18 at 15-Jan-2026 22:17:09 GMT
SimDepoSetSource got 4058 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4058 depos spanning: [7.02913, 7.03265]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=147268 n=14988 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=152491 n=13782 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 19th record. run: 200010 subRun: 0 event: 19 at 15-Jan-2026 22:17:34 GMT
SimDepoSetSource got 221659 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 221659 depos spanning: [2.30942, 4.82214]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=4.3892e+06 n=308003 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=4.7763e+06 n=281561 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 20th record. run: 200010 subRun: 0 event: 20 at 15-Jan-2026 22:19:04 GMT
SimDepoSetSource got 147740 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 147740 depos spanning: [6.37958, 10.681]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=4.0289e+06 n=435764 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=4.4576e+06 n=373889 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
15-Jan-2026 22:21:14 GMT Closed output file "mpvmpr_monte-carlo-011977-000010_gen_g4_detsim.root"
15-Jan-2026 22:21:14 GMT Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/usertests/29/1d/mpvmpr_monte-carlo-011977-000010_gen_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 24.3304 79.2988 150.221 89.5568 37.2008 20
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000986674 0.00346103 0.008528 0.00310559 0.00174322 20
simulate:tpcrawdecoder:WireCellToolkit 24.0997 78.1526 148.683 88.132 36.6838 20
simulate:opdigi:OpDetDigitizerDUNE 0.171507 0.599688 1.27639 0.523273 0.307635 20
simulate:rns:RandomNumberSaver 2.0989e-05 4.44039e-05 0.000269487 3.17725e-05 5.18981e-05 20
[art]:TriggerResults:TriggerResultInserter 9.26e-06 1.5621e-05 4.6784e-05 1.284e-05 8.36037e-06 20
end_path:out1:RootOutput 3.079e-06 5.7285e-06 2.1024e-05 4.8875e-06 3.58873e-06 20
end_path:out1:RootOutput(write) 0.0558884 0.542373 1.30403 0.377281 0.37498 20
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3922.9 MB
Peak resident set size usage (VmHWM): 2227.25 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 pildune32 pildune 625M Jan 15 22:21 mpvmpr_monte-carlo-011977-000010_gen_g4_detsim.root
Wrote processed DID: usertests:mpvmpr_monte-carlo-011977-000010_gen_g4.root
=== DETSIM job completed successfully ===
