Jobsub ID 273549.6@dunegpschedd02.fnal.gov
| Jobsub ID | 273549.6@dunegpschedd02.fnal.gov |
| Workflow ID | 11977 |
| Stage ID | 3 |
| User name | usher@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 28800 (8 hours) |
| Submitted time | 2026-01-15 21:52:21 |
| Site | UK_QMUL |
| Entry | DUNE_UK_London_QMUL_arcce02 |
| Last heartbeat | 2026-01-15 22:24:59 |
| From worker node | Hostname | cn067.htc.esc.qmul |
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2026-01-15 21:53:03 |
| Input files | usertests:mpvmpr_monte-carlo-011977-000024_gen_g4.root
|
| Outputting started | 2026-01-15 22:24:59 |
| Output files | |
| Finished | 2026-01-16 09:03:53 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
q=2.39707e+06 n=168280 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 10th record. run: 200024 subRun: 0 event: 10 at 15-Jan-2026 22:07:14 GMT
SimDepoSetSource got 156185 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 156185 depos spanning: [3.86642, 4.09757]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=2.96066e+06 n=170119 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=3.26201e+06 n=155826 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 11th record. run: 200024 subRun: 0 event: 11 at 15-Jan-2026 22:08:25 GMT
SimDepoSetSource got 166130 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 166130 depos spanning: [8.0196, 9.95503]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=4.14461e+06 n=328297 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=4.53398e+06 n=298419 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 12th record. run: 200024 subRun: 0 event: 12 at 15-Jan-2026 22:10:10 GMT
SimDepoSetSource got 15609 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 15609 depos spanning: [9.65788, 9.67514]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=441639 n=55749 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=449037 n=53266 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 13th record. run: 200024 subRun: 0 event: 13 at 15-Jan-2026 22:10:41 GMT
SimDepoSetSource got 35954 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 35954 depos spanning: [6.31672, 8.00183]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=811272 n=78026 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=926041 n=69095 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 14th record. run: 200024 subRun: 0 event: 14 at 15-Jan-2026 22:11:37 GMT
SimDepoSetSource got 197825 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 197825 depos spanning: [2.54182, 5.30127]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=3.60375e+06 n=289499 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=3.88199e+06 n=262111 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 15th record. run: 200024 subRun: 0 event: 15 at 15-Jan-2026 22:14:10 GMT
SimDepoSetSource got 63011 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 63011 depos spanning: [1.10708, 5.08893]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=1.74161e+06 n=203768 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=1.89068e+06 n=183969 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 16th record. run: 200024 subRun: 0 event: 16 at 15-Jan-2026 22:15:34 GMT
SimDepoSetSource got 80422 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 80422 depos spanning: [3.39654, 3.99996]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=1.80035e+06 n=172057 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=1.95436e+06 n=154917 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 17th record. run: 200024 subRun: 0 event: 17 at 15-Jan-2026 22:16:27 GMT
SimDepoSetSource got 102888 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 102888 depos spanning: [5.65077, 9.30062]us
Retagger: tagging trace set: wiener with 23040 traces, 23040 summary
Retagger: tagging trace set: gauss with 23040 traces, 0 summary
wclsFrameSaver: saving 23040 traces tagged "gauss"
FrameSaver: q=3.02951e+06 n=313184 tag=gauss
wclsFrameSaver: saving 23040 traces tagged "wiener"
FrameSaver: q=3.36739e+06 n=262903 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 18th record. run: 200024 subRun: 0 event: 18 at 15-Jan-2026 22:18:58 GMT
SimDepoSetSource got 79351 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 79351 depos spanning: [2.28956, 11.2027]us
Retagger: tagging trace set: wiener with 23040 traces, 23040 summary
Retagger: tagging trace set: gauss with 23040 traces, 0 summary
wclsFrameSaver: saving 23040 traces tagged "gauss"
FrameSaver: q=2.22552e+06 n=245309 tag=gauss
wclsFrameSaver: saving 23040 traces tagged "wiener"
FrameSaver: q=2.4478e+06 n=219535 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 19th record. run: 200024 subRun: 0 event: 19 at 15-Jan-2026 22:21:30 GMT
SimDepoSetSource got 144102 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 144102 depos spanning: [3.57521, 7.86153]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=2.903e+06 n=187378 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=3.23165e+06 n=172250 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 20th record. run: 200024 subRun: 0 event: 20 at 15-Jan-2026 22:23:19 GMT
SimDepoSetSource got 86573 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 86573 depos spanning: [4.62362, 7.39788]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=2.12234e+06 n=208646 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=2.29372e+06 n=190498 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
15-Jan-2026 22:24:58 GMT Closed output file "mpvmpr_monte-carlo-011977-000024_gen_g4_detsim.root"
15-Jan-2026 22:24:58 GMT Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/usertests/1f/ec/mpvmpr_monte-carlo-011977-000024_gen_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 30.8241 90.6544 152.204 89.4837 39.2172 20
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0017843 0.00464948 0.0274389 0.00329306 0.00535893 20
simulate:tpcrawdecoder:WireCellToolkit 30.3425 89.3312 149.829 88.3993 38.7977 20
simulate:opdigi:OpDetDigitizerDUNE 0.319311 0.719154 1.34261 0.64819 0.335828 20
simulate:rns:RandomNumberSaver 2.0126e-05 3.77304e-05 0.000199683 3.0161e-05 3.75077e-05 20
[art]:TriggerResults:TriggerResultInserter 9.453e-06 1.38648e-05 3.1888e-05 1.31935e-05 4.61559e-06 20
end_path:out1:RootOutput 2.837e-06 4.46315e-06 1.6771e-05 3.5695e-06 2.92895e-06 20
end_path:out1:RootOutput(write) 0.134225 0.598193 1.61092 0.555907 0.342292 20
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4096.67 MB
Peak resident set size usage (VmHWM): 2398.37 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 pildune22 pildune 607M Jan 15 22:24 mpvmpr_monte-carlo-011977-000024_gen_g4_detsim.root
Wrote processed DID: usertests:mpvmpr_monte-carlo-011977-000024_gen_g4.root
=== DETSIM job completed successfully ===
