Jobsub ID 273849.0@dunegpschedd02.fnal.gov
| Jobsub ID | 273849.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11995 |
| Stage ID | 3 |
| User name | usher@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 6291456000 (6000 MiB) |
| Wall seconds limit | 28800 (8 hours) |
| Submitted time | 2026-01-16 22:11:39 |
| Site | UK_RAL-PPD |
| Entry | CMSHTPC_T2_UK_SGrid_RALPP_hep206 |
| Last heartbeat | 2026-01-16 23:26:49 |
| From worker node | Hostname | heplnc147.pp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 7864320000 (7500 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2026-01-16 22:12:32 |
| Input files | usertests:mpvmpr_monte-carlo-011995-000045_gen_g4.root
|
| Outputting started | 2026-01-16 23:26:49 |
| Output files | |
| Finished | 2026-01-17 00:28:26 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
56482 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 200045 subRun: 0 event: 40 at 16-Jan-2026 23:10:40 GMT
SimDepoSetSource got 45040 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 45040 depos spanning: [0.72842, 2.67687]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=1.09504e+06 n=135329 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=1.15494e+06 n=126238 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 200045 subRun: 0 event: 41 at 16-Jan-2026 23:11:41 GMT
SimDepoSetSource got 112236 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 112236 depos spanning: [4.83626, 9.0178]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=2.727e+06 n=176742 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=3.0203e+06 n=159507 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 200045 subRun: 0 event: 42 at 16-Jan-2026 23:12:43 GMT
SimDepoSetSource got 193202 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 193202 depos spanning: [9.85836, 10.0556]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=4.13969e+06 n=255459 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=4.5711e+06 n=232130 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 200045 subRun: 0 event: 43 at 16-Jan-2026 23:15:33 GMT
SimDepoSetSource got 14374 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14374 depos spanning: [7.29152, 8.46176]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=508325 n=55139 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=534223 n=51515 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 200045 subRun: 0 event: 44 at 16-Jan-2026 23:16:04 GMT
SimDepoSetSource got 101313 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 101313 depos spanning: [7.96109, 8.0585]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=1.75516e+06 n=123737 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=1.88587e+06 n=113490 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 200045 subRun: 0 event: 45 at 16-Jan-2026 23:17:34 GMT
SimDepoSetSource got 59954 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 59954 depos spanning: [1.96034, 5.4664]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=1.63797e+06 n=161373 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=1.80526e+06 n=141589 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 200045 subRun: 0 event: 46 at 16-Jan-2026 23:19:17 GMT
SimDepoSetSource got 70089 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 70089 depos spanning: [4.97446, 9.33332]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=2.08586e+06 n=233820 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=2.26859e+06 n=213997 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 200045 subRun: 0 event: 47 at 16-Jan-2026 23:20:37 GMT
SimDepoSetSource got 93579 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 93579 depos spanning: [6.33182, 9.12078]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=2.67375e+06 n=274242 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=2.93698e+06 n=242812 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 200045 subRun: 0 event: 48 at 16-Jan-2026 23:22:04 GMT
SimDepoSetSource got 43438 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 43438 depos spanning: [9.89989, 11.3846]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=1.18404e+06 n=125061 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=1.27659e+06 n=115458 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 200045 subRun: 0 event: 49 at 16-Jan-2026 23:22:46 GMT
SimDepoSetSource got 53674 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 53674 depos spanning: [6.07087, 8.33618]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=1.40463e+06 n=160669 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=1.50332e+06 n=146047 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 200045 subRun: 0 event: 50 at 16-Jan-2026 23:23:53 GMT
SimDepoSetSource got 179506 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 179506 depos spanning: [6.9351, 11.3254]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=3.95966e+06 n=339596 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=4.38786e+06 n=305165 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
16-Jan-2026 23:26:48 GMT Closed output file "mpvmpr_monte-carlo-011995-000045_gen_g4_detsim.root"
16-Jan-2026 23:26:48 GMT Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/usertests/dc/5b/mpvmpr_monte-carlo-011995-000045_gen_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 14.7757 87.4778 192.724 86.4948 42.3033 50
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000687688 0.00567888 0.0285543 0.00489546 0.00501022 50
simulate:tpcrawdecoder:WireCellToolkit 14.5742 85.981 189.366 84.6757 41.7536 50
simulate:opdigi:OpDetDigitizerDUNE 0.0713896 0.742501 1.66773 0.597069 0.455443 50
simulate:rns:RandomNumberSaver 2.7472e-05 5.66983e-05 0.000399034 4.7124e-05 5.10629e-05 50
[art]:TriggerResults:TriggerResultInserter 1.1582e-05 1.86238e-05 6.0154e-05 1.66165e-05 8.84606e-06 50
end_path:out1:RootOutput 3.586e-06 6.9471e-06 2.7172e-05 6.712e-06 3.05168e-06 50
end_path:out1:RootOutput(write) 0.0769254 0.747691 1.9189 0.583316 0.467458 50
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4182.72 MB
Peak resident set size usage (VmHWM): 2443.89 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 pltdune04 pltdune 1.8G Jan 16 23:26 mpvmpr_monte-carlo-011995-000045_gen_g4_detsim.root
Wrote processed DID: usertests:mpvmpr_monte-carlo-011995-000045_gen_g4.root
=== DETSIM job completed successfully ===
