Jobsub ID 274589.90@dunegpschedd02.fnal.gov
| Jobsub ID | 274589.90@dunegpschedd02.fnal.gov |
| Workflow ID | 12005 |
| Stage ID | 3 |
| User name | usher@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 6291456000 (6000 MiB) |
| Wall seconds limit | 28800 (8 hours) |
| Submitted time | 2026-01-18 05:07:20 |
| Site | CA_SFU |
| Entry | DUNE_CA_SFU_lcg-ce3 |
| Last heartbeat | 2026-01-18 06:11:17 |
| From worker node | Hostname | fc30650.int.fir.alliancecan.ca |
| cpuinfo | AMD EPYC 9655 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 7864320000 (7500 MiB) |
| Wall seconds limit | 84598 (23 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2026-01-18 05:28:50 |
| Input files | usertests:mpvmpr_monte-carlo-012005-005159_gen_g4.root
|
| Outputting started | 2026-01-18 06:11:17 |
| Output files | |
| Finished | 2026-01-18 07:14:08 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
aces tagged "wiener"
FrameSaver: q=918087 n=113068 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 205159 subRun: 0 event: 40 at 17-Jan-2026 22:04:30 PST
SimDepoSetSource got 61755 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 61755 depos spanning: [1.60791, 9.92359]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=1.71354e+06 n=156739 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=1.84991e+06 n=136955 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 205159 subRun: 0 event: 41 at 17-Jan-2026 22:05:18 PST
SimDepoSetSource got 66184 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 66184 depos spanning: [3.76812, 9.97919]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=1.49553e+06 n=101724 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=1.70419e+06 n=92486 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 205159 subRun: 0 event: 42 at 17-Jan-2026 22:05:44 PST
SimDepoSetSource got 40267 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 40267 depos spanning: [0.0418366, 9.17534]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=1.14851e+06 n=145855 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=1.20786e+06 n=135357 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 205159 subRun: 0 event: 43 at 17-Jan-2026 22:06:25 PST
SimDepoSetSource got 151869 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 151869 depos spanning: [0.00924416, 9.86055]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=3.09959e+06 n=210560 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=3.36983e+06 n=193798 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 205159 subRun: 0 event: 44 at 17-Jan-2026 22:07:07 PST
SimDepoSetSource got 215973 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 215973 depos spanning: [1.61452, 9.47612]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=4.38564e+06 n=307419 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=4.79471e+06 n=276721 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 205159 subRun: 0 event: 45 at 17-Jan-2026 22:08:15 PST
SimDepoSetSource got 23156 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23156 depos spanning: [1.0176, 9.22277]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=635691 n=74299 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=671033 n=69854 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 205159 subRun: 0 event: 46 at 17-Jan-2026 22:08:29 PST
SimDepoSetSource got 23712 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23712 depos spanning: [7.87156, 9.02431]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=496769 n=64899 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=540477 n=58821 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 205159 subRun: 0 event: 47 at 17-Jan-2026 22:08:49 PST
SimDepoSetSource got 123837 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 123837 depos spanning: [0.071177, 9.72704]us
Retagger: tagging trace set: wiener with 20480 traces, 20480 summary
Retagger: tagging trace set: gauss with 20480 traces, 0 summary
wclsFrameSaver: saving 20480 traces tagged "gauss"
FrameSaver: q=3.58476e+06 n=379050 tag=gauss
wclsFrameSaver: saving 20480 traces tagged "wiener"
FrameSaver: q=3.98007e+06 n=329632 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 205159 subRun: 0 event: 48 at 17-Jan-2026 22:09:45 PST
SimDepoSetSource got 20047 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20047 depos spanning: [4.73986, 6.99129]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=419244 n=40845 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=442829 n=39545 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 205159 subRun: 0 event: 49 at 17-Jan-2026 22:10:00 PST
SimDepoSetSource got 57768 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 57768 depos spanning: [4.28075, 8.66908]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=1.58194e+06 n=213316 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=1.64986e+06 n=200627 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 205159 subRun: 0 event: 50 at 17-Jan-2026 22:10:54 PST
SimDepoSetSource got 35693 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 35693 depos spanning: [3.37062, 5.35187]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=856648 n=72114 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=931630 n=64785 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
17-Jan-2026 22:11:16 PST Closed output file "mpvmpr_monte-carlo-012005-005159_gen_g4_detsim.root"
17-Jan-2026 22:11:16 PST Closed input file "root://lcg-dunese1.sfu.computecanada.ca:1094//dune/RSE/usertests/6d/a6/mpvmpr_monte-carlo-012005-005159_gen_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 13.7553 50.1911 115.653 49.4691 22.7489 50
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000494906 0.00458512 0.0249117 0.00329268 0.00508349 50
simulate:tpcrawdecoder:WireCellToolkit 13.5458 49.4589 114.009 48.7346 22.3884 50
simulate:opdigi:OpDetDigitizerDUNE 0.0725277 0.255852 0.666619 0.215962 0.138841 50
simulate:rns:RandomNumberSaver 1.9549e-05 2.79801e-05 0.000200878 2.2879e-05 2.49856e-05 50
[art]:TriggerResults:TriggerResultInserter 9.87e-06 1.18363e-05 3.448e-05 1.12195e-05 3.4047e-06 50
end_path:out1:RootOutput 4.04e-06 5.05316e-06 1.9379e-05 4.5e-06 2.15125e-06 50
end_path:out1:RootOutput(write) 0.0884044 0.471329 1.34156 0.376804 0.309799 50
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4449.86 MB
Peak resident set size usage (VmHWM): 2756.9 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 nilic nilic 2.0G Jan 17 22:11 mpvmpr_monte-carlo-012005-005159_gen_g4_detsim.root
Wrote processed DID: usertests:mpvmpr_monte-carlo-012005-005159_gen_g4.root
=== DETSIM job completed successfully ===
