Jobsub ID 271691.1@dunegpschedd02.fnal.gov
| Jobsub ID | 271691.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11851 |
| Stage ID | 3 |
| User name | usher@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 28800 (8 hours) |
| Submitted time | 2026-01-13 20:19:43 |
| Site | NL_SURFsara |
| Entry | DUNE_SurfSARA_arc02 |
| Last heartbeat | 2026-01-13 20:30:48 |
| From worker node | Hostname | wn-lb-16.gina.surf.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-13 20:21:29 |
| Input files | usertests:muminus_monte-carlo-011851-000003_gen_g4.root
|
| Jobscript | Exit code | 0 |
| Real time | 6m (374s) |
| CPU time | 6m (363s = 97%) |
| Max RSS bytes | 1432199168 (1365 MiB) |
| Outputting started | 2026-01-13 20:27:44 |
| Output files | usertests:muminus_monte-carlo-011851-000003_gen_g4_detsim.root
|
| Finished | 2026-01-13 20:30:48 |
| Saved logs | justin-logs:271691.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
sFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce recob::Wires named "dnnsp"
13-Jan-2026 21:22:39 CET Initiating request to open input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/usertests/cc/d5/muminus_monte-carlo-011851-000003_gen_g4.root"
13-Jan-2026 21:22:43 CET Opened input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/usertests/cc/d5/muminus_monte-carlo-011851-000003_gen_g4.root"
Begin processing the 1st record. run: 20000014 subRun: 0 event: 1 at 13-Jan-2026 21:22:43 CET
SimDepoSetSource got 2957 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2957 depos spanning: [0.548211, 0.551595]us
[21:22:44.939] W [ gen ] <IncoherentAddNoise:addnoiseapa0> model EmpiricalNoiseModel:empericalnoisemeganodes produced 6174 samples instead of expected 6000, future warnings muted
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=88979.9 n=14936 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=91633 n=14335 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
13-Jan-2026 21:23:02 CET Opened output file with pattern "muminus_monte-carlo-011851-000003_gen_g4_detsim.root"
Begin processing the 2nd record. run: 20000014 subRun: 0 event: 2 at 13-Jan-2026 21:23:03 CET
SimDepoSetSource got 3906 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3906 depos spanning: [0.287596, 0.681614]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=128675 n=10896 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=139566 n=8975 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 3rd record. run: 20000014 subRun: 0 event: 3 at 13-Jan-2026 21:23:21 CET
SimDepoSetSource got 1131 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1131 depos spanning: [0.282508, 3.62815]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=47192.1 n=7526 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=50732.6 n=7271 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 4th record. run: 20000014 subRun: 0 event: 4 at 13-Jan-2026 21:24:04 CET
SimDepoSetSource got 23649 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23649 depos spanning: [0.941853, 0.965633]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=702935 n=91614 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=774962 n=72953 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 5th record. run: 20000014 subRun: 0 event: 5 at 13-Jan-2026 21:24:53 CET
SimDepoSetSource got 19413 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19413 depos spanning: [0.0200399, 0.0403258]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=577972 n=79952 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=607667 n=69346 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 6th record. run: 20000014 subRun: 0 event: 6 at 13-Jan-2026 21:25:37 CET
SimDepoSetSource got 8330 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8330 depos spanning: [0.399776, 0.409408]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=209189 n=30421 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=216209 n=29324 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 7th record. run: 20000014 subRun: 0 event: 7 at 13-Jan-2026 21:25:54 CET
SimDepoSetSource got 3333 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3333 depos spanning: [0.796284, 0.800813]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=95400.5 n=10512 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=99780.7 n=9002 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 8th record. run: 20000014 subRun: 0 event: 8 at 13-Jan-2026 21:26:09 CET
SimDepoSetSource got 4164 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4164 depos spanning: [0.0732183, 0.222678]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=116479 n=21040 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=121003 n=20265 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 9th record. run: 20000014 subRun: 0 event: 9 at 13-Jan-2026 21:26:38 CET
SimDepoSetSource got 17782 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17782 depos spanning: [0.61235, 0.631135]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=525832 n=38897 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=586076 n=32675 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 10th record. run: 20000014 subRun: 0 event: 10 at 13-Jan-2026 21:26:58 CET
SimDepoSetSource got 13356 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 13356 depos spanning: [0.656938, 0.671068]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=363049 n=45116 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=373555 n=41980 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
13-Jan-2026 21:27:43 CET Closed output file "muminus_monte-carlo-011851-000003_gen_g4_detsim.root"
13-Jan-2026 21:27:43 CET Closed input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/usertests/cc/d5/muminus_monte-carlo-011851-000003_gen_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 14.8005 29.7353 49.2179 24.4293 12.749 10
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000406698 0.00143355 0.00293512 0.00157007 0.000729133 10
simulate:tpcrawdecoder:WireCellToolkit 14.6139 29.455 48.7598 24.1334 12.6762 10
simulate:opdigi:OpDetDigitizerDUNE 0.0829731 0.164537 0.251504 0.14778 0.0553827 10
simulate:rns:RandomNumberSaver 2.8082e-05 5.11414e-05 0.000245568 2.96095e-05 6.48132e-05 10
[art]:TriggerResults:TriggerResultInserter 1.2749e-05 1.62464e-05 4.3135e-05 1.33045e-05 8.96913e-06 10
end_path:out1:RootOutput 4.206e-06 9.0193e-06 4.9184e-05 4.5515e-06 1.33899e-05 10
end_path:out1:RootOutput(write) 0.0651084 0.113698 0.205041 0.102046 0.0475182 10
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3123.56 MB
Peak resident set size usage (VmHWM): 1432.2 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r--. 1 dune009 dune 31M Jan 13 21:27 muminus_monte-carlo-011851-000003_gen_g4_detsim.root
Wrote processed DID: usertests:muminus_monte-carlo-011851-000003_gen_g4.root
=== DETSIM job completed successfully ===
