Jobsub ID 271691.0@dunegpschedd02.fnal.gov
| Jobsub ID | 271691.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11851 |
| Stage ID | 3 |
| User name | usher@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 28800 (8 hours) |
| Submitted time | 2026-01-13 20:19:43 |
| Site | NL_SURFsara |
| Entry | DUNE_SurfSARA_arc03 |
| Last heartbeat | 2026-01-13 20:30:25 |
| From worker node | Hostname | wn-la-09.gina.surf.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-13 20:21:42 |
| Input files | usertests:muminus_monte-carlo-011851-000001_gen_g4.root
|
| Jobscript | Exit code | 0 |
| Real time | 5m (358s) |
| CPU time | 5m (347s = 96%) |
| Max RSS bytes | 1666674688 (1589 MiB) |
| Outputting started | 2026-01-13 20:27:41 |
| Output files | usertests:muminus_monte-carlo-011851-000001_gen_g4_detsim.root
|
| Finished | 2026-01-13 20:30:25 |
| Saved logs | justin-logs:271691.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
aver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce recob::Wires named "dnnsp"
13-Jan-2026 21:22:51 CET Initiating request to open input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/usertests/27/14/muminus_monte-carlo-011851-000001_gen_g4.root"
13-Jan-2026 21:22:53 CET Opened input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/usertests/27/14/muminus_monte-carlo-011851-000001_gen_g4.root"
Begin processing the 1st record. run: 20000014 subRun: 0 event: 1 at 13-Jan-2026 21:22:54 CET
SimDepoSetSource got 6786 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6786 depos spanning: [0.160246, 0.170411]us
[21:22:56.064] W [ gen ] <IncoherentAddNoise:addnoiseapa6> model EmpiricalNoiseModel:empericalnoisemeganodes produced 6174 samples instead of expected 6000, future warnings muted
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=167408 n=18946 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=181436 n=15139 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
13-Jan-2026 21:23:28 CET Opened output file with pattern "muminus_monte-carlo-011851-000001_gen_g4_detsim.root"
Begin processing the 2nd record. run: 20000014 subRun: 0 event: 2 at 13-Jan-2026 21:23:28 CET
SimDepoSetSource got 23885 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23885 depos spanning: [0.00327004, 0.0265512]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=681694 n=98569 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=712725 n=89116 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 3rd record. run: 20000014 subRun: 0 event: 3 at 13-Jan-2026 21:24:18 CET
SimDepoSetSource got 3152 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3152 depos spanning: [0.942628, 0.950011]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=78966.1 n=9151 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=84099.2 n=8291 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 4th record. run: 20000014 subRun: 0 event: 4 at 13-Jan-2026 21:24:34 CET
SimDepoSetSource got 5042 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5042 depos spanning: [0.477014, 1.17661]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=166165 n=14768 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=178373 n=12334 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 5th record. run: 20000014 subRun: 0 event: 5 at 13-Jan-2026 21:24:51 CET
SimDepoSetSource got 29746 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 29746 depos spanning: [0.706895, 0.737783]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=857703 n=110884 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=905944 n=94044 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 6th record. run: 20000014 subRun: 0 event: 6 at 13-Jan-2026 21:26:02 CET
SimDepoSetSource got 7057 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7057 depos spanning: [0.960842, 0.969768]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=218462 n=29185 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=243569 n=22997 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 7th record. run: 20000014 subRun: 0 event: 7 at 13-Jan-2026 21:26:17 CET
SimDepoSetSource got 1691 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1691 depos spanning: [0.625853, 0.631486]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=45955.5 n=5584 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=48021.1 n=5113 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 8th record. run: 20000014 subRun: 0 event: 8 at 13-Jan-2026 21:26:29 CET
SimDepoSetSource got 8033 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8033 depos spanning: [0.301263, 0.309254]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=215855 n=32006 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=224484 n=28488 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 9th record. run: 20000014 subRun: 0 event: 9 at 13-Jan-2026 21:26:57 CET
SimDepoSetSource got 3710 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3710 depos spanning: [0.666064, 0.670766]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=98856.2 n=11490 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=102594 n=10220 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 10th record. run: 20000014 subRun: 0 event: 10 at 13-Jan-2026 21:27:11 CET
SimDepoSetSource got 13431 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 13431 depos spanning: [0.598217, 0.612933]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=415280 n=35243 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=453249 n=29261 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
13-Jan-2026 21:27:40 CET Closed output file "muminus_monte-carlo-011851-000001_gen_g4_detsim.root"
13-Jan-2026 21:27:40 CET Closed input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/usertests/27/14/muminus_monte-carlo-011851-000001_gen_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 12.1435 28.361 71.641 22.0468 18.1245 10
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000510642 0.00129888 0.00253351 0.00109779 0.000708618 10
simulate:tpcrawdecoder:WireCellToolkit 12.039 28.0998 71.113 21.7923 17.9967 10
simulate:opdigi:OpDetDigitizerDUNE 0.0530019 0.1463 0.28069 0.128292 0.0743972 10
simulate:rns:RandomNumberSaver 2.7491e-05 5.04872e-05 0.000225737 2.9849e-05 5.85839e-05 10
[art]:TriggerResults:TriggerResultInserter 1.1977e-05 1.6105e-05 4.5498e-05 1.30245e-05 9.80685e-06 10
end_path:out1:RootOutput 4.176e-06 7.3212e-06 1.8968e-05 4.7525e-06 5.24731e-06 10
end_path:out1:RootOutput(write) 0.0497989 0.113036 0.248535 0.0870406 0.0656269 10
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3355.32 MB
Peak resident set size usage (VmHWM): 1666.67 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r--. 1 dune009 dune 32M Jan 13 21:27 muminus_monte-carlo-011851-000001_gen_g4_detsim.root
Wrote processed DID: usertests:muminus_monte-carlo-011851-000001_gen_g4.root
=== DETSIM job completed successfully ===
