Jobsub ID 303045.92@dunegpschedd01.fnal.gov
| Jobsub ID | 303045.92@dunegpschedd01.fnal.gov |
| Workflow ID | 12654 |
| Stage ID | 3 |
| User name | usher@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 28800 (8 hours) |
| Submitted time | 2026-02-02 19:34:05 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-02-02 20:20:20 |
| From worker node | Hostname | td808.pic.es |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-02 19:36:15 |
| Input files | usertests:prodgenie_monte-carlo-012654-000683_gen_g4.root
|
| Jobscript | Exit code | 0 |
| Real time | 43m (2581s) |
| CPU time | 41m (2479s = 96%) |
| Max RSS bytes | 2261135360 (2156 MiB) |
| Outputting started | 2026-02-02 20:19:17 |
| Output files | |
| Finished | 2026-02-02 20:20:20 |
| Saved logs | justin-logs:303045.92-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
q=98209.9 n=12053 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100683 subRun: 0 event: 40 at 02-Feb-2026 21:09:27 CET
SimDepoSetSource got 37950 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 37950 depos spanning: [6.69113e-07, 3.42242]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=1.12585e+06 n=116146 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=1.29841e+06 n=99934 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100683 subRun: 0 event: 41 at 02-Feb-2026 21:10:07 CET
SimDepoSetSource got 3927 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3927 depos spanning: [2.12311e-06, 7.40857]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=104894 n=18435 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=115578 n=16018 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100683 subRun: 0 event: 42 at 02-Feb-2026 21:10:42 CET
SimDepoSetSource got 6046 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6046 depos spanning: [7.81523e-07, 0.0075895]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=172960 n=20981 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=191984 n=17506 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100683 subRun: 0 event: 43 at 02-Feb-2026 21:10:54 CET
SimDepoSetSource got 198249 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 198249 depos spanning: [6.67263e-07, 7.25349]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=5.56855e+06 n=592803 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=6.1472e+06 n=509287 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100683 subRun: 0 event: 44 at 02-Feb-2026 21:13:11 CET
SimDepoSetSource got 27507 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 27507 depos spanning: [6.67177e-07, 0.0295772]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=842053 n=84357 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=975670 n=70341 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100683 subRun: 0 event: 45 at 02-Feb-2026 21:13:55 CET
SimDepoSetSource got 36251 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 36251 depos spanning: [6.67208e-07, 3.76398]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=1.18439e+06 n=127580 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=1.36602e+06 n=106465 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100683 subRun: 0 event: 46 at 02-Feb-2026 21:15:23 CET
SimDepoSetSource got 31266 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 31266 depos spanning: [6.67767e-07, 2.06806]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=980943 n=127991 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.10704e+06 n=101431 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100683 subRun: 0 event: 47 at 02-Feb-2026 21:16:20 CET
SimDepoSetSource got 26815 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 26815 depos spanning: [6.67638e-07, 2.18737]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=853087 n=111965 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=917744 n=92243 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100683 subRun: 0 event: 48 at 02-Feb-2026 21:17:12 CET
SimDepoSetSource got 12841 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 12841 depos spanning: [6.77082e-07, 1.27351]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=426999 n=51814 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=477706 n=47087 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100683 subRun: 0 event: 49 at 02-Feb-2026 21:18:01 CET
SimDepoSetSource got 20204 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20204 depos spanning: [6.67725e-07, 0.567108]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=499943 n=71141 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=541427 n=57057 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100683 subRun: 0 event: 50 at 02-Feb-2026 21:18:38 CET
SimDepoSetSource got 10112 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 10112 depos spanning: [6.68168e-07, 2.23738]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=360232 n=50713 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=377363 n=43393 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:19:16 CET Closed output file "prodgenie_monte-carlo-012654-000683_gen_g4_detsim.root"
02-Feb-2026 21:19:16 CET Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/usertests/f8/cb/prodgenie_monte-carlo-012654-000683_gen_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 8.47354 49.6913 135.546 40.5328 31.4259 50
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000382912 0.00795901 0.0519929 0.00253177 0.0146559 50
simulate:tpcrawdecoder:WireCellToolkit 8.36449 49.1691 133.233 39.9486 30.9918 50
simulate:opdigi:OpDetDigitizerDUNE 0.0348597 0.267202 1.67847 0.174712 0.270956 50
simulate:rns:RandomNumberSaver 2.07e-05 3.37844e-05 0.000353292 2.603e-05 4.60463e-05 50
[art]:TriggerResults:TriggerResultInserter 9.611e-06 1.33408e-05 4.7841e-05 1.2285e-05 5.37671e-06 50
end_path:out1:RootOutput 2.849e-06 4.57702e-06 2.648e-05 4.165e-06 3.20867e-06 50
end_path:out1:RootOutput(write) 0.0430032 0.246407 1.21671 0.16457 0.251204 50
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4042.04 MB
Peak resident set size usage (VmHWM): 2261.14 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 dune 659M Feb 2 21:19 prodgenie_monte-carlo-012654-000683_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000683_gen_g4.root
=== DETSIM job completed successfully ===