Jobsub ID 297630.8@dunegpschedd02.fnal.gov
| Jobsub ID | 297630.8@dunegpschedd02.fnal.gov |
| Workflow ID | 12668 |
| Stage ID | 3 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 7200 (2 hours) |
| Submitted time | 2026-02-03 10:42:44 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2026-02-03 11:17:38 |
| From worker node | Hostname | dune001-1500145.0-lcg2494.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 10:44:39 |
| Input files | usertests:prod_monte-carlo-012668-000015_gen_g4.root
|
| Jobscript | Exit code | 0 |
| Real time | 31m (1878s) |
| CPU time | 29m (1795s = 95%) |
| Max RSS bytes | 1640681472 (1564 MiB) |
| Outputting started | 2026-02-03 11:15:58 |
| Output files | |
| Finished | 2026-02-03 11:17:38 |
| Saved logs | justin-logs:297630.8-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0 traces tagged "gauss"
FrameSaver: q=89618 n=7835 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=99625.7 n=6578 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210015 subRun: 0 event: 40 at 03-Feb-2026 11:10:33 UTC
SimDepoSetSource got 2920 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2920 depos spanning: [0.795948, 0.802156]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=92612.7 n=13358 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=96116 n=12702 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210015 subRun: 0 event: 41 at 03-Feb-2026 11:10:46 UTC
SimDepoSetSource got 3793 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3793 depos spanning: [0.596239, 0.60144]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=99229.3 n=15006 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=102655 n=14538 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210015 subRun: 0 event: 42 at 03-Feb-2026 11:11:02 UTC
SimDepoSetSource got 69 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 69 depos spanning: [0.515575, 0.515662]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=3868.09 n=1339 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=5172.91 n=1315 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210015 subRun: 0 event: 43 at 03-Feb-2026 11:11:15 UTC
SimDepoSetSource got 20626 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20626 depos spanning: [0.257691, 0.28291]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=631704 n=81255 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=685327 n=64200 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210015 subRun: 0 event: 44 at 03-Feb-2026 11:12:16 UTC
SimDepoSetSource got 5042 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5042 depos spanning: [0.00960703, 0.0150034]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=157169 n=13561 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=174434 n=11136 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210015 subRun: 0 event: 45 at 03-Feb-2026 11:12:44 UTC
SimDepoSetSource got 2008 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2008 depos spanning: [0.103909, 0.108175]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=50247.8 n=6130 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=53077 n=5413 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210015 subRun: 0 event: 46 at 03-Feb-2026 11:12:58 UTC
SimDepoSetSource got 25605 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25605 depos spanning: [0.366982, 0.401288]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=685283 n=92635 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=730555 n=74019 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210015 subRun: 0 event: 47 at 03-Feb-2026 11:14:19 UTC
SimDepoSetSource got 13523 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 13523 depos spanning: [0.358261, 0.372705]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=395021 n=40582 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=403954 n=37204 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210015 subRun: 0 event: 48 at 03-Feb-2026 11:14:39 UTC
SimDepoSetSource got 6404 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6404 depos spanning: [0.285054, 0.292236]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=194109 n=22350 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=218728 n=17578 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210015 subRun: 0 event: 49 at 03-Feb-2026 11:14:54 UTC
SimDepoSetSource got 2927 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2927 depos spanning: [0.886025, 1.37276]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=89420.9 n=12887 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=93519.7 n=12476 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210015 subRun: 0 event: 50 at 03-Feb-2026 11:15:23 UTC
SimDepoSetSource got 11651 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11651 depos spanning: [0.646238, 1.47998]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=350914 n=56466 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=362475 n=55202 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 11:15:56 UTC Closed output file "prod_monte-carlo-012668-000015_gen_g4_detsim.root"
03-Feb-2026 11:15:56 UTC Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/7c/83/prod_monte-carlo-012668-000015_gen_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 13.2049 35.3965 81.0102 31.4745 18.796 50
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000396574 0.00910342 0.11568 0.00266075 0.0209008 50
simulate:tpcrawdecoder:WireCellToolkit 13.1212 35.0049 80.4819 31.1143 18.69 50
simulate:opdigi:OpDetDigitizerDUNE 0.0203646 0.219797 0.474641 0.218495 0.0952974 50
simulate:rns:RandomNumberSaver 2.451e-05 4.30607e-05 0.000369925 3.39855e-05 4.72966e-05 50
[art]:TriggerResults:TriggerResultInserter 1.284e-05 2.03428e-05 7.0271e-05 1.755e-05 9.47234e-06 50
end_path:out1:RootOutput 3.77e-06 6.06836e-06 3.138e-05 4.57e-06 4.01336e-06 50
end_path:out1:RootOutput(write) 0.0601542 0.161897 0.293398 0.15871 0.0626394 50
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3529.53 MB
Peak resident set size usage (VmHWM): 1640.68 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 dune 216M Feb 3 11:15 prod_monte-carlo-012668-000015_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012668-000015_gen_g4.root
=== DETSIM job completed successfully ===