Jobsub ID 278352.2@dunegpschedd01.fnal.gov
| Jobsub ID | 278352.2@dunegpschedd01.fnal.gov |
| Workflow ID | 11933 |
| Stage ID | 3 |
| User name | usher@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 28800 (8 hours) |
| Submitted time | 2026-01-14 22:53:05 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce15-multicore |
| Last heartbeat | 2026-01-14 23:10:28 |
| From worker node | Hostname | hnode72.pic.es |
| cpuinfo | AMD EPYC 7443P 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-14 22:53:39 |
| Input files | usertests:prod_monte-carlo-011933-000003_gen_g4.root
|
| Jobscript | Exit code | 0 |
| Real time | 15m (953s) |
| CPU time | 7m (428s = 44%) |
| Max RSS bytes | 1693753344 (1615 MiB) |
| Outputting started | 2026-01-14 23:09:32 |
| Output files | |
| Finished | 2026-01-14 23:10:28 |
| Saved logs | justin-logs:278352.2-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
g 12800 traces tagged "gauss"
FrameSaver: q=758494 n=114231 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=790732 n=101410 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 10th record. run: 200003 subRun: 0 event: 10 at 15-Jan-2026 00:01:32 CET
SimDepoSetSource got 25114 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25114 depos spanning: [0.32501, 1.0607]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=747938 n=107723 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=794378 n=90663 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 11th record. run: 200003 subRun: 0 event: 11 at 15-Jan-2026 00:04:26 CET
SimDepoSetSource got 11609 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11609 depos spanning: [0.888047, 1.53384]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=346081 n=41178 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=354498 n=38748 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 12th record. run: 200003 subRun: 0 event: 12 at 15-Jan-2026 00:06:45 CET
SimDepoSetSource got 19258 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19258 depos spanning: [0.101715, 0.122565]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=520479 n=54283 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=552103 n=43029 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 13th record. run: 200003 subRun: 0 event: 13 at 15-Jan-2026 00:07:05 CET
SimDepoSetSource got 8835 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8835 depos spanning: [0.156188, 0.595746]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=257707 n=39355 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=274636 n=32267 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 14th record. run: 200003 subRun: 0 event: 14 at 15-Jan-2026 00:07:29 CET
SimDepoSetSource got 6615 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6615 depos spanning: [0.503787, 0.753412]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=199137 n=32860 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=204298 n=31240 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 15th record. run: 200003 subRun: 0 event: 15 at 15-Jan-2026 00:07:38 CET
SimDepoSetSource got 35463 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 35463 depos spanning: [0.499776, 0.530424]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=987935 n=97172 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=1.08214e+06 n=80776 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 16th record. run: 200003 subRun: 0 event: 16 at 15-Jan-2026 00:08:13 CET
SimDepoSetSource got 360 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 360 depos spanning: [0.466367, 0.472795]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=3853.81 n=1184 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=5074.91 n=1106 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 17th record. run: 200003 subRun: 0 event: 17 at 15-Jan-2026 00:08:20 CET
SimDepoSetSource got 1387 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1387 depos spanning: [0.509638, 0.513227]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=32736.3 n=4330 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=36157.5 n=4267 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 18th record. run: 200003 subRun: 0 event: 18 at 15-Jan-2026 00:08:27 CET
SimDepoSetSource got 29277 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 29277 depos spanning: [0.0668385, 0.0980383]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=859492 n=130195 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=908271 n=111488 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 19th record. run: 200003 subRun: 0 event: 19 at 15-Jan-2026 00:09:03 CET
SimDepoSetSource got 3272 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3272 depos spanning: [0.200581, 1.19913]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=89933.7 n=14467 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=95554 n=13225 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 20th record. run: 200003 subRun: 0 event: 20 at 15-Jan-2026 00:09:23 CET
SimDepoSetSource got 2346 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2346 depos spanning: [0.912228, 0.914917]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=48882.1 n=7601 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=52530.8 n=7587 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
15-Jan-2026 00:09:32 CET Closed output file "prod_monte-carlo-011933-000003_gen_g4_detsim.root"
15-Jan-2026 00:09:32 CET Closed input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/usertests/83/05/prod_monte-carlo-011933-000003_gen_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 6.83538 31.8661 174.169 19.0173 43.2081 20
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000218924 0.00115176 0.00286317 0.000888114 0.000826931 20
simulate:tpcrawdecoder:WireCellToolkit 6.77751 31.6645 173.671 18.7694 43.1341 20
simulate:opdigi:OpDetDigitizerDUNE 0.0211492 0.115978 0.302294 0.115074 0.0664145 20
simulate:rns:RandomNumberSaver 1.604e-05 2.81091e-05 0.000190024 1.8355e-05 3.73619e-05 20
[art]:TriggerResults:TriggerResultInserter 7.32e-06 1.00422e-05 3.0091e-05 8.83e-06 4.78022e-06 20
end_path:out1:RootOutput 1.92e-06 2.89505e-06 1.3921e-05 2.2355e-06 2.54918e-06 20
end_path:out1:RootOutput(write) 0.0271302 0.0841555 0.193992 0.0764636 0.0468792 20
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3431.26 MB
Peak resident set size usage (VmHWM): 1693.75 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 dune 85M Jan 15 00:09 prod_monte-carlo-011933-000003_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-011933-000003_gen_g4.root
=== DETSIM job completed successfully ===
