Jobsub ID 297621.6@dunegpschedd02.fnal.gov
| Jobsub ID | 297621.6@dunegpschedd02.fnal.gov |
| Workflow ID | 12668 |
| Stage ID | 3 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 7200 (2 hours) |
| Submitted time | 2026-02-03 09:54:42 |
| Site | UK_QMUL |
| Entry | DUNE_UK_London_QMUL_arcce02 |
| Last heartbeat | 2026-02-03 10:38:02 |
| From worker node | Hostname | cn083.htc.esc.qmul |
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 09:55:44 |
| Input files | usertests:prod_monte-carlo-012668-000019_gen_g4.root
|
| Jobscript | Exit code | 0 |
| Real time | 37m (2220s) |
| CPU time | 36m (2164s = 97%) |
| Max RSS bytes | 2056282112 (1961 MiB) |
| Outputting started | 2026-02-03 10:32:45 |
| Output files | |
| Finished | 2026-02-03 10:38:02 |
| Saved logs | justin-logs:297621.6-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
aver: saving 5120 traces tagged "gauss"
FrameSaver: q=363288 n=41571 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=402663 n=33729 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210019 subRun: 0 event: 40 at 03-Feb-2026 10:26:39 GMT
SimDepoSetSource got 4619 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4619 depos spanning: [0.737723, 0.744704]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=118788 n=15942 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=126110 n=13826 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210019 subRun: 0 event: 41 at 03-Feb-2026 10:26:59 GMT
SimDepoSetSource got 14366 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14366 depos spanning: [0.0974456, 0.40727]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=444993 n=41346 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=468427 n=37025 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210019 subRun: 0 event: 42 at 03-Feb-2026 10:27:30 GMT
SimDepoSetSource got 17864 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17864 depos spanning: [0.530211, 3.96361]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=539661 n=76692 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=574119 n=65602 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210019 subRun: 0 event: 43 at 03-Feb-2026 10:28:29 GMT
SimDepoSetSource got 2002 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2002 depos spanning: [0.108733, 0.11112]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=61239.3 n=8428 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=64925.6 n=7065 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210019 subRun: 0 event: 44 at 03-Feb-2026 10:28:47 GMT
SimDepoSetSource got 32990 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 32990 depos spanning: [0.310846, 0.347869]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=961732 n=127424 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.01196e+06 n=108690 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210019 subRun: 0 event: 45 at 03-Feb-2026 10:30:25 GMT
SimDepoSetSource got 8927 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8927 depos spanning: [0.561878, 0.571361]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=189454 n=31731 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=196411 n=30742 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210019 subRun: 0 event: 46 at 03-Feb-2026 10:30:49 GMT
SimDepoSetSource got 5305 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5305 depos spanning: [0.082447, 0.801067]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=170796 n=26018 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=175861 n=25647 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210019 subRun: 0 event: 47 at 03-Feb-2026 10:31:09 GMT
SimDepoSetSource got 4499 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4499 depos spanning: [0.538066, 0.54338]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=127739 n=11478 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=136890 n=9816 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210019 subRun: 0 event: 48 at 03-Feb-2026 10:31:28 GMT
SimDepoSetSource got 5924 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5924 depos spanning: [0.926829, 0.93359]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=183150 n=21597 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=204345 n=16997 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210019 subRun: 0 event: 49 at 03-Feb-2026 10:31:47 GMT
SimDepoSetSource got 401 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 401 depos spanning: [0.0784531, 0.0792053]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=11010.7 n=2883 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=12125.9 n=2818 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210019 subRun: 0 event: 50 at 03-Feb-2026 10:32:05 GMT
SimDepoSetSource got 14625 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14625 depos spanning: [0.488006, 0.505318]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=449442 n=59939 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=478079 n=50738 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 10:32:44 GMT Closed output file "prod_monte-carlo-012668-000019_gen_g4_detsim.root"
03-Feb-2026 10:32:44 GMT Closed input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/usertests/33/4c/prod_monte-carlo-012668-000019_gen_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 13.559 42.3833 155.41 37.0057 26.7694 50
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000537733 0.00630785 0.0441153 0.00245955 0.0118479 50
simulate:tpcrawdecoder:WireCellToolkit 13.2493 41.8419 154.32 36.4927 26.5995 50
simulate:opdigi:OpDetDigitizerDUNE 0.125055 0.356513 0.687641 0.364178 0.133166 50
simulate:rns:RandomNumberSaver 2.1388e-05 3.97445e-05 0.000327161 3.1055e-05 4.18104e-05 50
[art]:TriggerResults:TriggerResultInserter 9.496e-06 1.67837e-05 5.3358e-05 1.5567e-05 6.03187e-06 50
end_path:out1:RootOutput 3.099e-06 5.37996e-06 2.4469e-05 4.1995e-06 3.28111e-06 50
end_path:out1:RootOutput(write) 0.0769573 0.177806 0.396264 0.168996 0.080407 50
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3756.98 MB
Peak resident set size usage (VmHWM): 2056.28 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 pildune22 pildune 208M Feb 3 10:32 prod_monte-carlo-012668-000019_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012668-000019_gen_g4.root
=== DETSIM job completed successfully ===