Jobsub ID 303176.0@dunegpschedd01.fnal.gov
| Jobsub ID | 303176.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12654 |
| Stage ID | 3 |
| User name | usher@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 28800 (8 hours) |
| Submitted time | 2026-02-02 22:22:12 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-02-02 23:09:43 |
| From worker node | Hostname | td808.pic.es |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-02 22:23:30 |
| Input files | usertests:prodgenie_monte-carlo-012654-000503_gen_g4.root
|
| Jobscript | Exit code | 0 |
| Real time | 42m (2574s) |
| CPU time | 41m (2473s = 96%) |
| Max RSS bytes | 2176937984 (2076 MiB) |
| Outputting started | 2026-02-02 23:06:25 |
| Output files | |
| Finished | 2026-02-02 23:09:43 |
| Saved logs | justin-logs:303176.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ner"
FrameSaver: q=495269 n=57823 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100503 subRun: 0 event: 40 at 02-Feb-2026 23:56:49 CET
SimDepoSetSource got 22282 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 22282 depos spanning: [6.67977e-07, 4.05478]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=640413 n=102765 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=684031 n=84284 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100503 subRun: 0 event: 41 at 02-Feb-2026 23:58:04 CET
SimDepoSetSource got 1412 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1412 depos spanning: [4.05035e-05, 0.18342]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=33916.5 n=8268 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=40215.7 n=7303 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100503 subRun: 0 event: 42 at 02-Feb-2026 23:58:30 CET
SimDepoSetSource got 35065 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 35065 depos spanning: [6.67851e-07, 0.500026]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=1.01546e+06 n=138214 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.12252e+06 n=110055 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100503 subRun: 0 event: 43 at 02-Feb-2026 23:59:24 CET
SimDepoSetSource got 11608 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11608 depos spanning: [6.68798e-07, 9.47838]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=299781 n=48378 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=333522 n=42231 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100503 subRun: 0 event: 44 at 03-Feb-2026 00:00:25 CET
SimDepoSetSource got 19626 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19626 depos spanning: [6.81539e-07, 2.69476]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=593204 n=59524 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=656115 n=51846 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100503 subRun: 0 event: 45 at 03-Feb-2026 00:01:18 CET
SimDepoSetSource got 4992 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4992 depos spanning: [0.000372762, 6.88164]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=160910 n=19499 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=183767 n=17392 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100503 subRun: 0 event: 46 at 03-Feb-2026 00:01:56 CET
SimDepoSetSource got 45344 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 45344 depos spanning: [6.68627e-07, 0.352921]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=1.25753e+06 n=138831 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=1.41118e+06 n=115815 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100503 subRun: 0 event: 47 at 03-Feb-2026 00:02:48 CET
SimDepoSetSource got 222061 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 222061 depos spanning: [6.67279e-07, 11.4137]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=6.05042e+06 n=524087 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=7.0963e+06 n=459329 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100503 subRun: 0 event: 48 at 03-Feb-2026 00:04:23 CET
SimDepoSetSource got 27492 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 27492 depos spanning: [6.67685e-07, 0.068262]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=829614 n=109904 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=907394 n=85644 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100503 subRun: 0 event: 49 at 03-Feb-2026 00:05:11 CET
SimDepoSetSource got 940 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 940 depos spanning: [1.5894e-06, 1.97996]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=45997.5 n=7349 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=51477.1 n=6680 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100503 subRun: 0 event: 50 at 03-Feb-2026 00:05:40 CET
SimDepoSetSource got 20320 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20320 depos spanning: [5.5682e-07, 1.1792]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=613109 n=72290 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=701787 n=59803 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 00:06:24 CET Closed output file "prodgenie_monte-carlo-012654-000503_gen_g4_detsim.root"
03-Feb-2026 00:06:24 CET Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/usertests/e4/31/prodgenie_monte-carlo-012654-000503_gen_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 10.5953 49.6938 139.276 45.249 26.6579 50
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000705584 0.00815654 0.062525 0.00330522 0.0143615 50
simulate:tpcrawdecoder:WireCellToolkit 10.4862 49.211 137.467 44.7994 26.3416 50
simulate:opdigi:OpDetDigitizerDUNE 0.0608403 0.258561 1.38861 0.199102 0.226899 50
simulate:rns:RandomNumberSaver 1.99e-05 3.85113e-05 0.000272981 3.21155e-05 3.50689e-05 50
[art]:TriggerResults:TriggerResultInserter 1.012e-05 1.60947e-05 4.365e-05 1.5085e-05 6.01378e-06 50
end_path:out1:RootOutput 3e-06 4.98334e-06 2.098e-05 4.41e-06 2.59616e-06 50
end_path:out1:RootOutput(write) 0.0459816 0.21541 1.40456 0.164071 0.227509 50
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3956.39 MB
Peak resident set size usage (VmHWM): 2176.94 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 dune 572M Feb 3 00:06 prodgenie_monte-carlo-012654-000503_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000503_gen_g4.root
=== DETSIM job completed successfully ===
