Jobsub ID 297366.10@dunegpschedd02.fnal.gov
| Jobsub ID | 297366.10@dunegpschedd02.fnal.gov |
| Workflow ID | 12654 |
| Stage ID | 3 |
| User name | usher@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 28800 (8 hours) |
| Submitted time | 2026-02-02 19:28:05 |
| Site | IT_CNAF |
| Entry | CMSHTPC_T1_IT_CNAF_condor_ce02 |
| Last heartbeat | 2026-02-02 20:11:18 |
| From worker node | Hostname | wn-s04-05-07-03.cr.cnaf.infn.it |
| cpuinfo | AMD EPYC 7313 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-02 19:28:57 |
| Input files | usertests:prodgenie_monte-carlo-012654-000261_gen_g4.root
|
| Jobscript | Exit code | 0 |
| Real time | 32m (1955s) |
| CPU time | 28m (1721s = 88%) |
| Max RSS bytes | 2314862592 (2207 MiB) |
| Outputting started | 2026-02-02 20:01:33 |
| Output files | |
| Finished | 2026-02-02 20:11:18 |
| Saved logs | justin-logs:297366.10-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
FrameSaver: q=117238 n=9295 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100261 subRun: 0 event: 40 at 02-Feb-2026 20:54:31 CET
SimDepoSetSource got 65415 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 65415 depos spanning: [6.67395e-07, 9.91181]us
Retagger: tagging trace set: wiener with 23040 traces, 23040 summary
Retagger: tagging trace set: gauss with 23040 traces, 0 summary
wclsFrameSaver: saving 23040 traces tagged "gauss"
FrameSaver: q=2.11273e+06 n=217762 tag=gauss
wclsFrameSaver: saving 23040 traces tagged "wiener"
FrameSaver: q=2.44462e+06 n=182787 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100261 subRun: 0 event: 41 at 02-Feb-2026 20:55:52 CET
SimDepoSetSource got 41579 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 41579 depos spanning: [6.67337e-07, 0.0446432]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=1.23135e+06 n=164131 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=1.36903e+06 n=128197 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100261 subRun: 0 event: 42 at 02-Feb-2026 20:56:46 CET
SimDepoSetSource got 1445 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1445 depos spanning: [1.05095e-06, 0.333506]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=79130.2 n=7671 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=89658.3 n=6892 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100261 subRun: 0 event: 43 at 02-Feb-2026 20:57:04 CET
SimDepoSetSource got 110643 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 110643 depos spanning: [6.6713e-07, 3.40709]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=2.6084e+06 n=160672 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=3.25412e+06 n=153813 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100261 subRun: 0 event: 44 at 02-Feb-2026 20:57:36 CET
SimDepoSetSource got 25024 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25024 depos spanning: [7.19192e-07, 3.62498]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=902820 n=103386 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=966622 n=90330 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100261 subRun: 0 event: 45 at 02-Feb-2026 20:58:23 CET
SimDepoSetSource got 5090 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5090 depos spanning: [7.15347e-07, 1.75297]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=185792 n=18999 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=216330 n=16138 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100261 subRun: 0 event: 46 at 02-Feb-2026 20:58:43 CET
SimDepoSetSource got 3032 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3032 depos spanning: [1.99764e-06, 2.73477]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=92889.9 n=13987 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=102752 n=12339 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100261 subRun: 0 event: 47 at 02-Feb-2026 20:59:07 CET
SimDepoSetSource got 25697 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25697 depos spanning: [0.00101265, 1.05956]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=604436 n=83161 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=667221 n=73878 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100261 subRun: 0 event: 48 at 02-Feb-2026 20:59:44 CET
SimDepoSetSource got 24860 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 24860 depos spanning: [9.3564e-08, 6.14241]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=829503 n=88103 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=936364 n=76392 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100261 subRun: 0 event: 49 at 02-Feb-2026 21:00:13 CET
SimDepoSetSource got 8006 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8006 depos spanning: [6.69396e-07, 0.0521088]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=242392 n=34472 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=255454 n=30184 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100261 subRun: 0 event: 50 at 02-Feb-2026 21:00:36 CET
SimDepoSetSource got 30312 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 30312 depos spanning: [6.67996e-07, 8.96654]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=914948 n=123514 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=981701 n=98594 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:01:32 CET Closed output file "prodgenie_monte-carlo-012654-000261_gen_g4_detsim.root"
02-Feb-2026 21:01:32 CET Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/78/5e/prodgenie_monte-carlo-012654-000261_gen_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 8.63973 34.291 93.956 29.2101 17.9261 50
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000376548 0.0156433 0.164163 0.00157258 0.0392134 50
simulate:tpcrawdecoder:WireCellToolkit 8.51865 33.8732 92.7255 28.8162 17.7066 50
simulate:opdigi:OpDetDigitizerDUNE 0.0677871 0.217762 1.04025 0.161508 0.181806 50
simulate:rns:RandomNumberSaver 1.9116e-05 3.98393e-05 0.000384052 2.96405e-05 5.04724e-05 50
[art]:TriggerResults:TriggerResultInserter 7.794e-06 1.43812e-05 4.8601e-05 1.22225e-05 8.5046e-06 50
end_path:out1:RootOutput 2.865e-06 5.55328e-06 2.8484e-05 3.952e-06 4.37401e-06 50
end_path:out1:RootOutput(write) 0.0398715 0.18391 0.778093 0.13955 0.153555 50
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4028.02 MB
Peak resident set size usage (VmHWM): 2314.86 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 neutrino002 neutrino 544M Feb 2 21:01 prodgenie_monte-carlo-012654-000261_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000261_gen_g4.root
=== DETSIM job completed successfully ===