justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303052.7@dunegpschedd01.fnal.gov

Jobsub ID303052.7@dunegpschedd01.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 19:42:06
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce05
Last heartbeat2026-02-02 20:25:06
From worker nodeHostnamedune001-1806385.0-lcg2713.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 19:43:17
Input filesusertests:prodgenie_monte-carlo-012654-000727_gen_g4.root
JobscriptExit code0
Real time40m (2424s)
CPU time37m (2259s = 93%)
Max RSS bytes2062774272 (1967 MiB)
Outputting started2026-02-02 20:23:42
Output files
Finished2026-02-02 20:25:06
Saved logsjustin-logs:303052.7-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ng 7680 traces tagged "wiener"
FrameSaver: q=565075 n=57914 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100727 subRun: 0 event: 40 at 02-Feb-2026 20:15:09 UTC
SimDepoSetSource got 18743 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 18743 depos spanning: [6.68229e-07, 0.182551]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=472045 n=57525 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=531755 n=48806 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100727 subRun: 0 event: 41 at 02-Feb-2026 20:15:34 UTC
SimDepoSetSource got 44308 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 44308 depos spanning: [6.67169e-07, 0.371782]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=1.18041e+06 n=164331 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.28117e+06 n=132500 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100727 subRun: 0 event: 42 at 02-Feb-2026 20:16:38 UTC
SimDepoSetSource got 39486 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 39486 depos spanning: [6.77334e-07, 3.09769]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=902745 n=112249 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=998772 n=98351 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100727 subRun: 0 event: 43 at 02-Feb-2026 20:17:39 UTC
SimDepoSetSource got 48976 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 48976 depos spanning: [6.67147e-07, 3.24604]us
Retagger: tagging trace set: wiener with 23040 traces, 23040 summary
Retagger: tagging trace set: gauss with 23040 traces, 0 summary
wclsFrameSaver: saving 23040 traces tagged "gauss"
FrameSaver: q=1.62727e+06 n=190668 tag=gauss
wclsFrameSaver: saving 23040 traces tagged "wiener"
FrameSaver: q=1.80049e+06 n=158248 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100727 subRun: 0 event: 44 at 02-Feb-2026 20:19:20 UTC
SimDepoSetSource got 13044 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 13044 depos spanning: [6.67137e-07, 0.157192]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=389560 n=52111 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=427684 n=42516 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100727 subRun: 0 event: 45 at 02-Feb-2026 20:20:05 UTC
SimDepoSetSource got 22912 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 22912 depos spanning: [0.000755303, 0.347125]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=597294 n=92902 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=647522 n=73695 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100727 subRun: 0 event: 46 at 02-Feb-2026 20:21:01 UTC
SimDepoSetSource got 15243 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 15243 depos spanning: [6.86495e-07, 5.91584]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=474319 n=58956 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=519584 n=50871 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100727 subRun: 0 event: 47 at 02-Feb-2026 20:21:54 UTC
SimDepoSetSource got 3580 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3580 depos spanning: [6.67446e-07, 5.03956]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=146483 n=17713 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=168622 n=15402 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100727 subRun: 0 event: 48 at 02-Feb-2026 20:22:34 UTC
SimDepoSetSource got 2437 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2437 depos spanning: [9.12946e-07, 2.45399]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=105709 n=13887 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=114804 n=12093 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100727 subRun: 0 event: 49 at 02-Feb-2026 20:23:05 UTC
SimDepoSetSource got 5053 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5053 depos spanning: [6.67911e-07, 2.0659]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=148451 n=20430 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=155904 n=17173 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100727 subRun: 0 event: 50 at 02-Feb-2026 20:23:17 UTC
SimDepoSetSource got 4681 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4681 depos spanning: [7.65152e-07, 2.93846]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=179008 n=20160 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=192139 n=17238 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 20:23:40 UTC  Closed output file "prodgenie_monte-carlo-012654-000727_gen_g4_detsim.root"
02-Feb-2026 20:23:40 UTC  Closed input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/usertests/c1/fc/prodgenie_monte-carlo-012654-000727_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      9.45994       46.1663       116.022       42.4381       21.879         50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000383857   0.00997974     0.0652863    0.00373747      0.01808        50     
simulate:tpcrawdecoder:WireCellToolkit          9.42024       45.6895       114.327       41.6799       21.6535        50     
simulate:opdigi:OpDetDigitizerDUNE            0.00531497     0.255324       1.01973      0.210494      0.163391        50     
simulate:rns:RandomNumberSaver                2.0361e-05    7.25258e-05   0.000171398   4.49875e-05   4.12178e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.1127e-05    1.89456e-05   4.8452e-05    1.7932e-05    5.63995e-06      50     
end_path:out1:RootOutput                       2.854e-06    6.83588e-05   0.00303502     8.157e-06    0.00042382       50     
end_path:out1:RootOutput(write)                0.0286183      0.21078       1.31548      0.171693      0.187114        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4097.13 MB
  Peak resident set size usage (VmHWM): 2062.77 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 dune 498M Feb  2 20:23 prodgenie_monte-carlo-012654-000727_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000727_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:48:55 UTC       justIN version: 01.06.00