justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297772.6@dunegpschedd02.fnal.gov

Jobsub ID297772.6@dunegpschedd02.fnal.gov
Workflow ID12686
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 16:02:05
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2026-02-03 16:31:49
From worker nodeHostnamedune001-1504392.0-lcg2505.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 16:04:12
Input filesusertests:prod_monte-carlo-012686-000009_gen_g4.root
JobscriptExit code0
Real time26m (1570s)
CPU time25m (1532s = 97%)
Max RSS bytes1654095872 (1577 MiB)
Outputting started2026-02-03 16:30:24
Output files
Finished2026-02-03 16:31:49
Saved logsjustin-logs:297772.6-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=701902 n=100913 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=744663 n=86176 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210009 subRun: 0 event: 40 at 03-Feb-2026 16:26:08 UTC
SimDepoSetSource got 12143 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 12143 depos spanning: [0.620143, 1.06152]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=348172 n=33682 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=376869 n=27338 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210009 subRun: 0 event: 41 at 03-Feb-2026 16:26:42 UTC
SimDepoSetSource got 8802 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8802 depos spanning: [0.69738, 0.712409]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=233901 n=24305 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=247024 n=19311 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210009 subRun: 0 event: 42 at 03-Feb-2026 16:27:02 UTC
SimDepoSetSource got 18087 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 18087 depos spanning: [0.669555, 0.689129]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=410692 n=63829 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=424980 n=62075 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210009 subRun: 0 event: 43 at 03-Feb-2026 16:27:24 UTC
SimDepoSetSource got 4265 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4265 depos spanning: [0.733442, 0.74021]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=137919 n=17142 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=156413 n=13532 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210009 subRun: 0 event: 44 at 03-Feb-2026 16:27:38 UTC
SimDepoSetSource got 9697 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9697 depos spanning: [0.530953, 1.43831]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=250033 n=37418 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=261567 n=34811 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210009 subRun: 0 event: 45 at 03-Feb-2026 16:28:10 UTC
SimDepoSetSource got 3343 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3343 depos spanning: [0.365965, 0.613421]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=103204 n=14998 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=110443 n=12115 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210009 subRun: 0 event: 46 at 03-Feb-2026 16:28:26 UTC
SimDepoSetSource got 6689 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6689 depos spanning: [0.859208, 0.866742]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=186762 n=33119 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=191790 n=32254 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210009 subRun: 0 event: 47 at 03-Feb-2026 16:28:44 UTC
SimDepoSetSource got 25431 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25431 depos spanning: [0.602545, 0.63141]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=735635 n=117486 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=754747 n=110975 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210009 subRun: 0 event: 48 at 03-Feb-2026 16:29:35 UTC
SimDepoSetSource got 2903 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2903 depos spanning: [0.912434, 0.915651]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=55464.3 n=10675 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=57848.3 n=10462 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210009 subRun: 0 event: 49 at 03-Feb-2026 16:29:51 UTC
SimDepoSetSource got 199 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 199 depos spanning: [0.199175, 0.199425]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=6512.23 n=1783 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=7484.82 n=1759 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210009 subRun: 0 event: 50 at 03-Feb-2026 16:30:06 UTC
SimDepoSetSource got 2271 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2271 depos spanning: [0.344816, 0.347346]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=74558.4 n=8705 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=76327.2 n=8263 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 16:30:22 UTC  Closed output file "prod_monte-carlo-012686-000009_gen_g4_detsim.root"
03-Feb-2026 16:30:22 UTC  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/usertests/a6/80/prod_monte-carlo-012686-000009_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      13.087        29.6929       77.0299       28.5237       15.6561        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000517702   0.00240066    0.00922278    0.00178353    0.00182329       50     
simulate:tpcrawdecoder:WireCellToolkit          12.9687       29.3353       76.245        28.2747       15.5052        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0232683     0.201759      0.495622      0.181995      0.106242        50     
simulate:rns:RandomNumberSaver                2.7931e-05    4.84663e-05   0.000393559   4.1471e-05    5.04443e-05      50     
[art]:TriggerResults:TriggerResultInserter     1.445e-05    1.98143e-05   6.4041e-05    1.76955e-05   7.30184e-06      50     
end_path:out1:RootOutput                        3.6e-06     6.61838e-06   2.6011e-05    4.5655e-06    4.12453e-06      50     
end_path:out1:RootOutput(write)                0.0644263     0.152587      0.324802      0.128807      0.0732864       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3493.61 MB
  Peak resident set size usage (VmHWM): 1654.1 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 dune 179M Feb  3 16:30 prod_monte-carlo-012686-000009_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012686-000009_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:27:03 UTC       justIN version: 01.06.00