justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303490.6@dunegpschedd01.fnal.gov

Jobsub ID303490.6@dunegpschedd01.fnal.gov
Workflow ID12686
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 16:08:05
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce05
Last heartbeat2026-02-03 16:28:24
From worker nodeHostnamedune001-1830137.0-lcg2711.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 16:09:58
Input filesusertests:prod_monte-carlo-012686-000014_gen_g4.root
JobscriptExit code0
Real time17m (1020s)
CPU time15m (947s = 92%)
Max RSS bytes1602879488 (1528 MiB)
Outputting started2026-02-03 16:27:01
Output files
Finished2026-02-03 16:28:24
Saved logsjustin-logs:303490.6-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ing 2560 traces tagged "gauss"
FrameSaver: q=18997.3 n=3885 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=20498.9 n=3835 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210014 subRun: 0 event: 40 at 03-Feb-2026 16:23:55 UTC
SimDepoSetSource got 10944 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 10944 depos spanning: [0.867724, 0.879167]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=244311 n=40726 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=253535 n=40225 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210014 subRun: 0 event: 41 at 03-Feb-2026 16:24:08 UTC
SimDepoSetSource got 2377 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2377 depos spanning: [0.807574, 1.56421]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=75808.3 n=11319 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=82085.8 n=9371 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210014 subRun: 0 event: 42 at 03-Feb-2026 16:24:18 UTC
SimDepoSetSource got 11108 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11108 depos spanning: [0.632682, 0.644961]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=244712 n=41621 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=252168 n=39999 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210014 subRun: 0 event: 43 at 03-Feb-2026 16:24:32 UTC
SimDepoSetSource got 1686 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1686 depos spanning: [0.720565, 1.09431]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=58662.2 n=7209 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=64867.3 n=6095 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210014 subRun: 0 event: 44 at 03-Feb-2026 16:24:41 UTC
SimDepoSetSource got 5594 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5594 depos spanning: [0.893383, 1.01634]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=152378 n=16931 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=172227 n=14287 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210014 subRun: 0 event: 45 at 03-Feb-2026 16:25:01 UTC
SimDepoSetSource got 11517 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11517 depos spanning: [0.920755, 0.936186]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=304799 n=48547 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=328547 n=38031 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210014 subRun: 0 event: 46 at 03-Feb-2026 16:25:37 UTC
SimDepoSetSource got 13980 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 13980 depos spanning: [0.773412, 1.15509]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=408652 n=62235 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=430552 n=52505 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210014 subRun: 0 event: 47 at 03-Feb-2026 16:26:12 UTC
SimDepoSetSource got 3174 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3174 depos spanning: [0.420325, 0.424035]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=73010.3 n=14126 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=76090.7 n=13939 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210014 subRun: 0 event: 48 at 03-Feb-2026 16:26:23 UTC
SimDepoSetSource got 4059 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4059 depos spanning: [0.218994, 0.225046]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=102063 n=17684 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=106128 n=16964 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210014 subRun: 0 event: 49 at 03-Feb-2026 16:26:34 UTC
SimDepoSetSource got 16276 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 16276 depos spanning: [0.376912, 0.3912]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=344388 n=51596 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=364719 n=50181 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210014 subRun: 0 event: 50 at 03-Feb-2026 16:26:48 UTC
SimDepoSetSource got 1688 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1688 depos spanning: [0.641735, 0.643565]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=51152 n=6000 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=55398.5 n=4984 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 16:26:59 UTC  Closed output file "prod_monte-carlo-012686-000014_gen_g4_detsim.root"
03-Feb-2026 16:26:59 UTC  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/f0/4f/prod_monte-carlo-012686-000014_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      9.07934       18.9998       58.1347       12.8134       11.8526        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000398342    0.0110118     0.184969     0.00115779     0.033649        50     
simulate:tpcrawdecoder:WireCellToolkit          8.98273       18.744        57.6828       12.5108       11.7839        50     
simulate:opdigi:OpDetDigitizerDUNE             0.041703       0.14656      0.392455      0.145295      0.0649863       50     
simulate:rns:RandomNumberSaver                2.2333e-05    4.98499e-05   0.000282216   4.45525e-05   3.76536e-05      50     
[art]:TriggerResults:TriggerResultInserter     8.303e-06    1.57838e-05   4.3095e-05    1.40965e-05   5.99713e-06      50     
end_path:out1:RootOutput                       2.875e-06    7.9095e-06    4.8163e-05     6.345e-06    7.51653e-06      50     
end_path:out1:RootOutput(write)                0.0322501     0.0976983     0.214626      0.0880727     0.0424122       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3547.64 MB
  Peak resident set size usage (VmHWM): 1602.88 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 dune 166M Feb  3 16:26 prod_monte-carlo-012686-000014_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012686-000014_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:31:33 UTC       justIN version: 01.06.00