justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297629.7@dunegpschedd02.fnal.gov

Jobsub ID297629.7@dunegpschedd02.fnal.gov
Workflow ID12672
Stage ID3
User namelmcmahon@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 10:36:44
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce01
Last heartbeat2026-02-03 11:13:21
From worker nodeHostnamedune001-1507203.0-lcg2575.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 10:38:26
Input filesusertests:prod_monte-carlo-012672-000007_gen_g4.root
JobscriptExit code0
Real time32m (1962s)
CPU time31m (1877s = 95%)
Max RSS bytes1803005952 (1719 MiB)
Outputting started2026-02-03 11:11:09
Output files
Finished2026-02-03 11:13:21
Saved logsjustin-logs:297629.7-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ng 2560 traces tagged "gauss"
FrameSaver: q=280226 n=39520 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=290419 n=36190 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210007 subRun: 0 event: 40 at 03-Feb-2026 11:05:32 UTC
SimDepoSetSource got 6788 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6788 depos spanning: [0.421336, 0.428946]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=181028 n=29370 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=186922 n=28959 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210007 subRun: 0 event: 41 at 03-Feb-2026 11:05:49 UTC
SimDepoSetSource got 18362 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 18362 depos spanning: [0.268985, 0.286135]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=469308 n=67873 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=492227 n=67018 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210007 subRun: 0 event: 42 at 03-Feb-2026 11:06:11 UTC
SimDepoSetSource got 17643 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17643 depos spanning: [0.285612, 0.302617]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=502264 n=45530 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=541404 n=38477 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210007 subRun: 0 event: 43 at 03-Feb-2026 11:06:45 UTC
SimDepoSetSource got 6516 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6516 depos spanning: [0.759298, 0.767134]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=122021 n=20835 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=126374 n=20112 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210007 subRun: 0 event: 44 at 03-Feb-2026 11:07:02 UTC
SimDepoSetSource got 15958 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 15958 depos spanning: [0.48831, 1.43398]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=421221 n=66643 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=434536 n=63662 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210007 subRun: 0 event: 45 at 03-Feb-2026 11:07:51 UTC
SimDepoSetSource got 4344 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4344 depos spanning: [0.996547, 1.64745]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=135979 n=19188 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=148356 n=15687 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210007 subRun: 0 event: 46 at 03-Feb-2026 11:08:07 UTC
SimDepoSetSource got 1292 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1292 depos spanning: [0.663617, 0.993795]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=45411.6 n=6030 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=47225.7 n=5458 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210007 subRun: 0 event: 47 at 03-Feb-2026 11:08:23 UTC
SimDepoSetSource got 18066 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 18066 depos spanning: [0.483982, 0.504349]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=483623 n=69387 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=504530 n=61040 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210007 subRun: 0 event: 48 at 03-Feb-2026 11:09:15 UTC
SimDepoSetSource got 20585 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20585 depos spanning: [0.525587, 0.546068]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=596408 n=92077 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=615391 n=87683 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210007 subRun: 0 event: 49 at 03-Feb-2026 11:10:03 UTC
SimDepoSetSource got 5901 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5901 depos spanning: [0.109828, 0.116923]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=141062 n=21555 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=146704 n=19648 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210007 subRun: 0 event: 50 at 03-Feb-2026 11:10:22 UTC
SimDepoSetSource got 3257 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3257 depos spanning: [0.898444, 5.54896]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=117001 n=17274 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=132800 n=14203 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 11:11:07 UTC  Closed output file "prod_monte-carlo-012672-000007_gen_g4_detsim.root"
03-Feb-2026 11:11:07 UTC  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/8b/6a/prod_monte-carlo-012672-000007_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      14.4236       36.8881       102.759       30.8947       23.4208        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000399042    0.0128479     0.207078     0.00290929     0.0335804       50     
simulate:tpcrawdecoder:WireCellToolkit          14.236        36.4467       101.875       30.568        23.2604        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0430881     0.240481      0.515929      0.217755       0.11313        50     
simulate:rns:RandomNumberSaver                 2.138e-05    4.29715e-05   0.000365343   3.5235e-05    4.67163e-05      50     
[art]:TriggerResults:TriggerResultInserter     1.203e-05    2.07044e-05   6.5281e-05    1.79455e-05   9.25505e-06      50     
end_path:out1:RootOutput                       3.66e-06     5.62564e-06   3.0281e-05     4.42e-06     3.96294e-06      50     
end_path:out1:RootOutput(write)                0.0651275     0.187359      0.382047      0.171775      0.0793164       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3689.35 MB
  Peak resident set size usage (VmHWM): 1803.01 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 dune 233M Feb  3 11:11 prod_monte-carlo-012672-000007_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012672-000007_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:32:04 UTC       justIN version: 01.06.00