justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297829.0@dunegpschedd02.fnal.gov

Jobsub ID297829.0@dunegpschedd02.fnal.gov
Workflow ID12694
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 18:34:12
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2026-02-03 19:13:03
From worker nodeHostnamewn1208241.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 18:35:36
Input filesusertests:prod_monte-carlo-012694-000018_gen_g4.root
JobscriptExit code0
Real time35m (2133s)
CPU time32m (1963s = 92%)
Max RSS bytes1652969472 (1576 MiB)
Outputting started2026-02-03 19:11:10
Output files
Finished2026-02-03 19:13:03
Saved logsjustin-logs:297829.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

traces tagged "gauss"
FrameSaver: q=709102 n=97218 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=765612 n=79167 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210018 subRun: 0 event: 40 at 03-Feb-2026 19:03:34 GMT
SimDepoSetSource got 7858 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7858 depos spanning: [0.390195, 0.717919]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=241781 n=31727 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=253410 n=29028 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210018 subRun: 0 event: 41 at 03-Feb-2026 19:03:54 GMT
SimDepoSetSource got 11409 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11409 depos spanning: [0.892137, 2.79919]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=346007 n=54282 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=356912 n=49448 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210018 subRun: 0 event: 42 at 03-Feb-2026 19:05:18 GMT
SimDepoSetSource got 7027 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7027 depos spanning: [0.417217, 0.425145]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=174553 n=30669 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=179440 n=29724 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210018 subRun: 0 event: 43 at 03-Feb-2026 19:05:41 GMT
SimDepoSetSource got 1044 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1044 depos spanning: [0.137248, 0.139112]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=33148.9 n=3662 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=35755.8 n=3046 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210018 subRun: 0 event: 44 at 03-Feb-2026 19:06:00 GMT
SimDepoSetSource got 9520 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9520 depos spanning: [0.442598, 0.453296]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=284273 n=29885 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=293853 n=27025 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210018 subRun: 0 event: 45 at 03-Feb-2026 19:06:25 GMT
SimDepoSetSource got 18151 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 18151 depos spanning: [0.46974, 0.858851]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=488362 n=72389 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=505119 n=71639 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210018 subRun: 0 event: 46 at 03-Feb-2026 19:06:51 GMT
SimDepoSetSource got 7684 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7684 depos spanning: [0.945226, 1.40206]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=220349 n=24333 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=225808 n=22702 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210018 subRun: 0 event: 47 at 03-Feb-2026 19:07:12 GMT
SimDepoSetSource got 1898 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1898 depos spanning: [0.988941, 1.30418]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=60121.9 n=8322 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=68172.4 n=7438 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210018 subRun: 0 event: 48 at 03-Feb-2026 19:07:53 GMT
SimDepoSetSource got 22752 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 22752 depos spanning: [0.123887, 0.148517]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=657159 n=100878 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=682155 n=90461 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210018 subRun: 0 event: 49 at 03-Feb-2026 19:09:17 GMT
SimDepoSetSource got 2039 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2039 depos spanning: [0.715953, 1.35122]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=60572.4 n=12770 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=64102.9 n=12052 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210018 subRun: 0 event: 50 at 03-Feb-2026 19:09:57 GMT
SimDepoSetSource got 23423 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23423 depos spanning: [0.738914, 0.764506]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=644530 n=78841 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=690784 n=62803 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 19:11:09 GMT  Closed output file "prod_monte-carlo-012694-000018_gen_g4_detsim.root"
03-Feb-2026 19:11:09 GMT  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/usertests/23/de/prod_monte-carlo-012694-000018_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      19.0501       40.0987       114.079       26.9324       23.9263        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000352874    0.0039292     0.0270872    0.00213926    0.00553487       50     
simulate:tpcrawdecoder:WireCellToolkit          18.8532       39.6817       113.13        26.2465       23.8078        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0320628     0.232978      0.547254      0.236449      0.104707        50     
simulate:rns:RandomNumberSaver                2.6019e-05    3.87571e-05   0.000359597   3.07275e-05   4.68487e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.4177e-05    1.88813e-05   9.9518e-05    1.6386e-05    1.28984e-05      50     
end_path:out1:RootOutput                       3.386e-06    5.05792e-06   3.4294e-05    4.0175e-06    5.08625e-06      50     
end_path:out1:RootOutput(write)                0.0724429     0.179419      0.439255      0.157259      0.0813997       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3392.37 MB
  Peak resident set size usage (VmHWM): 1652.97 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune01 dune01 185M Feb  3 19:11 prod_monte-carlo-012694-000018_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012694-000018_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:28:32 UTC       justIN version: 01.06.00