justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303490.0@dunegpschedd01.fnal.gov

Jobsub ID303490.0@dunegpschedd01.fnal.gov
Workflow ID12686
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 16:08:05
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2026-02-03 16:43:55
From worker nodeHostnamedune002-1589394.0-lcg2533.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 16:09:38
Input filesusertests:prod_monte-carlo-012686-000015_gen_g4.root
JobscriptExit code0
Real time32m (1979s)
CPU time32m (1922s = 97%)
Max RSS bytes1851781120 (1765 MiB)
Outputting started2026-02-03 16:42:38
Output files
Finished2026-02-03 16:43:55
Saved logsjustin-logs:303490.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=689785 n=97130 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=723715 n=92451 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210015 subRun: 0 event: 40 at 03-Feb-2026 16:36:18 UTC
SimDepoSetSource got 18594 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 18594 depos spanning: [0.766799, 0.786567]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=505741 n=69838 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=544696 n=56789 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210015 subRun: 0 event: 41 at 03-Feb-2026 16:37:10 UTC
SimDepoSetSource got 17158 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17158 depos spanning: [0.773315, 1.04674]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=490293 n=60129 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=508117 n=55351 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210015 subRun: 0 event: 42 at 03-Feb-2026 16:38:00 UTC
SimDepoSetSource got 6768 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6768 depos spanning: [0.630487, 0.638]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=190605 n=32034 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=197809 n=27764 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210015 subRun: 0 event: 43 at 03-Feb-2026 16:38:20 UTC
SimDepoSetSource got 22331 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 22331 depos spanning: [0.988236, 1.01225]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=611726 n=94478 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=663250 n=74877 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210015 subRun: 0 event: 44 at 03-Feb-2026 16:39:18 UTC
SimDepoSetSource got 23918 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23918 depos spanning: [0.604705, 0.631204]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=699383 n=111278 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=715537 n=105188 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210015 subRun: 0 event: 45 at 03-Feb-2026 16:40:14 UTC
SimDepoSetSource got 7952 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7952 depos spanning: [0.664488, 0.678917]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=163695 n=26911 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=171931 n=25719 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210015 subRun: 0 event: 46 at 03-Feb-2026 16:40:48 UTC
SimDepoSetSource got 2225 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2225 depos spanning: [0.600344, 0.60277]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=61467 n=11647 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=64316.4 n=10620 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210015 subRun: 0 event: 47 at 03-Feb-2026 16:41:03 UTC
SimDepoSetSource got 8928 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8928 depos spanning: [0.884597, 1.09162]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=229802 n=28178 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=252622 n=23613 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210015 subRun: 0 event: 48 at 03-Feb-2026 16:41:32 UTC
SimDepoSetSource got 5677 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5677 depos spanning: [0.0409655, 0.0474284]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=153098 n=25158 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=160600 n=21519 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210015 subRun: 0 event: 49 at 03-Feb-2026 16:42:03 UTC
SimDepoSetSource got 1437 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1437 depos spanning: [0.15604, 0.160925]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=29480.5 n=5700 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=31200.3 n=5292 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210015 subRun: 0 event: 50 at 03-Feb-2026 16:42:19 UTC
SimDepoSetSource got 4396 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4396 depos spanning: [0.980524, 0.987206]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=129560 n=11414 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=139531 n=9958 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 16:42:36 UTC  Closed output file "prod_monte-carlo-012686-000015_gen_g4_detsim.root"
03-Feb-2026 16:42:36 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/usertests/54/a3/prod_monte-carlo-012686-000015_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      13.8685       37.9722       116.169       32.9422       20.5545        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000551361   0.00918962     0.123745     0.00292653     0.0213361       50     
simulate:tpcrawdecoder:WireCellToolkit          13.7145       37.5332       115.274       32.5213       20.4253        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0830815      0.24626      0.438277      0.259755      0.0832907       50     
simulate:rns:RandomNumberSaver                2.9821e-05    5.27461e-05   0.000276105   4.6621e-05    3.37508e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.4691e-05    2.2209e-05    7.6302e-05    2.00505e-05   9.26859e-06      50     
end_path:out1:RootOutput                       3.02e-06     6.68508e-06    2.239e-05     6.28e-06     3.52704e-06      50     
end_path:out1:RootOutput(write)                0.0677467     0.182542       0.4266       0.174001       0.0733         50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3691.75 MB
  Peak resident set size usage (VmHWM): 1851.78 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune002 dune 241M Feb  3 16:42 prod_monte-carlo-012686-000015_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012686-000015_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:31:41 UTC       justIN version: 01.06.00