justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303335.21@dunegpschedd01.fnal.gov

Jobsub ID303335.21@dunegpschedd01.fnal.gov
Workflow ID12670
Stage ID3
User nameckaragia@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 10:22:43
SiteUK_Imperial
EntryDUNE_T2_UK_London_IC_ceprod02
Last heartbeat2026-02-03 10:58:28
From worker nodeHostnamewl00.grid.hep.ph.ic.ac.uk
cpuinfoAMD EPYC 7742 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 10:24:33
Input filesusertests:prod_monte-carlo-012670-000006_gen_g4.root
JobscriptExit code0
Real time32m (1931s)
CPU time29m (1755s = 90%)
Max RSS bytes1565478912 (1492 MiB)
Outputting started2026-02-03 10:56:46
Output files
Finished2026-02-03 10:58:28
Saved logsjustin-logs:303335.21-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

auss"
FrameSaver: q=327229 n=55418 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=346399 n=54406 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210006 subRun: 0 event: 40 at 03-Feb-2026 10:49:43 GMT
SimDepoSetSource got 25071 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25071 depos spanning: [0.160139, 0.188413]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=624753 n=83414 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=665722 n=71648 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210006 subRun: 0 event: 41 at 03-Feb-2026 10:50:52 GMT
SimDepoSetSource got 25799 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25799 depos spanning: [0.339807, 0.366504]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=724966 n=105660 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=750726 n=103913 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210006 subRun: 0 event: 42 at 03-Feb-2026 10:51:34 GMT
SimDepoSetSource got 23022 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23022 depos spanning: [0.902588, 0.928285]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=657191 n=96674 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=677012 n=95426 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210006 subRun: 0 event: 43 at 03-Feb-2026 10:52:14 GMT
SimDepoSetSource got 5040 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5040 depos spanning: [0.0586669, 0.0648412]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=152871 n=25323 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=157391 n=22749 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210006 subRun: 0 event: 44 at 03-Feb-2026 10:52:32 GMT
SimDepoSetSource got 5706 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5706 depos spanning: [0.404129, 0.411093]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=159592 n=14876 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=172803 n=13032 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210006 subRun: 0 event: 45 at 03-Feb-2026 10:53:04 GMT
SimDepoSetSource got 6489 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6489 depos spanning: [0.657239, 0.664768]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=155624 n=29395 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=163445 n=28959 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210006 subRun: 0 event: 46 at 03-Feb-2026 10:53:38 GMT
SimDepoSetSource got 15890 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 15890 depos spanning: [0.235939, 0.253964]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=465786 n=72804 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=476675 n=68798 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210006 subRun: 0 event: 47 at 03-Feb-2026 10:54:15 GMT
SimDepoSetSource got 6058 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6058 depos spanning: [0.331082, 0.338086]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=189284 n=17450 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=201544 n=15095 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210006 subRun: 0 event: 48 at 03-Feb-2026 10:54:31 GMT
SimDepoSetSource got 21081 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 21081 depos spanning: [0.116101, 0.139305]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=632560 n=98788 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=660156 n=87955 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210006 subRun: 0 event: 49 at 03-Feb-2026 10:55:41 GMT
SimDepoSetSource got 15178 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 15178 depos spanning: [0.32471, 0.340447]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=419483 n=53504 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=429784 n=51279 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210006 subRun: 0 event: 50 at 03-Feb-2026 10:56:21 GMT
SimDepoSetSource got 11538 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11538 depos spanning: [0.100356, 0.11293]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=320273 n=49864 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=330491 n=49397 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 10:56:44 GMT  Closed output file "prod_monte-carlo-012670-000006_gen_g4_detsim.root"
03-Feb-2026 10:56:45 GMT  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/48/51/prod_monte-carlo-012670-000006_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      15.6809       36.6475       78.6606       35.6786       18.0937        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000426423    0.0065631     0.0536233    0.00210522     0.0131893       50     
simulate:tpcrawdecoder:WireCellToolkit          15.4385       36.1703       77.9495       35.2446       17.9584        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0568832     0.242796      0.412191      0.238988      0.0957647       50     
simulate:rns:RandomNumberSaver                2.1351e-05    3.97194e-05   0.000392422   2.9231e-05    5.16318e-05      50     
[art]:TriggerResults:TriggerResultInserter     1.164e-05    1.6725e-05    5.4311e-05    1.56455e-05   5.68636e-06      50     
end_path:out1:RootOutput                       3.56e-06     4.8129e-06     2.419e-05     4.035e-06    3.03194e-06      50     
end_path:out1:RootOutput(write)                0.083028      0.227102      0.616757      0.201669       0.11564        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3268.81 MB
  Peak resident set size usage (VmHWM): 1565.48 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r--. 1 job0036 job0036 223M Feb  3 10:56 prod_monte-carlo-012670-000006_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012670-000006_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:47:28 UTC       justIN version: 01.06.00