justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297621.6@dunegpschedd02.fnal.gov

Jobsub ID297621.6@dunegpschedd02.fnal.gov
Workflow ID12668
Stage ID3
User nameykermaid@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 09:54:42
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce02
Last heartbeat2026-02-03 10:38:02
From worker nodeHostnamecn083.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 09:55:44
Input filesusertests:prod_monte-carlo-012668-000019_gen_g4.root
JobscriptExit code0
Real time37m (2220s)
CPU time36m (2164s = 97%)
Max RSS bytes2056282112 (1961 MiB)
Outputting started2026-02-03 10:32:45
Output files
Finished2026-02-03 10:38:02
Saved logsjustin-logs:297621.6-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

aver: saving 5120 traces tagged "gauss"
FrameSaver: q=363288 n=41571 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=402663 n=33729 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210019 subRun: 0 event: 40 at 03-Feb-2026 10:26:39 GMT
SimDepoSetSource got 4619 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4619 depos spanning: [0.737723, 0.744704]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=118788 n=15942 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=126110 n=13826 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210019 subRun: 0 event: 41 at 03-Feb-2026 10:26:59 GMT
SimDepoSetSource got 14366 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14366 depos spanning: [0.0974456, 0.40727]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=444993 n=41346 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=468427 n=37025 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210019 subRun: 0 event: 42 at 03-Feb-2026 10:27:30 GMT
SimDepoSetSource got 17864 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17864 depos spanning: [0.530211, 3.96361]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=539661 n=76692 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=574119 n=65602 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210019 subRun: 0 event: 43 at 03-Feb-2026 10:28:29 GMT
SimDepoSetSource got 2002 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2002 depos spanning: [0.108733, 0.11112]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=61239.3 n=8428 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=64925.6 n=7065 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210019 subRun: 0 event: 44 at 03-Feb-2026 10:28:47 GMT
SimDepoSetSource got 32990 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 32990 depos spanning: [0.310846, 0.347869]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=961732 n=127424 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.01196e+06 n=108690 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210019 subRun: 0 event: 45 at 03-Feb-2026 10:30:25 GMT
SimDepoSetSource got 8927 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8927 depos spanning: [0.561878, 0.571361]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=189454 n=31731 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=196411 n=30742 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210019 subRun: 0 event: 46 at 03-Feb-2026 10:30:49 GMT
SimDepoSetSource got 5305 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5305 depos spanning: [0.082447, 0.801067]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=170796 n=26018 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=175861 n=25647 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210019 subRun: 0 event: 47 at 03-Feb-2026 10:31:09 GMT
SimDepoSetSource got 4499 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4499 depos spanning: [0.538066, 0.54338]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=127739 n=11478 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=136890 n=9816 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210019 subRun: 0 event: 48 at 03-Feb-2026 10:31:28 GMT
SimDepoSetSource got 5924 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5924 depos spanning: [0.926829, 0.93359]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=183150 n=21597 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=204345 n=16997 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210019 subRun: 0 event: 49 at 03-Feb-2026 10:31:47 GMT
SimDepoSetSource got 401 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 401 depos spanning: [0.0784531, 0.0792053]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=11010.7 n=2883 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=12125.9 n=2818 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210019 subRun: 0 event: 50 at 03-Feb-2026 10:32:05 GMT
SimDepoSetSource got 14625 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14625 depos spanning: [0.488006, 0.505318]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=449442 n=59939 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=478079 n=50738 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 10:32:44 GMT  Closed output file "prod_monte-carlo-012668-000019_gen_g4_detsim.root"
03-Feb-2026 10:32:44 GMT  Closed input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/usertests/33/4c/prod_monte-carlo-012668-000019_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      13.559        42.3833       155.41        37.0057       26.7694        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000537733   0.00630785     0.0441153    0.00245955     0.0118479       50     
simulate:tpcrawdecoder:WireCellToolkit          13.2493       41.8419       154.32        36.4927       26.5995        50     
simulate:opdigi:OpDetDigitizerDUNE             0.125055      0.356513      0.687641      0.364178      0.133166        50     
simulate:rns:RandomNumberSaver                2.1388e-05    3.97445e-05   0.000327161   3.1055e-05    4.18104e-05      50     
[art]:TriggerResults:TriggerResultInserter     9.496e-06    1.67837e-05   5.3358e-05    1.5567e-05    6.03187e-06      50     
end_path:out1:RootOutput                       3.099e-06    5.37996e-06   2.4469e-05    4.1995e-06    3.28111e-06      50     
end_path:out1:RootOutput(write)                0.0769573     0.177806      0.396264      0.168996      0.080407        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3756.98 MB
  Peak resident set size usage (VmHWM): 2056.28 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 pildune22 pildune 208M Feb  3 10:32 prod_monte-carlo-012668-000019_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012668-000019_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:45:39 UTC       justIN version: 01.06.00