justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303329.18@dunegpschedd01.fnal.gov

Jobsub ID303329.18@dunegpschedd01.fnal.gov
Workflow ID12669
Stage ID3
User nameluccalp@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 10:08:42
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce03
Last heartbeat2026-02-03 11:05:42
From worker nodeHostnamecn511.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 10:10:01
Input filesusertests:prod_monte-carlo-012669-000019_gen_g4.root
JobscriptExit code0
Real time50m (3034s)
CPU time49m (2980s = 98%)
Max RSS bytes1818689536 (1734 MiB)
Outputting started2026-02-03 11:00:35
Output files
Finished2026-02-03 11:05:42
Saved logsjustin-logs:303329.18-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

"
FrameSaver: q=17527.9 n=2843 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=18650.6 n=2689 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210019 subRun: 0 event: 40 at 03-Feb-2026 10:51:24 GMT
SimDepoSetSource got 6975 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6975 depos spanning: [0.150579, 0.629287]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=172091 n=26763 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=179692 n=26406 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210019 subRun: 0 event: 41 at 03-Feb-2026 10:51:47 GMT
SimDepoSetSource got 7298 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7298 depos spanning: [0.590619, 0.915558]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=234520 n=33406 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=242687 n=29933 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210019 subRun: 0 event: 42 at 03-Feb-2026 10:52:11 GMT
SimDepoSetSource got 17104 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17104 depos spanning: [0.395881, 0.408806]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=457074 n=64915 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=476820 n=60299 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210019 subRun: 0 event: 43 at 03-Feb-2026 10:53:02 GMT
SimDepoSetSource got 705 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 705 depos spanning: [0.512279, 0.597668]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=30016.2 n=3541 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=33601.4 n=3085 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210019 subRun: 0 event: 44 at 03-Feb-2026 10:53:22 GMT
SimDepoSetSource got 10124 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 10124 depos spanning: [0.473754, 0.484156]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=282110 n=45666 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=289630 n=43821 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210019 subRun: 0 event: 45 at 03-Feb-2026 10:54:06 GMT
SimDepoSetSource got 26015 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 26015 depos spanning: [0.282387, 0.306386]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=736607 n=94768 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=757731 n=91367 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210019 subRun: 0 event: 46 at 03-Feb-2026 10:54:58 GMT
SimDepoSetSource got 20737 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20737 depos spanning: [0.331258, 0.351168]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=605359 n=53653 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=634438 n=48404 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210019 subRun: 0 event: 47 at 03-Feb-2026 10:55:25 GMT
SimDepoSetSource got 31223 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 31223 depos spanning: [0.808342, 0.842567]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=895028 n=120063 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=912342 n=115924 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210019 subRun: 0 event: 48 at 03-Feb-2026 10:56:21 GMT
SimDepoSetSource got 8852 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8852 depos spanning: [0.114733, 0.124142]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=269152 n=26203 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=288798 n=22054 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210019 subRun: 0 event: 49 at 03-Feb-2026 10:57:05 GMT
SimDepoSetSource got 20180 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20180 depos spanning: [0.776823, 0.798342]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=570339 n=88376 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=605214 n=74108 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210019 subRun: 0 event: 50 at 03-Feb-2026 10:58:36 GMT
SimDepoSetSource got 35729 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 35729 depos spanning: [0.955123, 0.987047]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=903156 n=86540 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.00284e+06 n=69868 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 11:00:34 GMT  Closed output file "prod_monte-carlo-012669-000019_gen_g4_detsim.root"
03-Feb-2026 11:00:34 GMT  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/6d/3f/prod_monte-carlo-012669-000019_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      20.3745       58.7015       140.42        49.1825       32.677         50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000551495    0.0201766     0.537725     0.00251682     0.0776003       50     
simulate:tpcrawdecoder:WireCellToolkit          20.1458       58.012        139.239       48.6043       32.4865        50     
simulate:opdigi:OpDetDigitizerDUNE             0.135628      0.429046      0.784315      0.429931      0.144881        50     
simulate:rns:RandomNumberSaver                2.6458e-05    4.31468e-05   0.000335178   3.5066e-05    4.25922e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.3724e-05    1.90816e-05   5.8215e-05    1.7721e-05    6.66917e-06      50     
end_path:out1:RootOutput                       3.131e-06    5.44406e-06   2.5336e-05    4.5185e-06    3.19406e-06      50     
end_path:out1:RootOutput(write)                0.0834118     0.239555      0.471939       0.23102      0.0954489       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3523.92 MB
  Peak resident set size usage (VmHWM): 1818.69 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 pildune32 pildune 257M Feb  3 11:00 prod_monte-carlo-012669-000019_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012669-000019_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:53:14 UTC       justIN version: 01.06.00