justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297621.9@dunegpschedd02.fnal.gov

Jobsub ID297621.9@dunegpschedd02.fnal.gov
Workflow ID12668
Stage ID3
User nameykermaid@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 09:54:42
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep208
Last heartbeat2026-02-03 10:22:19
From worker nodeHostnameheplnc157.pp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 09:55:40
Input filesusertests:prod_monte-carlo-012668-000012_gen_g4.root
JobscriptExit code0
Real time25m (1509s)
CPU time23m (1412s = 93%)
Max RSS bytes2036133888 (1941 MiB)
Outputting started2026-02-03 10:20:51
Output files
Finished2026-02-03 10:22:19
Saved logsjustin-logs:297621.9-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

2560 traces tagged "gauss"
FrameSaver: q=236019 n=25769 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=242300 n=22907 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210012 subRun: 0 event: 40 at 03-Feb-2026 10:14:35 GMT
SimDepoSetSource got 19217 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19217 depos spanning: [0.49449, 0.514779]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=569443 n=84195 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=598986 n=72798 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210012 subRun: 0 event: 41 at 03-Feb-2026 10:15:17 GMT
SimDepoSetSource got 23863 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23863 depos spanning: [0.923318, 0.949082]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=724299 n=102738 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=788062 n=82469 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210012 subRun: 0 event: 42 at 03-Feb-2026 10:16:11 GMT
SimDepoSetSource got 19533 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19533 depos spanning: [0.434679, 0.453346]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=506923 n=46247 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=537584 n=40328 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210012 subRun: 0 event: 43 at 03-Feb-2026 10:16:38 GMT
SimDepoSetSource got 27378 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 27378 depos spanning: [0.684515, 0.994699]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=841117 n=95642 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=920156 n=77938 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210012 subRun: 0 event: 44 at 03-Feb-2026 10:17:43 GMT
SimDepoSetSource got 11212 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11212 depos spanning: [0.0849975, 0.0973454]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=314782 n=49328 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=325169 n=47122 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210012 subRun: 0 event: 45 at 03-Feb-2026 10:17:59 GMT
SimDepoSetSource got 27047 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 27047 depos spanning: [0.842456, 0.870848]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=722132 n=103935 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=783246 n=83223 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210012 subRun: 0 event: 46 at 03-Feb-2026 10:18:59 GMT
SimDepoSetSource got 681 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 681 depos spanning: [0.693003, 0.693849]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=20005.5 n=3988 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=21442.6 n=3778 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210012 subRun: 0 event: 47 at 03-Feb-2026 10:19:12 GMT
SimDepoSetSource got 4605 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4605 depos spanning: [0.849402, 0.855423]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=131192 n=15181 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=137572 n=14589 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210012 subRun: 0 event: 48 at 03-Feb-2026 10:19:36 GMT
SimDepoSetSource got 3842 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3842 depos spanning: [0.31435, 0.31891]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=107423 n=20921 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=110209 n=20264 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210012 subRun: 0 event: 49 at 03-Feb-2026 10:19:47 GMT
SimDepoSetSource got 7997 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7997 depos spanning: [0.327409, 0.366043]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=234639 n=37219 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=243589 n=33089 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210012 subRun: 0 event: 50 at 03-Feb-2026 10:20:15 GMT
SimDepoSetSource got 22851 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 22851 depos spanning: [0.526631, 0.55532]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=648167 n=107439 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=666779 n=104903 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 10:20:49 GMT  Closed output file "prod_monte-carlo-012668-000012_gen_g4_detsim.root"
03-Feb-2026 10:20:49 GMT  Closed input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/usertests/61/97/prod_monte-carlo-012668-000012_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      11.0351       28.2455       115.263       25.4215       18.8456        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000496432   0.00567291     0.0427343    0.00168957     0.0115853       50     
simulate:tpcrawdecoder:WireCellToolkit          10.8489       27.8965       114.465       25.1393       18.7315        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0451268     0.188774      0.448916      0.177508      0.0850012       50     
simulate:rns:RandomNumberSaver                2.8854e-05    5.3565e-05    0.000386706   4.5405e-05    4.90769e-05      50     
[art]:TriggerResults:TriggerResultInserter     1.096e-05    1.94714e-05   5.9161e-05    1.9071e-05    6.95434e-06      50     
end_path:out1:RootOutput                       3.276e-06    7.23512e-06    3.177e-05    7.0335e-06    4.10579e-06      50     
end_path:out1:RootOutput(write)                0.0588031     0.153896       0.42858      0.147025      0.0691684       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3798.7 MB
  Peak resident set size usage (VmHWM): 2036.13 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 pltdune04 pltdune 208M Feb  3 10:20 prod_monte-carlo-012668-000012_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012668-000012_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:27:10 UTC       justIN version: 01.06.00