justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303108.0@dunegpschedd01.fnal.gov

Jobsub ID303108.0@dunegpschedd01.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 20:56:08
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep208
Last heartbeat2026-02-02 21:40:44
From worker nodeHostnameheplnc153.pp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 20:56:32
Input filesusertests:prodgenie_monte-carlo-012654-000594_gen_g4.root
JobscriptExit code0
Real time43m (2583s)
CPU time41m (2477s = 95%)
Max RSS bytes2270765056 (2165 MiB)
Outputting started2026-02-02 21:39:35
Output files
Finished2026-02-02 21:40:44
Saved logsjustin-logs:303108.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

aces tagged "wiener"
FrameSaver: q=1.21403e+06 n=110160 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100594 subRun: 0 event: 40 at 02-Feb-2026 21:29:20 GMT
SimDepoSetSource got 70166 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 70166 depos spanning: [6.67176e-07, 1.78325]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=2.21253e+06 n=232958 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=2.43518e+06 n=200409 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100594 subRun: 0 event: 41 at 02-Feb-2026 21:30:41 GMT
SimDepoSetSource got 5079 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5079 depos spanning: [7.01841e-07, 6.79177]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=195363 n=22699 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=219044 n=20545 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100594 subRun: 0 event: 42 at 02-Feb-2026 21:31:17 GMT
SimDepoSetSource got 38203 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 38203 depos spanning: [6.67824e-07, 0.0271502]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=1.11834e+06 n=136196 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=1.25527e+06 n=113861 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100594 subRun: 0 event: 43 at 02-Feb-2026 21:32:08 GMT
SimDepoSetSource got 29155 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 29155 depos spanning: [6.67184e-07, 2.68123]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=893013 n=103176 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=996691 n=90105 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100594 subRun: 0 event: 44 at 02-Feb-2026 21:33:14 GMT
SimDepoSetSource got 27463 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 27463 depos spanning: [6.68114e-07, 2.5932]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=822730 n=114343 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=892559 n=99848 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100594 subRun: 0 event: 45 at 02-Feb-2026 21:34:34 GMT
SimDepoSetSource got 31536 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 31536 depos spanning: [0.000777587, 0.209982]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=848060 n=129390 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=915813 n=102032 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100594 subRun: 0 event: 46 at 02-Feb-2026 21:35:59 GMT
SimDepoSetSource got 15753 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 15753 depos spanning: [0.000339015, 4.97155]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=494588 n=56688 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=544395 n=50488 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100594 subRun: 0 event: 47 at 02-Feb-2026 21:36:45 GMT
SimDepoSetSource got 5827 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5827 depos spanning: [6.67188e-07, 0.217305]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=191496 n=23441 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=219741 n=21041 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100594 subRun: 0 event: 48 at 02-Feb-2026 21:37:10 GMT
SimDepoSetSource got 144 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 144 depos spanning: [0.00201386, 0.246474]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=5583.11 n=2970 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=8350.03 n=2910 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100594 subRun: 0 event: 49 at 02-Feb-2026 21:37:45 GMT
SimDepoSetSource got 10000 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 10000 depos spanning: [6.7342e-07, 0.533386]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=319738 n=42623 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=366834 n=35457 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100594 subRun: 0 event: 50 at 02-Feb-2026 21:38:37 GMT
SimDepoSetSource got 21384 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 21384 depos spanning: [6.6768e-07, 0.15271]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=629978 n=90270 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=672491 n=75115 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:39:34 GMT  Closed output file "prodgenie_monte-carlo-012654-000594_gen_g4_detsim.root"
02-Feb-2026 21:39:34 GMT  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/usertests/36/c2/prodgenie_monte-carlo-012654-000594_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      11.5277       50.1024       144.803       46.5195       22.7234        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000557754    0.0672295      3.18378     0.00283106     0.445233        50     
simulate:tpcrawdecoder:WireCellToolkit          11.3145       49.5328       143.949       46.0151       22.6327        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0482486     0.273624      0.616829      0.247805      0.118624        50     
simulate:rns:RandomNumberSaver                3.4525e-05    5.81138e-05   0.000382897   5.13915e-05   4.78954e-05      50     
[art]:TriggerResults:TriggerResultInserter     9.989e-06    1.91545e-05   6.0393e-05    1.69965e-05   9.69355e-06      50     
end_path:out1:RootOutput                       4.779e-06    1.15174e-05   8.1753e-05    9.5675e-06     1.091e-05       50     
end_path:out1:RootOutput(write)                0.0732982     0.228081      0.632003      0.194031       0.11488        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4054.7 MB
  Peak resident set size usage (VmHWM): 2270.77 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 pltdune04 pltdune 416M Feb  2 21:39 prodgenie_monte-carlo-012654-000594_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000594_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:33:31 UTC       justIN version: 01.06.00