justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303050.31@dunegpschedd01.fnal.gov

Jobsub ID303050.31@dunegpschedd01.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 19:40:05
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce513
Last heartbeat2026-02-02 20:24:05
From worker nodeHostnameb9p12p8471.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 19:41:43
Input filesusertests:prodgenie_monte-carlo-012654-000149_gen_g4.root
JobscriptExit code0
Real time41m (2477s)
CPU time39m (2398s = 96%)
Max RSS bytes3209633792 (3060 MiB)
Outputting started2026-02-02 20:23:02
Output files
Finished2026-02-02 20:24:05
Saved logsjustin-logs:303050.31-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

FrameSaver: q=48894.5 n=2578 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100149 subRun: 0 event: 40 at 02-Feb-2026 21:14:09 CET
SimDepoSetSource got 4420 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4420 depos spanning: [2.56596e-06, 2.26678]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=117479 n=17485 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=137027 n=15258 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100149 subRun: 0 event: 41 at 02-Feb-2026 21:14:30 CET
SimDepoSetSource got 10202 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 10202 depos spanning: [0.00068, 0.423574]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=201255 n=32068 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=223518 n=25495 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100149 subRun: 0 event: 42 at 02-Feb-2026 21:14:59 CET
SimDepoSetSource got 29646 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 29646 depos spanning: [6.67196e-07, 1.75518]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=985629 n=120605 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.08648e+06 n=98285 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100149 subRun: 0 event: 43 at 02-Feb-2026 21:16:05 CET
SimDepoSetSource got 84694 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 84694 depos spanning: [6.67136e-07, 1.39524]us
Retagger: tagging trace set: wiener with 20480 traces, 20480 summary
Retagger: tagging trace set: gauss with 20480 traces, 0 summary
wclsFrameSaver: saving 20480 traces tagged "gauss"
FrameSaver: q=2.17042e+06 n=259655 tag=gauss
wclsFrameSaver: saving 20480 traces tagged "wiener"
FrameSaver: q=2.41235e+06 n=219108 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100149 subRun: 0 event: 44 at 02-Feb-2026 21:17:56 CET
SimDepoSetSource got 20182 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20182 depos spanning: [6.74917e-07, 2.87671]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=665440 n=63631 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=776309 n=56731 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100149 subRun: 0 event: 45 at 02-Feb-2026 21:18:30 CET
SimDepoSetSource got 38680 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 38680 depos spanning: [6.67755e-07, 2.44106]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=1.21523e+06 n=180370 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=1.2797e+06 n=151771 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100149 subRun: 0 event: 46 at 02-Feb-2026 21:19:38 CET
SimDepoSetSource got 26699 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 26699 depos spanning: [6.68481e-07, 3.24087]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=970308 n=114864 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=1.06916e+06 n=98506 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100149 subRun: 0 event: 47 at 02-Feb-2026 21:20:36 CET
SimDepoSetSource got 26252 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 26252 depos spanning: [6.67407e-07, 0.205741]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=823967 n=108261 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=907297 n=88333 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100149 subRun: 0 event: 48 at 02-Feb-2026 21:21:16 CET
SimDepoSetSource got 31691 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 31691 depos spanning: [6.67538e-07, 7.36444]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=973566 n=140451 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=1.03511e+06 n=116019 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100149 subRun: 0 event: 49 at 02-Feb-2026 21:22:15 CET
SimDepoSetSource got 14156 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14156 depos spanning: [6.69906e-07, 0.241417]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=470071 n=50454 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=529303 n=43864 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100149 subRun: 0 event: 50 at 02-Feb-2026 21:22:26 CET
SimDepoSetSource got 2280 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2280 depos spanning: [6.67776e-07, 0.0206443]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=59063.5 n=10205 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=67059.9 n=9306 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:23:01 CET  Closed output file "prodgenie_monte-carlo-012654-000149_gen_g4_detsim.root"
02-Feb-2026 21:23:01 CET  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/usertests/4f/9c/prodgenie_monte-carlo-012654-000149_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      7.93606       48.1104       217.751       37.0952       42.2703        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000329274   0.00393596      0.02371     0.00120176    0.00652193       50     
simulate:tpcrawdecoder:WireCellToolkit          7.86147       47.5704       214.503       36.8489       41.4276        50     
simulate:opdigi:OpDetDigitizerDUNE            0.00634918     0.270374       3.87208      0.158057      0.538787        50     
simulate:rns:RandomNumberSaver                 1.812e-05     3.292e-05    0.000276094   2.76755e-05   3.50796e-05      50     
[art]:TriggerResults:TriggerResultInserter     8.37e-06     1.35408e-05   4.2741e-05    1.24005e-05   4.98199e-06      50     
end_path:out1:RootOutput                       2.85e-06     4.92864e-06   2.1521e-05     4.615e-06    2.64642e-06      50     
end_path:out1:RootOutput(write)                0.032531      0.265275       2.48754      0.113493       0.50223        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5010.84 MB
  Peak resident set size usage (VmHWM): 3209.63 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r--. 1 duneprd np-comp 798M Feb  2 21:23 prodgenie_monte-carlo-012654-000149_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000149_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 07:45:04 UTC       justIN version: 01.06.00