justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303050.39@dunegpschedd01.fnal.gov

Jobsub ID303050.39@dunegpschedd01.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 19:40:05
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce513
Last heartbeat2026-02-02 20:21:24
From worker nodeHostnameb9p12p8471.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 19:41:47
Input filesusertests:prodgenie_monte-carlo-012654-000564_gen_g4.root
JobscriptExit code0
Real time38m (2319s)
CPU time37m (2244s = 96%)
Max RSS bytes2543132672 (2425 MiB)
Outputting started2026-02-02 20:20:27
Output files
Finished2026-02-02 20:21:24
Saved logsjustin-logs:303050.39-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

360 traces tagged "wiener"
FrameSaver: q=1.41806e+06 n=114639 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100564 subRun: 0 event: 40 at 02-Feb-2026 21:11:17 CET
SimDepoSetSource got 11254 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11254 depos spanning: [6.73827e-07, 3.10173]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=413532 n=49996 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=449523 n=43548 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100564 subRun: 0 event: 41 at 02-Feb-2026 21:11:50 CET
SimDepoSetSource got 8626 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8626 depos spanning: [6.6714e-07, 6.97977]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=288847 n=37223 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=308694 n=31654 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100564 subRun: 0 event: 42 at 02-Feb-2026 21:12:31 CET
SimDepoSetSource got 89178 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 89178 depos spanning: [3.31145e-07, 8.03026]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=2.28977e+06 n=265262 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=2.52851e+06 n=223791 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100564 subRun: 0 event: 43 at 02-Feb-2026 21:14:00 CET
SimDepoSetSource got 24078 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 24078 depos spanning: [6.72422e-07, 1.76532]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=732622 n=88254 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=806275 n=73734 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100564 subRun: 0 event: 44 at 02-Feb-2026 21:14:28 CET
SimDepoSetSource got 8964 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8964 depos spanning: [6.92454e-07, 0.349996]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=314336 n=36787 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=336561 n=33053 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100564 subRun: 0 event: 45 at 02-Feb-2026 21:15:00 CET
SimDepoSetSource got 23280 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23280 depos spanning: [6.70044e-07, 0.18385]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=587543 n=41741 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=645685 n=37801 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100564 subRun: 0 event: 46 at 02-Feb-2026 21:15:17 CET
SimDepoSetSource got 20992 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20992 depos spanning: [6.67637e-07, 2.95437]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=690606 n=82862 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=763506 n=67451 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100564 subRun: 0 event: 47 at 02-Feb-2026 21:15:59 CET
SimDepoSetSource got 5130 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5130 depos spanning: [7.48361e-07, 1.9857]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=281111 n=22176 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=339008 n=19537 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100564 subRun: 0 event: 48 at 02-Feb-2026 21:16:21 CET
SimDepoSetSource got 23378 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23378 depos spanning: [6.68418e-07, 0.441564]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=754549 n=102203 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=811272 n=85705 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100564 subRun: 0 event: 49 at 02-Feb-2026 21:17:15 CET
SimDepoSetSource got 37054 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 37054 depos spanning: [6.68112e-07, 1.99653]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=848067 n=99696 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=946564 n=85272 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100564 subRun: 0 event: 50 at 02-Feb-2026 21:18:27 CET
SimDepoSetSource got 70448 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 70448 depos spanning: [6.67134e-07, 8.46792]us
Retagger: tagging trace set: wiener with 25600 traces, 25600 summary
Retagger: tagging trace set: gauss with 25600 traces, 0 summary
wclsFrameSaver: saving 25600 traces tagged "gauss"
FrameSaver: q=2.13016e+06 n=248876 tag=gauss
wclsFrameSaver: saving 25600 traces tagged "wiener"
FrameSaver: q=2.36266e+06 n=202300 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:20:26 CET  Closed output file "prodgenie_monte-carlo-012654-000564_gen_g4_detsim.root"
02-Feb-2026 21:20:26 CET  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/usertests/f7/90/prodgenie_monte-carlo-012654-000564_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      8.75803       44.9961       121.039       31.3024       30.5227        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000399574   0.00495423      0.05064     0.00161163    0.00990929       50     
simulate:tpcrawdecoder:WireCellToolkit          8.68797       44.5277       118.907       31.0517       30.151         50     
simulate:opdigi:OpDetDigitizerDUNE             0.0376834     0.239337       1.26728      0.166967      0.254906        50     
simulate:rns:RandomNumberSaver                 2.042e-05    3.5408e-05    0.000267453    2.833e-05    3.39937e-05      50     
[art]:TriggerResults:TriggerResultInserter     8.68e-06     1.31372e-05   5.5101e-05    1.04305e-05   7.65759e-06      50     
end_path:out1:RootOutput                       2.111e-06    4.57064e-06    2.256e-05     3.825e-06    2.80717e-06      50     
end_path:out1:RootOutput(write)                0.0307666     0.223682       1.22315      0.136572      0.247911        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4326.46 MB
  Peak resident set size usage (VmHWM): 2543.13 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r--. 1 duneprd np-comp 708M Feb  2 21:20 prodgenie_monte-carlo-012654-000564_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000564_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 09:15:16 UTC       justIN version: 01.06.00