justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303050.44@dunegpschedd01.fnal.gov

Jobsub ID303050.44@dunegpschedd01.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 19:40:05
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce505
Last heartbeat2026-02-02 20:02:35
From worker nodeHostnameb9p35p0005.cern.ch
cpuinfoAMD EPYC 9655P 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 19:41:41
Input filesusertests:prodgenie_monte-carlo-012654-000574_gen_g4.root
JobscriptExit code0
Real time20m (1211s)
CPU time19m (1174s = 96%)
Max RSS bytes1977315328 (1885 MiB)
Outputting started2026-02-02 20:01:53
Output files
Finished2026-02-02 20:02:35
Saved logsjustin-logs:303050.44-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=653753 n=51077 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100574 subRun: 0 event: 40 at 02-Feb-2026 20:57:32 CET
SimDepoSetSource got 3628 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3628 depos spanning: [6.70053e-07, 4.8126]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=109996 n=18663 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=122299 n=16757 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100574 subRun: 0 event: 41 at 02-Feb-2026 20:57:59 CET
SimDepoSetSource got 3389 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3389 depos spanning: [6.6779e-07, 15.4136]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=101633 n=13365 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=107303 n=11874 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100574 subRun: 0 event: 42 at 02-Feb-2026 20:58:06 CET
SimDepoSetSource got 30877 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 30877 depos spanning: [6.70554e-07, 3.34636]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=932239 n=115237 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=1.03043e+06 n=98849 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100574 subRun: 0 event: 43 at 02-Feb-2026 20:58:43 CET
SimDepoSetSource got 16072 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 16072 depos spanning: [6.68126e-07, 2.04378]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=475427 n=59683 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=547507 n=47621 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100574 subRun: 0 event: 44 at 02-Feb-2026 20:59:06 CET
SimDepoSetSource got 8715 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8715 depos spanning: [6.70547e-07, 7.96483]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=289979 n=34087 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=314567 n=28698 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100574 subRun: 0 event: 45 at 02-Feb-2026 20:59:27 CET
SimDepoSetSource got 848 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 848 depos spanning: [2.19195e-06, 0.171737]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=34376.2 n=5283 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=40873 n=4751 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100574 subRun: 0 event: 46 at 02-Feb-2026 20:59:40 CET
SimDepoSetSource got 906 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 906 depos spanning: [0.00366538, 8.09431]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=25089.9 n=7150 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=29460.8 n=6441 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100574 subRun: 0 event: 47 at 02-Feb-2026 20:59:59 CET
SimDepoSetSource got 31881 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 31881 depos spanning: [6.70827e-07, 5.21753]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=1.03065e+06 n=121334 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=1.12014e+06 n=104211 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100574 subRun: 0 event: 48 at 02-Feb-2026 21:00:31 CET
SimDepoSetSource got 161 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 161 depos spanning: [1.7869e-06, 0.00301174]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=16462.4 n=1963 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=17741 n=1811 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100574 subRun: 0 event: 49 at 02-Feb-2026 21:00:39 CET
SimDepoSetSource got 34480 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 34480 depos spanning: [6.68726e-07, 0.254917]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=948511 n=120293 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.0453e+06 n=104407 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100574 subRun: 0 event: 50 at 02-Feb-2026 21:01:25 CET
SimDepoSetSource got 47123 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 47123 depos spanning: [6.69163e-07, 1.07366]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=1.26378e+06 n=128368 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=1.46635e+06 n=110479 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:01:52 CET  Closed output file "prodgenie_monte-carlo-012654-000574_gen_g4_detsim.root"
02-Feb-2026 21:01:52 CET  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/usertests/d9/c9/prodgenie_monte-carlo-012654-000574_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      5.96821       23.2072       53.1428       22.0289       12.7186        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00023585    0.00476848     0.0330475    0.00139335     0.008696        50     
simulate:tpcrawdecoder:WireCellToolkit          5.88644       22.9714       52.7009       21.8577       12.607         50     
simulate:opdigi:OpDetDigitizerDUNE            0.00727102     0.119776      0.250943      0.110704      0.0623148       50     
simulate:rns:RandomNumberSaver                 1.834e-05    2.51454e-05   0.00015347     2.201e-05    1.84822e-05      50     
[art]:TriggerResults:TriggerResultInserter     9.54e-06     1.16746e-05    3.02e-05      1.106e-05    3.30192e-06      50     
end_path:out1:RootOutput                       3.05e-06     4.0402e-06      1.4e-05      3.795e-06    1.44435e-06      50     
end_path:out1:RootOutput(write)                0.021033       0.1109       0.464239      0.0840118     0.0837766       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3814.03 MB
  Peak resident set size usage (VmHWM): 1977.32 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r--. 1 duneprd np-comp 347M Feb  2 21:01 prodgenie_monte-carlo-012654-000574_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000574_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:48:31 UTC       justIN version: 01.06.00