justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303045.92@dunegpschedd01.fnal.gov

Jobsub ID303045.92@dunegpschedd01.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 19:34:05
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce16-multicore
Last heartbeat2026-02-02 20:20:20
From worker nodeHostnametd808.pic.es
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 19:36:15
Input filesusertests:prodgenie_monte-carlo-012654-000683_gen_g4.root
JobscriptExit code0
Real time43m (2581s)
CPU time41m (2479s = 96%)
Max RSS bytes2261135360 (2156 MiB)
Outputting started2026-02-02 20:19:17
Output files
Finished2026-02-02 20:20:20
Saved logsjustin-logs:303045.92-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

q=98209.9 n=12053 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100683 subRun: 0 event: 40 at 02-Feb-2026 21:09:27 CET
SimDepoSetSource got 37950 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 37950 depos spanning: [6.69113e-07, 3.42242]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=1.12585e+06 n=116146 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=1.29841e+06 n=99934 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100683 subRun: 0 event: 41 at 02-Feb-2026 21:10:07 CET
SimDepoSetSource got 3927 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3927 depos spanning: [2.12311e-06, 7.40857]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=104894 n=18435 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=115578 n=16018 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100683 subRun: 0 event: 42 at 02-Feb-2026 21:10:42 CET
SimDepoSetSource got 6046 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6046 depos spanning: [7.81523e-07, 0.0075895]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=172960 n=20981 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=191984 n=17506 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100683 subRun: 0 event: 43 at 02-Feb-2026 21:10:54 CET
SimDepoSetSource got 198249 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 198249 depos spanning: [6.67263e-07, 7.25349]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=5.56855e+06 n=592803 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=6.1472e+06 n=509287 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100683 subRun: 0 event: 44 at 02-Feb-2026 21:13:11 CET
SimDepoSetSource got 27507 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 27507 depos spanning: [6.67177e-07, 0.0295772]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=842053 n=84357 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=975670 n=70341 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100683 subRun: 0 event: 45 at 02-Feb-2026 21:13:55 CET
SimDepoSetSource got 36251 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 36251 depos spanning: [6.67208e-07, 3.76398]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=1.18439e+06 n=127580 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=1.36602e+06 n=106465 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100683 subRun: 0 event: 46 at 02-Feb-2026 21:15:23 CET
SimDepoSetSource got 31266 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 31266 depos spanning: [6.67767e-07, 2.06806]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=980943 n=127991 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.10704e+06 n=101431 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100683 subRun: 0 event: 47 at 02-Feb-2026 21:16:20 CET
SimDepoSetSource got 26815 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 26815 depos spanning: [6.67638e-07, 2.18737]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=853087 n=111965 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=917744 n=92243 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100683 subRun: 0 event: 48 at 02-Feb-2026 21:17:12 CET
SimDepoSetSource got 12841 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 12841 depos spanning: [6.77082e-07, 1.27351]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=426999 n=51814 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=477706 n=47087 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100683 subRun: 0 event: 49 at 02-Feb-2026 21:18:01 CET
SimDepoSetSource got 20204 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20204 depos spanning: [6.67725e-07, 0.567108]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=499943 n=71141 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=541427 n=57057 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100683 subRun: 0 event: 50 at 02-Feb-2026 21:18:38 CET
SimDepoSetSource got 10112 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 10112 depos spanning: [6.68168e-07, 2.23738]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=360232 n=50713 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=377363 n=43393 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:19:16 CET  Closed output file "prodgenie_monte-carlo-012654-000683_gen_g4_detsim.root"
02-Feb-2026 21:19:16 CET  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/usertests/f8/cb/prodgenie_monte-carlo-012654-000683_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      8.47354       49.6913       135.546       40.5328       31.4259        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000382912   0.00795901     0.0519929    0.00253177     0.0146559       50     
simulate:tpcrawdecoder:WireCellToolkit          8.36449       49.1691       133.233       39.9486       30.9918        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0348597     0.267202       1.67847      0.174712      0.270956        50     
simulate:rns:RandomNumberSaver                 2.07e-05     3.37844e-05   0.000353292    2.603e-05    4.60463e-05      50     
[art]:TriggerResults:TriggerResultInserter     9.611e-06    1.33408e-05   4.7841e-05    1.2285e-05    5.37671e-06      50     
end_path:out1:RootOutput                       2.849e-06    4.57702e-06    2.648e-05     4.165e-06    3.20867e-06      50     
end_path:out1:RootOutput(write)                0.0430032     0.246407       1.21671       0.16457      0.251204        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4042.04 MB
  Peak resident set size usage (VmHWM): 2261.14 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 dune 659M Feb  2 21:19 prodgenie_monte-carlo-012654-000683_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000683_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 10:29:42 UTC       justIN version: 01.06.00