justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297214.19@dunegpschedd02.fnal.gov

Jobsub ID297214.19@dunegpschedd02.fnal.gov
Workflow ID12614
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 15:43:54
SiteCZ_FZU
EntryNova_CZ_FZU_osgce2
Last heartbeat2026-02-02 16:10:43
From worker nodeHostnamemilan09.farm.particle.cz
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 15:45:47
Input filesusertests:prod_monte-carlo-012614-000015_gen_g4.root
JobscriptExit code0
Real time24m (1449s)
CPU time23m (1403s = 96%)
Max RSS bytes1622286336 (1547 MiB)
Outputting started2026-02-02 16:09:57
Output files
Finished2026-02-02 16:10:43
Saved logsjustin-logs:297214.19-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

s tagged "gauss"
FrameSaver: q=23616.5 n=6117 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=28069 n=5889 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210015 subRun: 0 event: 40 at 02-Feb-2026 17:05:16 CET
SimDepoSetSource got 8559 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8559 depos spanning: [0.883939, 0.893451]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=220419 n=36971 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=229709 n=35291 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210015 subRun: 0 event: 41 at 02-Feb-2026 17:05:49 CET
SimDepoSetSource got 11735 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11735 depos spanning: [0.283717, 0.793291]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=324305 n=49861 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=336197 n=49400 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210015 subRun: 0 event: 42 at 02-Feb-2026 17:06:02 CET
SimDepoSetSource got 5710 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5710 depos spanning: [0.918806, 3.1619]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=154117 n=24516 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=165289 n=19821 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210015 subRun: 0 event: 43 at 02-Feb-2026 17:06:24 CET
SimDepoSetSource got 622 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 622 depos spanning: [0.051571, 0.222061]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=17152.5 n=3241 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=18416.9 n=3093 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210015 subRun: 0 event: 44 at 02-Feb-2026 17:06:34 CET
SimDepoSetSource got 8930 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8930 depos spanning: [0.60025, 0.61255]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=240554 n=34354 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=249675 n=31501 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210015 subRun: 0 event: 45 at 02-Feb-2026 17:07:07 CET
SimDepoSetSource got 3122 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3122 depos spanning: [0.207685, 0.321126]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=102781 n=17482 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=106143 n=16986 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210015 subRun: 0 event: 46 at 02-Feb-2026 17:07:24 CET
SimDepoSetSource got 37655 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 37655 depos spanning: [0.864277, 0.90203]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=860847 n=121542 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=905927 n=108321 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210015 subRun: 0 event: 47 at 02-Feb-2026 17:08:10 CET
SimDepoSetSource got 1937 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1937 depos spanning: [0.113801, 4.37548]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=67599.5 n=13418 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=73783.1 n=12002 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210015 subRun: 0 event: 48 at 02-Feb-2026 17:08:44 CET
SimDepoSetSource got 10702 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 10702 depos spanning: [0.019421, 0.0330834]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=254904 n=41224 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=264401 n=40055 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210015 subRun: 0 event: 49 at 02-Feb-2026 17:09:04 CET
SimDepoSetSource got 9479 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9479 depos spanning: [0.165005, 0.175329]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=266081 n=36566 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=272337 n=35418 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210015 subRun: 0 event: 50 at 02-Feb-2026 17:09:16 CET
SimDepoSetSource got 21947 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 21947 depos spanning: [0.199272, 0.223725]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=628907 n=87138 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=659099 n=77261 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 17:09:56 CET  Closed output file "prod_monte-carlo-012614-000015_gen_g4_detsim.root"
02-Feb-2026 17:09:56 CET  Closed input file "root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/usertests/ed/e9/prod_monte-carlo-012614-000015_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      9.54589       27.7083       66.9949       24.0178       14.0185        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000408681    0.0049187     0.0468921    0.000883316    0.0116914       50     
simulate:tpcrawdecoder:WireCellToolkit          9.48887       27.4382       66.5556       23.7917       13.9433        50     
simulate:opdigi:OpDetDigitizerDUNE             0.023747      0.146732       0.29836      0.134729      0.0609966       50     
simulate:rns:RandomNumberSaver                 2.541e-05    4.45166e-05    0.0002568    3.7525e-05    3.22018e-05      50     
[art]:TriggerResults:TriggerResultInserter     8.75e-06     1.45008e-05    4.153e-05     1.351e-05    5.39328e-06      50     
end_path:out1:RootOutput                       3.11e-06     6.1848e-06     2.351e-05     5.895e-06    2.93285e-06      50     
end_path:out1:RootOutput(write)                0.0323006     0.117998       0.22835       0.10367      0.0498136       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3357.94 MB
  Peak resident set size usage (VmHWM): 1622.29 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 fermilab users 206M Feb  2 17:09 prod_monte-carlo-012614-000015_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012614-000015_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:29:09 UTC       justIN version: 01.06.00