justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297211.8@dunegpschedd02.fnal.gov

Jobsub ID297211.8@dunegpschedd02.fnal.gov
Workflow ID12617
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-02 15:39:54
SiteCZ_FZU
EntryNova_CZ_FZU_osgce2
Last heartbeat2026-02-02 16:08:35
From worker nodeHostnamelupin02.farm.particle.cz
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 15:41:33
Input filesusertests:prod_monte-carlo-012617-000010_gen_g4.root
JobscriptExit code0
Real time25m (1536s)
CPU time24m (1455s = 94%)
Max RSS bytes1781104640 (1698 MiB)
Outputting started2026-02-02 16:07:11
Output files
Finished2026-02-02 16:08:35
Saved logsjustin-logs:297211.8-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

tagged "gauss"
FrameSaver: q=516806 n=81438 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=534522 n=80097 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210010 subRun: 0 event: 40 at 02-Feb-2026 17:01:57 CET
SimDepoSetSource got 4016 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4016 depos spanning: [0.0788181, 0.0844506]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=104960 n=17133 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=108303 n=16706 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210010 subRun: 0 event: 41 at 02-Feb-2026 17:02:10 CET
SimDepoSetSource got 411 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 411 depos spanning: [0.428172, 0.428592]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=11576.2 n=2212 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=12779.9 n=2148 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210010 subRun: 0 event: 42 at 02-Feb-2026 17:02:22 CET
SimDepoSetSource got 19705 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19705 depos spanning: [0.433502, 0.455284]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=569489 n=55060 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=587989 n=48593 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210010 subRun: 0 event: 43 at 02-Feb-2026 17:02:54 CET
SimDepoSetSource got 14263 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14263 depos spanning: [0.954636, 1.23595]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=397345 n=54567 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=403834 n=52900 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210010 subRun: 0 event: 44 at 02-Feb-2026 17:03:12 CET
SimDepoSetSource got 8269 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8269 depos spanning: [0.016487, 0.0248184]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=227323 n=23030 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=235402 n=20882 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210010 subRun: 0 event: 45 at 02-Feb-2026 17:03:27 CET
SimDepoSetSource got 21621 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 21621 depos spanning: [0.818962, 0.907051]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=620140 n=78048 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=659855 n=66796 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210010 subRun: 0 event: 46 at 02-Feb-2026 17:04:21 CET
SimDepoSetSource got 13418 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 13418 depos spanning: [0.660608, 0.8028]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=405309 n=54663 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=439747 n=45500 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210010 subRun: 0 event: 47 at 02-Feb-2026 17:05:09 CET
SimDepoSetSource got 20408 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20408 depos spanning: [0.557204, 0.577619]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=609053 n=68296 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=659781 n=56238 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210010 subRun: 0 event: 48 at 02-Feb-2026 17:06:01 CET
SimDepoSetSource got 9166 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9166 depos spanning: [0.92324, 0.934336]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=257133 n=43519 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=264067 n=40053 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210010 subRun: 0 event: 49 at 02-Feb-2026 17:06:29 CET
SimDepoSetSource got 10801 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 10801 depos spanning: [0.630349, 0.722255]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=335357 n=41330 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=344633 n=39593 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210010 subRun: 0 event: 50 at 02-Feb-2026 17:06:55 CET
SimDepoSetSource got 516 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 516 depos spanning: [0.810294, 0.810935]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=14121 n=3223 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=15479.2 n=2992 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 17:07:09 CET  Closed output file "prod_monte-carlo-012617-000010_gen_g4_detsim.root"
02-Feb-2026 17:07:09 CET  Closed input file "root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/usertests/99/ec/prod_monte-carlo-012617-000010_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      11.3363       28.7409       81.9253       25.8954       16.6235        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000311211   0.00582642     0.0512999    0.00168005     0.0121055       50     
simulate:tpcrawdecoder:WireCellToolkit          11.2071       28.437        81.4037       25.6181       16.5251        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0121998     0.140112      0.310086      0.136484      0.0615681       50     
simulate:rns:RandomNumberSaver                2.2542e-05    3.69996e-05   0.000274199   3.30825e-05   3.45474e-05      50     
[art]:TriggerResults:TriggerResultInserter     1.221e-05    1.56064e-05   5.4844e-05    1.4621e-05    5.75368e-06      50     
end_path:out1:RootOutput                       3.44e-06     5.21496e-06   2.1882e-05     4.345e-06    2.63967e-06      50     
end_path:out1:RootOutput(write)                0.0541006     0.157355      0.313828      0.157171      0.0633696       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3488.69 MB
  Peak resident set size usage (VmHWM): 1781.1 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r--. 1 fermilab users 205M Feb  2 17:07 prod_monte-carlo-012617-000010_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012617-000010_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:32:47 UTC       justIN version: 01.06.00