justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303490.4@dunegpschedd01.fnal.gov

Jobsub ID303490.4@dunegpschedd01.fnal.gov
Workflow ID12686
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 16:08:05
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk
Last heartbeat2026-02-03 16:39:42
From worker nodeHostnamewn-choc-018.farm.nikhef.nl
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 16:10:04
Input filesusertests:prod_monte-carlo-012686-000018_gen_g4.root
JobscriptExit code0
Real time28m (1714s)
CPU time27m (1668s = 97%)
Max RSS bytes1795784704 (1712 MiB)
Outputting started2026-02-03 16:38:39
Output files
Finished2026-02-03 16:39:42
Saved logsjustin-logs:303490.4-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

tagged "gauss"
FrameSaver: q=227702 n=25919 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=250009 n=20519 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210018 subRun: 0 event: 40 at 03-Feb-2026 17:32:43 CET
SimDepoSetSource got 19805 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19805 depos spanning: [0.598964, 0.618882]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=445869 n=65965 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=463971 n=63226 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210018 subRun: 0 event: 41 at 03-Feb-2026 17:33:18 CET
SimDepoSetSource got 23683 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23683 depos spanning: [0.124581, 0.150218]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=688632 n=106680 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=727257 n=90807 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210018 subRun: 0 event: 42 at 03-Feb-2026 17:34:55 CET
SimDepoSetSource got 12474 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 12474 depos spanning: [0.276626, 0.290785]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=389669 n=48851 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=426100 n=39644 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210018 subRun: 0 event: 43 at 03-Feb-2026 17:35:26 CET
SimDepoSetSource got 1732 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1732 depos spanning: [0.320891, 0.322884]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=49795.9 n=5995 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=53484.4 n=5097 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210018 subRun: 0 event: 44 at 03-Feb-2026 17:35:41 CET
SimDepoSetSource got 6241 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6241 depos spanning: [0.428649, 0.435516]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=188110 n=26191 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=198200 n=22662 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210018 subRun: 0 event: 45 at 03-Feb-2026 17:35:57 CET
SimDepoSetSource got 11626 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11626 depos spanning: [0.492788, 0.504825]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=243437 n=37568 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=250698 n=35500 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210018 subRun: 0 event: 46 at 03-Feb-2026 17:36:16 CET
SimDepoSetSource got 14879 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14879 depos spanning: [0.353711, 0.632422]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=444000 n=58336 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=452543 n=56320 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210018 subRun: 0 event: 47 at 03-Feb-2026 17:36:50 CET
SimDepoSetSource got 355 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 355 depos spanning: [0.455261, 0.455683]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=11031 n=2556 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=12284 n=2422 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210018 subRun: 0 event: 48 at 03-Feb-2026 17:37:04 CET
SimDepoSetSource got 2931 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2931 depos spanning: [0.0105803, 0.0176937]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=65798.3 n=10096 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=69325.4 n=9158 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210018 subRun: 0 event: 49 at 03-Feb-2026 17:37:19 CET
SimDepoSetSource got 7185 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7185 depos spanning: [0.312173, 0.320082]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=187868 n=22750 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=195625 n=19673 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210018 subRun: 0 event: 50 at 03-Feb-2026 17:37:37 CET
SimDepoSetSource got 11919 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11919 depos spanning: [0.785154, 0.798007]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=330415 n=47601 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=364296 n=37694 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 17:38:38 CET  Closed output file "prod_monte-carlo-012686-000018_gen_g4_detsim.root"
03-Feb-2026 17:38:39 CET  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/10/7c/prod_monte-carlo-012686-000018_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      14.1788       32.6549       96.4213       31.613        17.6688        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000339145    0.0177809     0.438488     0.000886794    0.0696076       50     
simulate:tpcrawdecoder:WireCellToolkit          14.0814       32.3533       95.908        31.316        17.6067        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0198838     0.172616      0.339914      0.168901      0.0697858       50     
simulate:rns:RandomNumberSaver                  2.3e-05     3.62036e-05   0.000217851   3.2807e-05    2.62299e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.1779e-05    1.73665e-05   4.8473e-05    1.66415e-05   5.11124e-06      50     
end_path:out1:RootOutput                       2.603e-06    5.06338e-06   1.9076e-05    4.9275e-06     2.171e-06       50     
end_path:out1:RootOutput(write)                0.0434132     0.110747      0.215456      0.102864      0.0453908       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3486.54 MB
  Peak resident set size usage (VmHWM): 1795.78 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune090 dune 177M Feb  3 17:38 prod_monte-carlo-012686-000018_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012686-000018_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:45:36 UTC       justIN version: 01.06.00