justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303490.3@dunegpschedd01.fnal.gov

Jobsub ID303490.3@dunegpschedd01.fnal.gov
Workflow ID12686
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 16:08:05
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_klomp
Last heartbeat2026-02-03 16:39:04
From worker nodeHostnamewn-choc-010.farm.nikhef.nl
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 16:10:10
Input filesusertests:prod_monte-carlo-012686-000011_gen_g4.root
JobscriptExit code0
Real time28m (1688s)
CPU time27m (1631s = 96%)
Max RSS bytes1940647936 (1850 MiB)
Outputting started2026-02-03 16:38:19
Output files
Finished2026-02-03 16:39:04
Saved logsjustin-logs:303490.3-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ng 7680 traces tagged "gauss"
FrameSaver: q=156750 n=24859 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=167110 n=21057 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210011 subRun: 0 event: 40 at 03-Feb-2026 17:32:06 CET
SimDepoSetSource got 16542 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 16542 depos spanning: [0.60907, 0.627989]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=467114 n=73959 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=482379 n=72056 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210011 subRun: 0 event: 41 at 03-Feb-2026 17:32:40 CET
SimDepoSetSource got 14805 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14805 depos spanning: [0.747505, 0.76352]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=400432 n=49488 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=422143 n=40844 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210011 subRun: 0 event: 42 at 03-Feb-2026 17:33:31 CET
SimDepoSetSource got 21560 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 21560 depos spanning: [0.987596, 1.0104]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=669882 n=82541 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=717390 n=69290 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210011 subRun: 0 event: 43 at 03-Feb-2026 17:34:20 CET
SimDepoSetSource got 1839 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1839 depos spanning: [0.956123, 0.960102]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=12825.1 n=3003 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=14311.2 n=2888 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210011 subRun: 0 event: 44 at 03-Feb-2026 17:34:34 CET
SimDepoSetSource got 20447 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20447 depos spanning: [0.733757, 0.755818]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=478038 n=74403 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=497207 n=71848 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210011 subRun: 0 event: 45 at 03-Feb-2026 17:35:10 CET
SimDepoSetSource got 2008 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2008 depos spanning: [0.232649, 0.234976]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=45319.2 n=8961 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=47179.4 n=8799 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210011 subRun: 0 event: 46 at 03-Feb-2026 17:35:26 CET
SimDepoSetSource got 27796 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 27796 depos spanning: [0.306959, 0.337215]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=779551 n=76475 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=814920 n=65730 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210011 subRun: 0 event: 47 at 03-Feb-2026 17:36:06 CET
SimDepoSetSource got 6420 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6420 depos spanning: [0.256142, 0.264406]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=166979 n=24384 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=172729 n=22885 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210011 subRun: 0 event: 48 at 03-Feb-2026 17:36:37 CET
SimDepoSetSource got 27947 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 27947 depos spanning: [0.55039, 0.574911]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=745482 n=84917 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=776413 n=80160 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210011 subRun: 0 event: 49 at 03-Feb-2026 17:37:15 CET
SimDepoSetSource got 15004 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 15004 depos spanning: [0.10012, 0.575689]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=467168 n=70624 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=493167 n=60155 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210011 subRun: 0 event: 50 at 03-Feb-2026 17:38:02 CET
SimDepoSetSource got 1844 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1844 depos spanning: [0.471214, 2.10685]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=64684.6 n=10092 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=66888 n=9530 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 17:38:19 CET  Closed output file "prod_monte-carlo-012686-000011_gen_g4_detsim.root"
03-Feb-2026 17:38:19 CET  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/9d/e4/prod_monte-carlo-012686-000011_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      14.4792       31.9658       109.818       30.9615       19.2974        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00040192     0.015149      0.208275     0.00144212     0.0450367       50     
simulate:tpcrawdecoder:WireCellToolkit          14.387         31.65        109.24        30.5874       19.1929        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0415824     0.181184      0.345626      0.173326      0.0754595       50     
simulate:rns:RandomNumberSaver                3.0303e-05    4.60397e-05   0.00029792    4.00155e-05   3.63451e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.3589e-05    1.77834e-05   4.7403e-05    1.7214e-05     4.423e-06       50     
end_path:out1:RootOutput                       3.626e-06    6.5226e-06    2.0091e-05    6.1675e-06    2.07181e-06      50     
end_path:out1:RootOutput(write)                0.046859       0.1189       0.267889       0.10731      0.0541856       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3636.23 MB
  Peak resident set size usage (VmHWM): 1940.65 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune090 dune 197M Feb  3 17:38 prod_monte-carlo-012686-000011_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012686-000011_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:45:44 UTC       justIN version: 01.06.00