justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303548.5@dunegpschedd01.fnal.gov

Jobsub ID303548.5@dunegpschedd01.fnal.gov
Workflow ID12694
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 18:38:12
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel
Last heartbeat2026-02-03 19:08:33
From worker nodeHostnamewn-choc-015.farm.nikhef.nl
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 18:39:43
Input filesusertests:prod_monte-carlo-012694-000001_gen_g4.root
JobscriptExit code0
Real time28m (1686s)
CPU time27m (1655s = 98%)
Max RSS bytes1695502336 (1616 MiB)
Outputting started2026-02-03 19:07:49
Output files
Finished2026-02-03 19:08:33
Saved logsjustin-logs:303548.5-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

7680 traces tagged "gauss"
FrameSaver: q=659567 n=55334 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=717430 n=47080 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210001 subRun: 0 event: 40 at 03-Feb-2026 20:02:17 CET
SimDepoSetSource got 453 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 453 depos spanning: [0.672144, 0.672687]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=13871.7 n=3115 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=15938.8 n=2665 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210001 subRun: 0 event: 41 at 03-Feb-2026 20:02:32 CET
SimDepoSetSource got 32001 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 32001 depos spanning: [0.749889, 0.779497]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=846858 n=76183 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=942696 n=62887 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210001 subRun: 0 event: 42 at 03-Feb-2026 20:03:28 CET
SimDepoSetSource got 9516 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9516 depos spanning: [0.766711, 0.776808]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=286188 n=31713 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=309719 n=26829 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210001 subRun: 0 event: 43 at 03-Feb-2026 20:03:44 CET
SimDepoSetSource got 23365 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23365 depos spanning: [0.605267, 1.89199]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=644352 n=93692 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=685683 n=75833 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210001 subRun: 0 event: 44 at 03-Feb-2026 20:04:52 CET
SimDepoSetSource got 19119 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19119 depos spanning: [0.031447, 0.0534072]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=569231 n=69707 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=606200 n=57908 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210001 subRun: 0 event: 45 at 03-Feb-2026 20:05:40 CET
SimDepoSetSource got 4449 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4449 depos spanning: [0.0507159, 0.0557588]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=122867 n=13647 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=128715 n=11683 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210001 subRun: 0 event: 46 at 03-Feb-2026 20:05:57 CET
SimDepoSetSource got 2790 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2790 depos spanning: [0.686138, 0.690716]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=60491.2 n=9883 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=63061.5 n=9174 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210001 subRun: 0 event: 47 at 03-Feb-2026 20:06:13 CET
SimDepoSetSource got 11825 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11825 depos spanning: [0.981573, 0.992965]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=328594 n=46747 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=338933 n=45807 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210001 subRun: 0 event: 48 at 03-Feb-2026 20:06:47 CET
SimDepoSetSource got 4065 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4065 depos spanning: [0.928167, 0.933108]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=132229 n=17196 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=137084 n=15284 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210001 subRun: 0 event: 49 at 03-Feb-2026 20:07:02 CET
SimDepoSetSource got 5115 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5115 depos spanning: [0.0400889, 0.0533615]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=101110 n=16789 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=108429 n=14541 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210001 subRun: 0 event: 50 at 03-Feb-2026 20:07:33 CET
SimDepoSetSource got 612 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 612 depos spanning: [0.246336, 0.92016]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=27590.9 n=3248 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=29881 n=2827 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 20:07:49 CET  Closed output file "prod_monte-carlo-012694-000001_gen_g4_detsim.root"
03-Feb-2026 20:07:49 CET  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/ac/6e/prod_monte-carlo-012694-000001_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      14.4148       32.2316       90.9361       30.5353       19.0367        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000371783    0.0324598      1.10119     0.00137182     0.156444        50     
simulate:tpcrawdecoder:WireCellToolkit          14.3232       31.9005       89.2513       30.3259       18.8451        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0214653      0.17686       0.35879      0.178043      0.0757674       50     
simulate:rns:RandomNumberSaver                2.2324e-05    4.11402e-05   0.000279697   3.64625e-05   3.47713e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.1709e-05    1.47403e-05   4.6304e-05    1.40815e-05   4.89595e-06      50     
end_path:out1:RootOutput                       3.125e-06    6.93694e-06   2.1782e-05     6.772e-06    2.90647e-06      50     
end_path:out1:RootOutput(write)                0.0442662      0.12126      0.323675      0.105772      0.0632938       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3398.69 MB
  Peak resident set size usage (VmHWM): 1695.5 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune090 dune 202M Feb  3 20:07 prod_monte-carlo-012694-000001_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012694-000001_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:31:42 UTC       justIN version: 01.06.00