justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303330.0@dunegpschedd01.fnal.gov

Jobsub ID303330.0@dunegpschedd01.fnal.gov
Workflow ID12671
Stage ID3
User nameachatter@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 10:10:42
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_klomp
Last heartbeat2026-02-03 10:37:11
From worker nodeHostnamewn-sate-018.farm.nikhef.nl
cpuinfoAMD EPYC 7551P 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 10:11:32
Input filesusertests:prod_monte-carlo-012671-000010_gen_g4.root
JobscriptExit code0
Real time24m (1480s)
CPU time24m (1466s = 99%)
Max RSS bytes1800036352 (1716 MiB)
Outputting started2026-02-03 10:36:13
Output files
Finished2026-02-03 10:37:11
Saved logsjustin-logs:303330.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

aver: saving 7680 traces tagged "gauss"
FrameSaver: q=628957 n=73760 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=653535 n=70215 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210010 subRun: 0 event: 40 at 03-Feb-2026 11:32:18 CET
SimDepoSetSource got 8634 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8634 depos spanning: [0.742003, 0.753038]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=193068 n=31570 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=201008 n=29347 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210010 subRun: 0 event: 41 at 03-Feb-2026 11:32:44 CET
SimDepoSetSource got 2550 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2550 depos spanning: [0.586402, 0.589539]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=57906.3 n=11784 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=60061.3 n=11624 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210010 subRun: 0 event: 42 at 03-Feb-2026 11:32:56 CET
SimDepoSetSource got 16193 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 16193 depos spanning: [0.795917, 0.814843]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=507748 n=66331 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=544973 n=55353 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210010 subRun: 0 event: 43 at 03-Feb-2026 11:33:22 CET
SimDepoSetSource got 4533 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4533 depos spanning: [0.765258, 0.770764]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=87133.6 n=17095 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=90540.1 n=16944 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210010 subRun: 0 event: 44 at 03-Feb-2026 11:33:35 CET
SimDepoSetSource got 6344 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6344 depos spanning: [0.999566, 1.0068]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=162336 n=21126 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=172475 n=16808 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210010 subRun: 0 event: 45 at 03-Feb-2026 11:33:59 CET
SimDepoSetSource got 11803 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11803 depos spanning: [0.723906, 0.736524]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=250848 n=41450 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=261937 n=40977 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210010 subRun: 0 event: 46 at 03-Feb-2026 11:34:14 CET
SimDepoSetSource got 6546 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6546 depos spanning: [0.614137, 0.621831]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=182086 n=33122 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=189001 n=29581 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210010 subRun: 0 event: 47 at 03-Feb-2026 11:34:40 CET
SimDepoSetSource got 1973 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1973 depos spanning: [0.685091, 0.687712]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=59264.2 n=8137 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=63559.2 n=7339 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210010 subRun: 0 event: 48 at 03-Feb-2026 11:34:51 CET
SimDepoSetSource got 2154 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2154 depos spanning: [0.988867, 0.991853]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=56493.4 n=5640 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=61614.6 n=5175 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210010 subRun: 0 event: 49 at 03-Feb-2026 11:35:03 CET
SimDepoSetSource got 27742 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 27742 depos spanning: [0.185595, 0.214015]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=781843 n=114386 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=838243 n=92917 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210010 subRun: 0 event: 50 at 03-Feb-2026 11:35:59 CET
SimDepoSetSource got 2723 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2723 depos spanning: [0.524323, 0.528509]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=78837.2 n=10233 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=87469.2 n=8658 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 11:36:12 CET  Closed output file "prod_monte-carlo-012671-000010_gen_g4_detsim.root"
03-Feb-2026 11:36:12 CET  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/usertests/1e/1f/prod_monte-carlo-012671-000010_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      11.3353       28.3544       75.2649       25.365        17.0619        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000448534   0.00330558     0.0144841    0.00210845     0.0034543       50     
simulate:tpcrawdecoder:WireCellToolkit          11.1857       28.0649       74.6946       25.0901       16.9561        50     
simulate:opdigi:OpDetDigitizerDUNE             0.057792       0.15482      0.338557      0.147748      0.0719551       50     
simulate:rns:RandomNumberSaver                2.2363e-05    4.00896e-05   0.000323199   3.44445e-05   4.10632e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.1992e-05    1.58011e-05   5.5564e-05    1.5108e-05    5.99468e-06      50     
end_path:out1:RootOutput                       2.976e-06    5.18938e-06   2.4736e-05    5.0745e-06    3.05244e-06      50     
end_path:out1:RootOutput(write)                0.0581545     0.130591      0.257308      0.112248      0.056722        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3503.06 MB
  Peak resident set size usage (VmHWM): 1800.04 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune090 dune 209M Feb  3 11:36 prod_monte-carlo-012671-000010_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012671-000010_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:31:58 UTC       justIN version: 01.06.00