justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303548.11@dunegpschedd01.fnal.gov

Jobsub ID303548.11@dunegpschedd01.fnal.gov
Workflow ID12694
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 18:38:12
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel
Last heartbeat2026-02-03 19:06:52
From worker nodeHostnamewn-snel-024.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 18:39:32
Input filesusertests:prod_monte-carlo-012694-000011_gen_g4.root
JobscriptExit code0
Real time26m (1582s)
CPU time25m (1557s = 98%)
Max RSS bytes1718325248 (1638 MiB)
Outputting started2026-02-03 19:05:55
Output files
Finished2026-02-03 19:06:52
Saved logsjustin-logs:303548.11-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

sFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=905302 n=78287 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=995611 n=63834 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210011 subRun: 0 event: 40 at 03-Feb-2026 20:01:12 CET
SimDepoSetSource got 4361 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4361 depos spanning: [0.78846, 2.23252]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=134463 n=21395 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=138578 n=20874 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210011 subRun: 0 event: 41 at 03-Feb-2026 20:01:36 CET
SimDepoSetSource got 17296 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17296 depos spanning: [0.0115118, 0.0320699]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=540692 n=54750 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=611590 n=44637 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210011 subRun: 0 event: 42 at 03-Feb-2026 20:02:14 CET
SimDepoSetSource got 34153 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 34153 depos spanning: [0.289099, 0.325573]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=1.05777e+06 n=115897 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.2165e+06 n=91228 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210011 subRun: 0 event: 43 at 03-Feb-2026 20:03:23 CET
SimDepoSetSource got 253 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 253 depos spanning: [0.853489, 0.856324]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=9974.54 n=1954 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=11758.2 n=1826 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210011 subRun: 0 event: 44 at 03-Feb-2026 20:03:36 CET
SimDepoSetSource got 16278 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 16278 depos spanning: [0.955975, 0.971728]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=489911 n=68352 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=507217 n=61720 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210011 subRun: 0 event: 45 at 03-Feb-2026 20:04:04 CET
SimDepoSetSource got 3716 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3716 depos spanning: [0.307665, 1.21082]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=121672 n=12561 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=138802 n=10875 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210011 subRun: 0 event: 46 at 03-Feb-2026 20:04:31 CET
SimDepoSetSource got 5743 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5743 depos spanning: [0.398343, 0.405117]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=152639 n=19490 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=156031 n=18598 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210011 subRun: 0 event: 47 at 03-Feb-2026 20:04:47 CET
SimDepoSetSource got 2719 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2719 depos spanning: [0.488213, 0.491263]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=45652.4 n=9242 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=47532.1 n=9108 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210011 subRun: 0 event: 48 at 03-Feb-2026 20:05:02 CET
SimDepoSetSource got 1662 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1662 depos spanning: [0.0445571, 0.0943274]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=58186.9 n=8619 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=61073.9 n=8351 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210011 subRun: 0 event: 49 at 03-Feb-2026 20:05:16 CET
SimDepoSetSource got 5214 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5214 depos spanning: [0.0870243, 0.0945787]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=137738 n=21366 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=142627 n=19703 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210011 subRun: 0 event: 50 at 03-Feb-2026 20:05:30 CET
SimDepoSetSource got 700 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 700 depos spanning: [0.624651, 0.897262]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=31092 n=4443 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=36624.2 n=4070 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 20:05:54 CET  Closed output file "prod_monte-carlo-012694-000011_gen_g4_detsim.root"
03-Feb-2026 20:05:54 CET  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/usertests/10/52/prod_monte-carlo-012694-000011_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      12.634        30.0271       68.7774       27.3491       15.5793        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000337394    0.0043777     0.0297738    0.00183511    0.00708317       50     
simulate:tpcrawdecoder:WireCellToolkit          12.5454       29.6932       68.0955       27.0758       15.4595        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0305444     0.184142      0.409702      0.163618      0.0837893       50     
simulate:rns:RandomNumberSaver                 2.17e-05     3.28081e-05   0.000302308   2.68455e-05    3.872e-05       50     
[art]:TriggerResults:TriggerResultInserter    1.0229e-05    1.43603e-05   4.5345e-05    1.3761e-05    4.73974e-06      50     
end_path:out1:RootOutput                       2.825e-06    3.77148e-06    2.09e-05      3.436e-06    2.46662e-06      50     
end_path:out1:RootOutput(write)                0.0514526     0.144695      0.289463      0.124223      0.0631938       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3434.43 MB
  Peak resident set size usage (VmHWM): 1718.33 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune090 dune 204M Feb  3 20:05 prod_monte-carlo-012694-000011_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012694-000011_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 09:48:34 UTC       justIN version: 01.06.00