justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297630.8@dunegpschedd02.fnal.gov

Jobsub ID297630.8@dunegpschedd02.fnal.gov
Workflow ID12668
Stage ID3
User nameykermaid@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 10:42:44
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2026-02-03 11:17:38
From worker nodeHostnamedune001-1500145.0-lcg2494.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 10:44:39
Input filesusertests:prod_monte-carlo-012668-000015_gen_g4.root
JobscriptExit code0
Real time31m (1878s)
CPU time29m (1795s = 95%)
Max RSS bytes1640681472 (1564 MiB)
Outputting started2026-02-03 11:15:58
Output files
Finished2026-02-03 11:17:38
Saved logsjustin-logs:297630.8-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0 traces tagged "gauss"
FrameSaver: q=89618 n=7835 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=99625.7 n=6578 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210015 subRun: 0 event: 40 at 03-Feb-2026 11:10:33 UTC
SimDepoSetSource got 2920 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2920 depos spanning: [0.795948, 0.802156]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=92612.7 n=13358 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=96116 n=12702 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210015 subRun: 0 event: 41 at 03-Feb-2026 11:10:46 UTC
SimDepoSetSource got 3793 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3793 depos spanning: [0.596239, 0.60144]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=99229.3 n=15006 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=102655 n=14538 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210015 subRun: 0 event: 42 at 03-Feb-2026 11:11:02 UTC
SimDepoSetSource got 69 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 69 depos spanning: [0.515575, 0.515662]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=3868.09 n=1339 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=5172.91 n=1315 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210015 subRun: 0 event: 43 at 03-Feb-2026 11:11:15 UTC
SimDepoSetSource got 20626 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20626 depos spanning: [0.257691, 0.28291]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=631704 n=81255 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=685327 n=64200 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210015 subRun: 0 event: 44 at 03-Feb-2026 11:12:16 UTC
SimDepoSetSource got 5042 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5042 depos spanning: [0.00960703, 0.0150034]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=157169 n=13561 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=174434 n=11136 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210015 subRun: 0 event: 45 at 03-Feb-2026 11:12:44 UTC
SimDepoSetSource got 2008 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2008 depos spanning: [0.103909, 0.108175]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=50247.8 n=6130 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=53077 n=5413 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210015 subRun: 0 event: 46 at 03-Feb-2026 11:12:58 UTC
SimDepoSetSource got 25605 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25605 depos spanning: [0.366982, 0.401288]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=685283 n=92635 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=730555 n=74019 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210015 subRun: 0 event: 47 at 03-Feb-2026 11:14:19 UTC
SimDepoSetSource got 13523 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 13523 depos spanning: [0.358261, 0.372705]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=395021 n=40582 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=403954 n=37204 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210015 subRun: 0 event: 48 at 03-Feb-2026 11:14:39 UTC
SimDepoSetSource got 6404 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6404 depos spanning: [0.285054, 0.292236]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=194109 n=22350 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=218728 n=17578 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210015 subRun: 0 event: 49 at 03-Feb-2026 11:14:54 UTC
SimDepoSetSource got 2927 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2927 depos spanning: [0.886025, 1.37276]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=89420.9 n=12887 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=93519.7 n=12476 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210015 subRun: 0 event: 50 at 03-Feb-2026 11:15:23 UTC
SimDepoSetSource got 11651 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11651 depos spanning: [0.646238, 1.47998]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=350914 n=56466 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=362475 n=55202 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 11:15:56 UTC  Closed output file "prod_monte-carlo-012668-000015_gen_g4_detsim.root"
03-Feb-2026 11:15:56 UTC  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/7c/83/prod_monte-carlo-012668-000015_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      13.2049       35.3965       81.0102       31.4745       18.796         50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000396574   0.00910342      0.11568     0.00266075     0.0209008       50     
simulate:tpcrawdecoder:WireCellToolkit          13.1212       35.0049       80.4819       31.1143        18.69         50     
simulate:opdigi:OpDetDigitizerDUNE             0.0203646     0.219797      0.474641      0.218495      0.0952974       50     
simulate:rns:RandomNumberSaver                 2.451e-05    4.30607e-05   0.000369925   3.39855e-05   4.72966e-05      50     
[art]:TriggerResults:TriggerResultInserter     1.284e-05    2.03428e-05   7.0271e-05     1.755e-05    9.47234e-06      50     
end_path:out1:RootOutput                       3.77e-06     6.06836e-06    3.138e-05     4.57e-06     4.01336e-06      50     
end_path:out1:RootOutput(write)                0.0601542     0.161897      0.293398       0.15871      0.0626394       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3529.53 MB
  Peak resident set size usage (VmHWM): 1640.68 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 dune 216M Feb  3 11:15 prod_monte-carlo-012668-000015_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012668-000015_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:26:43 UTC       justIN version: 01.06.00