justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297772.5@dunegpschedd02.fnal.gov

Jobsub ID297772.5@dunegpschedd02.fnal.gov
Workflow ID12686
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 16:02:05
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce05
Last heartbeat2026-02-03 16:29:13
From worker nodeHostnamedune001-1829850.0-lcg2727.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 16:04:03
Input filesusertests:prod_monte-carlo-012686-000008_gen_g4.root
JobscriptExit code0
Real time23m (1414s)
CPU time22m (1327s = 93%)
Max RSS bytes1642479616 (1566 MiB)
Outputting started2026-02-03 16:27:39
Output files
Finished2026-02-03 16:29:13
Saved logsjustin-logs:297772.5-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

lsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=298979 n=32726 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=330368 n=26304 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210008 subRun: 0 event: 40 at 03-Feb-2026 16:24:04 UTC
SimDepoSetSource got 5485 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5485 depos spanning: [0.28196, 0.288572]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=155871 n=30143 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=159475 n=29570 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210008 subRun: 0 event: 41 at 03-Feb-2026 16:24:16 UTC
SimDepoSetSource got 19774 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19774 depos spanning: [0.780368, 1.65396]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=617045 n=79561 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=690354 n=64227 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210008 subRun: 0 event: 42 at 03-Feb-2026 16:24:58 UTC
SimDepoSetSource got 627 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 627 depos spanning: [0.0673742, 0.0682372]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=20954.1 n=3625 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=22292.3 n=3270 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210008 subRun: 0 event: 43 at 03-Feb-2026 16:25:07 UTC
SimDepoSetSource got 6918 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6918 depos spanning: [0.660919, 0.668896]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=183630 n=26968 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=188980 n=25557 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210008 subRun: 0 event: 44 at 03-Feb-2026 16:25:19 UTC
SimDepoSetSource got 3798 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3798 depos spanning: [0.993878, 0.997513]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=94915 n=14890 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=99574.9 n=13405 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210008 subRun: 0 event: 45 at 03-Feb-2026 16:25:41 UTC
SimDepoSetSource got 806 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 806 depos spanning: [0.735553, 0.987671]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=31685.2 n=3048 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=35222.1 n=2772 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210008 subRun: 0 event: 46 at 03-Feb-2026 16:25:51 UTC
SimDepoSetSource got 19485 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19485 depos spanning: [0.376361, 0.398827]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=554915 n=90939 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=567190 n=87424 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210008 subRun: 0 event: 47 at 03-Feb-2026 16:26:25 UTC
SimDepoSetSource got 13544 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 13544 depos spanning: [0.272846, 0.289732]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=400680 n=49038 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=412866 n=47047 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210008 subRun: 0 event: 48 at 03-Feb-2026 16:26:38 UTC
SimDepoSetSource got 5538 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5538 depos spanning: [0.0346861, 0.0409134]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=162499 n=27263 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=165735 n=25727 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210008 subRun: 0 event: 49 at 03-Feb-2026 16:26:49 UTC
SimDepoSetSource got 17579 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17579 depos spanning: [0.578402, 0.59722]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=411893 n=63157 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=428269 n=59965 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210008 subRun: 0 event: 50 at 03-Feb-2026 16:27:14 UTC
SimDepoSetSource got 7380 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7380 depos spanning: [0.87483, 0.88287]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=173813 n=27437 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=182155 n=25110 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 16:27:36 UTC  Closed output file "prod_monte-carlo-012686-000008_gen_g4_detsim.root"
03-Feb-2026 16:27:36 UTC  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/usertests/1e/30/prod_monte-carlo-012686-000008_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      9.45634       27.2235       62.4206       23.3333       14.5262        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000474478    0.0025877     0.0134827    0.00171618    0.00240477       50     
simulate:tpcrawdecoder:WireCellToolkit          9.33511       26.9164       61.9454       23.0393       14.435         50     
simulate:opdigi:OpDetDigitizerDUNE             0.0513118     0.181738      0.331724      0.181175      0.0719895       50     
simulate:rns:RandomNumberSaver                2.3455e-05    4.52816e-05   0.000348907   3.7987e-05    4.45726e-05      50     
[art]:TriggerResults:TriggerResultInserter     9.044e-06    1.5057e-05    4.8112e-05    1.34105e-05   7.25756e-06      50     
end_path:out1:RootOutput                       2.714e-06    5.7821e-06    2.4447e-05     4.146e-06    3.95195e-06      50     
end_path:out1:RootOutput(write)                0.0397092     0.122279      0.237053      0.111524      0.055983        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3511.9 MB
  Peak resident set size usage (VmHWM): 1642.48 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 dune 220M Feb  3 16:27 prod_monte-carlo-012686-000008_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012686-000008_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 07:23:57 UTC       justIN version: 01.06.00