justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297391.21@dunegpschedd02.fnal.gov

Jobsub ID297391.21@dunegpschedd02.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 20:06:06
SiteUK_Lancaster
EntryUBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat2026-02-02 21:07:43
From worker nodeHostnamecomp02-03
cpuinfoIntel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 20:11:26
Input filesusertests:prodgenie_monte-carlo-012654-000973_gen_g4.root
JobscriptExit code0
Real time52m (3130s)
CPU time51m (3066s = 97%)
Max RSS bytes2643824640 (2521 MiB)
Outputting started2026-02-02 21:03:39
Output files
Finished2026-02-02 21:07:43
Saved logsjustin-logs:297391.21-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

tagged "wiener"
FrameSaver: q=1.58208e+06 n=103062 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100973 subRun: 0 event: 40 at 02-Feb-2026 20:55:05 GMT
SimDepoSetSource got 9012 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9012 depos spanning: [6.86215e-07, 1.40115]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=296346 n=38122 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=318263 n=32359 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100973 subRun: 0 event: 41 at 02-Feb-2026 20:55:38 GMT
SimDepoSetSource got 19474 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19474 depos spanning: [6.67809e-07, 2.4257]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=468800 n=66196 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=511518 n=55842 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100973 subRun: 0 event: 42 at 02-Feb-2026 20:56:19 GMT
SimDepoSetSource got 154 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 154 depos spanning: [9.93645e-05, 0.0201862]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=10414 n=2781 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=12476.6 n=2648 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100973 subRun: 0 event: 43 at 02-Feb-2026 20:56:47 GMT
SimDepoSetSource got 9335 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9335 depos spanning: [6.67885e-07, 0.246816]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=348030 n=45387 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=365595 n=39306 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100973 subRun: 0 event: 44 at 02-Feb-2026 20:57:22 GMT
SimDepoSetSource got 8459 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8459 depos spanning: [7.42808e-07, 2.85537]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=256343 n=36100 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=277864 n=31727 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100973 subRun: 0 event: 45 at 02-Feb-2026 20:57:57 GMT
SimDepoSetSource got 34802 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 34802 depos spanning: [7.14731e-07, 3.91756]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=1.09026e+06 n=120079 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=1.21832e+06 n=102034 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100973 subRun: 0 event: 46 at 02-Feb-2026 20:58:50 GMT
SimDepoSetSource got 23851 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23851 depos spanning: [6.68869e-07, 2.41221]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=725295 n=96499 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=803311 n=78325 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100973 subRun: 0 event: 47 at 02-Feb-2026 20:59:58 GMT
SimDepoSetSource got 59093 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 59093 depos spanning: [6.67154e-07, 8.95277]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=1.66902e+06 n=169159 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=1.87073e+06 n=150030 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100973 subRun: 0 event: 48 at 02-Feb-2026 21:01:00 GMT
SimDepoSetSource got 99133 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 99133 depos spanning: [6.67143e-07, 2.60306]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=2.33648e+06 n=234766 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=2.5983e+06 n=201978 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100973 subRun: 0 event: 49 at 02-Feb-2026 21:02:30 GMT
SimDepoSetSource got 9472 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9472 depos spanning: [6.77448e-07, 1.63494]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=275141 n=38811 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=290698 n=33779 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100973 subRun: 0 event: 50 at 02-Feb-2026 21:03:01 GMT
SimDepoSetSource got 10301 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 10301 depos spanning: [6.81787e-07, 2.60379]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=384316 n=30368 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=424737 n=26353 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:03:33 GMT  Closed output file "prodgenie_monte-carlo-012654-000973_gen_g4_detsim.root"
02-Feb-2026 21:03:33 GMT  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/59/4e/prodgenie_monte-carlo-012654-000973_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      13.8658       60.5955       208.295       49.3497       39.9833        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000427702    0.0135151     0.169246     0.00221733     0.0352668       50     
simulate:tpcrawdecoder:WireCellToolkit          13.8238       60.048        205.158       48.8457       39.5306        50     
simulate:opdigi:OpDetDigitizerDUNE            0.00171339     0.269573       1.69487      0.221663      0.244177        50     
simulate:rns:RandomNumberSaver                 1.935e-05    4.12193e-05   0.000252495   3.7029e-05    3.21956e-05      50     
[art]:TriggerResults:TriggerResultInserter     1.065e-05    1.49431e-05   5.0563e-05    1.38925e-05   5.59287e-06      50     
end_path:out1:RootOutput                       2.691e-06    5.30234e-06   2.4253e-05    5.0425e-06    3.7059e-06       50     
end_path:out1:RootOutput(write)                0.0369094     0.263934       1.89787      0.168878       0.31904        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4346.94 MB
  Peak resident set size usage (VmHWM): 2643.82 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 pltdune004 pltdune 615M Feb  2 21:03 prodgenie_monte-carlo-012654-000973_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000973_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:33:44 UTC       justIN version: 01.06.00