justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303335.15@dunegpschedd01.fnal.gov

Jobsub ID303335.15@dunegpschedd01.fnal.gov
Workflow ID12670
Stage ID3
User nameckaragia@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 10:22:43
SiteUK_Imperial
EntryDUNE_T2_UK_London_IC_ceprod01
Last heartbeat2026-02-03 11:03:21
From worker nodeHostnamewm08.grid.hep.ph.ic.ac.uk
cpuinfoAMD EPYC 7742 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 10:24:50
Input filesusertests:prod_monte-carlo-012670-000007_gen_g4.root
JobscriptExit code0
Real time37m (2221s)
CPU time34m (2041s = 91%)
Max RSS bytes1809285120 (1725 MiB)
Outputting started2026-02-03 11:01:51
Output files
Finished2026-02-03 11:03:21
Saved logsjustin-logs:303335.15-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

s"
FrameSaver: q=445245 n=74756 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=461514 n=74089 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210007 subRun: 0 event: 40 at 03-Feb-2026 10:51:58 GMT
SimDepoSetSource got 9589 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9589 depos spanning: [0.345004, 0.354581]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=294693 n=37597 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=311919 n=32306 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210007 subRun: 0 event: 41 at 03-Feb-2026 10:52:31 GMT
SimDepoSetSource got 18099 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 18099 depos spanning: [0.241189, 0.912893]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=512566 n=77847 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=528471 n=75055 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210007 subRun: 0 event: 42 at 03-Feb-2026 10:53:10 GMT
SimDepoSetSource got 25744 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25744 depos spanning: [0.137544, 0.862626]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=715393 n=94548 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=781283 n=73294 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210007 subRun: 0 event: 43 at 03-Feb-2026 10:54:39 GMT
SimDepoSetSource got 12161 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 12161 depos spanning: [0.96289, 0.978369]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=335960 n=55790 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=352511 n=48157 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210007 subRun: 0 event: 44 at 03-Feb-2026 10:55:32 GMT
SimDepoSetSource got 17670 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17670 depos spanning: [0.571437, 7.62352]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=517275 n=65157 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=533091 n=60146 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210007 subRun: 0 event: 45 at 03-Feb-2026 10:56:26 GMT
SimDepoSetSource got 32218 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 32218 depos spanning: [0.452197, 0.485047]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=878505 n=105008 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=898780 n=99511 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210007 subRun: 0 event: 46 at 03-Feb-2026 10:57:26 GMT
SimDepoSetSource got 8275 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8275 depos spanning: [0.644984, 0.653933]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=244176 n=37317 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=251402 n=36587 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210007 subRun: 0 event: 47 at 03-Feb-2026 10:57:45 GMT
SimDepoSetSource got 34042 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 34042 depos spanning: [0.993844, 1.4909]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=993584 n=122859 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=1.10172e+06 n=95491 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210007 subRun: 0 event: 48 at 03-Feb-2026 10:59:33 GMT
SimDepoSetSource got 23936 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23936 depos spanning: [0.819211, 0.843601]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=717413 n=68822 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=786940 n=55993 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210007 subRun: 0 event: 49 at 03-Feb-2026 11:00:24 GMT
SimDepoSetSource got 22453 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 22453 depos spanning: [0.409669, 0.435292]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=678564 n=54100 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=767368 n=45339 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210007 subRun: 0 event: 50 at 03-Feb-2026 11:01:16 GMT
SimDepoSetSource got 4737 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4737 depos spanning: [0.679982, 0.684968]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=122432 n=16729 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=128560 n=14762 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 11:01:50 GMT  Closed output file "prod_monte-carlo-012670-000007_gen_g4_detsim.root"
03-Feb-2026 11:01:50 GMT  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/da/b6/prod_monte-carlo-012670-000007_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      14.0279       42.2661       107.494       37.762        23.2565        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00046972    0.00855582     0.0698716    0.00276509     0.0168944       50     
simulate:tpcrawdecoder:WireCellToolkit          13.8933       41.7459       106.662       37.1775       23.0769        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0542071     0.266046      0.524192      0.262015      0.115619        50     
simulate:rns:RandomNumberSaver                2.7742e-05    4.76094e-05   0.000439613   3.35285e-05   5.83025e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.3185e-05    2.00906e-05    7.899e-05    1.78735e-05   1.13423e-05      50     
end_path:out1:RootOutput                       3.316e-06    5.06898e-06    3.681e-05    4.1325e-06    4.69161e-06      50     
end_path:out1:RootOutput(write)                0.0763617     0.244853      0.573128      0.236238      0.130889        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3510.65 MB
  Peak resident set size usage (VmHWM): 1809.29 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r--. 1 job0033 job0033 256M Feb  3 11:01 prod_monte-carlo-012670-000007_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012670-000007_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:48:00 UTC       justIN version: 01.06.00