justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303346.13@dunegpschedd01.fnal.gov

Jobsub ID303346.13@dunegpschedd01.fnal.gov
Workflow ID12673
Stage ID3
User namedrielsma@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 10:54:44
SiteUK_Imperial
EntryDUNE_T2_UK_London_IC_ceprod01
Last heartbeat2026-02-03 11:28:28
From worker nodeHostnamewm08.grid.hep.ph.ic.ac.uk
cpuinfoAMD EPYC 7742 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 10:55:25
Input filesusertests:prod_monte-carlo-012673-000012_gen_g4.root
JobscriptExit code0
Real time31m (1891s)
CPU time29m (1745s = 92%)
Max RSS bytes1677910016 (1600 MiB)
Outputting started2026-02-03 11:26:57
Output files
Finished2026-02-03 11:28:28
Saved logsjustin-logs:303346.13-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

s"
FrameSaver: q=773001 n=57790 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=860409 n=49466 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210012 subRun: 0 event: 40 at 03-Feb-2026 11:19:53 GMT
SimDepoSetSource got 27713 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 27713 depos spanning: [0.0826731, 0.111235]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=794413 n=108858 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=815879 n=105614 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210012 subRun: 0 event: 41 at 03-Feb-2026 11:20:36 GMT
SimDepoSetSource got 1538 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1538 depos spanning: [0.976416, 0.981029]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=53065.6 n=6463 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=59597.1 n=5525 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210012 subRun: 0 event: 42 at 03-Feb-2026 11:21:07 GMT
SimDepoSetSource got 15119 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 15119 depos spanning: [0.541909, 0.558907]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=424503 n=62920 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=440748 n=57188 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210012 subRun: 0 event: 43 at 03-Feb-2026 11:21:45 GMT
SimDepoSetSource got 35590 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 35590 depos spanning: [0.213509, 0.250852]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=1.07453e+06 n=88037 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=1.13596e+06 n=75730 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210012 subRun: 0 event: 44 at 03-Feb-2026 11:22:58 GMT
SimDepoSetSource got 5891 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5891 depos spanning: [0.407331, 0.414296]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=156891 n=26356 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=162726 n=23746 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210012 subRun: 0 event: 45 at 03-Feb-2026 11:23:32 GMT
SimDepoSetSource got 1238 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1238 depos spanning: [0.511837, 0.51346]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=24671 n=3791 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=28281.8 n=3210 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210012 subRun: 0 event: 46 at 03-Feb-2026 11:23:48 GMT
SimDepoSetSource got 11931 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11931 depos spanning: [0.655362, 0.666533]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=348712 n=43196 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=391328 n=35728 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210012 subRun: 0 event: 47 at 03-Feb-2026 11:24:23 GMT
SimDepoSetSource got 6691 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6691 depos spanning: [0.334174, 0.342112]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=196922 n=28122 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=203392 n=27902 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210012 subRun: 0 event: 48 at 03-Feb-2026 11:24:40 GMT
SimDepoSetSource got 6066 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6066 depos spanning: [0.428926, 0.434846]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=138579 n=23797 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=143816 n=23005 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210012 subRun: 0 event: 49 at 03-Feb-2026 11:25:13 GMT
SimDepoSetSource got 19092 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19092 depos spanning: [0.68975, 0.71003]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=543789 n=82043 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=568334 n=71208 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210012 subRun: 0 event: 50 at 03-Feb-2026 11:26:37 GMT
SimDepoSetSource got 10173 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 10173 depos spanning: [0.90975, 0.920576]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=224817 n=31746 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=235056 n=31186 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 11:26:56 GMT  Closed output file "prod_monte-carlo-012673-000012_gen_g4_detsim.root"
03-Feb-2026 11:26:56 GMT  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/ca/c2/prod_monte-carlo-012673-000012_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      15.2577       35.9496       88.8501       34.0908       18.2073        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000519255   0.00702884     0.0777772    0.00182345     0.0169261       50     
simulate:tpcrawdecoder:WireCellToolkit          15.0736       35.519        87.9579       33.7097       18.0551        50     
simulate:opdigi:OpDetDigitizerDUNE             0.058398      0.213072      0.507641      0.190625      0.0950605       50     
simulate:rns:RandomNumberSaver                2.7652e-05    4.34219e-05   0.000444152   3.2326e-05    5.83197e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.4998e-05    2.11365e-05   9.2365e-05    1.6927e-05    1.60345e-05      50     
end_path:out1:RootOutput                       3.417e-06    4.80114e-06   3.3724e-05    3.9775e-06    4.24773e-06      50     
end_path:out1:RootOutput(write)                0.0792867     0.209828      0.542913      0.164331      0.116578        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3363.7 MB
  Peak resident set size usage (VmHWM): 1677.91 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r--. 1 job0033 job0033 196M Feb  3 11:26 prod_monte-carlo-012673-000012_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012673-000012_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:53:07 UTC       justIN version: 01.06.00