justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303329.6@dunegpschedd01.fnal.gov

Jobsub ID303329.6@dunegpschedd01.fnal.gov
Workflow ID12669
Stage ID3
User nameluccalp@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 10:08:42
SiteUK_Imperial
EntryDUNE_T2_UK_London_IC_ceprod01
Last heartbeat2026-02-03 10:43:01
From worker nodeHostnamewm08.grid.hep.ph.ic.ac.uk
cpuinfoAMD EPYC 7742 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 10:09:22
Input filesusertests:prod_monte-carlo-012669-000002_gen_g4.root
JobscriptExit code0
Real time31m (1905s)
CPU time29m (1754s = 92%)
Max RSS bytes1812660224 (1728 MiB)
Outputting started2026-02-03 10:41:08
Output files
Finished2026-02-03 10:43:01
Saved logsjustin-logs:303329.6-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

auss"
FrameSaver: q=210795 n=36511 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=219989 n=35259 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210002 subRun: 0 event: 40 at 03-Feb-2026 10:33:52 GMT
SimDepoSetSource got 5584 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5584 depos spanning: [0.706984, 0.712713]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=151967 n=19949 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=157822 n=18950 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210002 subRun: 0 event: 41 at 03-Feb-2026 10:34:24 GMT
SimDepoSetSource got 14265 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14265 depos spanning: [0.111631, 0.129567]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=374778 n=53480 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=401670 n=42158 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210002 subRun: 0 event: 42 at 03-Feb-2026 10:35:02 GMT
SimDepoSetSource got 2666 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2666 depos spanning: [0.355642, 0.543608]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=96684.8 n=11163 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=112908 n=9728 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210002 subRun: 0 event: 43 at 03-Feb-2026 10:35:30 GMT
SimDepoSetSource got 12743 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 12743 depos spanning: [0.22398, 0.494926]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=381845 n=43715 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=402379 n=40163 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210002 subRun: 0 event: 44 at 03-Feb-2026 10:36:16 GMT
SimDepoSetSource got 19052 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19052 depos spanning: [0.863287, 1.00037]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=480196 n=64756 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=503007 n=63432 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210002 subRun: 0 event: 45 at 03-Feb-2026 10:36:39 GMT
SimDepoSetSource got 10490 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 10490 depos spanning: [0.8187, 0.829305]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=294164 n=35766 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=326881 n=28528 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210002 subRun: 0 event: 46 at 03-Feb-2026 10:37:13 GMT
SimDepoSetSource got 16050 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 16050 depos spanning: [0.538847, 1.09334]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=485157 n=72228 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=501014 n=66221 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210002 subRun: 0 event: 47 at 03-Feb-2026 10:37:50 GMT
SimDepoSetSource got 9967 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9967 depos spanning: [0.974647, 0.985758]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=308259 n=44603 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=315334 n=42152 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210002 subRun: 0 event: 48 at 03-Feb-2026 10:38:09 GMT
SimDepoSetSource got 8442 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8442 depos spanning: [0.100192, 0.111087]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=222833 n=27165 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=229859 n=24433 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210002 subRun: 0 event: 49 at 03-Feb-2026 10:38:42 GMT
SimDepoSetSource got 44322 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 44322 depos spanning: [0.423179, 0.464967]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=1.27779e+06 n=153665 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=1.38287e+06 n=129633 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210002 subRun: 0 event: 50 at 03-Feb-2026 10:40:30 GMT
SimDepoSetSource got 12151 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 12151 depos spanning: [0.100432, 0.114666]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=286578 n=47140 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=297859 n=43750 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 10:41:07 GMT  Closed output file "prod_monte-carlo-012669-000002_gen_g4_detsim.root"
03-Feb-2026 10:41:07 GMT  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/c5/c9/prod_monte-carlo-012669-000002_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      13.9119       36.1768       108.017       32.6952       21.0429        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000437229   0.00774869     0.0920987    0.00250441     0.0174459       50     
simulate:tpcrawdecoder:WireCellToolkit          13.7571       35.733        107.269       32.2925       20.9044        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0391925     0.223247      0.494787      0.209696      0.088604        50     
simulate:rns:RandomNumberSaver                2.4747e-05    5.08763e-05   0.000468809   3.2186e-05    6.81994e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.2354e-05    1.70032e-05   5.8451e-05    1.58695e-05   6.31116e-06      50     
end_path:out1:RootOutput                       3.737e-06    9.70514e-06   8.2857e-05     4.443e-06    1.66679e-05      50     
end_path:out1:RootOutput(write)                0.0726709     0.211881      0.604822      0.184882      0.112334        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3509.75 MB
  Peak resident set size usage (VmHWM): 1812.66 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r--. 1 job0033 job0033 220M Feb  3 10:41 prod_monte-carlo-012669-000002_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012669-000002_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:46:16 UTC       justIN version: 01.06.00