justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303043.56@dunegpschedd01.fnal.gov

Jobsub ID303043.56@dunegpschedd01.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 19:30:05
SiteUK_Oxford
EntryDUNE_UK_SGrid_Oxford_arc01
Last heartbeat2026-02-02 20:22:58
From worker nodeHostnamet2wn001.physics.ox.ac.uk
cpuinfoAMD EPYC 7713P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 19:31:57
Input filesusertests:prodgenie_monte-carlo-012654-000572_gen_g4.root
JobscriptExit code0
Real time48m (2933s)
CPU time46m (2793s = 95%)
Max RSS bytes2460786688 (2346 MiB)
Outputting started2026-02-02 20:20:51
Output files
Finished2026-02-02 20:22:58
Saved logsjustin-logs:303043.56-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=725849 n=66916 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100572 subRun: 0 event: 40 at 02-Feb-2026 20:10:04 GMT
SimDepoSetSource got 2578 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2578 depos spanning: [0.000409368, 9.1815]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=54238.8 n=12109 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=59393.9 n=10958 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100572 subRun: 0 event: 41 at 02-Feb-2026 20:10:44 GMT
SimDepoSetSource got 9930 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9930 depos spanning: [2.37006e-07, 4.05036]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=313560 n=41020 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=338266 n=35427 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100572 subRun: 0 event: 42 at 02-Feb-2026 20:11:16 GMT
SimDepoSetSource got 33089 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 33089 depos spanning: [6.67483e-07, 2.29322]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=1.01447e+06 n=146829 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=1.09228e+06 n=122335 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100572 subRun: 0 event: 43 at 02-Feb-2026 20:13:01 GMT
SimDepoSetSource got 27902 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 27902 depos spanning: [6.67149e-07, 10.3085]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=734606 n=111002 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=799133 n=88832 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100572 subRun: 0 event: 44 at 02-Feb-2026 20:13:49 GMT
SimDepoSetSource got 24627 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 24627 depos spanning: [6.68237e-07, 0.0129938]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=747344 n=84294 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=820728 n=70768 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100572 subRun: 0 event: 45 at 02-Feb-2026 20:14:20 GMT
SimDepoSetSource got 281420 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 281420 depos spanning: [6.67143e-07, 6.74872]us
Retagger: tagging trace set: wiener with 20480 traces, 20480 summary
Retagger: tagging trace set: gauss with 20480 traces, 0 summary
wclsFrameSaver: saving 20480 traces tagged "gauss"
FrameSaver: q=7.15639e+06 n=571841 tag=gauss
wclsFrameSaver: saving 20480 traces tagged "wiener"
FrameSaver: q=8.48903e+06 n=501829 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100572 subRun: 0 event: 46 at 02-Feb-2026 20:17:03 GMT
SimDepoSetSource got 9874 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9874 depos spanning: [6.68975e-07, 0.0102958]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=320730 n=41076 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=359729 n=33365 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100572 subRun: 0 event: 47 at 02-Feb-2026 20:17:28 GMT
SimDepoSetSource got 13676 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 13676 depos spanning: [6.73967e-07, 1.74231]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=480886 n=56814 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=513551 n=50527 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100572 subRun: 0 event: 48 at 02-Feb-2026 20:18:01 GMT
SimDepoSetSource got 26018 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 26018 depos spanning: [6.68372e-07, 1.83637]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=848228 n=110236 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=928177 n=89731 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100572 subRun: 0 event: 49 at 02-Feb-2026 20:19:31 GMT
SimDepoSetSource got 26691 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 26691 depos spanning: [6.67635e-07, 3.18203]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=859650 n=92593 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=976874 n=75609 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100572 subRun: 0 event: 50 at 02-Feb-2026 20:20:14 GMT
SimDepoSetSource got 5305 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5305 depos spanning: [7.03846e-07, 2.05541]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=160382 n=24296 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=169110 n=22344 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 20:20:50 GMT  Closed output file "prodgenie_monte-carlo-012654-000572_gen_g4_detsim.root"
02-Feb-2026 20:20:50 GMT  Closed input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/usertests/54/17/prodgenie_monte-carlo-012654-000572_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      10.9856       55.9616       245.956       38.5923       44.3145        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000286162   0.00828334     0.0525291     0.0029894     0.0147834       50     
simulate:tpcrawdecoder:WireCellToolkit          10.8045       55.2134       240.319       38.2039       43.4578        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0473203     0.379066       1.96812      0.256329      0.398173        50     
simulate:rns:RandomNumberSaver                1.8716e-05    3.03243e-05   0.000199816    2.593e-05    2.52971e-05      50     
[art]:TriggerResults:TriggerResultInserter     8.947e-06    1.39549e-05   3.5257e-05    1.41625e-05   4.21919e-06      50     
end_path:out1:RootOutput                       2.475e-06    3.67494e-06   1.4989e-05     3.522e-06    1.71016e-06      50     
end_path:out1:RootOutput(write)                0.0467255     0.360473       3.81494      0.212549      0.586037        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4261.05 MB
  Peak resident set size usage (VmHWM): 2460.79 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune020 dune 801M Feb  2 20:20 prodgenie_monte-carlo-012654-000572_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000572_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:47:48 UTC       justIN version: 01.06.00