justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297405.0@dunegpschedd02.fnal.gov

Jobsub ID297405.0@dunegpschedd02.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 20:34:07
SiteUK_Lancaster
EntryUBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat2026-02-02 21:20:58
From worker nodeHostnamecomp22-07
cpuinfoIntel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 20:35:24
Input filesusertests:prodgenie_monte-carlo-012654-000640_gen_g4.root
JobscriptExit code0
Real time42m (2572s)
CPU time33m (2037s = 79%)
Max RSS bytes2342596608 (2234 MiB)
Outputting started2026-02-02 21:18:32
Output files
Finished2026-02-02 21:20:58
Saved logsjustin-logs:297405.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

: q=777530 n=81768 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100640 subRun: 0 event: 40 at 02-Feb-2026 21:09:14 GMT
SimDepoSetSource got 32297 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 32297 depos spanning: [6.67758e-07, 0.536927]us
Retagger: tagging trace set: wiener with 25600 traces, 25600 summary
Retagger: tagging trace set: gauss with 25600 traces, 0 summary
wclsFrameSaver: saving 25600 traces tagged "gauss"
FrameSaver: q=987171 n=126839 tag=gauss
wclsFrameSaver: saving 25600 traces tagged "wiener"
FrameSaver: q=1.13316e+06 n=103471 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100640 subRun: 0 event: 41 at 02-Feb-2026 21:11:04 GMT
SimDepoSetSource got 2401 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2401 depos spanning: [0.00182199, 3.44519]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=67421.1 n=13885 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=72906.7 n=12064 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100640 subRun: 0 event: 42 at 02-Feb-2026 21:11:39 GMT
SimDepoSetSource got 65328 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 65328 depos spanning: [6.67344e-07, 3.58573]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=1.64504e+06 n=168417 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=1.87274e+06 n=145188 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100640 subRun: 0 event: 43 at 02-Feb-2026 21:12:36 GMT
SimDepoSetSource got 69112 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 69112 depos spanning: [6.67131e-07, 3.81473]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=1.66121e+06 n=157090 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=1.89522e+06 n=140837 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100640 subRun: 0 event: 44 at 02-Feb-2026 21:13:34 GMT
SimDepoSetSource got 11686 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11686 depos spanning: [6.69063e-07, 2.12676]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=357762 n=52586 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=377707 n=46983 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100640 subRun: 0 event: 45 at 02-Feb-2026 21:14:13 GMT
SimDepoSetSource got 32503 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 32503 depos spanning: [6.67857e-07, 1.85425]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=985185 n=136619 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.06222e+06 n=111029 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100640 subRun: 0 event: 46 at 02-Feb-2026 21:15:20 GMT
SimDepoSetSource got 2262 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2262 depos spanning: [8.04578e-07, 0.0358672]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=138455 n=11194 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=161279 n=9817 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100640 subRun: 0 event: 47 at 02-Feb-2026 21:15:42 GMT
SimDepoSetSource got 8961 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8961 depos spanning: [0.00427713, 0.0286484]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=268501 n=37512 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=293167 n=30924 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100640 subRun: 0 event: 48 at 02-Feb-2026 21:16:06 GMT
SimDepoSetSource got 26642 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 26642 depos spanning: [6.67157e-07, 0.0287462]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=832466 n=111004 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=916907 n=87075 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100640 subRun: 0 event: 49 at 02-Feb-2026 21:16:58 GMT
SimDepoSetSource got 36291 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 36291 depos spanning: [0.000273409, 1.81043]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=1.10464e+06 n=137291 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.2747e+06 n=110791 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100640 subRun: 0 event: 50 at 02-Feb-2026 21:18:00 GMT
SimDepoSetSource got 1551 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1551 depos spanning: [6.67755e-07, 0.112781]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=40194.6 n=7136 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=43621.4 n=6327 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:18:13 GMT  Closed output file "prodgenie_monte-carlo-012654-000640_gen_g4_detsim.root"
02-Feb-2026 21:18:13 GMT  Closed input file "root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/usertests/77/61/prodgenie_monte-carlo-012654-000640_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.783017       41.8382       107.251       38.939        24.0468        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000235419    0.120764       5.4723      0.00199165     0.764959        50     
simulate:tpcrawdecoder:WireCellToolkit         0.713224       41.3341       106.572       38.309        23.8522        50     
simulate:opdigi:OpDetDigitizerDUNE            4.4635e-05     0.250328      0.598367      0.243502       0.11915        50     
simulate:rns:RandomNumberSaver                1.4658e-05    3.28453e-05   0.000180433   3.1461e-05    2.25044e-05      50     
[art]:TriggerResults:TriggerResultInserter     8.126e-06    1.0492e-05     3.237e-05     9.945e-06    3.30916e-06      50     
end_path:out1:RootOutput                       2.093e-06    3.62372e-06   1.5392e-05     3.607e-06    1.83013e-06      50     
end_path:out1:RootOutput(write)                0.0283378     0.132732      0.436902      0.105045      0.0941049       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4051.63 MB
  Peak resident set size usage (VmHWM): 2342.6 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 pltdune004 pltdune 399M Feb  2 21:18 prodgenie_monte-carlo-012654-000640_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000640_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:28:23 UTC       justIN version: 01.06.00