justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297366.23@dunegpschedd02.fnal.gov

Jobsub ID297366.23@dunegpschedd02.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 19:28:05
SiteIT_CNAF
EntryCMSHTPC_T1_IT_CNAF_condor_ce02
Last heartbeat2026-02-02 20:18:02
From worker nodeHostnamewn-s04-05-07-03.cr.cnaf.infn.it
cpuinfoAMD EPYC 7313 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 19:29:57
Input filesusertests:prodgenie_monte-carlo-012654-000615_gen_g4.root
JobscriptExit code0
Real time38m (2293s)
CPU time34m (2086s = 90%)
Max RSS bytes2412761088 (2300 MiB)
Outputting started2026-02-02 20:08:12
Output files
Finished2026-02-02 20:18:02
Saved logsjustin-logs:297366.23-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

: q=1.2214e+06 n=129845 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100615 subRun: 0 event: 40 at 02-Feb-2026 20:58:23 CET
SimDepoSetSource got 76514 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 76514 depos spanning: [6.67209e-07, 2.46032]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=2.15219e+06 n=254790 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=2.4069e+06 n=210855 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100615 subRun: 0 event: 41 at 02-Feb-2026 20:59:39 CET
SimDepoSetSource got 198 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 198 depos spanning: [0.00145333, 0.00225713]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=23130.6 n=1839 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=27376.8 n=1745 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100615 subRun: 0 event: 42 at 02-Feb-2026 20:59:48 CET
SimDepoSetSource got 14701 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14701 depos spanning: [2.17198e-06, 2.66746]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=352673 n=45623 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=393942 n=40541 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100615 subRun: 0 event: 43 at 02-Feb-2026 21:00:39 CET
SimDepoSetSource got 12380 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 12380 depos spanning: [6.13125e-07, 4.41605]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=590158 n=54141 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=644576 n=49839 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100615 subRun: 0 event: 44 at 02-Feb-2026 21:01:17 CET
SimDepoSetSource got 11773 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11773 depos spanning: [0.00125237, 6.92464]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=248724 n=35568 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=272058 n=31130 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100615 subRun: 0 event: 45 at 02-Feb-2026 21:01:59 CET
SimDepoSetSource got 840 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 840 depos spanning: [6.67134e-07, 4.40957]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=10855.7 n=3699 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=13241.4 n=3357 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100615 subRun: 0 event: 46 at 02-Feb-2026 21:02:21 CET
SimDepoSetSource got 71744 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 71744 depos spanning: [6.67135e-07, 7.13422]us
Retagger: tagging trace set: wiener with 20480 traces, 20480 summary
Retagger: tagging trace set: gauss with 20480 traces, 0 summary
wclsFrameSaver: saving 20480 traces tagged "gauss"
FrameSaver: q=2.02022e+06 n=234284 tag=gauss
wclsFrameSaver: saving 20480 traces tagged "wiener"
FrameSaver: q=2.20916e+06 n=196010 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100615 subRun: 0 event: 47 at 02-Feb-2026 21:04:06 CET
SimDepoSetSource got 31704 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 31704 depos spanning: [0.000262399, 1.85215]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=901909 n=108146 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=995368 n=95318 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100615 subRun: 0 event: 48 at 02-Feb-2026 21:04:39 CET
SimDepoSetSource got 326904 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 326904 depos spanning: [4.20809e-07, 3.60816]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=7.28439e+06 n=566322 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=8.28627e+06 n=505278 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100615 subRun: 0 event: 49 at 02-Feb-2026 21:07:03 CET
SimDepoSetSource got 16667 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 16667 depos spanning: [1.54919e-05, 0.597327]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=524339 n=74697 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=573505 n=60231 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100615 subRun: 0 event: 50 at 02-Feb-2026 21:07:26 CET
SimDepoSetSource got 33108 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 33108 depos spanning: [6.72408e-07, 8.95384]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=1.01176e+06 n=124832 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=1.1207e+06 n=106052 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:08:11 CET  Closed output file "prodgenie_monte-carlo-012654-000615_gen_g4_detsim.root"
02-Feb-2026 21:08:11 CET  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/usertests/d1/f1/prodgenie_monte-carlo-012654-000615_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.135017       41.7569       157.791       34.8274       31.8856        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000357682   0.00702537     0.0599277    0.00198094     0.014057        50     
simulate:tpcrawdecoder:WireCellToolkit         0.0915519      41.3783       156.514       34.4749       31.5301        50     
simulate:opdigi:OpDetDigitizerDUNE            0.00189146     0.182806       1.30404      0.159723       0.18132        50     
simulate:rns:RandomNumberSaver                1.7913e-05    4.72964e-05   0.00048995    3.5702e-05    6.46615e-05      50     
[art]:TriggerResults:TriggerResultInserter     8.086e-06    1.5237e-05    5.5885e-05     1.35e-05     7.88757e-06      50     
end_path:out1:RootOutput                       2.725e-06    5.6256e-06    2.4045e-05    4.4735e-06    3.82985e-06      50     
end_path:out1:RootOutput(write)                0.0299903     0.188178       1.97645      0.113911      0.289089        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4136.46 MB
  Peak resident set size usage (VmHWM): 2412.76 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 neutrino002 neutrino 503M Feb  2 21:08 prodgenie_monte-carlo-012654-000615_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000615_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 10:29:40 UTC       justIN version: 01.06.00