justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297366.9@dunegpschedd02.fnal.gov

Jobsub ID297366.9@dunegpschedd02.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 19:28:05
SiteIT_CNAF
EntryCMSHTPC_T1_IT_CNAF_condor_ce02
Last heartbeat2026-02-02 20:15:09
From worker nodeHostnamewn-s04-05-07-03.cr.cnaf.infn.it
cpuinfoAMD EPYC 7313 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 19:29:18
Input filesusertests:prodgenie_monte-carlo-012654-000614_gen_g4.root
JobscriptExit code0
Real time35m (2154s)
CPU time32m (1951s = 90%)
Max RSS bytes2429919232 (2317 MiB)
Outputting started2026-02-02 20:05:13
Output files
Finished2026-02-02 20:15:09
Saved logsjustin-logs:297366.9-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

g 2560 traces tagged "wiener"
FrameSaver: q=33797.7 n=2793 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100614 subRun: 0 event: 40 at 02-Feb-2026 20:58:32 CET
SimDepoSetSource got 38984 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 38984 depos spanning: [6.69074e-07, 1.57012]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=1.08673e+06 n=129141 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.18798e+06 n=108324 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100614 subRun: 0 event: 41 at 02-Feb-2026 20:59:27 CET
SimDepoSetSource got 24039 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 24039 depos spanning: [6.68556e-07, 0.55107]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=639476 n=99366 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=694033 n=81241 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100614 subRun: 0 event: 42 at 02-Feb-2026 21:00:27 CET
SimDepoSetSource got 85162 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 85162 depos spanning: [6.67461e-07, 5.38566]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=2.64864e+06 n=222487 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=3.12057e+06 n=200662 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100614 subRun: 0 event: 43 at 02-Feb-2026 21:01:22 CET
SimDepoSetSource got 1712 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1712 depos spanning: [6.87425e-07, 0.23048]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=48182.7 n=9061 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=50945.3 n=8175 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100614 subRun: 0 event: 44 at 02-Feb-2026 21:01:32 CET
SimDepoSetSource got 4133 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4133 depos spanning: [8.54681e-07, 2.30158]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=163544 n=17313 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=170854 n=15808 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100614 subRun: 0 event: 45 at 02-Feb-2026 21:01:55 CET
SimDepoSetSource got 5566 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5566 depos spanning: [6.82666e-07, 1.82637]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=228307 n=22465 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=249540 n=19022 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100614 subRun: 0 event: 46 at 02-Feb-2026 21:02:08 CET
SimDepoSetSource got 691 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 691 depos spanning: [1.52893e-06, 4.90207]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=37762.9 n=5860 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=43332.3 n=5319 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100614 subRun: 0 event: 47 at 02-Feb-2026 21:02:28 CET
SimDepoSetSource got 1767 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1767 depos spanning: [0.000906407, 4.11957]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=37162.1 n=12907 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=44030.9 n=11596 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100614 subRun: 0 event: 48 at 02-Feb-2026 21:03:08 CET
SimDepoSetSource got 27518 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 27518 depos spanning: [6.67909e-07, 8.77397]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=828146 n=120517 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=908562 n=95934 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100614 subRun: 0 event: 49 at 02-Feb-2026 21:04:19 CET
SimDepoSetSource got 21381 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 21381 depos spanning: [0.000225592, 2.03947]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=611284 n=86218 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=673156 n=68328 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100614 subRun: 0 event: 50 at 02-Feb-2026 21:04:52 CET
SimDepoSetSource got 3547 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3547 depos spanning: [7.99889e-07, 1.75031]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=169050 n=16410 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=185379 n=14850 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:05:12 CET  Closed output file "prodgenie_monte-carlo-012654-000614_gen_g4_detsim.root"
02-Feb-2026 21:05:12 CET  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/usertests/a5/ec/prodgenie_monte-carlo-012654-000614_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      7.2814        38.8939       130.268       34.7062       23.3279        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000433034   0.00687831     0.0570367    0.00285042     0.0120571       50     
simulate:tpcrawdecoder:WireCellToolkit          7.19031       38.4902       128.602       34.2918       23.0509        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0274768     0.223175       1.00374      0.184067      0.182825        50     
simulate:rns:RandomNumberSaver                1.7893e-05    5.05541e-05   0.000374093   3.21655e-05   7.32108e-05      50     
[art]:TriggerResults:TriggerResultInserter     9.608e-06    1.93164e-05   3.7029e-05    1.6726e-05    7.52024e-06      50     
end_path:out1:RootOutput                       2.615e-06    5.04426e-06   1.8475e-05     4.278e-06    2.86467e-06      50     
end_path:out1:RootOutput(write)                0.0301921     0.173028      0.894821       0.13973      0.156061        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4147.83 MB
  Peak resident set size usage (VmHWM): 2429.92 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 neutrino002 neutrino 452M Feb  2 21:05 prodgenie_monte-carlo-012654-000614_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000614_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 08:47:24 UTC       justIN version: 01.06.00