justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297366.10@dunegpschedd02.fnal.gov

Jobsub ID297366.10@dunegpschedd02.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 19:28:05
SiteIT_CNAF
EntryCMSHTPC_T1_IT_CNAF_condor_ce02
Last heartbeat2026-02-02 20:11:18
From worker nodeHostnamewn-s04-05-07-03.cr.cnaf.infn.it
cpuinfoAMD EPYC 7313 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 19:28:57
Input filesusertests:prodgenie_monte-carlo-012654-000261_gen_g4.root
JobscriptExit code0
Real time32m (1955s)
CPU time28m (1721s = 88%)
Max RSS bytes2314862592 (2207 MiB)
Outputting started2026-02-02 20:01:33
Output files
Finished2026-02-02 20:11:18
Saved logsjustin-logs:297366.10-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

FrameSaver: q=117238 n=9295 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100261 subRun: 0 event: 40 at 02-Feb-2026 20:54:31 CET
SimDepoSetSource got 65415 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 65415 depos spanning: [6.67395e-07, 9.91181]us
Retagger: tagging trace set: wiener with 23040 traces, 23040 summary
Retagger: tagging trace set: gauss with 23040 traces, 0 summary
wclsFrameSaver: saving 23040 traces tagged "gauss"
FrameSaver: q=2.11273e+06 n=217762 tag=gauss
wclsFrameSaver: saving 23040 traces tagged "wiener"
FrameSaver: q=2.44462e+06 n=182787 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100261 subRun: 0 event: 41 at 02-Feb-2026 20:55:52 CET
SimDepoSetSource got 41579 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 41579 depos spanning: [6.67337e-07, 0.0446432]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=1.23135e+06 n=164131 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=1.36903e+06 n=128197 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100261 subRun: 0 event: 42 at 02-Feb-2026 20:56:46 CET
SimDepoSetSource got 1445 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1445 depos spanning: [1.05095e-06, 0.333506]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=79130.2 n=7671 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=89658.3 n=6892 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100261 subRun: 0 event: 43 at 02-Feb-2026 20:57:04 CET
SimDepoSetSource got 110643 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 110643 depos spanning: [6.6713e-07, 3.40709]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=2.6084e+06 n=160672 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=3.25412e+06 n=153813 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100261 subRun: 0 event: 44 at 02-Feb-2026 20:57:36 CET
SimDepoSetSource got 25024 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25024 depos spanning: [7.19192e-07, 3.62498]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=902820 n=103386 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=966622 n=90330 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100261 subRun: 0 event: 45 at 02-Feb-2026 20:58:23 CET
SimDepoSetSource got 5090 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5090 depos spanning: [7.15347e-07, 1.75297]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=185792 n=18999 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=216330 n=16138 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100261 subRun: 0 event: 46 at 02-Feb-2026 20:58:43 CET
SimDepoSetSource got 3032 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3032 depos spanning: [1.99764e-06, 2.73477]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=92889.9 n=13987 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=102752 n=12339 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100261 subRun: 0 event: 47 at 02-Feb-2026 20:59:07 CET
SimDepoSetSource got 25697 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25697 depos spanning: [0.00101265, 1.05956]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=604436 n=83161 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=667221 n=73878 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100261 subRun: 0 event: 48 at 02-Feb-2026 20:59:44 CET
SimDepoSetSource got 24860 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 24860 depos spanning: [9.3564e-08, 6.14241]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=829503 n=88103 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=936364 n=76392 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100261 subRun: 0 event: 49 at 02-Feb-2026 21:00:13 CET
SimDepoSetSource got 8006 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8006 depos spanning: [6.69396e-07, 0.0521088]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=242392 n=34472 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=255454 n=30184 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100261 subRun: 0 event: 50 at 02-Feb-2026 21:00:36 CET
SimDepoSetSource got 30312 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 30312 depos spanning: [6.67996e-07, 8.96654]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=914948 n=123514 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=981701 n=98594 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:01:32 CET  Closed output file "prodgenie_monte-carlo-012654-000261_gen_g4_detsim.root"
02-Feb-2026 21:01:32 CET  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/78/5e/prodgenie_monte-carlo-012654-000261_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      8.63973       34.291        93.956        29.2101       17.9261        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000376548    0.0156433     0.164163     0.00157258     0.0392134       50     
simulate:tpcrawdecoder:WireCellToolkit          8.51865       33.8732       92.7255       28.8162       17.7066        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0677871     0.217762       1.04025      0.161508      0.181806        50     
simulate:rns:RandomNumberSaver                1.9116e-05    3.98393e-05   0.000384052   2.96405e-05   5.04724e-05      50     
[art]:TriggerResults:TriggerResultInserter     7.794e-06    1.43812e-05   4.8601e-05    1.22225e-05   8.5046e-06       50     
end_path:out1:RootOutput                       2.865e-06    5.55328e-06   2.8484e-05     3.952e-06    4.37401e-06      50     
end_path:out1:RootOutput(write)                0.0398715      0.18391      0.778093       0.13955      0.153555        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4028.02 MB
  Peak resident set size usage (VmHWM): 2314.86 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 neutrino002 neutrino 544M Feb  2 21:01 prodgenie_monte-carlo-012654-000261_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000261_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:45:56 UTC       justIN version: 01.06.00