justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297379.21@dunegpschedd02.fnal.gov

Jobsub ID297379.21@dunegpschedd02.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 19:50:07
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce507
Last heartbeat2026-02-02 20:18:38
From worker nodeHostnameb9p34p1036.cern.ch
cpuinfoAMD EPYC 9655 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 19:51:23
Input filesusertests:prodgenie_monte-carlo-012654-000556_gen_g4.root
JobscriptExit code0
Real time26m (1587s)
CPU time25m (1531s = 96%)
Max RSS bytes2085416960 (1988 MiB)
Outputting started2026-02-02 20:17:51
Output files
Finished2026-02-02 20:18:38
Saved logsjustin-logs:297379.21-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

s, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=633931 n=84617 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=683577 n=70340 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100556 subRun: 0 event: 40 at 02-Feb-2026 21:12:27 CET
SimDepoSetSource got 0 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1 depos spanning: [0, 0]us
wclsFrameSaver: no traces tagged "gauss"
FrameSaver: q=0 n=0 tag=gauss
wclsFrameSaver: no traces tagged "wiener"
FrameSaver: q=0 n=0 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100556 subRun: 0 event: 41 at 02-Feb-2026 21:12:28 CET
SimDepoSetSource got 19641 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19641 depos spanning: [7.62598e-07, 2.72691]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=514121 n=51548 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=564902 n=45310 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100556 subRun: 0 event: 42 at 02-Feb-2026 21:12:40 CET
SimDepoSetSource got 30731 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 30731 depos spanning: [6.67995e-07, 1.90734]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=943705 n=126989 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=1.0129e+06 n=105782 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100556 subRun: 0 event: 43 at 02-Feb-2026 21:13:23 CET
SimDepoSetSource got 144970 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 144970 depos spanning: [6.67128e-07, 5.29599]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=3.16488e+06 n=202499 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=3.65108e+06 n=184567 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100556 subRun: 0 event: 44 at 02-Feb-2026 21:14:18 CET
SimDepoSetSource got 12061 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 12061 depos spanning: [6.67206e-07, 8.26384]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=334869 n=42200 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=376625 n=35466 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100556 subRun: 0 event: 45 at 02-Feb-2026 21:14:53 CET
SimDepoSetSource got 10442 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 10442 depos spanning: [6.67541e-07, 0.239429]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=365209 n=44295 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=393113 n=37480 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100556 subRun: 0 event: 46 at 02-Feb-2026 21:15:16 CET
SimDepoSetSource got 359175 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 359175 depos spanning: [6.67128e-07, 0.306844]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=7.41848e+06 n=329571 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=8.65576e+06 n=305434 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100556 subRun: 0 event: 47 at 02-Feb-2026 21:16:12 CET
SimDepoSetSource got 15172 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 15172 depos spanning: [6.71549e-07, 1.49097]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=491910 n=65700 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=518109 n=56151 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100556 subRun: 0 event: 48 at 02-Feb-2026 21:16:31 CET
SimDepoSetSource got 29403 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 29403 depos spanning: [6.67305e-07, 2.71165]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=839268 n=121328 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=897051 n=102993 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100556 subRun: 0 event: 49 at 02-Feb-2026 21:17:09 CET
SimDepoSetSource got 27046 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 27046 depos spanning: [6.67627e-07, 1.81258]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=784712 n=79440 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=925703 n=69751 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100556 subRun: 0 event: 50 at 02-Feb-2026 21:17:27 CET
SimDepoSetSource got 1337 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1337 depos spanning: [2.68077e-07, 3.14862]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=39104.3 n=9092 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=47450.4 n=8386 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:17:50 CET  Closed output file "prodgenie_monte-carlo-012654-000556_gen_g4_detsim.root"
02-Feb-2026 21:17:50 CET  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/usertests/d9/57/prodgenie_monte-carlo-012654-000556_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.115592       30.5785       76.9049       26.7269       17.2018        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000290195   0.00542655     0.0320667    0.00268619    0.00785337       50     
simulate:tpcrawdecoder:WireCellToolkit         0.093931       30.2065       76.1045       26.5591       16.9796        50     
simulate:opdigi:OpDetDigitizerDUNE            9.0947e-05     0.175495       1.46112      0.122596      0.208802        50     
simulate:rns:RandomNumberSaver                2.0952e-05    4.13778e-05   0.000237917   3.6455e-05    2.92619e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.1267e-05     1.518e-05    4.0591e-05    1.4351e-05    4.31646e-06      50     
end_path:out1:RootOutput                       4.336e-06    7.62038e-06    2.711e-05     7.311e-06    3.70023e-06      50     
end_path:out1:RootOutput(write)                0.0183262     0.190507      0.925901      0.134035      0.185907        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3975.67 MB
  Peak resident set size usage (VmHWM): 2085.42 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r--. 1 duneprd np-comp 605M Feb  2 21:17 prodgenie_monte-carlo-012654-000556_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000556_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 06:07:45 UTC       justIN version: 01.06.00