justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297379.46@dunegpschedd02.fnal.gov

Jobsub ID297379.46@dunegpschedd02.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 19:50:07
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce513
Last heartbeat2026-02-02 20:37:40
From worker nodeHostnameb9p12p8471.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 19:51:25
Input filesusertests:prodgenie_monte-carlo-012654-000964_gen_g4.root
JobscriptExit code0
Real time45m (2701s)
CPU time34m (2042s = 75%)
Max RSS bytes2431320064 (2318 MiB)
Outputting started2026-02-02 20:36:27
Output files
Finished2026-02-02 20:37:40
Saved logsjustin-logs:297379.46-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

3319 n=14857 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100964 subRun: 0 event: 40 at 02-Feb-2026 21:25:27 CET
SimDepoSetSource got 29527 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 29527 depos spanning: [6.69696e-07, 1.31811]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=832352 n=100773 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=927587 n=84414 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100964 subRun: 0 event: 41 at 02-Feb-2026 21:26:23 CET
SimDepoSetSource got 245639 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 245639 depos spanning: [6.6793e-07, 8.53154]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=5.89408e+06 n=489762 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=6.7985e+06 n=436435 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100964 subRun: 0 event: 42 at 02-Feb-2026 21:28:55 CET
SimDepoSetSource got 46756 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 46756 depos spanning: [6.76638e-07, 0.511777]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=1.00493e+06 n=94337 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=1.1362e+06 n=82963 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100964 subRun: 0 event: 43 at 02-Feb-2026 21:29:49 CET
SimDepoSetSource got 41085 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 41085 depos spanning: [0.00111921, 5.26504]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=1.22261e+06 n=155152 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=1.38569e+06 n=123957 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100964 subRun: 0 event: 44 at 02-Feb-2026 21:31:15 CET
SimDepoSetSource got 23521 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23521 depos spanning: [6.67129e-07, 1.82049]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=719195 n=91876 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=804043 n=73721 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100964 subRun: 0 event: 45 at 02-Feb-2026 21:32:00 CET
SimDepoSetSource got 33650 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 33650 depos spanning: [6.6715e-07, 0.144506]us
Retagger: tagging trace set: wiener with 25600 traces, 25600 summary
Retagger: tagging trace set: gauss with 25600 traces, 0 summary
wclsFrameSaver: saving 25600 traces tagged "gauss"
FrameSaver: q=930911 n=134305 tag=gauss
wclsFrameSaver: saving 25600 traces tagged "wiener"
FrameSaver: q=1.02745e+06 n=106318 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100964 subRun: 0 event: 46 at 02-Feb-2026 21:33:50 CET
SimDepoSetSource got 25631 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25631 depos spanning: [6.67138e-07, 1.05319]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=799758 n=99969 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=901836 n=79003 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100964 subRun: 0 event: 47 at 02-Feb-2026 21:34:37 CET
SimDepoSetSource got 1660 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1660 depos spanning: [7.07822e-07, 7.86812]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=76695.5 n=11197 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=81903.6 n=9916 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100964 subRun: 0 event: 48 at 02-Feb-2026 21:35:08 CET
SimDepoSetSource got 1218 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1218 depos spanning: [7.14786e-07, 3.98035]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=41885.2 n=7666 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=45871.2 n=7285 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100964 subRun: 0 event: 49 at 02-Feb-2026 21:35:29 CET
SimDepoSetSource got 3239 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3239 depos spanning: [7.18084e-07, 0.124957]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=141990 n=16139 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=147979 n=14942 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100964 subRun: 0 event: 50 at 02-Feb-2026 21:35:41 CET
SimDepoSetSource got 53075 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 53075 depos spanning: [6.79966e-07, 1.49826]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=1.48506e+06 n=141556 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=1.72999e+06 n=124647 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:36:26 CET  Closed output file "prodgenie_monte-carlo-012654-000964_gen_g4_detsim.root"
02-Feb-2026 21:36:26 CET  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/0a/1f/prodgenie_monte-carlo-012654-000964_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      8.66456       42.9667       161.873       39.7459       30.1239        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000181072    0.0164339     0.196768      0.0011819     0.0451115       50     
simulate:tpcrawdecoder:WireCellToolkit          8.58157       42.5009       159.442       39.2947       29.7136        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0185685     0.221508       1.61401      0.175693      0.232623        50     
simulate:rns:RandomNumberSaver                 1.45e-05     3.3382e-05    0.000296613   2.6886e-05    3.83711e-05      50     
[art]:TriggerResults:TriggerResultInserter     8.33e-06     1.4309e-05    4.9661e-05     1.355e-05    5.91893e-06      50     
end_path:out1:RootOutput                       2.341e-06    5.26666e-06    2.832e-05     4.06e-06     4.50052e-06      50     
end_path:out1:RootOutput(write)                0.0267582     0.227445       1.91249      0.145653      0.333106        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4201.77 MB
  Peak resident set size usage (VmHWM): 2431.32 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r--. 1 duneprd np-comp 579M Feb  2 21:36 prodgenie_monte-carlo-012654-000964_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000964_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:47:54 UTC       justIN version: 01.06.00