justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297366.21@dunegpschedd02.fnal.gov

Jobsub ID297366.21@dunegpschedd02.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 19:28:05
SiteIT_CNAF
EntryCMSHTPC_T1_IT_CNAF_condor_ce02
Last heartbeat2026-02-02 20:17:46
From worker nodeHostnamewn-s04-05-07-03.cr.cnaf.infn.it
cpuinfoAMD EPYC 7313 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 19:29:42
Input filesusertests:prodgenie_monte-carlo-012654-000508_gen_g4.root
JobscriptExit code0
Real time38m (2289s)
CPU time34m (2040s = 89%)
Max RSS bytes2151129088 (2051 MiB)
Outputting started2026-02-02 20:07:52
Output files
Finished2026-02-02 20:17:46
Saved logsjustin-logs:297366.21-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Saver: q=915183 n=69842 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100508 subRun: 0 event: 40 at 02-Feb-2026 21:01:25 CET
SimDepoSetSource got 1822 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1822 depos spanning: [1.15843e-06, 0.18207]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=110730 n=8541 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=123143 n=7156 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100508 subRun: 0 event: 41 at 02-Feb-2026 21:01:38 CET
SimDepoSetSource got 183 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 183 depos spanning: [1.59645e-06, 0.000764476]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=20897.5 n=1901 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=21710 n=1862 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100508 subRun: 0 event: 42 at 02-Feb-2026 21:01:49 CET
SimDepoSetSource got 26381 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 26381 depos spanning: [6.68337e-07, 7.96744]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=792219 n=112262 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=884529 n=89741 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100508 subRun: 0 event: 43 at 02-Feb-2026 21:02:38 CET
SimDepoSetSource got 36630 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 36630 depos spanning: [6.69476e-07, 9.99962]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=1.07663e+06 n=115946 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=1.22649e+06 n=98834 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100508 subRun: 0 event: 44 at 02-Feb-2026 21:03:22 CET
SimDepoSetSource got 37604 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 37604 depos spanning: [6.69587e-07, 4.29938]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=1.09003e+06 n=114264 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=1.19209e+06 n=96285 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100508 subRun: 0 event: 45 at 02-Feb-2026 21:03:54 CET
SimDepoSetSource got 28920 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 28920 depos spanning: [6.67536e-07, 0.0343261]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=870145 n=120897 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=944157 n=95474 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100508 subRun: 0 event: 46 at 02-Feb-2026 21:04:47 CET
SimDepoSetSource got 18438 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 18438 depos spanning: [6.67611e-07, 2.57866]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=671713 n=74305 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=749272 n=62598 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100508 subRun: 0 event: 47 at 02-Feb-2026 21:05:21 CET
SimDepoSetSource got 18103 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 18103 depos spanning: [6.67938e-07, 1.56124]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=351093 n=39372 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=387922 n=35278 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100508 subRun: 0 event: 48 at 02-Feb-2026 21:05:45 CET
SimDepoSetSource got 56055 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 56055 depos spanning: [6.68789e-07, 1.73695]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=1.60245e+06 n=122410 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=1.88525e+06 n=112105 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100508 subRun: 0 event: 49 at 02-Feb-2026 21:06:02 CET
SimDepoSetSource got 8338 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8338 depos spanning: [6.79826e-07, 1.56234]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=257994 n=38283 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=272328 n=35416 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100508 subRun: 0 event: 50 at 02-Feb-2026 21:06:22 CET
SimDepoSetSource got 92796 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 92796 depos spanning: [6.67155e-07, 11.6644]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=2.49688e+06 n=299986 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=2.70853e+06 n=257733 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:07:51 CET  Closed output file "prodgenie_monte-carlo-012654-000508_gen_g4_detsim.root"
02-Feb-2026 21:07:51 CET  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/usertests/a7/85/prodgenie_monte-carlo-012654-000508_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      11.6983       40.7335       91.7107       33.8246       20.4156        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000613914   0.00632106     0.0424384    0.00213183     0.0114464       50     
simulate:tpcrawdecoder:WireCellToolkit          11.4933       40.3304       91.1078       33.6149       20.2609        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0735983     0.209831      0.794392      0.182373      0.126406        50     
simulate:rns:RandomNumberSaver                1.9237e-05    4.93389e-05   0.000283021   3.5702e-05    5.16565e-05      50     
[art]:TriggerResults:TriggerResultInserter     7.404e-06    1.33865e-05   3.3382e-05    1.2213e-05    5.09769e-06      50     
end_path:out1:RootOutput                       2.935e-06    6.15456e-06   2.0389e-05     5.315e-06    2.99175e-06      50     
end_path:out1:RootOutput(write)                0.0478466      0.18641      0.636954      0.149507      0.132376        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3874.65 MB
  Peak resident set size usage (VmHWM): 2151.13 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 neutrino002 neutrino 548M Feb  2 21:07 prodgenie_monte-carlo-012654-000508_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000508_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 11:47:35 UTC       justIN version: 01.06.00