justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297391.41@dunegpschedd02.fnal.gov

Jobsub ID297391.41@dunegpschedd02.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 20:06:06
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel
Last heartbeat2026-02-02 21:10:47
From worker nodeHostnamewn-choc-008.farm.nikhef.nl
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 20:13:19
Input filesusertests:prodgenie_monte-carlo-012654-000966_gen_g4.root
JobscriptExit code0
Real time56m (3395s)
CPU time54m (3262s = 96%)
Max RSS bytes2916388864 (2781 MiB)
Outputting started2026-02-02 21:09:55
Output files
Finished2026-02-02 21:10:47
Saved logsjustin-logs:297391.41-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

FrameSaver: q=688673 n=91574 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100966 subRun: 0 event: 40 at 02-Feb-2026 21:48:51 CET
SimDepoSetSource got 20111 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20111 depos spanning: [6.67291e-07, 4.86159]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=573536 n=70797 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=626363 n=57608 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100966 subRun: 0 event: 41 at 02-Feb-2026 21:49:44 CET
SimDepoSetSource got 3568 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3568 depos spanning: [1.06742e-06, 0.116603]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=143305 n=13906 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=163746 n=11948 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100966 subRun: 0 event: 42 at 02-Feb-2026 21:49:59 CET
SimDepoSetSource got 32407 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 32407 depos spanning: [0.00131095, 0.160094]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=896131 n=132575 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=977792 n=103133 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100966 subRun: 0 event: 43 at 02-Feb-2026 21:51:37 CET
SimDepoSetSource got 42358 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 42358 depos spanning: [6.68465e-07, 9.91193]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=1.16886e+06 n=137577 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=1.258e+06 n=120806 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100966 subRun: 0 event: 44 at 02-Feb-2026 21:52:41 CET
SimDepoSetSource got 555346 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 555346 depos spanning: [3.56198e-07, 12.9913]us
Retagger: tagging trace set: wiener with 23040 traces, 23040 summary
Retagger: tagging trace set: gauss with 23040 traces, 0 summary
wclsFrameSaver: saving 23040 traces tagged "gauss"
FrameSaver: q=1.26132e+07 n=1038763 tag=gauss
wclsFrameSaver: saving 23040 traces tagged "wiener"
FrameSaver: q=1.42126e+07 n=931478 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100966 subRun: 0 event: 45 at 02-Feb-2026 21:59:16 CET
SimDepoSetSource got 17335 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17335 depos spanning: [6.85935e-07, 2.10574]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=480502 n=62398 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=519553 n=53326 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100966 subRun: 0 event: 46 at 02-Feb-2026 22:00:30 CET
SimDepoSetSource got 2270 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2270 depos spanning: [0.000599582, 6.22279]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=59400.4 n=9007 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=63340.6 n=7927 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100966 subRun: 0 event: 47 at 02-Feb-2026 22:01:02 CET
SimDepoSetSource got 58940 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 58940 depos spanning: [6.6822e-07, 3.13703]us
Retagger: tagging trace set: wiener with 25600 traces, 25600 summary
Retagger: tagging trace set: gauss with 25600 traces, 0 summary
wclsFrameSaver: saving 25600 traces tagged "gauss"
FrameSaver: q=1.74328e+06 n=210604 tag=gauss
wclsFrameSaver: saving 25600 traces tagged "wiener"
FrameSaver: q=1.92702e+06 n=181192 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100966 subRun: 0 event: 48 at 02-Feb-2026 22:03:57 CET
SimDepoSetSource got 203970 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 203970 depos spanning: [6.67139e-07, 6.74941]us
Retagger: tagging trace set: wiener with 28160 traces, 28160 summary
Retagger: tagging trace set: gauss with 28160 traces, 0 summary
wclsFrameSaver: saving 28160 traces tagged "gauss"
FrameSaver: q=5.89922e+06 n=551408 tag=gauss
wclsFrameSaver: saving 28160 traces tagged "wiener"
FrameSaver: q=6.8435e+06 n=489291 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100966 subRun: 0 event: 49 at 02-Feb-2026 22:07:33 CET
SimDepoSetSource got 22301 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 22301 depos spanning: [6.71085e-07, 1.66773]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=684004 n=89868 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=727428 n=77631 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100966 subRun: 0 event: 50 at 02-Feb-2026 22:08:30 CET
SimDepoSetSource got 53359 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 53359 depos spanning: [6.67592e-07, 2.82578]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=1.5779e+06 n=147311 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=1.79859e+06 n=132056 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 22:09:54 CET  Closed output file "prodgenie_monte-carlo-012654-000966_gen_g4_detsim.root"
02-Feb-2026 22:09:54 CET  Closed input file "root://xrootd-archive.cr.cnaf.infn.it:1096//dune/usertests/fb/ee/prodgenie_monte-carlo-012654-000966_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      14.1484       64.8313       391.733       48.7882       63.9776        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000391412    0.0188046     0.165057     0.00206587     0.0444948       50     
simulate:tpcrawdecoder:WireCellToolkit           14.08        64.2286       385.259       48.4299       63.1302        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0238633     0.296826       1.95649      0.211854      0.343181        50     
simulate:rns:RandomNumberSaver                2.3195e-05    6.20903e-05   0.000906978   4.0835e-05    0.000123796      50     
[art]:TriggerResults:TriggerResultInserter     1.21e-05     1.84069e-05   4.3394e-05    1.8041e-05    4.35825e-06      50     
end_path:out1:RootOutput                       2.844e-06    5.12214e-06   1.7259e-05    4.9145e-06    2.02791e-06      50     
end_path:out1:RootOutput(write)                0.0435919     0.286463       4.66596      0.150236      0.649565        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4620.87 MB
  Peak resident set size usage (VmHWM): 2916.39 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune090 dune 654M Feb  2 22:09 prodgenie_monte-carlo-012654-000966_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000966_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:52:49 UTC       justIN version: 01.06.00