justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297635.2@dunegpschedd02.fnal.gov

Jobsub ID297635.2@dunegpschedd02.fnal.gov
Workflow ID12672
Stage ID3
User namelmcmahon@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 10:58:45
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_klomp
Last heartbeat2026-02-03 11:31:25
From worker nodeHostnamewn-choc-003.farm.nikhef.nl
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 10:59:28
Input filesusertests:prod_monte-carlo-012672-000010_gen_g4.root
JobscriptExit code0
Real time30m (1848s)
CPU time29m (1795s = 97%)
Max RSS bytes1559224320 (1486 MiB)
Outputting started2026-02-03 11:30:18
Output files
Finished2026-02-03 11:31:25
Saved logsjustin-logs:297635.2-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

sFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=847038 n=69738 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=911527 n=57530 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210010 subRun: 0 event: 40 at 03-Feb-2026 12:25:04 CET
SimDepoSetSource got 21990 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 21990 depos spanning: [0.294557, 0.316326]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=640316 n=76768 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=657998 n=73391 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210010 subRun: 0 event: 41 at 03-Feb-2026 12:25:26 CET
SimDepoSetSource got 7424 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7424 depos spanning: [0.0376372, 0.0460084]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=213616 n=35567 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=220146 n=35109 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210010 subRun: 0 event: 42 at 03-Feb-2026 12:25:44 CET
SimDepoSetSource got 14225 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14225 depos spanning: [0.698115, 0.711697]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=397074 n=60927 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=408810 n=58235 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210010 subRun: 0 event: 43 at 03-Feb-2026 12:26:05 CET
SimDepoSetSource got 22398 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 22398 depos spanning: [0.135647, 0.162426]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=579400 n=72109 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=612617 n=61812 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210010 subRun: 0 event: 44 at 03-Feb-2026 12:26:55 CET
SimDepoSetSource got 15837 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 15837 depos spanning: [0.798856, 0.816076]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=473068 n=55123 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=481785 n=52549 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210010 subRun: 0 event: 45 at 03-Feb-2026 12:27:14 CET
SimDepoSetSource got 10025 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 10025 depos spanning: [0.475365, 0.486705]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=198526 n=33705 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=206020 n=33252 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210010 subRun: 0 event: 46 at 03-Feb-2026 12:27:32 CET
SimDepoSetSource got 19205 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19205 depos spanning: [0.208859, 0.230484]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=586510 n=49184 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=671734 n=39982 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210010 subRun: 0 event: 47 at 03-Feb-2026 12:28:06 CET
SimDepoSetSource got 2267 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2267 depos spanning: [0.592219, 1.33304]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=77028.3 n=12588 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=81043.9 n=11380 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210010 subRun: 0 event: 48 at 03-Feb-2026 12:28:36 CET
SimDepoSetSource got 17923 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17923 depos spanning: [0.852192, 0.871504]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=532484 n=69172 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=548405 n=66474 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210010 subRun: 0 event: 49 at 03-Feb-2026 12:29:27 CET
SimDepoSetSource got 5855 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5855 depos spanning: [0.48402, 0.49096]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=126767 n=20862 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=130729 n=19856 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210010 subRun: 0 event: 50 at 03-Feb-2026 12:29:45 CET
SimDepoSetSource got 6202 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6202 depos spanning: [0.658511, 0.9035]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=194024 n=31289 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=200175 n=29145 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 12:30:17 CET  Closed output file "prod_monte-carlo-012672-000010_gen_g4_detsim.root"
03-Feb-2026 12:30:17 CET  Closed input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/usertests/0e/a7/prod_monte-carlo-012672-000010_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      14.8314       35.1946       87.1747       32.7076       18.2132        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00048424    0.00582663     0.0442733    0.00174488     0.0123251       50     
simulate:tpcrawdecoder:WireCellToolkit          14.6108       34.8785       86.6505       32.3956       18.1347        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0590995     0.186081      0.356546       0.18186      0.0619632       50     
simulate:rns:RandomNumberSaver                 2.879e-05    4.61685e-05   0.000241578    4.205e-05    2.87852e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.2876e-05    1.69899e-05   4.7392e-05    1.63095e-05   4.67174e-06      50     
end_path:out1:RootOutput                       3.715e-06    6.21256e-06   2.0594e-05     5.994e-06    2.32647e-06      50     
end_path:out1:RootOutput(write)                0.0510318     0.123578      0.246512      0.122625      0.0475192       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3255.33 MB
  Peak resident set size usage (VmHWM): 1559.22 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune090 dune 204M Feb  3 12:30 prod_monte-carlo-012672-000010_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012672-000010_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:44:07 UTC       justIN version: 01.06.00