justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 281659.55@dunegpschedd01.fnal.gov

Jobsub ID281659.55@dunegpschedd01.fnal.gov
Workflow ID12080
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-01-19 01:20:24
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel_multicore
Last heartbeat2026-01-19 02:47:52
From worker nodeHostnamewn-lot-030.farm.nikhef.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-19 01:21:36
Input filesusertests:mpvmpr_monte-carlo-012080-005386_gen_g4.root
JobscriptExit code0
Real time1h (5110s)
CPU time1h (5028s = 98%)
Max RSS bytes2733776896 (2607 MiB)
Outputting started2026-01-19 02:46:47
Output files
Finished2026-01-19 02:47:52
Saved logsjustin-logs:281659.55-dunegpschedd01.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

s tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 215386 subRun: 0 event: 40 at 19-Jan-2026 03:28:12 CET
SimDepoSetSource got 274709 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 274709 depos spanning: [5.24901, 12.3201]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=5.45207e+06 n=428975 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=5.94472e+06 n=390361 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 215386 subRun: 0 event: 41 at 19-Jan-2026 03:31:11 CET
SimDepoSetSource got 129575 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 129575 depos spanning: [2.37399, 8.74456]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=3.48335e+06 n=282584 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=3.96728e+06 n=257356 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 215386 subRun: 0 event: 42 at 19-Jan-2026 03:32:22 CET
SimDepoSetSource got 157977 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 157977 depos spanning: [1.66299, 9.08654]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=2.76029e+06 n=233795 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=2.95709e+06 n=215777 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 215386 subRun: 0 event: 43 at 19-Jan-2026 03:34:08 CET
SimDepoSetSource got 151353 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 151353 depos spanning: [1.79793, 9.51375]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=3.13667e+06 n=168324 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=3.56653e+06 n=153609 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 215386 subRun: 0 event: 44 at 19-Jan-2026 03:35:39 CET
SimDepoSetSource got 182224 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 182224 depos spanning: [0.312383, 0.47519]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=3.20251e+06 n=230123 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=3.48756e+06 n=212000 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 215386 subRun: 0 event: 45 at 19-Jan-2026 03:37:25 CET
SimDepoSetSource got 127182 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 127182 depos spanning: [0.12953, 9.16866]us
Retagger: tagging trace set: wiener with 20480 traces, 20480 summary
Retagger: tagging trace set: gauss with 20480 traces, 0 summary
wclsFrameSaver: saving 20480 traces tagged "gauss"
FrameSaver: q=3.57345e+06 n=391717 tag=gauss
wclsFrameSaver: saving 20480 traces tagged "wiener"
FrameSaver: q=3.88916e+06 n=348827 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 215386 subRun: 0 event: 46 at 19-Jan-2026 03:39:46 CET
SimDepoSetSource got 15640 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 15640 depos spanning: [0.719791, 6.39462]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=548358 n=64102 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=572189 n=61453 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 215386 subRun: 0 event: 47 at 19-Jan-2026 03:40:06 CET
SimDepoSetSource got 116175 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 116175 depos spanning: [5.54048, 9.69529]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=2.65855e+06 n=224123 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=2.85987e+06 n=204902 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 215386 subRun: 0 event: 48 at 19-Jan-2026 03:41:29 CET
SimDepoSetSource got 195162 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 195162 depos spanning: [1.90872, 5.10178]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=4.11858e+06 n=255315 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=4.68981e+06 n=230655 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 215386 subRun: 0 event: 49 at 19-Jan-2026 03:42:46 CET
SimDepoSetSource got 394156 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 394156 depos spanning: [0.416564, 6.85677]us
Retagger: tagging trace set: wiener with 20480 traces, 20480 summary
Retagger: tagging trace set: gauss with 20480 traces, 0 summary
wclsFrameSaver: saving 20480 traces tagged "gauss"
FrameSaver: q=7.55617e+06 n=476465 tag=gauss
wclsFrameSaver: saving 20480 traces tagged "wiener"
FrameSaver: q=8.40044e+06 n=428993 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 215386 subRun: 0 event: 50 at 19-Jan-2026 03:45:53 CET
SimDepoSetSource got 75345 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 75345 depos spanning: [0.484567, 7.34653]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=1.8164e+06 n=121937 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=1.96687e+06 n=111410 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
19-Jan-2026 03:46:46 CET  Closed output file "mpvmpr_monte-carlo-012080-005386_gen_g4_detsim.root"
19-Jan-2026 03:46:46 CET  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/usertests/d3/60/mpvmpr_monte-carlo-012080-005386_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      19.3493       100.427       186.377       92.5113       40.0676        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00115571    0.00963995     0.104119     0.00668623     0.0147791       50     
simulate:tpcrawdecoder:WireCellToolkit          18.7664       98.0121       180.247       90.3705       39.1411        50     
simulate:opdigi:OpDetDigitizerDUNE             0.147579      0.512665       1.16939      0.454261      0.242621        50     
simulate:rns:RandomNumberSaver                2.2522e-05    2.95167e-05   0.000240068   2.4771e-05    3.01445e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.1241e-05    1.31429e-05   4.2028e-05    1.2498e-05    4.19777e-06      50     
end_path:out1:RootOutput                       3.056e-06    4.25854e-06   2.0979e-05     3.867e-06    2.4187e-06       50     
end_path:out1:RootOutput(write)                0.351192       1.89166       5.10369       1.79382       1.16164        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4467.1 MB
  Peak resident set size usage (VmHWM): 2733.78 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune090 dune 2.3G Jan 19 03:46 mpvmpr_monte-carlo-012080-005386_gen_g4_detsim.root
Wrote processed DID: usertests:mpvmpr_monte-carlo-012080-005386_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 14:55:36 UTC       justIN version: 01.06.00