justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297366.20@dunegpschedd02.fnal.gov

Jobsub ID297366.20@dunegpschedd02.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 19:28:05
SiteIT_CNAF
EntryCMSHTPC_T1_IT_CNAF_condor_ce02
Last heartbeat2026-02-02 20:12:54
From worker nodeHostnamewn-s04-05-07-03.cr.cnaf.infn.it
cpuinfoAMD EPYC 7313 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 19:29:00
Input filesusertests:prodgenie_monte-carlo-012654-000328_gen_g4.root
JobscriptExit code0
Real time34m (2042s)
CPU time30m (1801s = 88%)
Max RSS bytes2163458048 (2063 MiB)
Outputting started2026-02-02 20:03:04
Output files
Finished2026-02-02 20:12:54
Saved logsjustin-logs:297366.20-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

"wiener"
FrameSaver: q=487874 n=43511 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100328 subRun: 0 event: 40 at 02-Feb-2026 20:56:02 CET
SimDepoSetSource got 63165 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 63165 depos spanning: [6.7159e-07, 15.9442]us
Retagger: tagging trace set: wiener with 20480 traces, 20480 summary
Retagger: tagging trace set: gauss with 20480 traces, 0 summary
wclsFrameSaver: saving 20480 traces tagged "gauss"
FrameSaver: q=1.98606e+06 n=234362 tag=gauss
wclsFrameSaver: saving 20480 traces tagged "wiener"
FrameSaver: q=2.17743e+06 n=206683 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100328 subRun: 0 event: 41 at 02-Feb-2026 20:57:30 CET
SimDepoSetSource got 93001 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 93001 depos spanning: [6.67597e-07, 4.58971]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=2.27106e+06 n=208941 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=2.51672e+06 n=182871 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100328 subRun: 0 event: 42 at 02-Feb-2026 20:58:19 CET
SimDepoSetSource got 57433 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 57433 depos spanning: [6.67491e-07, 2.05165]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=1.80534e+06 n=240565 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=1.93181e+06 n=200529 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100328 subRun: 0 event: 43 at 02-Feb-2026 20:59:18 CET
SimDepoSetSource got 7987 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7987 depos spanning: [0.00102967, 10.1397]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=202284 n=33219 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=219429 n=30117 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100328 subRun: 0 event: 44 at 02-Feb-2026 21:00:13 CET
SimDepoSetSource got 8867 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8867 depos spanning: [6.67283e-07, 5.73017]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=270571 n=40061 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=321559 n=34093 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100328 subRun: 0 event: 45 at 02-Feb-2026 21:00:46 CET
SimDepoSetSource got 5459 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5459 depos spanning: [2.98321e-06, 1.93598]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=148402 n=22979 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=167153 n=20036 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100328 subRun: 0 event: 46 at 02-Feb-2026 21:01:14 CET
SimDepoSetSource got 28 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 28 depos spanning: [0.0285446, 0.030468]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=2059.57 n=1058 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=3017.53 n=1041 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100328 subRun: 0 event: 47 at 02-Feb-2026 21:01:23 CET
SimDepoSetSource got 26699 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 26699 depos spanning: [6.67973e-07, 0.279617]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=817323 n=94756 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=945556 n=78185 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100328 subRun: 0 event: 48 at 02-Feb-2026 21:01:58 CET
SimDepoSetSource got 14680 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14680 depos spanning: [6.88453e-07, 2.94412]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=447686 n=50741 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=505078 n=43217 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100328 subRun: 0 event: 49 at 02-Feb-2026 21:02:21 CET
SimDepoSetSource got 17518 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17518 depos spanning: [6.67907e-07, 0.0214274]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=523014 n=79140 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=564597 n=63916 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100328 subRun: 0 event: 50 at 02-Feb-2026 21:02:46 CET
SimDepoSetSource got 3825 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3825 depos spanning: [6.70783e-07, 0.211703]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=124819 n=17757 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=134422 n=15384 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:03:03 CET  Closed output file "prodgenie_monte-carlo-012654-000328_gen_g4_detsim.root"
02-Feb-2026 21:03:03 CET  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/usertests/f8/88/prodgenie_monte-carlo-012654-000328_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      8.22526       35.9514       88.5224       30.4464       21.0924        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000337645   0.00535274     0.0332575    0.00186711    0.00960687       50     
simulate:tpcrawdecoder:WireCellToolkit          8.14592       35.5606       87.4247       30.1314       20.8008        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0107701     0.194917      0.972849      0.143078      0.175355        50     
simulate:rns:RandomNumberSaver                2.2512e-05    5.24194e-05   0.000442992   3.4009e-05    6.83602e-05      50     
[art]:TriggerResults:TriggerResultInserter     8.015e-06    1.60426e-05   4.3882e-05     1.316e-05    8.61938e-06      50     
end_path:out1:RootOutput                       2.575e-06     5.243e-06    1.8965e-05    4.5885e-06    2.68714e-06      50     
end_path:out1:RootOutput(write)                0.0282247      0.18988      0.808149      0.114722      0.179512        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3874.81 MB
  Peak resident set size usage (VmHWM): 2163.46 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 neutrino002 neutrino 687M Feb  2 21:03 prodgenie_monte-carlo-012654-000328_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000328_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:26:43 UTC       justIN version: 01.06.00