justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303045.129@dunegpschedd01.fnal.gov

Jobsub ID303045.129@dunegpschedd01.fnal.gov
Workflow ID12654
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-02-02 19:34:05
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2026-02-02 20:31:16
From worker nodeHostnamehnode56.pic.es
cpuinfoAMD EPYC 7402P 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 19:36:23
Input filesusertests:prodgenie_monte-carlo-012654-000892_gen_g4.root
JobscriptExit code0
Real time53m (3222s)
CPU time51m (3087s = 95%)
Max RSS bytes2184757248 (2083 MiB)
Outputting started2026-02-02 20:30:06
Output files
Finished2026-02-02 20:31:16
Saved logsjustin-logs:303045.129-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=160796 n=16041 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=185923 n=14561 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 100892 subRun: 0 event: 40 at 02-Feb-2026 21:21:18 CET
SimDepoSetSource got 0 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1 depos spanning: [0, 0]us
wclsFrameSaver: no traces tagged "gauss"
FrameSaver: q=0 n=0 tag=gauss
wclsFrameSaver: no traces tagged "wiener"
FrameSaver: q=0 n=0 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 100892 subRun: 0 event: 41 at 02-Feb-2026 21:21:18 CET
SimDepoSetSource got 17088 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17088 depos spanning: [6.67923e-07, 2.58942]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=545993 n=62706 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=623652 n=52339 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 100892 subRun: 0 event: 42 at 02-Feb-2026 21:21:49 CET
SimDepoSetSource got 9396 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9396 depos spanning: [6.67797e-07, 2.95497]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=312163 n=41626 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=343508 n=33448 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 100892 subRun: 0 event: 43 at 02-Feb-2026 21:22:41 CET
SimDepoSetSource got 484 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 484 depos spanning: [0.00903015, 0.260757]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=13244.5 n=4578 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=16121.7 n=4213 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 100892 subRun: 0 event: 44 at 02-Feb-2026 21:23:07 CET
SimDepoSetSource got 9418 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9418 depos spanning: [6.67135e-07, 3.41245]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=187914 n=22612 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=208819 n=20453 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 100892 subRun: 0 event: 45 at 02-Feb-2026 21:23:37 CET
SimDepoSetSource got 40516 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 40516 depos spanning: [6.67353e-07, 2.3005]us
Retagger: tagging trace set: wiener with 17920 traces, 17920 summary
Retagger: tagging trace set: gauss with 17920 traces, 0 summary
wclsFrameSaver: saving 17920 traces tagged "gauss"
FrameSaver: q=1.07488e+06 n=153916 tag=gauss
wclsFrameSaver: saving 17920 traces tagged "wiener"
FrameSaver: q=1.17698e+06 n=124286 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 100892 subRun: 0 event: 46 at 02-Feb-2026 21:25:24 CET
SimDepoSetSource got 25614 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25614 depos spanning: [6.69113e-07, 2.69027]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=756489 n=95017 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=822535 n=79583 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 100892 subRun: 0 event: 47 at 02-Feb-2026 21:26:11 CET
SimDepoSetSource got 2536 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2536 depos spanning: [0.000134783, 0.135074]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=111608 n=10981 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=126097 n=9857 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 100892 subRun: 0 event: 48 at 02-Feb-2026 21:26:36 CET
SimDepoSetSource got 11147 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11147 depos spanning: [7.00538e-07, 3.37904]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=333832 n=48352 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=355202 n=41579 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 100892 subRun: 0 event: 49 at 02-Feb-2026 21:27:32 CET
SimDepoSetSource got 266545 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 266545 depos spanning: [6.67132e-07, 8.24792]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=5.41447e+06 n=544365 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=6.17316e+06 n=473456 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 100892 subRun: 0 event: 50 at 02-Feb-2026 21:29:51 CET
SimDepoSetSource got 5726 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5726 depos spanning: [8.18657e-07, 0.314789]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=212470 n=20526 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=234560 n=18554 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
02-Feb-2026 21:30:05 CET  Closed output file "prodgenie_monte-carlo-012654-000892_gen_g4_detsim.root"
02-Feb-2026 21:30:05 CET  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/usertests/9e/b7/prodgenie_monte-carlo-012654-000892_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.155275       62.3202       258.664       53.9206       45.7337        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000253216   0.00850666     0.0514511    0.00351366     0.0141982       50     
simulate:tpcrawdecoder:WireCellToolkit         0.110619       61.6047       255.074       52.738        45.0942        50     
simulate:opdigi:OpDetDigitizerDUNE            5.7502e-05     0.340272       1.38951      0.260124      0.284209        50     
simulate:rns:RandomNumberSaver                1.7481e-05    3.32481e-05   0.000311368   2.6681e-05    4.00855e-05      50     
[art]:TriggerResults:TriggerResultInserter     9.76e-06     1.41514e-05   4.9581e-05    1.34055e-05   5.45055e-06      50     
end_path:out1:RootOutput                       2.681e-06    4.52648e-06   4.9881e-05     3.385e-06    6.52048e-06      50     
end_path:out1:RootOutput(write)                0.0396937     0.366169       2.91049      0.208736      0.525858        50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3911.85 MB
  Peak resident set size usage (VmHWM): 2184.76 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 dune 797M Feb  2 21:30 prodgenie_monte-carlo-012654-000892_gen_g4_detsim.root
Wrote processed DID: usertests:prodgenie_monte-carlo-012654-000892_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:28:07 UTC       justIN version: 01.06.00