justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303330.9@dunegpschedd01.fnal.gov

Jobsub ID303330.9@dunegpschedd01.fnal.gov
Workflow ID12671
Stage ID3
User nameachatter@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 10:10:42
SiteUK_Imperial
EntryDUNE_T2_UK_London_IC_ceprod03
Last heartbeat2026-02-03 10:43:48
From worker nodeHostnamewm14.grid.hep.ph.ic.ac.uk
cpuinfoAMD EPYC 7742 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 10:11:11
Input filesusertests:prod_monte-carlo-012671-000016_gen_g4.root
JobscriptExit code0
Real time31m (1895s)
CPU time28m (1709s = 90%)
Max RSS bytes1781092352 (1698 MiB)
Outputting started2026-02-03 10:42:47
Output files
Finished2026-02-03 10:43:48
Saved logsjustin-logs:303330.9-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

agged "gauss"
FrameSaver: q=518293 n=44622 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=562781 n=37183 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210016 subRun: 0 event: 40 at 03-Feb-2026 10:35:44 GMT
SimDepoSetSource got 6006 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6006 depos spanning: [0.194478, 0.227578]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=178441 n=19630 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=190761 n=16877 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210016 subRun: 0 event: 41 at 03-Feb-2026 10:36:00 GMT
SimDepoSetSource got 17639 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17639 depos spanning: [0.618434, 1.28382]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=564191 n=65108 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=627079 n=52389 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210016 subRun: 0 event: 42 at 03-Feb-2026 10:36:48 GMT
SimDepoSetSource got 7870 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7870 depos spanning: [0.545256, 1.1855]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=250404 n=37416 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=261402 n=32616 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210016 subRun: 0 event: 43 at 03-Feb-2026 10:37:21 GMT
SimDepoSetSource got 14674 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14674 depos spanning: [0.4018, 0.417834]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=362448 n=53601 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=379628 n=48235 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210016 subRun: 0 event: 44 at 03-Feb-2026 10:37:59 GMT
SimDepoSetSource got 2807 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2807 depos spanning: [0.470028, 2.44537]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=88582 n=13096 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=91080.7 n=12913 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210016 subRun: 0 event: 45 at 03-Feb-2026 10:38:17 GMT
SimDepoSetSource got 28152 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 28152 depos spanning: [0.705733, 0.738204]us
Retagger: tagging trace set: wiener with 15360 traces, 15360 summary
Retagger: tagging trace set: gauss with 15360 traces, 0 summary
wclsFrameSaver: saving 15360 traces tagged "gauss"
FrameSaver: q=847074 n=120724 tag=gauss
wclsFrameSaver: saving 15360 traces tagged "wiener"
FrameSaver: q=902661 n=100269 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210016 subRun: 0 event: 46 at 03-Feb-2026 10:39:57 GMT
SimDepoSetSource got 20885 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 20885 depos spanning: [0.0227085, 0.0432127]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=567460 n=86497 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=603336 n=71472 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210016 subRun: 0 event: 47 at 03-Feb-2026 10:41:24 GMT
SimDepoSetSource got 9004 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9004 depos spanning: [0.380923, 0.390003]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=250559 n=34826 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=257031 n=33738 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210016 subRun: 0 event: 48 at 03-Feb-2026 10:41:43 GMT
SimDepoSetSource got 15762 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 15762 depos spanning: [0.183736, 0.826521]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=442843 n=37562 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=471345 n=31686 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210016 subRun: 0 event: 49 at 03-Feb-2026 10:42:00 GMT
SimDepoSetSource got 7390 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7390 depos spanning: [0.790424, 0.798197]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=196668 n=26713 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=201375 n=25762 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210016 subRun: 0 event: 50 at 03-Feb-2026 10:42:13 GMT
SimDepoSetSource got 12571 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 12571 depos spanning: [0.694666, 1.84924]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=403360 n=33397 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=464613 n=28391 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 10:42:46 GMT  Closed output file "prod_monte-carlo-012671-000016_gen_g4_detsim.root"
03-Feb-2026 10:42:46 GMT  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/d0/42/prod_monte-carlo-012671-000016_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      13.4659       35.5467       99.6163       31.5984       20.8806        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000468804    0.0090742     0.104953      0.0024319     0.0217997       50     
simulate:tpcrawdecoder:WireCellToolkit          13.2848       35.1261       98.6867       31.3036       20.7355        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0729641     0.228333      0.492871      0.210629      0.0991888       50     
simulate:rns:RandomNumberSaver                2.1881e-05    5.18229e-05   0.000367813   4.02355e-05   5.10112e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.1492e-05    1.79568e-05   6.3941e-05    1.6777e-05    6.94577e-06      50     
end_path:out1:RootOutput                       3.206e-06    6.94628e-06   6.6345e-05     4.423e-06    9.51717e-06      50     
end_path:out1:RootOutput(write)                0.0798716     0.182535      0.507632      0.163654      0.0798491       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3491.7 MB
  Peak resident set size usage (VmHWM): 1781.09 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r--. 1 job0003 job0003 188M Feb  3 10:42 prod_monte-carlo-012671-000016_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012671-000016_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 09:13:26 UTC       justIN version: 01.06.00