justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297829.3@dunegpschedd02.fnal.gov

Jobsub ID297829.3@dunegpschedd02.fnal.gov
Workflow ID12694
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 18:34:12
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2026-02-03 19:04:06
From worker nodeHostnamewn2207300.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 18:35:34
Input filesusertests:prod_monte-carlo-012694-000006_gen_g4.root
JobscriptExit code0
Real time27m (1644s)
CPU time26m (1560s = 94%)
Max RSS bytes1650495488 (1574 MiB)
Outputting started2026-02-03 19:02:58
Output files
Finished2026-02-03 19:04:06
Saved logsjustin-logs:297829.3-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

eSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=657508 n=89814 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=703977 n=75042 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210006 subRun: 0 event: 40 at 03-Feb-2026 18:59:14 GMT
SimDepoSetSource got 123 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 123 depos spanning: [0.331047, 0.331198]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=5610.43 n=1537 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=6860.45 n=1453 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210006 subRun: 0 event: 41 at 03-Feb-2026 18:59:28 GMT
SimDepoSetSource got 22209 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 22209 depos spanning: [0.464316, 0.485185]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=628375 n=71551 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=704191 n=56856 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210006 subRun: 0 event: 42 at 03-Feb-2026 19:00:13 GMT
SimDepoSetSource got 1570 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 1570 depos spanning: [0.21648, 0.218289]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=42893.4 n=7202 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=45025.6 n=6943 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210006 subRun: 0 event: 43 at 03-Feb-2026 19:00:26 GMT
SimDepoSetSource got 333 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 333 depos spanning: [0.63646, 0.63689]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=10434.1 n=1945 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=11853.3 n=1792 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210006 subRun: 0 event: 44 at 03-Feb-2026 19:00:36 GMT
SimDepoSetSource got 11885 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 11885 depos spanning: [0.322966, 0.335331]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=303852 n=31965 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=325277 n=26501 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210006 subRun: 0 event: 45 at 03-Feb-2026 19:01:04 GMT
SimDepoSetSource got 4205 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4205 depos spanning: [0.580287, 0.585086]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=118106 n=16262 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=124710 n=13308 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210006 subRun: 0 event: 46 at 03-Feb-2026 19:01:17 GMT
SimDepoSetSource got 7263 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7263 depos spanning: [0.0934961, 0.178218]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=238593 n=33945 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=253119 n=29214 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210006 subRun: 0 event: 47 at 03-Feb-2026 19:01:41 GMT
SimDepoSetSource got 5692 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5692 depos spanning: [0.588761, 0.596591]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=181091 n=21791 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=200801 n=17363 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210006 subRun: 0 event: 48 at 03-Feb-2026 19:01:54 GMT
SimDepoSetSource got 19674 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19674 depos spanning: [0.819192, 0.841186]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=528493 n=75840 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=548532 n=73491 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210006 subRun: 0 event: 49 at 03-Feb-2026 19:02:34 GMT
SimDepoSetSource got 766 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 766 depos spanning: [0.250296, 0.251267]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=24859.9 n=4764 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=26225.7 n=4550 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210006 subRun: 0 event: 50 at 03-Feb-2026 19:02:45 GMT
SimDepoSetSource got 322 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 322 depos spanning: [0.27399, 0.274385]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=10269.7 n=2823 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=11618.3 n=2802 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 19:02:57 GMT  Closed output file "prod_monte-carlo-012694-000006_gen_g4_detsim.root"
03-Feb-2026 19:02:57 GMT  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/usertests/57/b0/prod_monte-carlo-012694-000006_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      10.5465       30.9443       85.5244       27.4106       17.657         50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000344808   0.00317728     0.0170249    0.00185049    0.00434166       50     
simulate:tpcrawdecoder:WireCellToolkit          10.435        30.6204       84.9283       27.2206       17.5538        50     
simulate:opdigi:OpDetDigitizerDUNE             0.0292921     0.176544      0.346192      0.168288      0.0776762       50     
simulate:rns:RandomNumberSaver                2.0248e-05    4.82964e-05   0.000356852   4.15535e-05   4.55566e-05      50     
[art]:TriggerResults:TriggerResultInserter     8.666e-06    1.64065e-05   5.3321e-05    1.45075e-05   6.89825e-06      50     
end_path:out1:RootOutput                       2.224e-06    6.78956e-06   5.0104e-05     5.706e-06    7.42479e-06      50     
end_path:out1:RootOutput(write)                0.0449915     0.143568      0.316842      0.132416      0.0673607       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3397.51 MB
  Peak resident set size usage (VmHWM): 1650.5 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune01 dune01 197M Feb  3 19:02 prod_monte-carlo-012694-000006_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012694-000006_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:27:01 UTC       justIN version: 01.06.00