justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303346.2@dunegpschedd01.fnal.gov

Jobsub ID303346.2@dunegpschedd01.fnal.gov
Workflow ID12673
Stage ID3
User namedrielsma@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 10:54:44
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2026-02-03 11:28:57
From worker nodeHostnamehnode59.pic.es
cpuinfoAMD EPYC 7402P 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 10:56:06
Input filesusertests:prod_monte-carlo-012673-000004_gen_g4.root
JobscriptExit code0
Real time31m (1910s)
CPU time20m (1213s = 63%)
Max RSS bytes1693532160 (1615 MiB)
Outputting started2026-02-03 11:27:57
Output files
Finished2026-02-03 11:28:57
Saved logsjustin-logs:303346.2-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

s tagged "gauss"
FrameSaver: q=885349 n=121839 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=930085 n=105798 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210004 subRun: 0 event: 40 at 03-Feb-2026 12:23:24 CET
SimDepoSetSource got 14762 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14762 depos spanning: [0.875852, 0.893136]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=347042 n=49688 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=362319 n=44261 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210004 subRun: 0 event: 41 at 03-Feb-2026 12:23:49 CET
SimDepoSetSource got 5611 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5611 depos spanning: [0.913908, 1.3092]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=162946 n=26440 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=166107 n=25600 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210004 subRun: 0 event: 42 at 03-Feb-2026 12:24:02 CET
SimDepoSetSource got 7026 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7026 depos spanning: [0.524317, 0.53287]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=206638 n=18858 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=229414 n=15909 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210004 subRun: 0 event: 43 at 03-Feb-2026 12:24:23 CET
SimDepoSetSource got 18591 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 18591 depos spanning: [0.27981, 0.300135]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=520611 n=74030 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=536182 n=72865 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210004 subRun: 0 event: 44 at 03-Feb-2026 12:24:48 CET
SimDepoSetSource got 5576 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5576 depos spanning: [0.349037, 0.355715]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=159172 n=20167 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=165601 n=19169 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210004 subRun: 0 event: 45 at 03-Feb-2026 12:25:10 CET
SimDepoSetSource got 32828 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 32828 depos spanning: [0.161678, 0.196754]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=956111 n=104451 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=982358 n=97079 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210004 subRun: 0 event: 46 at 03-Feb-2026 12:25:50 CET
SimDepoSetSource got 23920 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 23920 depos spanning: [0.684851, 0.821732]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=587964 n=68050 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=640389 n=55550 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210004 subRun: 0 event: 47 at 03-Feb-2026 12:26:38 CET
SimDepoSetSource got 5221 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 5221 depos spanning: [0.220724, 0.432177]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=161770 n=20096 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=165511 n=18583 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210004 subRun: 0 event: 48 at 03-Feb-2026 12:26:51 CET
SimDepoSetSource got 19998 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19998 depos spanning: [0.807151, 0.829235]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=625032 n=79304 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=708398 n=63073 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210004 subRun: 0 event: 49 at 03-Feb-2026 12:27:25 CET
SimDepoSetSource got 2098 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 2098 depos spanning: [0.0758169, 0.0782408]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=62213.9 n=6975 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=67807.4 n=6011 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210004 subRun: 0 event: 50 at 03-Feb-2026 12:27:36 CET
SimDepoSetSource got 19361 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19361 depos spanning: [0.486546, 0.506715]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=519811 n=45145 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=560896 n=37505 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 12:27:56 CET  Closed output file "prod_monte-carlo-012673-000004_gen_g4_detsim.root"
03-Feb-2026 12:27:56 CET  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/75/3e/prod_monte-carlo-012673-000004_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.165617       36.2114       385.331       21.9848       63.1529        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000367172    0.0121015     0.156081     0.00280283     0.030421        50     
simulate:tpcrawdecoder:WireCellToolkit         0.0930065      35.9242       385.121       21.8056       63.134         50     
simulate:opdigi:OpDetDigitizerDUNE             0.0322401     0.169282      0.346952      0.156065      0.0810881       50     
simulate:rns:RandomNumberSaver                 1.872e-05    3.07816e-05   0.000226218   2.4981e-05    2.88209e-05      50     
[art]:TriggerResults:TriggerResultInserter      9.6e-06     1.40169e-05   3.8021e-05     1.268e-05    5.34099e-06      50     
end_path:out1:RootOutput                       2.88e-06     4.3077e-06     1.745e-05     3.845e-06    2.1227e-06       50     
end_path:out1:RootOutput(write)                0.0361329     0.105203      0.234305      0.0928409     0.0458332       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3443.59 MB
  Peak resident set size usage (VmHWM): 1693.53 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 dune 213M Feb  3 12:27 prod_monte-carlo-012673-000004_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012673-000004_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:44:57 UTC       justIN version: 01.06.00