justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297623.4@dunegpschedd02.fnal.gov

Jobsub ID297623.4@dunegpschedd02.fnal.gov
Workflow ID12667
Stage ID3
User namescalvez@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 10:02:42
SiteUK_Oxford
EntryDUNE_UK_SGrid_Oxford_arc01
Last heartbeat2026-02-03 10:15:24
From worker nodeHostnamet2wn001.physics.ox.ac.uk
cpuinfoAMD EPYC 7713P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 10:04:53
Input filesusertests:prod_monte-carlo-012667-000010_gen_g4.root
JobscriptExit code0
Real time8m (497s)
CPU time7m (466s = 93%)
Max RSS bytes1611374592 (1536 MiB)
Outputting started2026-02-03 10:13:11
Output files
Finished2026-02-03 10:15:24
Saved logsjustin-logs:297623.4-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

SetSource:"
Outputer: "wclsDepoFluxWriter:postdrift"
Outputer: "wclsFrameSaver:spsignals"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce recob::Wires named "dnnsp"
03-Feb-2026 10:05:46 GMT  Initiating request to open input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/usertests/ec/cc/prod_monte-carlo-012667-000010_gen_g4.root"
03-Feb-2026 10:05:49 GMT  Opened input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/usertests/ec/cc/prod_monte-carlo-012667-000010_gen_g4.root"
Begin processing the 1st record. run: 210010 subRun: 0 event: 1 at 03-Feb-2026 10:05:51 GMT
SimDepoSetSource got 8775 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8775 depos spanning: [0.962903, 0.979634]us
[10:05:54.100] W [  gen   ] <IncoherentAddNoise:addnoiseapa9> model EmpiricalNoiseModel:empericalnoisemeganodes produced 6174 samples instead of expected 6000, future warnings muted 
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=278447 n=43319 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=292456 n=37130 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 10:06:18 GMT  Opened output file with pattern "prod_monte-carlo-012667-000010_gen_g4_detsim.root"
Begin processing the 2nd record. run: 210010 subRun: 0 event: 2 at 03-Feb-2026 10:06:27 GMT
SimDepoSetSource got 17118 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 17118 depos spanning: [0.65183, 0.700419]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=467027 n=69796 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=508213 n=54762 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 3rd record. run: 210010 subRun: 0 event: 3 at 03-Feb-2026 10:07:15 GMT
SimDepoSetSource got 4064 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4064 depos spanning: [0.189661, 0.19363]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=103502 n=12145 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=115054 n=10224 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 4th record. run: 210010 subRun: 0 event: 4 at 03-Feb-2026 10:07:30 GMT
SimDepoSetSource got 4003 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4003 depos spanning: [0.293285, 0.405273]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=133355 n=18471 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=151118 n=15050 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 5th record. run: 210010 subRun: 0 event: 5 at 03-Feb-2026 10:07:58 GMT
SimDepoSetSource got 4361 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 4361 depos spanning: [0.0915539, 0.0968988]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=117596 n=14884 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=121739 n=13263 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 6th record. run: 210010 subRun: 0 event: 6 at 03-Feb-2026 10:08:15 GMT
SimDepoSetSource got 19220 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 19220 depos spanning: [0.976956, 1.69787]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=434042 n=64067 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=450860 n=59740 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 7th record. run: 210010 subRun: 0 event: 7 at 03-Feb-2026 10:09:02 GMT
SimDepoSetSource got 25435 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25435 depos spanning: [0.501831, 3.56521]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=673942 n=85128 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=705872 n=74955 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 8th record. run: 210010 subRun: 0 event: 8 at 03-Feb-2026 10:10:02 GMT
SimDepoSetSource got 22953 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 22953 depos spanning: [0.240681, 0.265591]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=675072 n=105760 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=691832 n=97688 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 9th record. run: 210010 subRun: 0 event: 9 at 03-Feb-2026 10:10:49 GMT
SimDepoSetSource got 33779 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 33779 depos spanning: [0.67109, 1.01708]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=936968 n=132161 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=979334 n=119100 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 10th record. run: 210010 subRun: 0 event: 10 at 03-Feb-2026 10:12:05 GMT
SimDepoSetSource got 31645 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 31645 depos spanning: [0.518891, 0.553244]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=690451 n=92691 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=744954 n=77795 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 10:13:10 GMT  Closed output file "prod_monte-carlo-012667-000010_gen_g4_detsim.root"
03-Feb-2026 10:13:10 GMT  Closed input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/usertests/ec/cc/prod_monte-carlo-012667-000010_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      15.1866       42.7175       75.1468       47.087        19.3195        10     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000477952   0.00589999     0.0418095    0.00205226     0.0120024       10     
simulate:tpcrawdecoder:WireCellToolkit          15.0032       42.2275       74.3571       46.4651       19.1479        10     
simulate:opdigi:OpDetDigitizerDUNE             0.0832608     0.278584      0.430903      0.278614      0.110423        10     
simulate:rns:RandomNumberSaver                2.4498e-05    5.22037e-05   0.000253168   3.02085e-05   6.7098e-05       10     
[art]:TriggerResults:TriggerResultInserter    1.3025e-05    2.22619e-05    5.186e-05    1.7018e-05    1.31994e-05      10     
end_path:out1:RootOutput                       3.006e-06    5.8794e-06    2.3997e-05    3.9575e-06    6.0576e-06       10     
end_path:out1:RootOutput(write)                0.0975872     0.204853      0.355308      0.206412      0.0834553       10     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3360.89 MB
  Peak resident set size usage (VmHWM): 1611.37 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune020 dune 57M Feb  3 10:13 prod_monte-carlo-012667-000010_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012667-000010_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 04:45:50 UTC       justIN version: 01.06.00