justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303490.5@dunegpschedd01.fnal.gov

Jobsub ID303490.5@dunegpschedd01.fnal.gov
Workflow ID12686
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-02-03 16:08:05
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel
Last heartbeat2026-02-03 16:45:14
From worker nodeHostnamewn-choc-001.farm.nikhef.nl
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-03 16:10:12
Input filesusertests:prod_monte-carlo-012686-000020_gen_g4.root
JobscriptExit code0
Real time34m (2056s)
CPU time33m (1991s = 96%)
Max RSS bytes2044084224 (1949 MiB)
Outputting started2026-02-03 16:44:29
Output files
Finished2026-02-03 16:45:14
Saved logsjustin-logs:303490.5-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

races tagged "gauss"
FrameSaver: q=343375 n=33065 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=358249 n=28312 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 40th record. run: 210020 subRun: 0 event: 40 at 03-Feb-2026 17:37:00 CET
SimDepoSetSource got 6573 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 6573 depos spanning: [0.984032, 0.992524]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=187182 n=26739 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=195651 n=23500 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 41st record. run: 210020 subRun: 0 event: 41 at 03-Feb-2026 17:37:31 CET
SimDepoSetSource got 8034 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8034 depos spanning: [0.950006, 0.960284]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=216408 n=34989 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=227215 n=30103 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 42nd record. run: 210020 subRun: 0 event: 42 at 03-Feb-2026 17:38:06 CET
SimDepoSetSource got 7528 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7528 depos spanning: [0.501058, 0.5402]us
Retagger: tagging trace set: wiener with 12800 traces, 12800 summary
Retagger: tagging trace set: gauss with 12800 traces, 0 summary
wclsFrameSaver: saving 12800 traces tagged "gauss"
FrameSaver: q=210399 n=34928 tag=gauss
wclsFrameSaver: saving 12800 traces tagged "wiener"
FrameSaver: q=228607 n=28238 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 43rd record. run: 210020 subRun: 0 event: 43 at 03-Feb-2026 17:39:23 CET
SimDepoSetSource got 7953 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 7953 depos spanning: [0.856936, 0.86773]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=216958 n=31697 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=221077 n=30720 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 44th record. run: 210020 subRun: 0 event: 44 at 03-Feb-2026 17:39:42 CET
SimDepoSetSource got 9723 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 9723 depos spanning: [0.751929, 0.763202]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=269044 n=19113 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=309434 n=16991 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 45th record. run: 210020 subRun: 0 event: 45 at 03-Feb-2026 17:40:00 CET
SimDepoSetSource got 22226 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 22226 depos spanning: [0.406622, 0.431352]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=578592 n=87186 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=602218 n=85920 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 46th record. run: 210020 subRun: 0 event: 46 at 03-Feb-2026 17:40:52 CET
SimDepoSetSource got 3973 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 3973 depos spanning: [0.0540399, 0.0587141]us
Retagger: tagging trace set: wiener with 2560 traces, 2560 summary
Retagger: tagging trace set: gauss with 2560 traces, 0 summary
wclsFrameSaver: saving 2560 traces tagged "gauss"
FrameSaver: q=98064 n=18182 tag=gauss
wclsFrameSaver: saving 2560 traces tagged "wiener"
FrameSaver: q=100815 n=17887 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 47th record. run: 210020 subRun: 0 event: 47 at 03-Feb-2026 17:41:09 CET
SimDepoSetSource got 27172 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 27172 depos spanning: [0.746595, 1.98242]us
Retagger: tagging trace set: wiener with 10240 traces, 10240 summary
Retagger: tagging trace set: gauss with 10240 traces, 0 summary
wclsFrameSaver: saving 10240 traces tagged "gauss"
FrameSaver: q=814081 n=102531 tag=gauss
wclsFrameSaver: saving 10240 traces tagged "wiener"
FrameSaver: q=905658 n=79804 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 48th record. run: 210020 subRun: 0 event: 48 at 03-Feb-2026 17:42:16 CET
SimDepoSetSource got 25513 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 25513 depos spanning: [0.84756, 0.874551]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=776040 n=76713 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=845693 n=64269 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 49th record. run: 210020 subRun: 0 event: 49 at 03-Feb-2026 17:43:05 CET
SimDepoSetSource got 8900 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 8900 depos spanning: [0.310023, 0.580266]us
Retagger: tagging trace set: wiener with 5120 traces, 5120 summary
Retagger: tagging trace set: gauss with 5120 traces, 0 summary
wclsFrameSaver: saving 5120 traces tagged "gauss"
FrameSaver: q=278951 n=41140 tag=gauss
wclsFrameSaver: saving 5120 traces tagged "wiener"
FrameSaver: q=287616 n=38833 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 50th record. run: 210020 subRun: 0 event: 50 at 03-Feb-2026 17:43:38 CET
SimDepoSetSource got 14296 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSetSource: ready with 14296 depos spanning: [0.272908, 0.288962]us
Retagger: tagging trace set: wiener with 7680 traces, 7680 summary
Retagger: tagging trace set: gauss with 7680 traces, 0 summary
wclsFrameSaver: saving 7680 traces tagged "gauss"
FrameSaver: q=332377 n=52771 tag=gauss
wclsFrameSaver: saving 7680 traces tagged "wiener"
FrameSaver: q=347558 n=50543 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
03-Feb-2026 17:44:28 CET  Closed output file "prod_monte-carlo-012686-000020_gen_g4_detsim.root"
03-Feb-2026 17:44:28 CET  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/e3/05/prod_monte-carlo-012686-000020_gen_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.475743       39.263        130.54        35.0031       24.5127        50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000273793    0.0252082     0.588252      0.0012385     0.0998385       50     
simulate:tpcrawdecoder:WireCellToolkit         0.432207       38.8981        129.9        34.6318       24.3845        50     
simulate:opdigi:OpDetDigitizerDUNE            0.00018545     0.207543       0.4303       0.183407      0.0942852       50     
simulate:rns:RandomNumberSaver                1.9809e-05    4.00557e-05   0.000243761   3.65725e-05   2.99907e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.2003e-05    1.62071e-05   4.5144e-05    1.5492e-05    4.67244e-06      50     
end_path:out1:RootOutput                       2.76e-06     5.25948e-06   1.8593e-05     5.172e-06    2.30398e-06      50     
end_path:out1:RootOutput(write)                0.0415897      0.13173      0.284986      0.110482      0.0636779       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3732.25 MB
  Peak resident set size usage (VmHWM): 2044.08 MB
====================================================================================================
Art has completed and will exit with status 0.
-rw-r--r-- 1 dune090 dune 236M Feb  3 17:44 prod_monte-carlo-012686-000020_gen_g4_detsim.root
Wrote processed DID: usertests:prod_monte-carlo-012686-000020_gen_g4.root
=== DETSIM job completed successfully ===
justIN time: 2026-02-04 07:42:21 UTC       justIN version: 01.06.00