justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 223710.81@dunegpschedd02.fnal.gov

Jobsub ID223710.81@dunegpschedd02.fnal.gov
Workflow ID8503
Stage ID1
User nameepennacc@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-10-03 16:39:26
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2025-10-03 16:54:00
From worker nodeHostnamewn2210240.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-03 16:40:50
Input filesmonte-carlo-008503-000396
JobscriptExit code0
Real time11m (679s)
CPU time10m (635s = 93%)
Max RSS bytes3028471808 (2888 MiB)
Outputting started2025-10-03 16:52:10
Output filesfardet-hd:prod_gamma_1-500MeV_dune10kt_1x2x6_20251003T164057Z_gen_000396_g4_detsim.root
Finished2025-10-03 16:54:00
Saved logsjustin-logs:223710.81-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

imer  ] Timer: WireCell::Gen::DepoTransform : 0.18 sec
[17:51:26.044] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.18 sec
[17:51:26.044] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.18 sec
[17:51:26.044] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.17 sec
[17:51:26.044] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.17 sec
[17:51:26.044] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.16 sec
[17:51:26.044] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.16 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.16 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.16 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.15 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.08 sec
[17:51:26.045] I [ timer  ] Timer: wcls::SimChannelSink : 0.07 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.05 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.05 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.05 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.05 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.05 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.04 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::Drifter : 0.04 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.04 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.04 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::Retagger : 0.03 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::DepoBagger : 0.03 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.03 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::FrameFanin : 0.03 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::DumpFrames : 0.02 sec
[17:51:26.045] I [ timer  ] Timer: wcls::FrameSaver : 0.02 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.02 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::DepoSetFanout : 0.02 sec
[17:51:26.045] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.02 sec
[17:51:26.045] I [ timer  ] Timer: wcls::SimDepoSource : 0 sec
[17:51:26.045] I [ timer  ] Timer: Total node execution : 10.810000024735928 sec
wclsFrameSaver: saving raw::RawDigits tagged "daq"
Begin processing the 10th record. run: 8503 subRun: 0 event: 3960 at 03-Oct-2025 17:51:40 BST
SimDepoSource got 1701 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 1701 depos spanning: [1.00215, 1.00799]us
Retagger: tagging trace set: daq with 30720 traces, 0 summary
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.43 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.39 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Digitizer : 0.35 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Digitizer : 0.34 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Digitizer : 0.33 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Digitizer : 0.33 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Digitizer : 0.33 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::IncoherentAddNoise : 0.33 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Digitizer : 0.33 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Digitizer : 0.33 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Digitizer : 0.32 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::IncoherentAddNoise : 0.32 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Digitizer : 0.31 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Digitizer : 0.31 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Digitizer : 0.31 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::IncoherentAddNoise : 0.31 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::IncoherentAddNoise : 0.3 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::IncoherentAddNoise : 0.3 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::IncoherentAddNoise : 0.3 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::IncoherentAddNoise : 0.3 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Digitizer : 0.3 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::IncoherentAddNoise : 0.29 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::IncoherentAddNoise : 0.29 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::IncoherentAddNoise : 0.29 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::IncoherentAddNoise : 0.28 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::IncoherentAddNoise : 0.27 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.17 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.17 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.15 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.15 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.15 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.15 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.15 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.15 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.15 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 0.14 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.06 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.06 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.05 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.05 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.04 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.04 sec
[17:51:51.978] I [ timer  ] Timer: wcls::SimChannelSink : 0.04 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.04 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.04 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.04 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.03 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.03 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DumpFrames : 0.02 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.02 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Retagger : 0.02 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DepoBagger : 0.02 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::DepoSetFanout : 0.02 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::Drifter : 0.01 sec
[17:51:51.978] I [ timer  ] Timer: wcls::FrameSaver : 0 sec
[17:51:51.978] I [ timer  ] Timer: wcls::SimDepoSource : 0 sec
[17:51:51.978] I [ timer  ] Timer: WireCell::Gen::FrameFanin : 0 sec
[17:51:51.978] I [ timer  ] Timer: Total node execution : 10.450000146403909 sec
wclsFrameSaver: saving raw::RawDigits tagged "daq"
03-Oct-2025 17:52:06 BST  Closed output file "prod_gamma_1-500MeV_dune10kt_1x2x6_20251003T164057Z_gen_000396_g4_detsim.root"
03-Oct-2025 17:52:06 BST  Closed input file "prod_gamma_1-500MeV_dune10kt_1x2x6_20251003T164057Z_gen_000396_g4.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      25.3562       26.7417       29.6271       26.3336       1.37807        10     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000503456   0.000992205   0.00118535    0.00104961    0.000181877      10     
simulate:tpcrawdecoder:WireCellToolkit          15.3479       17.1404       19.7439       16.7987       1.45911        10     
simulate:opdigi:OpDetDigitizerDUNE             0.0834988     0.126388      0.182595       0.12174      0.0327629       10     
simulate:rns:RandomNumberSaver                4.0145e-05    6.9582e-05    0.000270709    4.758e-05    6.72526e-05      10     
[art]:TriggerResults:TriggerResultInserter    1.3946e-05    1.94374e-05   4.6387e-05    1.63705e-05   9.1877e-06       10     
end_path:out1:RootOutput                       5.16e-06     7.7336e-06    2.0589e-05     6.687e-06    4.33387e-06      10     
end_path:out1:RootOutput(write)                 9.05944       9.47349       9.92272       9.44222      0.293263        10     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4706.46 MB
  Peak resident set size usage (VmHWM): 3028.47 MB
====================================================================================================
Art has completed and will exit with status 0.
written output file: prod_gamma_1-500MeV_dune10kt_1x2x6_20251003T164057Z_gen_000396.root 99209
written output file: prod_gamma_1-500MeV_dune10kt_1x2x6_20251003T164057Z_gen_000396_g4.root 8240687
written output file: prod_gamma_1-500MeV_dune10kt_1x2x6_20251003T164057Z_gen_000396_g4_detsim.root 1808450268
written output file: prod_gamma_1-500MeV_dune10kt_1x2x6_20251003T164057Z_gen_000396_g4_detsim.root.ext.json 1465
written output file: prod_gamma_1-500MeV_dune10kt_1x2x6_20251003T164057Z_gen_000396_g4_detsim.root.json 1767
written output file: prod_gamma_1-500MeV_dune10kt_1x2x6_20251003T164057Z_gen_000396_g4_detsim.root.temp.json 1767
written output file: prod_gamma_1-500MeV_dune10kt_1x2x6_20251003T164057Z_gen_000396_g4_detsim_hist.root 519
justIN time: 2025-11-04 19:42:03 UTC       justIN version: 01.05.01