Jobsub ID 214095.169@dunegpschedd01.fnal.gov
| Jobsub ID | 214095.169@dunegpschedd01.fnal.gov |
| Workflow ID | 8188 |
| Stage ID | 1 |
| User name | epennacc@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-09-28 13:19:07 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce05 |
| Last heartbeat | 2025-09-28 14:57:08 |
| From worker node | Hostname | dune004-7950291.0-lcg2457.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-09-28 13:32:25 |
| Input files | monte-carlo-008188-007457
|
| Outputting started | 2025-09-28 14:57:08 |
| Output files | |
| Finished | 2025-09-28 15:30:47 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
mer: WireCell::Gen::Digitizer : 1.02 sec
[14:50:15.121] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.97 sec
[14:50:15.121] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.96 sec
[14:50:15.121] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.95 sec
[14:50:15.121] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.91 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.9 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.89 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::Reframer : 0.82 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::Reframer : 0.79 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::Reframer : 0.78 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.78 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::DepoBagger : 0.77 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::Reframer : 0.74 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::Reframer : 0.74 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::Reframer : 0.71 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::Reframer : 0.71 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::Reframer : 0.71 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::Reframer : 0.68 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::Reframer : 0.68 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::DepoSetFanout : 0.66 sec
[14:50:15.122] I [ timer ] Timer: wcls::FrameSaver : 0.64 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::Reframer : 0.63 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::Retagger : 0.58 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::Reframer : 0.58 sec
[14:50:15.122] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0.5 sec
[14:50:15.122] I [ timer ] Timer: wcls::SimDepoSource : 0.24 sec
[14:50:15.122] I [ timer ] Timer: Total node execution : 299.96000115573406 sec
wclsFrameSaver: saving raw::RawDigits tagged "daq"
Begin processing the 10th record. run: 8188 subRun: 0 event: 74570 at 28-Sep-2025 14:50:34 UTC
SimDepoSource got 141628 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 141628 depos spanning: [-2245.69, 2245.59]us
Retagger: tagging trace set: daq with 30720 traces, 0 summary
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::DepoTransform : 28.44 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::DepoTransform : 24.45 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::DepoTransform : 24.4 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::DepoTransform : 24.25 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::DepoTransform : 23.45 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::DepoTransform : 23.13 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::DepoTransform : 22.79 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::DepoTransform : 22.3 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::DepoTransform : 21.22 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::DepoTransform : 20.14 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::DepoTransform : 20.01 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::DepoTransform : 18.68 sec
[14:56:38.784] I [ timer ] Timer: wcls::SimChannelSink : 3.51 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Digitizer : 1.69 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Digitizer : 1.62 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Digitizer : 1.61 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Digitizer : 1.57 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Digitizer : 1.56 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Digitizer : 1.49 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Digitizer : 1.48 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Drifter : 1.42 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Digitizer : 1.41 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Digitizer : 1.35 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Digitizer : 1.25 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Digitizer : 1.21 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 1.2 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 1.11 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 1.08 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 1.07 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 1.05 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 1.01 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.99 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.97 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.97 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.96 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Reframer : 0.96 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.95 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::DepoBagger : 0.86 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Reframer : 0.83 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Reframer : 0.83 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Reframer : 0.83 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.83 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Reframer : 0.82 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Reframer : 0.8 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Reframer : 0.77 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.76 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Reframer : 0.75 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Reframer : 0.75 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::DepoSetFanout : 0.73 sec
[14:56:38.784] I [ timer ] Timer: wcls::FrameSaver : 0.71 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Retagger : 0.68 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::Reframer : 0.64 sec
[14:56:38.784] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.64 sec
[14:56:38.785] I [ timer ] Timer: WireCell::Gen::Reframer : 0.61 sec
[14:56:38.785] I [ timer ] Timer: WireCell::Gen::Reframer : 0.6 sec
[14:56:38.785] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0.39 sec
[14:56:38.785] I [ timer ] Timer: wcls::SimDepoSource : 0.3 sec
[14:56:38.785] I [ timer ] Timer: Total node execution : 320.8800003528595 sec
wclsFrameSaver: saving raw::RawDigits tagged "daq"
28-Sep-2025 14:57:00 UTC Closed output file "prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T133232Z_gen_007457_supernova_g4_detsim.root"
28-Sep-2025 14:57:00 UTC Closed input file "prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T133232Z_gen_007457_supernova_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 359.244 386.874 441.613 383.977 23.1154 10
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00134956 0.0058072 0.00778157 0.00576146 0.00176266 10
simulate:tpcrawdecoder:WireCellToolkit 344.007 371.167 424.677 368.157 22.8506 10
simulate:opdigi:OpDetDigitizerDUNE 3.48765 3.64915 3.78695 3.65342 0.0952486 10
simulate:rns:RandomNumberSaver 4.6918e-05 9.2983e-05 0.000385326 5.8871e-05 9.77853e-05 10
[art]:TriggerResults:TriggerResultInserter 1.4768e-05 2.2649e-05 5.7699e-05 1.8866e-05 1.18644e-05 10
end_path:out1:RootOutput 7.695e-06 1.10939e-05 3.0126e-05 9.1675e-06 6.39051e-06 10
end_path:out1:RootOutput(write) 11.587 12.0512 13.27 11.9954 0.449313 10
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5269.52 MB
Peak resident set size usage (VmHWM): 3504.79 MB
====================================================================================================
Art has completed and will exit with status 0.
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T133232Z_gen_007457.root 21953550
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T133232Z_gen_007457_supernova_g4.root 180955751
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T133232Z_gen_007457_supernova_g4_detsim.root 2352489292
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T133232Z_gen_007457_supernova_g4_detsim.root.ext.json 1561
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T133232Z_gen_007457_supernova_g4_detsim.root.json 1827
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T133232Z_gen_007457_supernova_g4_detsim.root.temp.json 1827
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_centralAPA_20250928T133232Z_gen_007457_supernova_g4_detsim_hist.root 519
