Jobsub ID 215337.166@dunegpschedd01.fnal.gov
| Jobsub ID | 215337.166@dunegpschedd01.fnal.gov |
| Workflow ID | 8278 |
| Stage ID | 1 |
| User name | epennacc@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-09-30 13:23:34 |
| Site | IT_CNAF |
| Entry | CMSHTPC_T1_IT_CNAF_condor_ce02 |
| Last heartbeat | 2025-09-30 14:17:31 |
| From worker node | Hostname | wn-s03-04-07-04.cr.cnaf.infn.it |
| cpuinfo | Intel(R) Xeon(R) Gold 6438Y+ |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-09-30 13:37:28 |
| Input files | monte-carlo-008278-009074
|
| Outputting started | 2025-09-30 14:05:15 |
| Output files | |
| Finished | 2025-09-30 15:03:27 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.32 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.3 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.29 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.28 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.25 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.22 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::Reframer : 0.17 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::DepoBagger : 0.16 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::Reframer : 0.16 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::Reframer : 0.16 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::Reframer : 0.16 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::Drifter : 0.15 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::DepoSetFanout : 0.14 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::Reframer : 0.13 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::Reframer : 0.13 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.13 sec
[16:03:01.315] I [ timer ] Timer: WireCell::Gen::Reframer : 0.12 sec
[16:03:01.316] I [ timer ] Timer: WireCell::Gen::Reframer : 0.12 sec
[16:03:01.316] I [ timer ] Timer: WireCell::Gen::Reframer : 0.11 sec
[16:03:01.316] I [ timer ] Timer: WireCell::Gen::Reframer : 0.1 sec
[16:03:01.316] I [ timer ] Timer: WireCell::Gen::Retagger : 0.1 sec
[16:03:01.316] I [ timer ] Timer: WireCell::Gen::Reframer : 0.09 sec
[16:03:01.316] I [ timer ] Timer: WireCell::Gen::Reframer : 0.09 sec
[16:03:01.316] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0.08 sec
[16:03:01.316] I [ timer ] Timer: wcls::FrameSaver : 0.08 sec
[16:03:01.316] I [ timer ] Timer: wcls::SimDepoSource : 0.05 sec
[16:03:01.316] I [ timer ] Timer: Total node execution : 95.6299997009337 sec
wclsFrameSaver: saving raw::RawDigits tagged "daq"
Begin processing the 10th record. run: 8278 subRun: 0 event: 90740 at 30-Sep-2025 16:03:12 CEST
SimDepoSource got 80085 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 80085 depos spanning: [-2244.96, 2.2465e+09]us
Retagger: tagging trace set: daq with 30720 traces, 0 summary
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::DepoTransform : 10.19 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::DepoTransform : 9.6 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::DepoTransform : 9.42 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::DepoTransform : 8.64 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::DepoTransform : 7.78 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::DepoTransform : 7.32 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::DepoTransform : 7.12 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::DepoTransform : 6.96 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::DepoTransform : 6.85 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::DepoTransform : 6.44 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::DepoTransform : 5.2 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::DepoTransform : 4.48 sec
[16:05:02.200] I [ timer ] Timer: wcls::SimChannelSink : 1.23 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.56 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.54 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.52 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.48 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.47 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.46 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.45 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.43 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.43 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.42 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.42 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.4 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Digitizer : 0.4 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.36 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.34 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.32 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.3 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Drifter : 0.3 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.3 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.3 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.29 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.29 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.29 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.28 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::IncoherentAddNoise : 0.28 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::DepoBagger : 0.21 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Reframer : 0.2 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Reframer : 0.19 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Reframer : 0.17 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.16 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Reframer : 0.15 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Reframer : 0.14 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Reframer : 0.14 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Reframer : 0.12 sec
[16:05:02.200] I [ timer ] Timer: wcls::FrameSaver : 0.11 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Reframer : 0.11 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Reframer : 0.11 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Reframer : 0.11 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Reframer : 0.1 sec
[16:05:02.200] I [ timer ] Timer: WireCell::Gen::Reframer : 0.1 sec
[16:05:02.201] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0.08 sec
[16:05:02.201] I [ timer ] Timer: WireCell::Gen::Retagger : 0.08 sec
[16:05:02.201] I [ timer ] Timer: WireCell::Gen::DepoSetFanout : 0.05 sec
[16:05:02.201] I [ timer ] Timer: wcls::SimDepoSource : 0.02 sec
[16:05:02.201] I [ timer ] Timer: Total node execution : 103.21000051498413 sec
wclsFrameSaver: saving raw::RawDigits tagged "daq"
30-Sep-2025 16:05:13 CEST Closed output file "prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T133730Z_gen_009074_supernova_g4_detsim.root"
30-Sep-2025 16:05:13 CEST Closed input file "prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T133730Z_gen_009074_supernova_g4.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 110.732 115.542 122.891 114.999 3.97081 10
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000573756 0.00237635 0.00398294 0.00222003 0.00108598 10
simulate:tpcrawdecoder:WireCellToolkit 101.653 107.184 114.773 106.647 4.08446 10
simulate:opdigi:OpDetDigitizerDUNE 1.47883 1.53079 1.65521 1.50349 0.0550345 10
simulate:rns:RandomNumberSaver 3.3187e-05 4.99837e-05 0.000160351 3.6489e-05 3.7009e-05 10
[art]:TriggerResults:TriggerResultInserter 1.1862e-05 1.68144e-05 3.0044e-05 1.4676e-05 6.13542e-06 10
end_path:out1:RootOutput 4.166e-06 5.9692e-06 1.3988e-05 5.2955e-06 2.73569e-06 10
end_path:out1:RootOutput(write) 6.33673 6.82372 7.46798 6.72948 0.301298 10
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4973.28 MB
Peak resident set size usage (VmHWM): 3321.58 MB
====================================================================================================
Art has completed and will exit with status 0.
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T133730Z_gen_009074.root 22105475
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T133730Z_gen_009074_supernova_g4.root 131079215
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T133730Z_gen_009074_supernova_g4_detsim.root 2143092678
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T133730Z_gen_009074_supernova_g4_detsim.root.ext.json 1575
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T133730Z_gen_009074_supernova_g4_detsim.root.json 1841
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T133730Z_gen_009074_supernova_g4_detsim.root.temp.json 1841
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T133730Z_gen_009074_supernova_g4_detsim_hist.root 519
