Jobsub ID 46546.107@dunegpschedd01.fnal.gov
| Jobsub ID | 46546.107@dunegpschedd01.fnal.gov |
| Workflow ID | 2607 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-15 09:01:34 |
| Site | UK_Oxford |
| Entry | DUNE_UK_SGrid_Oxford_arc01 |
| Last heartbeat | 2025-09-15 13:11:33 |
| From worker node | Hostname | t2wn166.physics.ox.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-09-15 10:30:45 |
| Input files | vd-protodune:np02vd_raw_run039275_0307_df-s04-d1_dw_0_20250902T012910.hdf5
|
| Outputting started | 2025-09-15 12:28:18 |
| Output files | |
| Finished | 2025-09-15 13:17:54 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0.429] D [ glue ] frame sink sees EOS
[13:24:50.429] D [ pgraph ] <Pgrapher:> graph execution complete
[13:24:50.429] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 15.23 sec
[13:24:50.429] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 14.53 sec
[13:24:50.429] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 14.12 sec
[13:24:50.429] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 13.6 sec
[13:24:50.429] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 11.99 sec
[13:24:50.429] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 11.79 sec
[13:24:50.429] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 11.27 sec
[13:24:50.429] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 10.59 sec
[13:24:50.429] I [ timer ] Timer: WireCell::Aux::Resampler : 1.36 sec
[13:24:50.429] I [ timer ] Timer: WireCell::Aux::Resampler : 1.31 sec
[13:24:50.429] I [ timer ] Timer: WireCell::Aux::Resampler : 1.31 sec
[13:24:50.429] I [ timer ] Timer: WireCell::Aux::Resampler : 1.29 sec
[13:24:50.429] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.03 sec
[13:24:50.429] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.02 sec
[13:24:50.429] I [ timer ] Timer: WireCell::Gen::Retagger : 0.02 sec
[13:24:50.429] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[13:24:50.429] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[13:24:50.429] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[13:24:50.430] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[13:24:50.430] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[13:24:50.430] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0 sec
[13:24:50.430] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[13:24:50.430] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[13:24:50.430] I [ timer ] Timer: WireCell::Gen::FrameFanout : 0 sec
[13:24:50.430] I [ timer ] Timer: wcls::RawFrameSource : 0 sec
[13:24:50.430] I [ timer ] Timer: wcls::FrameSaver : 0 sec
[13:24:50.430] I [ timer ] Timer: Total node execution : 108.47999974526465 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 65758 traces tagged "gauss"
FrameSaver: q=1.24242e+07 n=1464116 tag=gauss
wclsFrameSaver: saving 81377 traces tagged "wiener"
FrameSaver: q=1.32329e+07 n=1408850 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1730 XUs and 1770 XVs -> 95 XUVs
C:0 T:1 992 XUs and 1251 XVs -> 38 XUVs
C:0 T:2 2376 XUs and 1803 XVs -> 179 XUVs
C:0 T:3 871 XUs and 926 XVs -> 42 XUVs
C:0 T:4 903 XUs and 761 XVs -> 56 XUVs
C:0 T:5 889 XUs and 707 XVs -> 37 XUVs
C:0 T:6 849 XUs and 699 XVs -> 36 XUVs
C:0 T:7 1123 XUs and 1368 XVs -> 40 XUVs
C:0 T:8 7442 XUs and 8465 XVs -> 1273 XUVs
C:0 T:9 7123 XUs and 12218 XVs -> 649 XUVs
C:0 T:10 4906 XUs and 6986 XVs -> 532 XUVs
C:0 T:11 5575 XUs and 7785 XVs -> 1085 XUVs
C:0 T:12 1908 XUs and 3052 XVs -> 159 XUVs
C:0 T:13 16282 XUs and 43005 XVs -> 5091 XUVs
C:0 T:14 11824 XUs and 27329 XVs -> 3251 XUVs
C:0 T:15 7134 XUs and 6487 XVs -> 683 XUVs
13246 XUVs total
2588 collection wire objects
13246 potential space points
Neighbour search...
1521186 tests to find 633836 neighbours
Iterating with no regularization...
Begin: 7.12072e+08
0 6.37892e+08
1 6.32087e+08
2 6.31279e+08
3 6.30998e+08
Now with regularization...
Begin: 6.18012e+08
0 6.17753e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
15-Sep-2025 13:27:51 BST Closed output file "np02vd_raw_run039275_0307_df-s04-d1_dw_0_20250902T012910_reco_stage1_20250915T122751_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 243.564 386.924 1078.5 342.416 185.818 18
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.0821e-05 0.000143146 0.000311858 0.000113149 5.8291e-05 18
produce:tpcrawdecoder:PDVDTPCReader 62.3375 82.5875 112.22 82.0403 13.1299 18
produce:triggerrawdecoder:PDVDTriggerReader4 0.0370933 0.0405024 0.0556403 0.0376398 0.00624647 18
produce:pdvddaphne:DAPHNEReaderPDVD 8.63527 13.0903 22.0017 12.4235 2.80484 18
produce:ophit:OpHitFinder 0.0645445 0.0793347 0.0966593 0.0794357 0.00773201 18
produce:opflash:OpFlashFinderVerticalDrift 0.0157858 0.022872 0.0372631 0.0221884 0.00462067 18
produce:wclsdatavd:WireCellToolkit 85.1548 103.057 129.994 103.257 12.2505 18
produce:gaushit:GausHitFinder 1.33542 2.09225 3.10391 1.8821 0.52717 18
produce:nhitsfilter:NumberOfHitsFilter 0.000309344 0.000527667 0.000700042 0.000541287 0.000113202 18
produce:reco3d:SpacePointSolver 14.2955 24.5131 44.5149 22.4765 7.97751 18
produce:hitpdune:DisambigFromSpacePoints 0.173316 0.427423 0.944327 0.373021 0.198834 18
produce:pandora:StandardPandora 39.0672 151.289 782.802 100.111 166.413 18
produce:pandoraTrack:LArPandoraTrackCreation 0.759336 2.13291 3.84738 2.12171 0.750313 18
produce:pandoraGnocalo:GnocchiCalorimetry 0.0343076 0.0531239 0.0799868 0.0508814 0.0121572 18
[art]:TriggerResults:TriggerResultInserter 2.3764e-05 5.81937e-05 9.2565e-05 5.22585e-05 2.0325e-05 18
end_path:out1:RootOutput 8.516e-06 1.3142e-05 3.6038e-05 1.0891e-05 6.80027e-06 18
end_path:out1:RootOutput(write) 5.96058 7.46148 8.56565 7.66536 0.692198 18
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5418.71 MB
Peak resident set size usage (VmHWM): 3475.69 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039275_0307_df-s04-d1_dw_0_20250902T012910_reco_stage1_20250915T122751_keepup.root
\tHists: np02vd_raw_run039275_0307_df-s04-d1_dw_0_20250902T012910_reco_stage1_20250915T122751_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039275_0307_df-s04-d1_dw_0_20250902T012910_reco_stage1_20250915T122751_keepup.root
Ran successfully
{
"name": "np02vd_raw_run039275_0307_df-s04-d1_dw_0_20250902T012910_reco_stage1_20250915T122751_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757939273.0,
"core.end_time": 1757939273.0,
"core.events": [
110531,
110551,
110571,
110591,
110611,
110631,
110651,
110671,
110691,
110711,
110731,
110751,
110771,
110791,
110811,
110831,
110851,
110871
],
"core.event_count": 18,
"core.first_event_number": 110531,
"core.last_event_number": 110871,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39275
],
"core.runs_subruns": [
3927500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039275_0307_df-s04-d1_dw_0_20250902T012910.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run039275_0307_df-s04-d1_dw_0_20250902T012910_reco_stage1_20250915T122751_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757939273.0,
"core.end_time": 1757939273.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39275
],
"core.runs_subruns": [
3927500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039275_0307_df-s04-d1_dw_0_20250902T012910.hdf5"
}
]
} 