Jobsub ID 43821.65@dunegpschedd01.fnal.gov
| Jobsub ID | 43821.65@dunegpschedd01.fnal.gov |
| Workflow ID | 2365 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-09 15:43:13 |
| Site | UK_Durham |
| Entry | DUNE_UK_SGridDurham_ce3 |
| Last heartbeat | 2025-09-09 16:52:50 |
| From worker node | Hostname | n250.dur.scotgrid.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | aborted |
| Started | 2025-09-09 15:44:06 |
| Input files | vd-protodune:np02vd_raw_run039349_0113_df-s05-d1_dw_0_20250909T144100.hdf5
|
| Outputting started | 2025-09-09 16:47:52 |
| Output files | |
| Finished | 2025-09-09 16:52:50 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ll=55 anode=0
[17:46:59.285] D [ glue ] <FrameFanin:nfsp> EOS at call=55 with 8
[17:46:59.285] D [ glue ] frame sink sees EOS
[17:46:59.285] D [ pgraph ] <Pgrapher:> graph execution complete
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 6.19 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 5.84 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 4.81 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 4.81 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 4.76 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 4.75 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 4.41 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 4.38 sec
[17:46:59.285] I [ timer ] Timer: WireCell::Aux::Resampler : 0.25 sec
[17:46:59.285] I [ timer ] Timer: WireCell::Aux::Resampler : 0.24 sec
[17:46:59.285] I [ timer ] Timer: WireCell::Aux::Resampler : 0.24 sec
[17:46:59.285] I [ timer ] Timer: WireCell::Aux::Resampler : 0.24 sec
[17:46:59.285] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.01 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[17:46:59.285] I [ timer ] Timer: WireCell::Gen::FrameFanout : 0.01 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:46:59.285] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0 sec
[17:46:59.285] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[17:46:59.285] I [ timer ] Timer: WireCell::Gen::Retagger : 0 sec
[17:46:59.285] I [ timer ] Timer: wcls::RawFrameSource : 0 sec
[17:46:59.285] I [ timer ] Timer: wcls::FrameSaver : 0 sec
[17:46:59.285] I [ timer ] Timer: Total node execution : 40.970000268891454 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 28139 traces tagged "gauss"
FrameSaver: q=4.49379e+06 n=635666 tag=gauss
wclsFrameSaver: saving 34206 traces tagged "wiener"
FrameSaver: q=4.797e+06 n=618342 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1586 XUs and 1716 XVs -> 65 XUVs
C:0 T:1 239 XUs and 250 XVs -> 13 XUVs
C:0 T:2 14 XUs and 22 XVs -> 0 XUVs
C:0 T:3 338 XUs and 325 XVs -> 26 XUVs
C:0 T:4 273 XUs and 459 XVs -> 5 XUVs
C:0 T:5 311 XUs and 283 XVs -> 21 XUVs
C:0 T:6 63 XUs and 82 XVs -> 2 XUVs
C:0 T:7 1234 XUs and 1053 XVs -> 56 XUVs
C:0 T:8 2511 XUs and 3318 XVs -> 335 XUVs
C:0 T:9 6568 XUs and 12761 XVs -> 1124 XUVs
C:0 T:10 6105 XUs and 24547 XVs -> 2976 XUVs
C:0 T:11 1292 XUs and 829 XVs -> 33 XUVs
C:0 T:12 731 XUs and 1115 XVs -> 116 XUVs
C:0 T:13 355 XUs and 275 XVs -> 20 XUVs
C:0 T:14 821 XUs and 995 XVs -> 51 XUVs
C:0 T:15 1014 XUs and 793 XVs -> 42 XUVs
4885 XUVs total
795 collection wire objects
4885 potential space points
Neighbour search...
588879 tests to find 232598 neighbours
Iterating with no regularization...
Begin: 1.64079e+08
0 1.47608e+08
1 1.46074e+08
2 1.4581e+08
3 1.45711e+08
Now with regularization...
Begin: 1.42295e+08
0 1.42218e+08
09-Sep-2025 17:47:39 BST Closed output file "np02vd_raw_run039349_0113_df-s05-d1_dw_0_20250909T144100_reco_stage1_20250909T164739_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 104.804 133.576 174.35 132.49 16.2281 28
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.1483e-05 0.000121835 0.000346674 0.000107898 4.9977e-05 28
produce:tpcrawdecoder:PDVDTPCReader 41.9858 51.8559 84.9615 46.0465 11.0372 28
produce:triggerrawdecoder:PDVDTriggerReader4 0.0599144 0.0797401 0.319148 0.0687375 0.0485512 28
produce:pdvddaphne:DAPHNEReaderPDVD 4.92814 6.68981 16.2511 6.10483 2.0376 28
produce:ophit:OpHitFinder 0.0302553 0.0395425 0.0456442 0.0400628 0.0037871 28
produce:opflash:OpFlashFinderVerticalDrift 0.00450606 0.00885001 0.0147797 0.0087195 0.00208697 28
produce:wclsdatavd:WireCellToolkit 38.6826 42.8136 50.9338 41.5995 3.49863 28
produce:gaushit:GausHitFinder 0.415937 0.708246 1.12211 0.702493 0.153119 28
produce:nhitsfilter:NumberOfHitsFilter 0.000229313 0.000702218 0.00156859 0.000644803 0.000308019 28
produce:reco3d:SpacePointSolver 3.33632 7.11019 13.2958 7.36706 2.05979 28
produce:hitpdune:DisambigFromSpacePoints 0.0528283 0.1009 0.220641 0.0988302 0.0336102 28
produce:pandora:StandardPandora 8.47171 20.5335 40.764 18.2326 8.38554 28
produce:pandoraTrack:LArPandoraTrackCreation 0.127158 0.481154 1.27209 0.454573 0.212811 28
produce:pandoraGnocalo:GnocchiCalorimetry 0.00990008 0.0206888 0.028899 0.0199982 0.0051298 28
[art]:TriggerResults:TriggerResultInserter 2.6771e-05 5.64209e-05 0.000151857 5.22335e-05 2.38654e-05 28
end_path:out1:RootOutput 6.873e-06 1.54894e-05 5.9432e-05 1.3074e-05 9.90295e-06 28
end_path:out1:RootOutput(write) 2.70509 3.0434 4.24815 3.01442 0.269101 28
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4224.46 MB
Peak resident set size usage (VmHWM): 2324.8 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039349_0113_df-s05-d1_dw_0_20250909T144100_reco_stage1_20250909T164739_keepup.root
\tHists: np02vd_raw_run039349_0113_df-s05-d1_dw_0_20250909T144100_reco_stage1_20250909T164739_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039349_0113_df-s05-d1_dw_0_20250909T144100_reco_stage1_20250909T164739_keepup.root
Ran successfully
{
"name": "np02vd_raw_run039349_0113_df-s05-d1_dw_0_20250909T144100_reco_stage1_20250909T164739_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757436460.0,
"core.end_time": 1757436460.0,
"core.events": [
62895,
62915,
62935,
62955,
62975,
62995,
63015,
63035,
63055,
63075,
63095,
63115,
63135,
63155,
63175,
63195,
63215,
63235,
63255,
63275,
63295,
63315,
63335,
63355,
63375,
63395,
63415,
63435
],
"core.event_count": 28,
"core.first_event_number": 62895,
"core.last_event_number": 63435,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39349
],
"core.runs_subruns": [
3934900001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039349_0113_df-s05-d1_dw_0_20250909T144100.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run039349_0113_df-s05-d1_dw_0_20250909T144100_reco_stage1_20250909T164739_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757436460.0,
"core.end_time": 1757436460.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39349
],
"core.runs_subruns": [
3934900001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039349_0113_df-s05-d1_dw_0_20250909T144100.hdf5"
}
]
} 