Jobsub ID 38124.96@dunegpschedd02.fnal.gov
| Jobsub ID | 38124.96@dunegpschedd02.fnal.gov |
| Workflow ID | 2494 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-11 10:04:31 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce512 |
| Last heartbeat | 2025-09-11 12:11:30 |
| From worker node | Hostname | b9p10p0918.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | aborted |
| Started | 2025-09-11 10:57:29 |
| Input files | vd-protodune:np02vd_raw_run039255_1837_df-s03-d0_dw_0_20250831T073203.hdf5
|
| Outputting started | 2025-09-11 12:06:36 |
| Output files | |
| Finished | 2025-09-11 12:11:30 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
c:anode0sigproc0> EOS at call=35 anode=0
[14:04:51.902] D [ glue ] <FrameFanin:nfsp> EOS at call=35 with 8
[14:04:51.902] D [ glue ] frame sink sees EOS
[14:04:51.903] D [ pgraph ] <Pgrapher:> graph execution complete
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 11.05 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 9.64 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 9.38 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 8.43 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 8.05 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 7.96 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 6.84 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 6.81 sec
[14:04:51.903] I [ timer ] Timer: WireCell::Aux::Resampler : 1.18 sec
[14:04:51.903] I [ timer ] Timer: WireCell::Aux::Resampler : 1.18 sec
[14:04:51.903] I [ timer ] Timer: WireCell::Aux::Resampler : 0.72 sec
[14:04:51.903] I [ timer ] Timer: WireCell::Aux::Resampler : 0.71 sec
[14:04:51.903] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.01 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[14:04:51.903] I [ timer ] Timer: WireCell::Gen::Retagger : 0.01 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[14:04:51.903] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[14:04:51.903] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[14:04:51.903] I [ timer ] Timer: WireCell::Gen::FrameFanout : 0 sec
[14:04:51.903] I [ timer ] Timer: wcls::RawFrameSource : 0 sec
[14:04:51.903] I [ timer ] Timer: wcls::FrameSaver : 0 sec
[14:04:51.903] I [ timer ] Timer: Total node execution : 71.9900011792779 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 52933 traces tagged "gauss"
FrameSaver: q=1.05206e+07 n=1162775 tag=gauss
wclsFrameSaver: saving 64935 traces tagged "wiener"
FrameSaver: q=1.10489e+07 n=1114183 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 273 XUs and 414 XVs -> 9 XUVs
C:0 T:1 921 XUs and 782 XVs -> 52 XUVs
C:0 T:2 151 XUs and 128 XVs -> 7 XUVs
C:0 T:3 693 XUs and 638 XVs -> 33 XUVs
C:0 T:4 1637 XUs and 1736 XVs -> 79 XUVs
C:0 T:5 933 XUs and 941 XVs -> 24 XUVs
C:0 T:6 453 XUs and 516 XVs -> 25 XUVs
C:0 T:7 606 XUs and 658 XVs -> 26 XUVs
C:0 T:8 8175 XUs and 14354 XVs -> 2748 XUVs
C:0 T:9 3210 XUs and 3688 XVs -> 153 XUVs
C:0 T:10 3914 XUs and 4352 XVs -> 202 XUVs
C:0 T:11 1638 XUs and 2928 XVs -> 204 XUVs
C:0 T:12 14501 XUs and 24703 XVs -> 1488 XUVs
C:0 T:13 1673 XUs and 2063 XVs -> 181 XUVs
C:0 T:14 1124 XUs and 2125 XVs -> 155 XUVs
C:0 T:15 2199 XUs and 2171 XVs -> 145 XUVs
5531 XUVs total
2146 collection wire objects
5531 potential space points
Neighbour search...
418553 tests to find 194654 neighbours
Iterating with no regularization...
Begin: 3.78317e+09
0 3.54779e+09
1 3.53603e+09
2 3.53574e+09
Now with regularization...
Begin: 3.5202e+09
0 3.52007e+09
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
11-Sep-2025 14:06:24 CEST Closed output file "np02vd_raw_run039255_1837_df-s03-d0_dw_0_20250831T073203_reco_stage1_20250911T120623_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 131.802 227.389 327.63 221.704 61.115 18
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.6841e-05 9.53856e-05 0.000197212 8.4085e-05 3.48824e-05 18
produce:tpcrawdecoder:PDVDTPCReader 6.37054 6.85385 8.02914 6.6767 0.446611 18
produce:triggerrawdecoder:PDVDTriggerReader4 0.00123526 0.00578825 0.0281204 0.00183301 0.00773403 18
produce:pdvddaphne:DAPHNEReaderPDVD 3.27549 4.34175 5.49211 4.32042 0.576493 18
produce:ophit:OpHitFinder 0.0352238 0.0496177 0.0624389 0.0497553 0.00771197 18
produce:opflash:OpFlashFinderVerticalDrift 0.00984303 0.014431 0.0197606 0.0142448 0.0027299 18
produce:wclsdatavd:WireCellToolkit 65.4417 74.9763 89.681 74.1904 6.61825 18
produce:gaushit:GausHitFinder 0.702477 1.72479 2.39242 1.75544 0.498934 18
produce:nhitsfilter:NumberOfHitsFilter 0.000222851 0.000417329 0.000779795 0.000428823 0.000125319 18
produce:reco3d:SpacePointSolver 8.89705 21.8027 31.7916 21.9077 6.17158 18
produce:hitpdune:DisambigFromSpacePoints 0.11385 0.35475 0.627715 0.343292 0.142503 18
produce:pandora:StandardPandora 33.5451 109.665 194.74 103.358 50.8862 18
produce:pandoraTrack:LArPandoraTrackCreation 0.37332 1.61842 2.33715 1.80431 0.624037 18
produce:pandoraGnocalo:GnocchiCalorimetry 0.01656 0.0397464 0.0700435 0.0410969 0.0158471 18
[art]:TriggerResults:TriggerResultInserter 1.693e-05 3.23391e-05 8.6541e-05 2.8465e-05 1.53619e-05 18
end_path:out1:RootOutput 4.57e-06 9.70389e-06 2.666e-05 8.485e-06 4.8966e-06 18
end_path:out1:RootOutput(write) 4.23158 5.89292 7.51614 6.20864 0.972764 18
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5220.97 MB
Peak resident set size usage (VmHWM): 3268.05 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039255_1837_df-s03-d0_dw_0_20250831T073203_reco_stage1_20250911T120623_keepup.root
\tHists: np02vd_raw_run039255_1837_df-s03-d0_dw_0_20250831T073203_reco_stage1_20250911T120624_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039255_1837_df-s03-d0_dw_0_20250831T073203_reco_stage1_20250911T120623_keepup.root
Ran successfully
{
"name": "np02vd_raw_run039255_1837_df-s03-d0_dw_0_20250831T073203_reco_stage1_20250911T120623_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757592385.0,
"core.end_time": 1757592385.0,
"core.events": [
662279,
662299,
662319,
662339,
662359,
662379,
662399,
662419,
662439,
662459,
662479,
662499,
662519,
662539,
662559,
662579,
662599,
662619
],
"core.event_count": 18,
"core.first_event_number": 662279,
"core.last_event_number": 662619,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39255
],
"core.runs_subruns": [
3925500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039255_1837_df-s03-d0_dw_0_20250831T073203.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run039255_1837_df-s03-d0_dw_0_20250831T073203_reco_stage1_20250911T120624_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757592385.0,
"core.end_time": 1757592385.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39255
],
"core.runs_subruns": [
3925500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039255_1837_df-s03-d0_dw_0_20250831T073203.hdf5"
}
]
} 