Jobsub ID 37940.11@dunegpschedd02.fnal.gov
| Jobsub ID | 37940.11@dunegpschedd02.fnal.gov |
| Workflow ID | 2482 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-11 00:49:59 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce515 |
| Last heartbeat | 2025-09-11 03:05:53 |
| From worker node | Hostname | b9p24p7422.cern.ch |
| cpuinfo | AMD EPYC 7302 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | aborted |
| Started | 2025-09-11 01:53:41 |
| Input files | vd-protodune:np02vd_raw_run039255_1131_df-s02-d2_dw_0_20250830T223620.hdf5
|
| Outputting started | 2025-09-11 03:00:09 |
| Output files | |
| Finished | 2025-09-11 03:05:53 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
call=35 with 8
[04:57:53.153] D [ glue ] frame sink sees EOS
[04:57:53.153] D [ pgraph ] <Pgrapher:> graph execution complete
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 10.05 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 7.96 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 7.61 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 7.44 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 7.18 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 6.85 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 6.76 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 6.41 sec
[04:57:53.153] I [ timer ] Timer: WireCell::Aux::Resampler : 0.77 sec
[04:57:53.153] I [ timer ] Timer: WireCell::Aux::Resampler : 0.76 sec
[04:57:53.153] I [ timer ] Timer: WireCell::Aux::Resampler : 0.76 sec
[04:57:53.153] I [ timer ] Timer: WireCell::Aux::Resampler : 0.75 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.02 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[04:57:53.153] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.01 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[04:57:53.153] I [ timer ] Timer: WireCell::Gen::Retagger : 0.01 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[04:57:53.153] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0 sec
[04:57:53.153] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[04:57:53.153] I [ timer ] Timer: WireCell::Gen::FrameFanout : 0 sec
[04:57:53.153] I [ timer ] Timer: wcls::RawFrameSource : 0 sec
[04:57:53.153] I [ timer ] Timer: wcls::FrameSaver : 0 sec
[04:57:53.153] I [ timer ] Timer: Total node execution : 63.37000018917024 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 58351 traces tagged "gauss"
FrameSaver: q=1.09228e+07 n=1322837 tag=gauss
wclsFrameSaver: saving 71501 traces tagged "wiener"
FrameSaver: q=1.16211e+07 n=1274715 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 184 XUs and 233 XVs -> 6 XUVs
C:0 T:1 1057 XUs and 920 XVs -> 38 XUVs
C:0 T:2 716 XUs and 907 XVs -> 15 XUVs
C:0 T:3 294 XUs and 303 XVs -> 17 XUVs
C:0 T:4 274 XUs and 350 XVs -> 14 XUVs
C:0 T:5 941 XUs and 1312 XVs -> 39 XUVs
C:0 T:6 1534 XUs and 1167 XVs -> 67 XUVs
C:0 T:7 209 XUs and 209 XVs -> 11 XUVs
C:0 T:8 7136 XUs and 7699 XVs -> 641 XUVs
C:0 T:9 1134 XUs and 1210 XVs -> 107 XUVs
C:0 T:10 2124 XUs and 2555 XVs -> 127 XUVs
C:0 T:11 1243 XUs and 1935 XVs -> 240 XUVs
C:0 T:12 16348 XUs and 14685 XVs -> 789 XUVs
C:0 T:13 14476 XUs and 23401 XVs -> 1860 XUVs
C:0 T:14 13803 XUs and 30684 XVs -> 4971 XUVs
C:0 T:15 1633 XUs and 2917 XVs -> 375 XUVs
9317 XUVs total
2289 collection wire objects
9317 potential space points
Neighbour search...
1089041 tests to find 446608 neighbours
Iterating with no regularization...
Begin: 1.21263e+09
0 1.10083e+09
1 1.09421e+09
2 1.09346e+09
Now with regularization...
Begin: 1.07275e+09
0 1.07245e+09
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
11-Sep-2025 05:00:00 CEST Closed output file "np02vd_raw_run039255_1131_df-s02-d2_dw_0_20250830T223620_reco_stage1_20250911T030000_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 130.385 219.101 370.154 201.678 65.3468 18
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.613e-05 9.29592e-05 0.000278343 7.80305e-05 5.47896e-05 18
produce:tpcrawdecoder:PDVDTPCReader 5.76023 6.80471 7.32989 7.00004 0.492809 18
produce:triggerrawdecoder:PDVDTriggerReader4 0.00091462 0.00279134 0.01491 0.00124513 0.00341747 18
produce:pdvddaphne:DAPHNEReaderPDVD 3.79497 4.61193 5.57804 4.43911 0.504351 18
produce:ophit:OpHitFinder 0.0332414 0.0428976 0.0531264 0.0421089 0.00608004 18
produce:opflash:OpFlashFinderVerticalDrift 0.00916258 0.0149592 0.019856 0.0146192 0.00308278 18
produce:wclsdatavd:WireCellToolkit 59.123 72.0544 91.7146 70.9872 8.566 18
produce:gaushit:GausHitFinder 0.85746 1.31452 1.71919 1.3686 0.220622 18
produce:nhitsfilter:NumberOfHitsFilter 0.000267713 0.000438714 0.000796609 0.00042276 0.000140708 18
produce:reco3d:SpacePointSolver 9.81111 19.6991 29.1167 19.9367 4.81816 18
produce:hitpdune:DisambigFromSpacePoints 0.197315 0.312574 0.458065 0.303936 0.0758535 18
produce:pandora:StandardPandora 38.5217 107.705 239.029 97.1141 53.6833 18
produce:pandoraTrack:LArPandoraTrackCreation 0.67736 1.47906 2.33862 1.43349 0.436007 18
produce:pandoraGnocalo:GnocchiCalorimetry 0.0210125 0.0340963 0.0504581 0.0333328 0.00708405 18
[art]:TriggerResults:TriggerResultInserter 1.4031e-05 2.12832e-05 4.5381e-05 1.801e-05 8.00644e-06 18
end_path:out1:RootOutput 3.69e-06 7.25122e-06 2.361e-05 7.64e-06 4.52586e-06 18
end_path:out1:RootOutput(write) 4.51626 4.98175 6.69854 4.93581 0.446417 18
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5336.47 MB
Peak resident set size usage (VmHWM): 3401.43 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039255_1131_df-s02-d2_dw_0_20250830T223620_reco_stage1_20250911T030000_keepup.root
\tHists: np02vd_raw_run039255_1131_df-s02-d2_dw_0_20250830T223620_reco_stage1_20250911T030000_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039255_1131_df-s02-d2_dw_0_20250830T223620_reco_stage1_20250911T030000_keepup.root
Ran successfully
{
"name": "np02vd_raw_run039255_1131_df-s02-d2_dw_0_20250830T223620_reco_stage1_20250911T030000_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757559601.0,
"core.end_time": 1757559601.0,
"core.events": [
407157,
407177,
407197,
407217,
407237,
407257,
407277,
407297,
407317,
407337,
407357,
407377,
407397,
407417,
407437,
407457,
407477,
407497
],
"core.event_count": 18,
"core.first_event_number": 407157,
"core.last_event_number": 407497,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39255
],
"core.runs_subruns": [
3925500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039255_1131_df-s02-d2_dw_0_20250830T223620.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run039255_1131_df-s02-d2_dw_0_20250830T223620_reco_stage1_20250911T030000_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757559601.0,
"core.end_time": 1757559601.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39255
],
"core.runs_subruns": [
3925500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039255_1131_df-s02-d2_dw_0_20250830T223620.hdf5"
}
]
} 