Jobsub ID 39330.25@dunegpschedd02.fnal.gov
| Jobsub ID | 39330.25@dunegpschedd02.fnal.gov |
| Workflow ID | 2576 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-13 15:24:17 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_klomp |
| Last heartbeat | 2025-09-13 18:16:02 |
| From worker node | Hostname | wn-sate-044.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7551P 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | aborted |
| Started | 2025-09-13 16:05:30 |
| Input files | vd-protodune:np02vd_raw_run039275_0088_df-s05-d3_dw_0_20250901T180408.hdf5
|
| Outputting started | 2025-09-13 18:14:16 |
| Output files | |
| Finished | 2025-09-13 18:16:02 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
fsp> EOS at call=35 with 8
[20:10:14.590] D [ glue ] frame sink sees EOS
[20:10:14.590] D [ pgraph ] <Pgrapher:> graph execution complete
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 18.54 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 14.92 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 12.6 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 11.87 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 11.69 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 10.78 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 10.27 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 9.96 sec
[20:10:14.590] I [ timer ] Timer: WireCell::Aux::Resampler : 1.28 sec
[20:10:14.590] I [ timer ] Timer: WireCell::Aux::Resampler : 1.26 sec
[20:10:14.590] I [ timer ] Timer: WireCell::Aux::Resampler : 1.26 sec
[20:10:14.590] I [ timer ] Timer: WireCell::Aux::Resampler : 1.22 sec
[20:10:14.590] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.03 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[20:10:14.590] I [ timer ] Timer: WireCell::Gen::Retagger : 0.01 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[20:10:14.590] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[20:10:14.590] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[20:10:14.590] I [ timer ] Timer: WireCell::Gen::FrameFanout : 0 sec
[20:10:14.590] I [ timer ] Timer: wcls::RawFrameSource : 0 sec
[20:10:14.590] I [ timer ] Timer: wcls::FrameSaver : 0 sec
[20:10:14.590] I [ timer ] Timer: Total node execution : 105.71000104770064 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 54405 traces tagged "gauss"
FrameSaver: q=1.0518e+07 n=1284504 tag=gauss
wclsFrameSaver: saving 67949 traces tagged "wiener"
FrameSaver: q=1.14088e+07 n=1236975 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 464 XUs and 754 XVs -> 17 XUVs
C:0 T:1 28 XUs and 30 XVs -> 0 XUVs
C:0 T:2 26 XUs and 37 XVs -> 0 XUVs
C:0 T:3 813 XUs and 962 XVs -> 19 XUVs
C:0 T:4 563 XUs and 498 XVs -> 36 XUVs
C:0 T:5 219 XUs and 191 XVs -> 2 XUVs
C:0 T:6 1560 XUs and 1539 XVs -> 79 XUVs
C:0 T:7 489 XUs and 475 XVs -> 25 XUVs
C:0 T:8 21015 XUs and 45672 XVs -> 6975 XUVs
C:0 T:9 18390 XUs and 38551 XVs -> 4116 XUVs
C:0 T:10 27725 XUs and 61587 XVs -> 12759 XUVs
C:0 T:11 3918 XUs and 2894 XVs -> 143 XUVs
C:0 T:12 7617 XUs and 10618 XVs -> 1677 XUVs
C:0 T:13 2251 XUs and 1901 XVs -> 125 XUVs
C:0 T:14 880 XUs and 1238 XVs -> 49 XUVs
C:0 T:15 3998 XUs and 6397 XVs -> 572 XUVs
26594 XUVs total
2612 collection wire objects
26594 potential space points
Neighbour search...
4825336 tests to find 1912326 neighbours
Iterating with no regularization...
Begin: 6.5466e+08
0 5.55222e+08
1 5.49117e+08
2 5.47866e+08
3 5.47442e+08
Now with regularization...
Begin: 5.34174e+08
0 5.33792e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
13-Sep-2025 20:14:05 CEST Closed output file "np02vd_raw_run039275_0088_df-s05-d3_dw_0_20250901T180408_reco_stage1_20250913T181405_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 277.308 425.553 878.75 402.241 146.128 18
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.7837e-05 0.000106134 0.000186369 0.00010134 2.5602e-05 18
produce:tpcrawdecoder:PDVDTPCReader 70.1188 98.651 136.933 97.5692 16.4211 18
produce:triggerrawdecoder:PDVDTriggerReader4 0.0348459 0.0452976 0.123641 0.0352829 0.0212997 18
produce:pdvddaphne:DAPHNEReaderPDVD 10.7945 14.559 21.1322 14.0291 2.44803 18
produce:ophit:OpHitFinder 0.0692611 0.08787 0.168158 0.0845642 0.0205255 18
produce:opflash:OpFlashFinderVerticalDrift 0.00976153 0.0195253 0.0403496 0.0191987 0.00638942 18
produce:wclsdatavd:WireCellToolkit 97.0348 109.593 146.869 107.645 12.0355 18
produce:gaushit:GausHitFinder 1.45008 2.37983 3.66597 2.24393 0.613809 18
produce:nhitsfilter:NumberOfHitsFilter 0.000334097 0.000534635 0.000949593 0.000504903 0.000150395 18
produce:reco3d:SpacePointSolver 10.3469 26.1799 46.5223 22.707 9.88501 18
produce:hitpdune:DisambigFromSpacePoints 0.153132 0.462758 0.987505 0.432114 0.199344 18
produce:pandora:StandardPandora 44.9449 162.978 521.771 139.054 121.381 18
produce:pandoraTrack:LArPandoraTrackCreation 1.03929 2.96801 6.05001 2.59269 1.42352 18
produce:pandoraGnocalo:GnocchiCalorimetry 0.031074 0.0568881 0.0826889 0.0556946 0.013436 18
[art]:TriggerResults:TriggerResultInserter 2.0819e-05 3.94792e-05 9.4698e-05 2.85085e-05 2.15862e-05 18
end_path:out1:RootOutput 4.669e-06 1.11071e-05 3.4164e-05 9.643e-06 6.15879e-06 18
end_path:out1:RootOutput(write) 6.81801 7.5139 8.22069 7.49358 0.385678 18
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5714.15 MB
Peak resident set size usage (VmHWM): 3824.06 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039275_0088_df-s05-d3_dw_0_20250901T180408_reco_stage1_20250913T181405_keepup.root
\tHists: np02vd_raw_run039275_0088_df-s05-d3_dw_0_20250901T180408_reco_stage1_20250913T181405_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039275_0088_df-s05-d3_dw_0_20250901T180408_reco_stage1_20250913T181405_keepup.root
Ran successfully
{
"name": "np02vd_raw_run039275_0088_df-s05-d3_dw_0_20250901T180408_reco_stage1_20250913T181405_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757787246.0,
"core.end_time": 1757787246.0,
"core.events": [
31697,
31717,
31737,
31757,
31777,
31797,
31817,
31837,
31857,
31877,
31897,
31917,
31937,
31957,
31977,
31997,
32017,
32037
],
"core.event_count": 18,
"core.first_event_number": 31697,
"core.last_event_number": 32037,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39275
],
"core.runs_subruns": [
3927500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039275_0088_df-s05-d3_dw_0_20250901T180408.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run039275_0088_df-s05-d3_dw_0_20250901T180408_reco_stage1_20250913T181405_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757787246.0,
"core.end_time": 1757787246.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39275
],
"core.runs_subruns": [
3927500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039275_0088_df-s05-d3_dw_0_20250901T180408.hdf5"
}
]
} 