Jobsub ID 234439.34@dunegpschedd02.fnal.gov
| Jobsub ID | 234439.34@dunegpschedd02.fnal.gov |
| Workflow ID | 9410 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-10-29 08:08:18 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2025-10-29 12:07:22 |
| From worker node | Hostname | dune002-68704.0-lcg2517.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | aborted |
| Started | 2025-10-29 08:33:56 |
| Input files | vd-protodune:np02vd_raw_run040267_0504_df-s04-d0_dw_0_20251026T083920.hdf5
|
| Outputting started | 2025-10-29 11:54:04 |
| Output files | |
| Finished | 2025-10-29 12:07:22 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
anin:nfsp> EOS at call=47 with 8
[11:52:19.376] D [ glue ] frame sink sees EOS
[11:52:19.376] D [ pgraph ] <Pgrapher:> graph execution complete
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 19.9 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 13.08 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 12.82 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 12.7 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 12.19 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 12.09 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 12.08 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::OmnibusSigProc : 11.1 sec
[11:52:19.376] I [ timer ] Timer: WireCell::Aux::Resampler : 0.77 sec
[11:52:19.376] I [ timer ] Timer: WireCell::Aux::Resampler : 0.74 sec
[11:52:19.376] I [ timer ] Timer: WireCell::Aux::Resampler : 0.73 sec
[11:52:19.376] I [ timer ] Timer: WireCell::Aux::Resampler : 0.67 sec
[11:52:19.376] I [ timer ] Timer: WireCell::Gen::FrameFanin : 0.04 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.02 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[11:52:19.376] I [ timer ] Timer: WireCell::Gen::Retagger : 0.01 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[11:52:19.376] I [ timer ] Timer: WireCell::Gen::DumpFrames : 0 sec
[11:52:19.376] I [ timer ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[11:52:19.376] I [ timer ] Timer: WireCell::Gen::FrameFanout : 0 sec
[11:52:19.376] I [ timer ] Timer: wcls::RawFrameSource : 0 sec
[11:52:19.376] I [ timer ] Timer: wcls::FrameSaver : 0 sec
[11:52:19.376] I [ timer ] Timer: Total node execution : 108.95999910868704 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 49442 traces tagged "gauss"
FrameSaver: q=1.66988e+07 n=1094921 tag=gauss
wclsFrameSaver: saving 64539 traces tagged "wiener"
FrameSaver: q=1.80061e+07 n=1042257 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1806 XUs and 1979 XVs -> 173 XUVs
C:0 T:1 2757 XUs and 2350 XVs -> 120 XUVs
C:0 T:2 3193 XUs and 2759 XVs -> 236 XUVs
C:0 T:3 29785 XUs and 44175 XVs -> 2193 XUVs
C:0 T:4 721 XUs and 745 XVs -> 20 XUVs
C:0 T:5 1394 XUs and 1659 XVs -> 66 XUVs
C:0 T:6 355 XUs and 433 XVs -> 11 XUVs
C:0 T:7 796 XUs and 1199 XVs -> 47 XUVs
C:0 T:8 2480 XUs and 4582 XVs -> 884 XUVs
C:0 T:9 1527 XUs and 2781 XVs -> 419 XUVs
C:0 T:10 1299 XUs and 1715 XVs -> 241 XUVs
C:0 T:11 648 XUs and 830 XVs -> 84 XUVs
C:0 T:12 3833 XUs and 5434 XVs -> 1135 XUVs
C:0 T:13 3266 XUs and 5606 XVs -> 1190 XUVs
C:0 T:14 2088 XUs and 3839 XVs -> 889 XUVs
C:0 T:15 1208 XUs and 1373 XVs -> 39 XUVs
7747 XUVs total
2640 collection wire objects
7747 potential space points
Neighbour search...
521351 tests to find 252302 neighbours
Iterating with no regularization...
Begin: 6.99775e+10
0 6.62746e+10
1 6.61416e+10
2 6.61393e+10
Now with regularization...
Begin: 6.5803e+10
0 6.58019e+10
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
29-Oct-2025 11:53:46 UTC Closed output file "np02vd_raw_run040267_0504_df-s04-d0_dw_0_20251026T083920_reco_stage1_20251029T115346_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 156.789 495.892 3713.87 191.732 787.066 24
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.6161e-05 0.000155643 0.000357386 0.000134723 6.50598e-05 24
produce:tpcrawdecoder:PDVDTPCReader 17.7624 19.725 25.6912 19.0468 1.94789 24
produce:triggerrawdecoder:PDVDTriggerReader4 0.389807 0.401756 0.449553 0.397457 0.0127526 24
produce:pdvddaphne:DAPHNEReaderPDVD 0.000453378 0.000713418 0.00145268 0.000542025 0.000338554 24
produce:ophit:OpHitFinder 8.7532e-05 0.000279765 0.00223222 0.000145147 0.000436953 24
produce:opflash:OpFlashFinderVerticalDrift 6.2642e-05 0.000138562 0.00100289 8.5371e-05 0.000184367 24
produce:wclsdatavd:WireCellToolkit 75.7915 120.436 281.385 91.7971 53.9979 24
produce:gaushit:GausHitFinder 1.54531 3.11628 11.67 2.06177 2.73772 24
produce:nhitsfilter:NumberOfHitsFilter 0.000347716 0.000528911 0.00102674 0.000449598 0.000164735 24
produce:reco3d:SpacePointSolver 12.0769 23.4124 60.4087 19.3271 12.0972 24
produce:hitpdune:DisambigFromSpacePoints 0.18017 0.40017 1.23291 0.329141 0.252357 24
produce:pandora:StandardPandora 27.0301 318.09 3376.41 44.4517 732.726 24
produce:pandoraTrack:LArPandoraTrackCreation 0.965476 2.97655 8.73971 2.27507 2.01622 24
produce:pandoraGnocalo:GnocchiCalorimetry 0.0393328 0.0693055 0.148223 0.0667143 0.0203486 24
[art]:TriggerResults:TriggerResultInserter 3.6611e-05 8.38603e-05 0.000180093 8.16265e-05 2.71298e-05 24
end_path:out1:RootOutput 5.08e-06 1.98149e-05 5.1181e-05 1.90955e-05 1.02928e-05 24
end_path:out1:RootOutput(write) 6.19939 7.15573 9.64914 6.90177 0.855327 24
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 8272.22 MB
Peak resident set size usage (VmHWM): 6197.35 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run040267_0504_df-s04-d0_dw_0_20251026T083920_reco_stage1_20251029T115346_keepup.root
\tHists: np02vd_raw_run040267_0504_df-s04-d0_dw_0_20251026T083920_reco_stage1_20251029T115346_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run040267_0504_df-s04-d0_dw_0_20251026T083920_reco_stage1_20251029T115346_keepup.root
Ran successfully
{
"name": "np02vd_raw_run040267_0504_df-s04-d0_dw_0_20251026T083920_reco_stage1_20251029T115346_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_11_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1761738828.0,
"core.end_time": 1761738828.0,
"core.events": [
93340,
93348,
93356,
93364,
93372,
93380,
93388,
93396,
93404,
93412,
93420,
93428,
93436,
93444,
93452,
93460,
93468,
93476,
93484,
93492,
93500,
93508,
93516,
93524
],
"core.event_count": 24,
"core.first_event_number": 93340,
"core.last_event_number": 93524,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
40267
],
"core.runs_subruns": [
4026700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run040267_0504_df-s04-d0_dw_0_20251026T083920.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run040267_0504_df-s04-d0_dw_0_20251026T083920_reco_stage1_20251029T115346_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_11_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1761738828.0,
"core.end_time": 1761738828.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
40267
],
"core.runs_subruns": [
4026700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run040267_0504_df-s04-d0_dw_0_20251026T083920.hdf5"
}
]
} 