Jobsub ID 37918.88@dunegpschedd02.fnal.gov
| Jobsub ID | 37918.88@dunegpschedd02.fnal.gov |
| Workflow ID | 2483 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-10 23:38:59 |
| Site | UK_Durham |
| Entry | DUNE_UK_SGridDurham_ce4 |
| Last heartbeat | 2025-09-11 03:00:20 |
| From worker node | Hostname | n246.dur.scotgrid.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-09-11 00:59:55 |
| Input files | vd-protodune:np02vd_raw_run039255_1324_df-s05-d3_dw_0_20250831T004019.hdf5
|
| Outputting started | 2025-09-11 03:00:20 |
| Output files | |
| Finished | 2025-09-11 03:21:10 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
nel 11347
wclsFrameSaver: no samples within desired window for channel 11348
wclsFrameSaver: no samples within desired window for channel 11348
wclsFrameSaver: no samples within desired window for channel 11349
wclsFrameSaver: no samples within desired window for channel 11349
wclsFrameSaver: no samples within desired window for channel 11350
wclsFrameSaver: no samples within desired window for channel 11350
wclsFrameSaver: no samples within desired window for channel 11351
wclsFrameSaver: no samples within desired window for channel 11352
wclsFrameSaver: no samples within desired window for channel 11352
wclsFrameSaver: no samples within desired window for channel 11953
wclsFrameSaver: no samples within desired window for channel 11954
wclsFrameSaver: no samples within desired window for channel 11954
wclsFrameSaver: no samples within desired window for channel 11954
wclsFrameSaver: no samples within desired window for channel 11955
wclsFrameSaver: no samples within desired window for channel 11956
wclsFrameSaver: no samples within desired window for channel 11956
wclsFrameSaver: no samples within desired window for channel 11986
wclsFrameSaver: no samples within desired window for channel 11986
wclsFrameSaver: no samples within desired window for channel 11987
wclsFrameSaver: no samples within desired window for channel 11987
wclsFrameSaver: no samples within desired window for channel 11988
wclsFrameSaver: no samples within desired window for channel 11988
wclsFrameSaver: no samples within desired window for channel 11988
wclsFrameSaver: no samples within desired window for channel 11989
wclsFrameSaver: no samples within desired window for channel 11989
wclsFrameSaver: no samples within desired window for channel 11990
wclsFrameSaver: no samples within desired window for channel 11990
wclsFrameSaver: no samples within desired window for channel 12058
wclsFrameSaver: no samples within desired window for channel 12094
wclsFrameSaver: no samples within desired window for channel 12094
wclsFrameSaver: no samples within desired window for channel 12095
wclsFrameSaver: no samples within desired window for channel 12096
wclsFrameSaver: no samples within desired window for channel 12096
wclsFrameSaver: no samples within desired window for channel 12097
wclsFrameSaver: no samples within desired window for channel 12097
FrameSaver: q=1.83163e+07 n=1558341 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 9361 XUs and 11274 XVs -> 744 XUVs
C:0 T:1 702 XUs and 1081 XVs -> 42 XUVs
C:0 T:2 1747 XUs and 2053 XVs -> 96 XUVs
C:0 T:3 122 XUs and 182 XVs -> 11 XUVs
C:0 T:4 274 XUs and 292 XVs -> 17 XUVs
C:0 T:5 1307 XUs and 1392 XVs -> 59 XUVs
C:0 T:6 348 XUs and 283 XVs -> 12 XUVs
C:0 T:7 130 XUs and 119 XVs -> 5 XUVs
C:0 T:8 21134 XUs and 31803 XVs -> 6111 XUVs
C:0 T:9 12478 XUs and 17664 XVs -> 2055 XUVs
C:0 T:10 14811 XUs and 40506 XVs -> 5464 XUVs
C:0 T:11 14286 XUs and 33615 XVs -> 4036 XUVs
C:0 T:12 17905 XUs and 40557 XVs -> 2574 XUVs
C:0 T:13 9824 XUs and 9820 XVs -> 1126 XUVs
C:0 T:14 5510 XUs and 7825 XVs -> 1456 XUVs
C:0 T:15 4494 XUs and 5210 XVs -> 219 XUVs
24027 XUVs total
3620 collection wire objects
24027 potential space points
Neighbour search...
3090515 tests to find 1302444 neighbours
Iterating with no regularization...
Begin: 1.00026e+10
0 9.51125e+09
1 9.49058e+09
2 9.48957e+09
Now with regularization...
Begin: 9.46095e+09
0 9.46041e+09
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
11-Sep-2025 03:59:58 BST Closed output file "np02vd_raw_run039255_1324_df-s05-d3_dw_0_20250831T004019_reco_stage1_20250911T025958_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 305.421 393.962 581.929 372.804 73.9457 18
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.2687e-05 0.00014391 0.000441646 0.000112333 8.15426e-05 18
produce:tpcrawdecoder:PDVDTPCReader 136.994 158.948 179.982 160.43 14.0097 18
produce:triggerrawdecoder:PDVDTriggerReader4 0.0607821 0.0753438 0.124978 0.072954 0.0164465 18
produce:pdvddaphne:DAPHNEReaderPDVD 11.4879 16.5318 22.1297 16.4257 2.36645 18
produce:ophit:OpHitFinder 0.0433565 0.0583761 0.0966809 0.0569686 0.0114613 18
produce:opflash:OpFlashFinderVerticalDrift 0.00630947 0.0134378 0.021113 0.0141906 0.00415262 18
produce:wclsdatavd:WireCellToolkit 73.6423 89.8218 119.78 86.8262 12.0226 18
produce:gaushit:GausHitFinder 1.02525 1.58026 2.0959 1.52642 0.329279 18
produce:nhitsfilter:NumberOfHitsFilter 0.000575359 0.00205974 0.00560806 0.00164998 0.0014066 18
produce:reco3d:SpacePointSolver 13.9374 20.4525 28.8578 20.7249 4.3225 18
produce:hitpdune:DisambigFromSpacePoints 0.213392 0.360063 0.641232 0.347149 0.112134 18
produce:pandora:StandardPandora 41.1195 96.9981 243.591 86.4789 50.0096 18
produce:pandoraTrack:LArPandoraTrackCreation 0.588988 3.52674 10.7803 3.03585 2.21301 18
produce:pandoraGnocalo:GnocchiCalorimetry 0.0255533 0.0483138 0.0710264 0.0497938 0.0129792 18
[art]:TriggerResults:TriggerResultInserter 2.7582e-05 7.05207e-05 0.000238271 4.8582e-05 5.55908e-05 18
end_path:out1:RootOutput 5.541e-06 1.56804e-05 5.7609e-05 1.2093e-05 1.18175e-05 18
end_path:out1:RootOutput(write) 4.86426 5.40228 6.41374 5.18815 0.455262 18
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5184.8 MB
Peak resident set size usage (VmHWM): 3283.42 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039255_1324_df-s05-d3_dw_0_20250831T004019_reco_stage1_20250911T025958_keepup.root
\tHists: np02vd_raw_run039255_1324_df-s05-d3_dw_0_20250831T004019_reco_stage1_20250911T025959_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039255_1324_df-s05-d3_dw_0_20250831T004019_reco_stage1_20250911T025958_keepup.root
Ran successfully
{
"name": "np02vd_raw_run039255_1324_df-s05-d3_dw_0_20250831T004019_reco_stage1_20250911T025958_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757559600.0,
"core.end_time": 1757559600.0,
"core.events": [
476650,
476670,
476690,
476710,
476730,
476750,
476770,
476790,
476810,
476830,
476850,
476870,
476890,
476910,
476930,
476950,
476970,
476990
],
"core.event_count": 18,
"core.first_event_number": 476650,
"core.last_event_number": 476990,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39255
],
"core.runs_subruns": [
3925500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039255_1324_df-s05-d3_dw_0_20250831T004019.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run039255_1324_df-s05-d3_dw_0_20250831T004019_reco_stage1_20250911T025959_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757559600.0,
"core.end_time": 1757559600.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39255
],
"core.runs_subruns": [
3925500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039255_1324_df-s05-d3_dw_0_20250831T004019.hdf5"
}
]
} 