Jobsub ID 47593.47@dunegpschedd01.fnal.gov
Jobsub ID | 47593.47@dunegpschedd01.fnal.gov |
Workflow ID | 2815 |
Stage ID | 1 |
User name | ykermaid@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
GPU | No |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2025-09-17 14:47:21 |
Site | UK_RAL-Tier1 |
Entry | LIGO_UK_RAL_arc_ce04 |
Last heartbeat | 2025-09-17 17:21:23 |
From worker node | Hostname | dune001-7747058.0-lcg2480.gridpp.rl.ac.uk |
cpuinfo | AMD EPYC 7452 32-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4194304000 (4000 MiB) |
Wall seconds limit | 216000 (60 hours) |
GPU | |
Inner Apptainer? | True |
Job state | stalled |
Started | 2025-09-17 15:01:16 |
Input files | vd-protodune:np02vd_raw_run039388_0374_df-s05-d1_dw_0_20250916T210437.hdf5
|
Outputting started | 2025-09-17 16:39:59 |
Output files | |
Finished | 2025-09-17 18:10:49 |
List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
aver: no samples within desired window for channel 10313
wclsFrameSaver: no samples within desired window for channel 10313
wclsFrameSaver: no samples within desired window for channel 10313
wclsFrameSaver: no samples within desired window for channel 10314
wclsFrameSaver: no samples within desired window for channel 10483
wclsFrameSaver: no samples within desired window for channel 10542
wclsFrameSaver: no samples within desired window for channel 10918
wclsFrameSaver: no samples within desired window for channel 11176
wclsFrameSaver: no samples within desired window for channel 11179
wclsFrameSaver: no samples within desired window for channel 11180
wclsFrameSaver: no samples within desired window for channel 11180
wclsFrameSaver: no samples within desired window for channel 11181
wclsFrameSaver: no samples within desired window for channel 11357
wclsFrameSaver: no samples within desired window for channel 11357
wclsFrameSaver: no samples within desired window for channel 11358
wclsFrameSaver: no samples within desired window for channel 11359
wclsFrameSaver: no samples within desired window for channel 11359
wclsFrameSaver: no samples within desired window for channel 11360
wclsFrameSaver: no samples within desired window for channel 11360
wclsFrameSaver: no samples within desired window for channel 11361
wclsFrameSaver: no samples within desired window for channel 11361
wclsFrameSaver: no samples within desired window for channel 11362
wclsFrameSaver: no samples within desired window for channel 11362
wclsFrameSaver: no samples within desired window for channel 11363
wclsFrameSaver: no samples within desired window for channel 11363
wclsFrameSaver: no samples within desired window for channel 11370
wclsFrameSaver: no samples within desired window for channel 11704
wclsFrameSaver: no samples within desired window for channel 11705
wclsFrameSaver: no samples within desired window for channel 11706
wclsFrameSaver: no samples within desired window for channel 11706
wclsFrameSaver: no samples within desired window for channel 11998
wclsFrameSaver: no samples within desired window for channel 11998
wclsFrameSaver: no samples within desired window for channel 11999
wclsFrameSaver: no samples within desired window for channel 11999
wclsFrameSaver: no samples within desired window for channel 11999
wclsFrameSaver: no samples within desired window for channel 12000
wclsFrameSaver: no samples within desired window for channel 12002
FrameSaver: q=9.95058e+06 n=1149643 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 487 XUs and 616 XVs -> 38 XUVs
C:0 T:1 689 XUs and 752 XVs -> 23 XUVs
C:0 T:2 884 XUs and 1034 XVs -> 34 XUVs
C:0 T:3 1122 XUs and 1089 XVs -> 43 XUVs
C:0 T:4 1024 XUs and 1326 XVs -> 78 XUVs
C:0 T:5 1103 XUs and 1318 XVs -> 60 XUVs
C:0 T:6 2037 XUs and 2187 XVs -> 88 XUVs
C:0 T:7 435 XUs and 432 XVs -> 30 XUVs
C:0 T:8 680 XUs and 1399 XVs -> 77 XUVs
C:0 T:9 1848 XUs and 2275 XVs -> 97 XUVs
C:0 T:10 1033 XUs and 1328 XVs -> 76 XUVs
C:0 T:11 2601 XUs and 3420 XVs -> 196 XUVs
C:0 T:12 1813 XUs and 2210 XVs -> 108 XUVs
C:0 T:13 2703 XUs and 3317 XVs -> 171 XUVs
C:0 T:14 4388 XUs and 5016 XVs -> 215 XUVs
C:0 T:15 4747 XUs and 4101 XVs -> 170 XUVs
1504 XUVs total
1272 collection wire objects
1504 potential space points
Neighbour search...
10738 tests to find 5638 neighbours
Iterating with no regularization...
Begin: 5.1292e+08
0 5.05535e+08
1 5.05032e+08
Now with regularization...
Begin: 4.97473e+08
0 4.97459e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
17-Sep-2025 16:39:45 UTC Closed output file "np02vd_raw_run039388_0374_df-s05-d1_dw_0_20250916T210437_reco_stage1_20250917T163945_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 64.5418 291.253 396.233 295.663 77.6157 20
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.8165e-05 0.000157876 0.000380247 0.000120046 8.66955e-05 20
produce:tpcrawdecoder:PDVDTPCReader 28.8315 111.582 160.483 113.029 30.2082 20
produce:triggerrawdecoder:PDVDTriggerReader4 0.307914 0.400908 0.579622 0.362078 0.0875626 20
produce:pdvddaphne:DAPHNEReaderPDVD 0.000302831 0.000438778 0.000968626 0.000412823 0.000137601 20
produce:ophit:OpHitFinder 0.000170261 0.000604843 0.0033488 0.000287346 0.000810935 20
produce:opflash:OpFlashFinderVerticalDrift 5.4142e-05 0.000103811 0.000532453 7.72e-05 0.00010055 20
produce:wclsdatavd:WireCellToolkit 27.8757 78.6567 97.9476 77.2226 14.8534 20
produce:gaushit:GausHitFinder 0.905025 1.64623 2.55091 1.61075 0.410606 20
produce:nhitsfilter:NumberOfHitsFilter 0.000162547 0.000530631 0.00211621 0.000428237 0.000390789 20
produce:reco3d:SpacePointSolver 1.79073 16.3046 31.8575 16.7656 6.30868 20
produce:hitpdune:DisambigFromSpacePoints 0.0311437 0.248809 0.5019 0.24866 0.100521 20
produce:pandora:StandardPandora 2.7538 74.6301 178.56 61.6489 42.7627 20
produce:pandoraTrack:LArPandoraTrackCreation 0.172766 1.66235 3.57483 1.4071 0.87717 20
produce:pandoraGnocalo:GnocchiCalorimetry 0.0119737 0.0455458 0.0811037 0.0440377 0.0148631 20
[art]:TriggerResults:TriggerResultInserter 2.7532e-05 7.06697e-05 0.00018595 6.77575e-05 3.15804e-05 20
end_path:out1:RootOutput 8.997e-06 1.43896e-05 4.0286e-05 1.25585e-05 6.79662e-06 20
end_path:out1:RootOutput(write) 1.53255 6.0063 6.90811 6.19652 1.07791 20
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4772.77 MB
Peak resident set size usage (VmHWM): 2730.05 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039388_0374_df-s05-d1_dw_0_20250916T210437_reco_stage1_20250917T163945_keepup.root
\tHists: np02vd_raw_run039388_0374_df-s05-d1_dw_0_20250916T210437_reco_stage1_20250917T163946_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039388_0374_df-s05-d1_dw_0_20250916T210437_reco_stage1_20250917T163945_keepup.root
Ran successfully
{
"name": "np02vd_raw_run039388_0374_df-s05-d1_dw_0_20250916T210437_reco_stage1_20250917T163945_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1758127186.0,
"core.end_time": 1758127186.0,
"core.events": [
28813,
28817,
28821,
28825,
28829,
28833,
28837,
28841,
28845,
28849,
28853,
28857,
28861,
28865,
28869,
28873,
28877,
28881,
28885,
28889
],
"core.event_count": 20,
"core.first_event_number": 28813,
"core.last_event_number": 28889,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39388
],
"core.runs_subruns": [
3938800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039388_0374_df-s05-d1_dw_0_20250916T210437.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run039388_0374_df-s05-d1_dw_0_20250916T210437_reco_stage1_20250917T163946_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1758127186.0,
"core.end_time": 1758127186.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39388
],
"core.runs_subruns": [
3938800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039388_0374_df-s05-d1_dw_0_20250916T210437.hdf5"
}
]
}