Jobsub ID 46546.174@dunegpschedd01.fnal.gov
| Jobsub ID | 46546.174@dunegpschedd01.fnal.gov |
| Workflow ID | 2607 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-15 09:01:34 |
| Site | UK_Oxford |
| Entry | DUNE_UK_SGrid_Oxford_arc01 |
| Last heartbeat | 2025-09-15 13:03:55 |
| From worker node | Hostname | t2wn070.physics.ox.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-09-15 10:33:26 |
| Input files | vd-protodune:np02vd_raw_run039275_0311_df-s05-d3_dw_0_20250902T013839.hdf5
|
| Outputting started | 2025-09-15 12:24:33 |
| Output files | |
| Finished | 2025-09-15 14:10:59 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ndow for channel 9082
wclsFrameSaver: no samples within desired window for channel 9082
wclsFrameSaver: no samples within desired window for channel 9083
wclsFrameSaver: no samples within desired window for channel 9084
wclsFrameSaver: no samples within desired window for channel 9215
wclsFrameSaver: no samples within desired window for channel 9372
wclsFrameSaver: no samples within desired window for channel 9555
wclsFrameSaver: no samples within desired window for channel 9556
wclsFrameSaver: no samples within desired window for channel 9557
wclsFrameSaver: no samples within desired window for channel 9557
wclsFrameSaver: no samples within desired window for channel 9893
wclsFrameSaver: no samples within desired window for channel 9893
wclsFrameSaver: no samples within desired window for channel 9975
wclsFrameSaver: no samples within desired window for channel 9977
wclsFrameSaver: no samples within desired window for channel 10374
wclsFrameSaver: no samples within desired window for channel 10588
wclsFrameSaver: no samples within desired window for channel 10589
wclsFrameSaver: no samples within desired window for channel 10652
wclsFrameSaver: no samples within desired window for channel 10810
wclsFrameSaver: no samples within desired window for channel 10812
wclsFrameSaver: no samples within desired window for channel 10859
wclsFrameSaver: no samples within desired window for channel 10860
wclsFrameSaver: no samples within desired window for channel 10861
wclsFrameSaver: no samples within desired window for channel 10862
wclsFrameSaver: no samples within desired window for channel 11012
wclsFrameSaver: no samples within desired window for channel 11015
wclsFrameSaver: no samples within desired window for channel 11433
wclsFrameSaver: no samples within desired window for channel 11436
wclsFrameSaver: no samples within desired window for channel 11902
wclsFrameSaver: no samples within desired window for channel 11902
wclsFrameSaver: no samples within desired window for channel 11902
wclsFrameSaver: no samples within desired window for channel 12241
wclsFrameSaver: no samples within desired window for channel 12242
wclsFrameSaver: no samples within desired window for channel 12244
wclsFrameSaver: no samples within desired window for channel 12244
wclsFrameSaver: no samples within desired window for channel 12244
FrameSaver: q=1.10422e+07 n=1260694 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 95 XUs and 101 XVs -> 5 XUVs
C:0 T:1 365 XUs and 359 XVs -> 17 XUVs
C:0 T:2 237 XUs and 210 XVs -> 15 XUVs
C:0 T:3 1102 XUs and 1221 XVs -> 44 XUVs
C:0 T:4 613 XUs and 665 XVs -> 28 XUVs
C:0 T:5 637 XUs and 728 XVs -> 20 XUVs
C:0 T:6 1607 XUs and 1283 XVs -> 87 XUVs
C:0 T:7 539 XUs and 542 XVs -> 29 XUVs
C:0 T:8 19300 XUs and 46021 XVs -> 5025 XUVs
C:0 T:9 7541 XUs and 12668 XVs -> 1753 XUVs
C:0 T:10 2462 XUs and 2039 XVs -> 105 XUVs
C:0 T:11 2681 XUs and 2545 XVs -> 119 XUVs
C:0 T:12 987 XUs and 1498 XVs -> 92 XUVs
C:0 T:13 9747 XUs and 13254 XVs -> 1766 XUVs
C:0 T:14 9127 XUs and 13494 XVs -> 1039 XUVs
C:0 T:15 13915 XUs and 19814 XVs -> 3282 XUVs
13426 XUVs total
2184 collection wire objects
13426 potential space points
Neighbour search...
1428476 tests to find 631902 neighbours
Iterating with no regularization...
Begin: 5.95506e+08
0 5.13054e+08
1 5.06416e+08
2 5.05159e+08
3 5.04737e+08
Now with regularization...
Begin: 4.91363e+08
0 4.91051e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
15-Sep-2025 13:24:18 BST Closed output file "np02vd_raw_run039275_0311_df-s05-d3_dw_0_20250902T013839_reco_stage1_20250915T122418_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 243.452 362.368 570.69 337.434 100.252 18
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.0662e-05 0.000379287 0.00432254 0.000148363 0.000958117 18
produce:tpcrawdecoder:PDVDTPCReader 66.2214 89.3225 110.788 86.7621 11.0785 18
produce:triggerrawdecoder:PDVDTriggerReader4 0.0369476 0.0412739 0.0538064 0.0377307 0.00611224 18
produce:pdvddaphne:DAPHNEReaderPDVD 8.524 11.7894 15.0639 11.5629 1.67682 18
produce:ophit:OpHitFinder 0.0634405 0.0835546 0.104602 0.083857 0.00990287 18
produce:opflash:OpFlashFinderVerticalDrift 0.0143664 0.0208665 0.0358211 0.0199501 0.00477216 18
produce:wclsdatavd:WireCellToolkit 86.6186 97.7744 117.792 96.7947 8.09626 18
produce:gaushit:GausHitFinder 1.28584 2.08858 3.44749 1.93544 0.576938 18
produce:nhitsfilter:NumberOfHitsFilter 0.000335809 0.000533928 0.000947986 0.000484964 0.000179839 18
produce:reco3d:SpacePointSolver 11.8317 23.0798 40.0018 23.4814 7.76277 18
produce:hitpdune:DisambigFromSpacePoints 0.128667 0.408986 0.865031 0.401724 0.20921 18
produce:pandora:StandardPandora 33.287 128.549 307.778 100.859 86.8843 18
produce:pandoraTrack:LArPandoraTrackCreation 0.838881 1.86096 3.95446 1.75481 0.821333 18
produce:pandoraGnocalo:GnocchiCalorimetry 0.0238731 0.0503176 0.0931913 0.047319 0.0170713 18
[art]:TriggerResults:TriggerResultInserter 3.6278e-05 6.58106e-05 0.000180208 5.6506e-05 3.1566e-05 18
end_path:out1:RootOutput 5.04e-06 1.44766e-05 5.361e-05 1.319e-05 1.02769e-05 18
end_path:out1:RootOutput(write) 5.40665 7.21802 8.4337 7.1523 0.74364 18
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5169.04 MB
Peak resident set size usage (VmHWM): 3092.95 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039275_0311_df-s05-d3_dw_0_20250902T013839_reco_stage1_20250915T122418_keepup.root
\tHists: np02vd_raw_run039275_0311_df-s05-d3_dw_0_20250902T013839_reco_stage1_20250915T122418_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039275_0311_df-s05-d3_dw_0_20250902T013839_reco_stage1_20250915T122418_keepup.root
Ran successfully
{
"name": "np02vd_raw_run039275_0311_df-s05-d3_dw_0_20250902T013839_reco_stage1_20250915T122418_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757939059.0,
"core.end_time": 1757939059.0,
"core.events": [
111977,
111997,
112017,
112037,
112057,
112077,
112097,
112117,
112137,
112157,
112177,
112197,
112217,
112237,
112257,
112277,
112297,
112317
],
"core.event_count": 18,
"core.first_event_number": 111977,
"core.last_event_number": 112317,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39275
],
"core.runs_subruns": [
3927500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039275_0311_df-s05-d3_dw_0_20250902T013839.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run039275_0311_df-s05-d3_dw_0_20250902T013839_reco_stage1_20250915T122418_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1757939059.0,
"core.end_time": 1757939059.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39275
],
"core.runs_subruns": [
3927500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039275_0311_df-s05-d3_dw_0_20250902T013839.hdf5"
}
]
} 