Jobsub ID 41054.62@dunegpschedd02.fnal.gov
| Jobsub ID | 41054.62@dunegpschedd02.fnal.gov |
| Workflow ID | 2815 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2025-09-17 14:49:20 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce05 |
| Last heartbeat | 2025-09-17 17:18:38 |
| From worker node | Hostname | dune001-7808092.0-lcg2715.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-09-17 16:28:35 |
| Input files | vd-protodune:np02vd_raw_run039388_0460_df-s05-d2_dw_0_20250916T225304.hdf5
|
| Outputting started | 2025-09-17 17:11:07 |
| Output files | |
| Finished | 2025-09-17 18:10:49 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
w for channel 9871
wclsFrameSaver: no samples within desired window for channel 9871
wclsFrameSaver: no samples within desired window for channel 9872
wclsFrameSaver: no samples within desired window for channel 9872
wclsFrameSaver: no samples within desired window for channel 9875
wclsFrameSaver: no samples within desired window for channel 9876
wclsFrameSaver: no samples within desired window for channel 10055
wclsFrameSaver: no samples within desired window for channel 10056
wclsFrameSaver: no samples within desired window for channel 10262
wclsFrameSaver: no samples within desired window for channel 10271
wclsFrameSaver: no samples within desired window for channel 10296
wclsFrameSaver: no samples within desired window for channel 10489
wclsFrameSaver: no samples within desired window for channel 10489
wclsFrameSaver: no samples within desired window for channel 10489
wclsFrameSaver: no samples within desired window for channel 10519
wclsFrameSaver: no samples within desired window for channel 10521
wclsFrameSaver: no samples within desired window for channel 10521
wclsFrameSaver: no samples within desired window for channel 10522
wclsFrameSaver: no samples within desired window for channel 10523
wclsFrameSaver: no samples within desired window for channel 10584
wclsFrameSaver: no samples within desired window for channel 10825
wclsFrameSaver: no samples within desired window for channel 10831
wclsFrameSaver: no samples within desired window for channel 10962
wclsFrameSaver: no samples within desired window for channel 11005
wclsFrameSaver: no samples within desired window for channel 11083
wclsFrameSaver: no samples within desired window for channel 11529
wclsFrameSaver: no samples within desired window for channel 11530
wclsFrameSaver: no samples within desired window for channel 11565
wclsFrameSaver: no samples within desired window for channel 11565
wclsFrameSaver: no samples within desired window for channel 11566
wclsFrameSaver: no samples within desired window for channel 11566
wclsFrameSaver: no samples within desired window for channel 11567
wclsFrameSaver: no samples within desired window for channel 11569
wclsFrameSaver: no samples within desired window for channel 11835
wclsFrameSaver: no samples within desired window for channel 11835
wclsFrameSaver: no samples within desired window for channel 11836
wclsFrameSaver: no samples within desired window for channel 11837
wclsFrameSaver: no samples within desired window for channel 11838
wclsFrameSaver: no samples within desired window for channel 11838
FrameSaver: q=7.51865e+06 n=952391 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 812 XUs and 1142 XVs -> 34 XUVs
C:0 T:1 344 XUs and 290 XVs -> 9 XUVs
C:0 T:2 1201 XUs and 1563 XVs -> 71 XUVs
C:0 T:3 787 XUs and 754 XVs -> 19 XUVs
C:0 T:4 779 XUs and 834 XVs -> 33 XUVs
C:0 T:5 1883 XUs and 1215 XVs -> 72 XUVs
C:0 T:6 1647 XUs and 1360 XVs -> 62 XUVs
C:0 T:7 1922 XUs and 1354 XVs -> 108 XUVs
C:0 T:8 1301 XUs and 979 XVs -> 58 XUVs
C:0 T:9 595 XUs and 653 XVs -> 60 XUVs
C:0 T:10 889 XUs and 668 XVs -> 48 XUVs
C:0 T:11 560 XUs and 741 XVs -> 44 XUVs
C:0 T:12 2835 XUs and 2499 XVs -> 152 XUVs
C:0 T:13 4773 XUs and 3816 XVs -> 167 XUVs
C:0 T:14 961 XUs and 1161 XVs -> 75 XUVs
C:0 T:15 2569 XUs and 2118 XVs -> 100 XUVs
1112 XUVs total
985 collection wire objects
1112 potential space points
Neighbour search...
5402 tests to find 2772 neighbours
Iterating with no regularization...
Begin: 4.38515e+08
0 4.32165e+08
1 4.31466e+08
2 4.31463e+08
Now with regularization...
Begin: 4.2759e+08
0 4.2759e+08
17-Sep-2025 17:10:58 UTC Closed output file "np02vd_raw_run039388_0460_df-s05-d2_dw_0_20250916T225304_reco_stage1_20250917T171058_keepup.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 88.9124 130.449 186.224 126.765 21.9879 19
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.2108e-05 0.000102664 0.000239379 8.1382e-05 5.31676e-05 19
produce:tpcrawdecoder:PDVDTPCReader 14.7283 15.5121 20.8018 15.2239 1.26368 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.385897 0.389214 0.396986 0.388438 0.00306477 19
produce:pdvddaphne:DAPHNEReaderPDVD 0.000218799 0.000347354 0.000930437 0.000318488 0.000143241 19
produce:ophit:OpHitFinder 0.000138809 0.000331608 0.00127403 0.000244017 0.000263232 19
produce:opflash:OpFlashFinderVerticalDrift 3.9199e-05 8.21634e-05 0.000506821 5.7226e-05 0.000101269 19
produce:wclsdatavd:WireCellToolkit 47.1229 54.0173 61.0452 54.5787 3.70833 19
produce:gaushit:GausHitFinder 0.523551 1.0639 1.80756 1.00634 0.327288 19
produce:nhitsfilter:NumberOfHitsFilter 0.000142784 0.000250222 0.000439641 0.000221853 8.62958e-05 19
produce:reco3d:SpacePointSolver 6.80237 12.3846 18.8412 12.0894 3.15952 19
produce:hitpdune:DisambigFromSpacePoints 0.0599626 0.173045 0.296758 0.157321 0.0568179 19
produce:pandora:StandardPandora 14.8755 41.9943 92.3236 40.8223 18.7326 19
produce:pandoraTrack:LArPandoraTrackCreation 0.239938 0.848557 1.26066 0.857176 0.268132 19
produce:pandoraGnocalo:GnocchiCalorimetry 0.010873 0.0255521 0.0445103 0.0229485 0.0079274 19
[art]:TriggerResults:TriggerResultInserter 1.8107e-05 2.80527e-05 5.9259e-05 2.5298e-05 1.04745e-05 19
end_path:out1:RootOutput 4.176e-06 8.35926e-06 2.1062e-05 8.583e-06 3.82785e-06 19
end_path:out1:RootOutput(write) 3.4246 3.99252 5.16667 3.77224 0.539929 19
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5150.19 MB
Peak resident set size usage (VmHWM): 2716.39 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039388_0460_df-s05-d2_dw_0_20250916T225304_reco_stage1_20250917T171058_keepup.root
\tHists: np02vd_raw_run039388_0460_df-s05-d2_dw_0_20250916T225304_reco_stage1_20250917T171058_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039388_0460_df-s05-d2_dw_0_20250916T225304_reco_stage1_20250917T171058_keepup.root
Ran successfully
{
"name": "np02vd_raw_run039388_0460_df-s05-d2_dw_0_20250916T225304_reco_stage1_20250917T171058_keepup.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1758129058.0,
"core.end_time": 1758129058.0,
"core.events": [
35422,
35426,
35430,
35434,
35438,
35442,
35446,
35450,
35454,
35458,
35462,
35466,
35470,
35474,
35478,
35482,
35486,
35490,
35494
],
"core.event_count": 19,
"core.first_event_number": 35422,
"core.last_event_number": 35494,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39388
],
"core.runs_subruns": [
3938800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039388_0460_df-s05-d2_dw_0_20250916T225304.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np02vd_raw_run039388_0460_df-s05-d2_dw_0_20250916T225304_reco_stage1_20250917T171058_keepup_hists.root",
"namespace": "vd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_10_00d00",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
"dune.campaign": "vd-protodune-reco-keepup-v0",
"core.start_time": 1758129058.0,
"core.end_time": 1758129058.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39388
],
"core.runs_subruns": [
3938800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics"
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039388_0460_df-s05-d2_dw_0_20250916T225304.hdf5"
}
]
} 