Jobsub ID 297920.153@dunegpschedd02.fnal.gov
| Jobsub ID | 297920.153@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:54:27 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce05 |
| Last heartbeat | 2026-02-04 00:39:14 |
| From worker node | Hostname | dune001-1845413.0-lcg2708.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:43:13 |
| Input files | vd-protodune:np02vd_raw_run042433_0022_df-s03-d1_dw_0_20260203T185029.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 54m (3268s) |
| CPU time | 48m (2882s = 88%) |
| Max RSS bytes | 3350417408 (3195 MiB) |
| Outputting started | 2026-02-04 00:37:41 |
| Output files | |
| Finished | 2026-02-04 00:39:14 |
| Saved logs | justin-logs:297920.153-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
p space point ptr... 0x7c5c6080, 0x31104c10
Caught exception in looking up space point ptr... 0x58de6eb0, 0x58de7050
Caught exception in looking up space point ptr... 0x58de7050, 0x58de6eb0
Caught exception in looking up space point ptr... 0x2b076810, 0x2b0766c0
Caught exception in looking up space point ptr... 0x2b0766c0, 0x2b076810
Caught exception in looking up space point ptr... 0x592569d0, 0x59254bf0
Caught exception in looking up space point ptr... 0x59254bf0, 0x59255a90
Caught exception in looking up space point ptr... 0xa7601f40, 0x80e64160
Caught exception in looking up space point ptr... 0x80e64160, 0x80cfa8b0
Caught exception in looking up space point ptr... 0x30297e90, 0x2b053850
Caught exception in looking up space point ptr... 0x2b053850, 0x30297e90
Caught exception in looking up space point ptr... 0x8466d7a0, 0x8466ecd0
Caught exception in looking up space point ptr... 0x8466ecd0, 0x8466d7a0
Caught exception in looking up space point ptr... 0x3c296180, 0x3a3b7660
Caught exception in looking up space point ptr... 0x3a3b7660, 0x3c295ff0
Caught exception in looking up space point ptr... 0x33ec8570, 0x33ece350
Caught exception in looking up space point ptr... 0x33ed0020, 0x33ec8570
Caught exception in looking up space point ptr... 0x8b6005a0, 0x8b600450
Caught exception in looking up space point ptr... 0x8b600450, 0x8b6005a0
Caught exception in looking up space point ptr... 0x5a11edb0, 0x5a11ea80
Caught exception in looking up space point ptr... 0x5a11ea80, 0x5a11edb0
Caught exception in looking up space point ptr... 0x856d0a40, 0x856c7270
Caught exception in looking up space point ptr... 0x856c7270, 0x856d0a40
Caught exception in looking up space point ptr... 0x544b3b60, 0x544b2d90
Caught exception in looking up space point ptr... 0x544b2d90, 0x544b29d0
Caught exception in looking up space point ptr... 0x75b63e00, 0x75b64d70
Caught exception in looking up space point ptr... 0x75b64d70, 0x75b63e00
Caught exception in looking up space point ptr... 0x75b63e00, 0x75b60900
Caught exception in looking up space point ptr... 0x75b60900, 0x75b63e00
Caught exception in looking up space point ptr... 0x58c6e7d0, 0x2b07c570
Caught exception in looking up space point ptr... 0x2b07c570, 0x58c6e5d0
Caught exception in looking up space point ptr... 0x3b62c940, 0x2b008d10
Caught exception in looking up space point ptr... 0x2b008d10, 0x3b62c940
Caught exception in looking up space point ptr... 0x55a44270, 0xa7df8da0
Caught exception in looking up space point ptr... 0xa7df8da0, 0xa7df5140
Caught exception in looking up space point ptr... 0x54510950, 0x54510c70
Caught exception in looking up space point ptr... 0x54510c70, 0x54510950
Caught exception in looking up space point ptr... 0x37469280, 0x3579c510
Caught exception in looking up space point ptr... 0x3579c510, 0x37469280
Caught exception in looking up space point ptr... 0x37469280, 0x5475c0b0
Caught exception in looking up space point ptr... 0x5475c0b0, 0x37469280
Caught exception in looking up space point ptr... 0x62b312f0, 0x80ff7770
Caught exception in looking up space point ptr... 0x80ff7770, 0x6dbcf480
Caught exception in looking up space point ptr... 0x6b6bf800, 0x6b6a7540
Caught exception in looking up space point ptr... 0x6b6a7540, 0x6b6a73b0
Caught exception in looking up space point ptr... 0x6b6b8fd0, 0x6b6a7540
Caught exception in looking up space point ptr... 0x6b6a7540, 0x6b6bfc20
Caught exception in looking up space point ptr... 0x6b6bfc20, 0x6b6a7540
Caught exception in looking up space point ptr... 0x6b6a7540, 0x6b6bf800
Caught exception in looking up space point ptr... 0x4f9c1ca0, 0x7b36db60
Caught exception in looking up space point ptr... 0x3029dc40, 0x4f9c1ca0
Caught exception in looking up space point ptr... 0x5e7f4830, 0x5e7f3390
Caught exception in looking up space point ptr... 0x5e7f3390, 0x5e7f4830
Caught exception in looking up space point ptr... 0x364671d0, 0x36460ea0
Caught exception in looking up space point ptr... 0x36460ea0, 0x364671d0
Caught exception in looking up space point ptr... 0x311952d0, 0x31195430
Caught exception in looking up space point ptr... 0x31195430, 0x311952d0
Caught exception in looking up space point ptr... 0x628e6c60, 0x545376f0
Caught exception in looking up space point ptr... 0x545376f0, 0x628e6c60
Caught exception in looking up space point ptr... 0x4d4c33a0, 0x4d4e8410
Caught exception in looking up space point ptr... 0x4d4e8410, 0x4d4e8310
Caught exception in looking up space point ptr... 0x33edfca0, 0x33edf980
Caught exception in looking up space point ptr... 0x33edf980, 0x33edfca0
Caught exception in looking up space point ptr... 0x36475200, 0x36475570
Caught exception in looking up space point ptr... 0x36475570, 0x36475200
Caught exception in looking up space point ptr... 0x723472f0, 0x723470f0
Caught exception in looking up space point ptr... 0x723470f0, 0x72346ff0
++++>>>> total num hits: 116272, num free: 112662
04-Feb-2026 00:37:31 UTC Closed output file "np02vd_raw_run042433_0022_df-s03-d1_dw_0_20260203T185029_reco_stage0_20260204T003731_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 149.728 167.622 192.918 167.171 11.6292 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.4592e-05 0.000138432 0.00031264 0.000111158 5.83244e-05 19
produce:tpcrawdecoder:PDVDTPCReader 16.6416 20.3889 24.2402 21.0316 1.81138 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.687681 0.709292 0.734383 0.712657 0.0119881 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0231807 0.0233774 0.0239273 0.0233135 0.000189487 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0230937 0.0233355 0.0240459 0.0232722 0.000218793 19
produce:beamevent:BeamEvent 0.000113661 0.000304434 0.00115328 0.000196296 0.000292939 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.29695 3.66617 3.92951 3.73798 0.188181 19
produce:ophit:OpHitFinder 0.034091 0.0410337 0.0488243 0.0410815 0.00327746 19
produce:wclsdatavd:WireCellToolkit 98.3555 113.078 126.762 114.633 7.62053 19
produce:gaushit:GausHitFinder 0.857444 1.47518 2.1254 1.62753 0.435003 19
produce:nhitsfilter:NumberOfHitsFilter 0.000229134 0.000388158 0.000986225 0.000390728 0.00016154 19
produce:reco3d:SpacePointSolver 13.3749 19.6744 28.263 19.9254 3.52482 19
produce:hitpdune:DisambigFromSpacePoints 0.12956 0.210329 0.299113 0.200998 0.0523423 19
produce:cluster3d:Cluster3D 1.49862 2.74512 5.04673 2.54149 0.868977 19
[art]:TriggerResults:TriggerResultInserter 2.7942e-05 4.22242e-05 0.000143066 3.7527e-05 2.44529e-05 19
end_path:out1:RootOutput 6.45e-06 1.20098e-05 4.6951e-05 1.0767e-05 8.34262e-06 19
end_path:out1:RootOutput(write) 4.11953 5.52701 6.52533 5.91009 0.882103 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5685.23 MB
Peak resident set size usage (VmHWM): 3350.42 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0022_df-s03-d1_dw_0_20260203T185029_reco_stage0_20260204T003731_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0022_df-s03-d1_dw_0_20260203T185029_reco_stage0_20260204T003731_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0022_df-s03-d1_dw_0_20260203T185029_reco_stage0_20260204T003731_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162205.0,
"core.end_time": 1770165453.0,
"core.events": [
2517,
2523,
2529,
2535,
2541,
2547,
2553,
2559,
2565,
2571,
2577,
2583,
2589,
2595,
2601,
2607,
2613,
2619,
2625
],
"core.event_count": 19,
"core.first_event_number": 2517,
"core.last_event_number": 2625,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0022_df-s03-d1_dw_0_20260203T185029.hdf5"
}
]
} 