Jobsub ID 303656.9@dunegpschedd01.fnal.gov
| Jobsub ID | 303656.9@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:56:25 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 01:09:24 |
| From worker node | Hostname | dune002-1603975.0-lcg2717.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:11:16 |
| Input files | vd-protodune:np02vd_raw_run042421_0147_df-s04-d0_dw_0_20260203T145031.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 56m (3367s) |
| CPU time | 49m (2945s = 87%) |
| Max RSS bytes | 3714293760 (3542 MiB) |
| Outputting started | 2026-02-04 01:07:25 |
| Output files | |
| Finished | 2026-02-04 01:09:24 |
| Saved logs | justin-logs:303656.9-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x5870e4e0, 0x56c6cf50
Caught exception in looking up space point ptr... 0x589a60e0, 0x7f32c2d0
Caught exception in looking up space point ptr... 0x7f32c2d0, 0x7f32c560
Caught exception in looking up space point ptr... 0x64bb69b0, 0xa36a2520
Caught exception in looking up space point ptr... 0xa36a2520, 0x64bb69b0
Caught exception in looking up space point ptr... 0x8613da30, 0x8613e6f0
Caught exception in looking up space point ptr... 0x8613e6f0, 0x8613da30
Caught exception in looking up space point ptr... 0x8613da30, 0x86144440
Caught exception in looking up space point ptr... 0x86144440, 0x8613da30
Caught exception in looking up space point ptr... 0x8eec4f90, 0x696eaf50
Caught exception in looking up space point ptr... 0x696eaf50, 0x8eec5120
Caught exception in looking up space point ptr... 0x64b499f0, 0x5f537320
Caught exception in looking up space point ptr... 0x5f537320, 0x64b499f0
Caught exception in looking up space point ptr... 0x760e4b40, 0x63b685f0
Caught exception in looking up space point ptr... 0x63b685f0, 0x63b67490
Caught exception in looking up space point ptr... 0x78403c70, 0x698d7db0
Caught exception in looking up space point ptr... 0x698d7db0, 0x78403c70
Caught exception in looking up space point ptr... 0x6d78aa60, 0x6d78a6a0
Caught exception in looking up space point ptr... 0x6d78a6a0, 0x6d78aa60
Caught exception in looking up space point ptr... 0x845580d0, 0x56443370
Caught exception in looking up space point ptr... 0x5647d510, 0x845580d0
Caught exception in looking up space point ptr... 0x5ce724d0, 0x46a6ff00
Caught exception in looking up space point ptr... 0x46a6ff00, 0x6d60b7d0
Caught exception in looking up space point ptr... 0x3f9db4a0, 0x3f9db150
Caught exception in looking up space point ptr... 0x3f9db150, 0x3f9db4a0
Caught exception in looking up space point ptr... 0x69986940, 0x6e614150
Caught exception in looking up space point ptr... 0x6e614150, 0x5fb62ec0
Caught exception in looking up space point ptr... 0x69b3f200, 0x69b425a0
Caught exception in looking up space point ptr... 0x69b425a0, 0x69b3f200
Caught exception in looking up space point ptr... 0x76da72c0, 0x3a52c480
Caught exception in looking up space point ptr... 0x3a52c480, 0x76da72c0
Caught exception in looking up space point ptr... 0x674af260, 0x5dbdc100
Caught exception in looking up space point ptr... 0x5dbdc100, 0x674af260
Caught exception in looking up space point ptr... 0x69bf9e70, 0x69bfbb10
Caught exception in looking up space point ptr... 0x69bfbb10, 0x69bf95a0
Caught exception in looking up space point ptr... 0x69abc860, 0x760fcaa0
Caught exception in looking up space point ptr... 0x760fcaa0, 0x69abc860
Caught exception in looking up space point ptr... 0x84145960, 0x84145810
Caught exception in looking up space point ptr... 0x84145810, 0x84145960
Caught exception in looking up space point ptr... 0x644ba470, 0x945a4c10
Caught exception in looking up space point ptr... 0x945a4c10, 0x7bbe8020
Caught exception in looking up space point ptr... 0x41e1ec60, 0x41e1ef80
Caught exception in looking up space point ptr... 0x41e1ef80, 0x41e1f2a0
Caught exception in looking up space point ptr... 0x46ff49f0, 0x46ff4f70
Caught exception in looking up space point ptr... 0x46ff4f70, 0x439244d0
Caught exception in looking up space point ptr... 0x6669e8e0, 0x8b9b16d0
Caught exception in looking up space point ptr... 0x8b9b16d0, 0x6669efc0
Caught exception in looking up space point ptr... 0x5d274e40, 0x5d274fe0
Caught exception in looking up space point ptr... 0x5d274fe0, 0x5d274e40
Caught exception in looking up space point ptr... 0x5c8c0260, 0x5c8bfdb0
Caught exception in looking up space point ptr... 0x5c8bfdb0, 0x5c8c0260
Caught exception in looking up space point ptr... 0x85f13310, 0x79814be0
Caught exception in looking up space point ptr... 0x85f13940, 0x85f13310
Caught exception in looking up space point ptr... 0x64bd1290, 0x5fb7a2b0
Caught exception in looking up space point ptr... 0x5fb7a2b0, 0x64bd1290
Caught exception in looking up space point ptr... 0x64bd1290, 0x61255020
Caught exception in looking up space point ptr... 0x61255020, 0x64bd1290
Caught exception in looking up space point ptr... 0x6e139640, 0x43924860
Caught exception in looking up space point ptr... 0x43924860, 0x6e139640
Caught exception in looking up space point ptr... 0x53df8310, 0x5f47c6b0
Caught exception in looking up space point ptr... 0x5f47c6b0, 0x53df8310
Caught exception in looking up space point ptr... 0x6d572220, 0x8265b480
Caught exception in looking up space point ptr... 0x8265b480, 0x6d572220
Caught exception in looking up space point ptr... 0x61dc3e30, 0x6496fe70
Caught exception in looking up space point ptr... 0x6496fe70, 0x61dc3e30
++++>>>> total num hits: 58872, num free: 55868
04-Feb-2026 01:07:15 UTC Closed output file "np02vd_raw_run042421_0147_df-s04-d0_dw_0_20260203T145031_reco_stage0_20260204T010715_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 79.1769 121.726 311.087 101.429 57.2979 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.976e-05 0.000130496 0.000281152 0.000104787 5.82116e-05 27
produce:tpcrawdecoder:PDVDTPCReader 13.7084 15.0361 36.2123 14.2137 4.15934 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.69098 0.711861 0.785981 0.708859 0.0181395 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0228986 0.0231823 0.0236974 0.0231531 0.000177446 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.113238 0.115273 0.136972 0.114539 0.00428824 27
produce:beamevent:BeamEvent 0.000116034 0.000201773 0.0013082 0.00016658 0.000218441 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.07089 3.50943 3.82639 3.55086 0.222606 27
produce:ophit:OpHitFinder 0.0299111 0.040371 0.0465905 0.0406669 0.00356201 27
produce:wclsdatavd:WireCellToolkit 49.261 65.9645 73.4044 68.2191 7.24092 27
produce:gaushit:GausHitFinder 0.349215 1.45694 10.501 0.907231 1.89291 27
produce:nhitsfilter:NumberOfHitsFilter 0.000116275 0.000245272 0.000490527 0.000231257 8.85149e-05 27
produce:reco3d:SpacePointSolver 3.08183 8.6721 19.3609 6.94123 4.097 27
produce:hitpdune:DisambigFromSpacePoints 0.0283826 0.137741 0.572275 0.0853336 0.130802 27
produce:cluster3d:Cluster3D 0.524239 21.925 191.66 1.41777 49.3639 27
[art]:TriggerResults:TriggerResultInserter 1.9068e-05 3.76449e-05 0.000108253 3.3229e-05 1.7473e-05 27
end_path:out1:RootOutput 5.658e-06 1.09483e-05 4.7281e-05 9.654e-06 7.59237e-06 27
end_path:out1:RootOutput(write) 2.62019 4.09878 8.59296 3.94559 1.50867 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6104.23 MB
Peak resident set size usage (VmHWM): 3714.29 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0147_df-s04-d0_dw_0_20260203T145031_reco_stage0_20260204T010715_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0147_df-s04-d0_dw_0_20260203T145031_reco_stage0_20260204T010715_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0147_df-s04-d0_dw_0_20260203T145031_reco_stage0_20260204T010715_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163886.0,
"core.end_time": 1770167237.0,
"core.events": [
23884,
23890,
23896,
23902,
23908,
23914,
23920,
23926,
23932,
23938,
23944,
23950,
23956,
23962,
23968,
23974,
23980,
23986,
23992,
23998,
24004,
24010,
24016,
24022,
24028,
24034,
24040
],
"core.event_count": 27,
"core.first_event_number": 23884,
"core.last_event_number": 24040,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0147_df-s04-d0_dw_0_20260203T145031.hdf5"
}
]
} 