Jobsub ID 297922.12@dunegpschedd02.fnal.gov
| Jobsub ID | 297922.12@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:24 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2026-02-04 00:57:08 |
| From worker node | Hostname | dune001-1520389.0-lcg2700.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:57:23 |
| Input files | vd-protodune:np02vd_raw_run042421_0147_df-s03-d1_dw_0_20260203T145031.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 57m (3467s) |
| CPU time | 51m (3066s = 88%) |
| Max RSS bytes | 3722969088 (3550 MiB) |
| Outputting started | 2026-02-04 00:55:11 |
| Output files | |
| Finished | 2026-02-04 00:57:08 |
| Saved logs | justin-logs:297922.12-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x4a621f60, 0x68f0aec0
Caught exception in looking up space point ptr... 0x761f65e0, 0x761fa690
Caught exception in looking up space point ptr... 0x761fa690, 0x761fba20
Caught exception in looking up space point ptr... 0x532ba130, 0x801cfed0
Caught exception in looking up space point ptr... 0x801cfed0, 0x532ba130
Caught exception in looking up space point ptr... 0x2ec310c0, 0x2ec30f30
Caught exception in looking up space point ptr... 0x2ec30f30, 0x2ec30c10
Caught exception in looking up space point ptr... 0x462d3e10, 0x27a12b50
Caught exception in looking up space point ptr... 0x27a12b50, 0x596ad6a0
Caught exception in looking up space point ptr... 0x7822f370, 0x42d1ddd0
Caught exception in looking up space point ptr... 0x42d1ddd0, 0x593144c0
Caught exception in looking up space point ptr... 0x30d7e350, 0x30d7e670
Caught exception in looking up space point ptr... 0x30d7e670, 0x30d7e350
Caught exception in looking up space point ptr... 0x93301840, 0x63460cc0
Caught exception in looking up space point ptr... 0x4ed2a2c0, 0x93301840
Caught exception in looking up space point ptr... 0x4dd9a4b0, 0x6314e470
Caught exception in looking up space point ptr... 0x6314e470, 0x6314eba0
Caught exception in looking up space point ptr... 0x7b40a020, 0x7a4e6620
Caught exception in looking up space point ptr... 0x7a4e6620, 0x4eb43bf0
Caught exception in looking up space point ptr... 0x4eb43bf0, 0x7b40d0c0
Caught exception in looking up space point ptr... 0x7b40d0c0, 0x7b40a020
Caught exception in looking up space point ptr... 0x58303eb0, 0x58301470
Caught exception in looking up space point ptr... 0x58301470, 0x58304900
Caught exception in looking up space point ptr... 0x2c765bf0, 0x2c765e40
Caught exception in looking up space point ptr... 0x2c765500, 0x2c765bf0
Caught exception in looking up space point ptr... 0x2c79bf60, 0x2c79bc40
Caught exception in looking up space point ptr... 0x2c79bc40, 0x2c79bdd0
Caught exception in looking up space point ptr... 0x2c79bdd0, 0x2c79c280
Caught exception in looking up space point ptr... 0x2c79c280, 0x681e9960
Caught exception in looking up space point ptr... 0x273b5280, 0x32b1e110
Caught exception in looking up space point ptr... 0x32b1e110, 0x273b5280
Caught exception in looking up space point ptr... 0x705f6800, 0x284e85c0
Caught exception in looking up space point ptr... 0x705f4f90, 0x705f6800
Caught exception in looking up space point ptr... 0x2c79b790, 0x2c79b920
Caught exception in looking up space point ptr... 0x2c79b920, 0x2c79b790
Caught exception in looking up space point ptr... 0x4ebaa120, 0x3f904bf0
Caught exception in looking up space point ptr... 0x3f904bf0, 0x4ebaa120
Caught exception in looking up space point ptr... 0x282a4020, 0x282a3d40
Caught exception in looking up space point ptr... 0x282a3d40, 0x282a4020
Caught exception in looking up space point ptr... 0x50d953c0, 0x50d95660
Caught exception in looking up space point ptr... 0x50d95660, 0x50d953c0
Caught exception in looking up space point ptr... 0x788a01d0, 0x75fc6990
Caught exception in looking up space point ptr... 0x75fc6990, 0x75fc6b70
Caught exception in looking up space point ptr... 0x7c20a6a0, 0x7c20be90
Caught exception in looking up space point ptr... 0x7c20be90, 0x7c20a6a0
Caught exception in looking up space point ptr... 0x2f173820, 0x450c7250
Caught exception in looking up space point ptr... 0x450c7250, 0x2f173820
Caught exception in looking up space point ptr... 0x62f96790, 0x5b378ab0
Caught exception in looking up space point ptr... 0x5b378ab0, 0x62f965d0
Caught exception in looking up space point ptr... 0x2c105c80, 0x2c105fa0
Caught exception in looking up space point ptr... 0x2c105fa0, 0x2c105af0
Caught exception in looking up space point ptr... 0x32f73b10, 0x50d8d9b0
Caught exception in looking up space point ptr... 0x50d8d9b0, 0x59a323f0
Caught exception in looking up space point ptr... 0x540cb880, 0x2bdd7800
Caught exception in looking up space point ptr... 0x2bdd7800, 0x540cb880
Caught exception in looking up space point ptr... 0x42d5df80, 0x7a4a7490
Caught exception in looking up space point ptr... 0x7a4a7490, 0x42d5df80
Caught exception in looking up space point ptr... 0x76f15a50, 0x76f15be0
Caught exception in looking up space point ptr... 0x76f15be0, 0x76f15f00
Caught exception in looking up space point ptr... 0x2f8fbce0, 0x2f8fbc00
Caught exception in looking up space point ptr... 0x2f8fbc00, 0x2f8fba40
Caught exception in looking up space point ptr... 0x419dc630, 0x42ea2770
Caught exception in looking up space point ptr... 0x42ea2770, 0x42ea2900
Caught exception in looking up space point ptr... 0x605f9030, 0x4e65f280
Caught exception in looking up space point ptr... 0x4e65f280, 0x487547e0
++++>>>> total num hits: 58033, num free: 56110
04-Feb-2026 00:55:03 UTC Closed output file "np02vd_raw_run042421_0147_df-s03-d1_dw_0_20260203T145031_reco_stage0_20260204T005503_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 92.8781 125.403 288.28 107.106 50.0323 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.9034e-05 0.000139902 0.000245359 0.000110967 4.96274e-05 27
produce:tpcrawdecoder:PDVDTPCReader 13.3695 13.8901 14.1947 13.9025 0.204305 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.679904 0.707403 0.760639 0.708495 0.0178116 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0228098 0.0235283 0.0286929 0.0231386 0.00118276 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.112938 0.115051 0.137365 0.114304 0.00440352 27
produce:beamevent:BeamEvent 0.000109555 0.000235064 0.00116986 0.0001867 0.000197795 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.10709 3.67542 4.27836 3.63934 0.282634 27
produce:ophit:OpHitFinder 0.0335604 0.0404476 0.0644877 0.040244 0.00574401 27
produce:wclsdatavd:WireCellToolkit 63.7299 70.8821 78.2045 70.5386 3.85343 27
produce:gaushit:GausHitFinder 0.675983 1.64663 10.434 1.21506 1.81166 27
produce:nhitsfilter:NumberOfHitsFilter 0.000165268 0.000289678 0.000596496 0.000281353 7.87338e-05 27
produce:reco3d:SpacePointSolver 4.29591 9.68348 18.2408 9.33771 3.1895 27
produce:hitpdune:DisambigFromSpacePoints 0.0648161 0.160517 0.551172 0.12344 0.124381 27
produce:cluster3d:Cluster3D 0.778392 19.8187 166.734 2.2109 44.7203 27
[art]:TriggerResults:TriggerResultInserter 2.8973e-05 5.5608e-05 0.000165739 4.8173e-05 3.01062e-05 27
end_path:out1:RootOutput 4.557e-06 2.22334e-05 0.000326961 8.643e-06 6.01144e-05 27
end_path:out1:RootOutput(write) 3.55501 4.71852 8.43801 4.31411 1.16606 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6033.64 MB
Peak resident set size usage (VmHWM): 3722.97 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0147_df-s03-d1_dw_0_20260203T145031_reco_stage0_20260204T005503_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0147_df-s03-d1_dw_0_20260203T145031_reco_stage0_20260204T005503_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0147_df-s03-d1_dw_0_20260203T145031_reco_stage0_20260204T005503_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163055.0,
"core.end_time": 1770166504.0,
"core.events": [
23889,
23895,
23901,
23907,
23913,
23919,
23925,
23931,
23937,
23943,
23949,
23955,
23961,
23967,
23973,
23979,
23985,
23991,
23997,
24003,
24009,
24015,
24021,
24027,
24033,
24039,
24045
],
"core.event_count": 27,
"core.first_event_number": 23889,
"core.last_event_number": 24045,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0147_df-s03-d1_dw_0_20260203T145031.hdf5"
}
]
} 