Jobsub ID 297921.121@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.121@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce05 |
| Last heartbeat | 2026-02-04 01:27:39 |
| From worker node | Hostname | dune001-1845821.0-lcg2678.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:55:52 |
| Input files | vd-protodune:np02vd_raw_run042433_0519_df-s04-d0_dw_0_20260203T215923.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5368s) |
| CPU time | 1h (5041s = 93%) |
| Max RSS bytes | 3522465792 (3359 MiB) |
| Outputting started | 2026-02-04 01:25:22 |
| Output files | |
| Finished | 2026-02-04 01:27:39 |
| Saved logs | justin-logs:297921.121-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x7879f8a0, 0x561f0da0
Caught exception in looking up space point ptr... 0x2d58a780, 0x2d58aaa0
Caught exception in looking up space point ptr... 0x2d58aaa0, 0x2d58a910
Caught exception in looking up space point ptr... 0x794ae150, 0x794baf80
Caught exception in looking up space point ptr... 0x794adf00, 0x794ae150
Caught exception in looking up space point ptr... 0x6240ff80, 0x26fc07f0
Caught exception in looking up space point ptr... 0x26fc07f0, 0x552e7040
Caught exception in looking up space point ptr... 0x6c171210, 0x6c171da0
Caught exception in looking up space point ptr... 0x6c170430, 0x6c171210
Caught exception in looking up space point ptr... 0x8849f250, 0x5110c0c0
Caught exception in looking up space point ptr... 0x767fe900, 0x8849f250
Caught exception in looking up space point ptr... 0x81c3f670, 0x81c3eea0
Caught exception in looking up space point ptr... 0x81c3f990, 0x81c3f670
Caught exception in looking up space point ptr... 0x73f4f6b0, 0x73f73290
Caught exception in looking up space point ptr... 0x73f73290, 0x73f84720
Caught exception in looking up space point ptr... 0x4f37fe40, 0x4f37fbf0
Caught exception in looking up space point ptr... 0x4f37fbf0, 0x4f382b40
Caught exception in looking up space point ptr... 0x45a23a70, 0x45a218d0
Caught exception in looking up space point ptr... 0x45a218d0, 0x81c45940
Caught exception in looking up space point ptr... 0x75562430, 0x755620e0
Caught exception in looking up space point ptr... 0x755620e0, 0x75563100
Caught exception in looking up space point ptr... 0x20e17810, 0x1e6adec0
Caught exception in looking up space point ptr... 0x1e6adec0, 0x20e31510
Caught exception in looking up space point ptr... 0x787c8730, 0x787c88c0
Caught exception in looking up space point ptr... 0x787b6940, 0x787c8730
Caught exception in looking up space point ptr... 0x8bbfaa20, 0x8bbcf9a0
Caught exception in looking up space point ptr... 0x8bbfa890, 0x8bbfaa20
Caught exception in looking up space point ptr... 0x556d62d0, 0x933cd3f0
Caught exception in looking up space point ptr... 0x933cd3f0, 0x54e779a0
Caught exception in looking up space point ptr... 0x83203810, 0x83203370
Caught exception in looking up space point ptr... 0x81950bb0, 0x83203810
Caught exception in looking up space point ptr... 0x54d96a70, 0x473378c0
Caught exception in looking up space point ptr... 0x473378c0, 0x4e88b960
Caught exception in looking up space point ptr... 0x1e06c280, 0x1e08bbd0
Caught exception in looking up space point ptr... 0x1e06c410, 0x1e06c280
Caught exception in looking up space point ptr... 0x28437160, 0x52f82e20
Caught exception in looking up space point ptr... 0x52f82e20, 0x52f82fb0
Caught exception in looking up space point ptr... 0x6e7e1410, 0x280c79d0
Caught exception in looking up space point ptr... 0x280c79d0, 0x831ed070
Caught exception in looking up space point ptr... 0x78581c60, 0x79906720
Caught exception in looking up space point ptr... 0x79906720, 0x760b4aa0
Caught exception in looking up space point ptr... 0x21ab0140, 0x21a9e030
Caught exception in looking up space point ptr... 0x21a9e030, 0x21a8cec0
Caught exception in looking up space point ptr... 0x750c1cc0, 0x750afd40
Caught exception in looking up space point ptr... 0x750afd40, 0x7509d910
Caught exception in looking up space point ptr... 0x74b25be0, 0x74b140c0
Caught exception in looking up space point ptr... 0x74b37b60, 0x74b25be0
Caught exception in looking up space point ptr... 0x78bcd240, 0x78bbe970
Caught exception in looking up space point ptr... 0x78bde860, 0x78bcd240
Caught exception in looking up space point ptr... 0x48e07230, 0x7c315a20
Caught exception in looking up space point ptr... 0x7c315a20, 0x7c308410
Caught exception in looking up space point ptr... 0x2b83e0b0, 0x22222270
Caught exception in looking up space point ptr... 0x831e5e60, 0x2b83e0b0
Caught exception in looking up space point ptr... 0x2a5bf430, 0x22233810
Caught exception in looking up space point ptr... 0x2b7dc560, 0x2a5bf430
Caught exception in looking up space point ptr... 0x66bc0950, 0x78b1aa30
Caught exception in looking up space point ptr... 0x22230c00, 0x66bc0950
Caught exception in looking up space point ptr... 0x2b80b840, 0x2aacf5a0
Caught exception in looking up space point ptr... 0x2aacf5a0, 0x68a95930
Caught exception in looking up space point ptr... 0x5110a3c0, 0x86425ee0
Caught exception in looking up space point ptr... 0x86425ee0, 0x5110a3c0
Caught exception in looking up space point ptr... 0x78c62ec0, 0x62735030
Caught exception in looking up space point ptr... 0x62735030, 0x62735130
Caught exception in looking up space point ptr... 0x28140de0, 0x86fbcee0
Caught exception in looking up space point ptr... 0x86fbcee0, 0x28140de0
Caught exception in looking up space point ptr... 0x2d89e660, 0x4e459a00
Caught exception in looking up space point ptr... 0x4e459a00, 0x20d8b5e0
++++>>>> total num hits: 536310, num free: 527960
04-Feb-2026 01:25:11 UTC Closed output file "np02vd_raw_run042433_0519_df-s04-d0_dw_0_20260203T215923_reco_stage0_20260204T012511_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 199.454 276.577 310.57 285.908 34.2993 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.9608e-05 0.000156836 0.000303791 0.000134613 5.59175e-05 19
produce:tpcrawdecoder:PDVDTPCReader 16.5916 17.1457 18.3072 17.0286 0.475782 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.688256 0.710052 0.799876 0.701311 0.0254123 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0231837 0.0240065 0.0292639 0.0235412 0.00149964 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0230475 0.0234216 0.0239198 0.0234062 0.000223887 19
produce:beamevent:BeamEvent 0.000125836 0.000280342 0.00134186 0.000197441 0.000262459 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.65783 4.16906 4.83709 4.14065 0.336598 19
produce:ophit:OpHitFinder 0.0401915 0.0495714 0.0613229 0.0495334 0.00540781 19
produce:wclsdatavd:WireCellToolkit 138.153 157.854 172.966 158.172 7.22621 19
produce:gaushit:GausHitFinder 1.09219 3.12439 4.07941 3.21436 0.763553 19
produce:nhitsfilter:NumberOfHitsFilter 0.000411643 0.000554274 0.000751613 0.000576714 9.18372e-05 19
produce:reco3d:SpacePointSolver 11.2821 23.2494 38.0777 20.6583 7.94162 19
produce:hitpdune:DisambigFromSpacePoints 0.148045 0.42016 0.63982 0.429438 0.11856 19
produce:cluster3d:Cluster3D 2.05305 61.1208 85.5648 76.362 29.9576 19
[art]:TriggerResults:TriggerResultInserter 2.8894e-05 5.21618e-05 0.000127209 4.6548e-05 2.08896e-05 19
end_path:out1:RootOutput 7.935e-06 1.87515e-05 3.5707e-05 1.6832e-05 7.95294e-06 19
end_path:out1:RootOutput(write) 5.12519 8.61804 10.1242 9.50439 1.51195 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5746.61 MB
Peak resident set size usage (VmHWM): 3522.47 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0519_df-s04-d0_dw_0_20260203T215923_reco_stage0_20260204T012511_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0519_df-s04-d0_dw_0_20260203T215923_reco_stage0_20260204T012511_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0519_df-s04-d0_dw_0_20260203T215923_reco_stage0_20260204T012511_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162970.0,
"core.end_time": 1770168314.0,
"core.events": [
59176,
59182,
59188,
59194,
59200,
59206,
59212,
59218,
59224,
59230,
59236,
59242,
59248,
59254,
59260,
59266,
59272,
59278,
59284
],
"core.event_count": 19,
"core.first_event_number": 59176,
"core.last_event_number": 59284,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0519_df-s04-d0_dw_0_20260203T215923.hdf5"
}
]
} 