Jobsub ID 297921.75@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.75@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_Oxford |
| Entry | DUNE_UK_SGrid_Oxford_arc01 |
| Last heartbeat | 2026-02-04 02:20:55 |
| From worker node | Hostname | t2wn070.physics.ox.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:52:48 |
| Input files | vd-protodune:np02vd_raw_run042433_0565_df-s03-d1_dw_0_20260203T221651.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8670s) |
| CPU time | 1h (4362s = 50%) |
| Max RSS bytes | 3540086784 (3376 MiB) |
| Outputting started | 2026-02-04 02:17:21 |
| Output files | |
| Finished | 2026-02-04 02:20:55 |
| Saved logs | justin-logs:297921.75-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
space point ptr... 0x54e61000, 0x7f7d9850
Caught exception in looking up space point ptr... 0xe58e630, 0xe58e530
Caught exception in looking up space point ptr... 0xe58e530, 0x10e99950
Caught exception in looking up space point ptr... 0x3d167c70, 0x67e8ae40
Caught exception in looking up space point ptr... 0x67e8ae40, 0x16152260
Caught exception in looking up space point ptr... 0x150dcd70, 0x30969220
Caught exception in looking up space point ptr... 0x30969220, 0x150dcd70
Caught exception in looking up space point ptr... 0x150dcd70, 0x3d12e290
Caught exception in looking up space point ptr... 0x3d12e290, 0x150dcd70
Caught exception in looking up space point ptr... 0x62eb1d70, 0x4b03e870
Caught exception in looking up space point ptr... 0x4b03e870, 0x4407f270
Caught exception in looking up space point ptr... 0x35f55950, 0x35f43cf0
Caught exception in looking up space point ptr... 0x35f43cf0, 0x35f20f20
Caught exception in looking up space point ptr... 0x3ff77600, 0x3d06fe90
Caught exception in looking up space point ptr... 0x3d06fe90, 0x3fd47e30
Caught exception in looking up space point ptr... 0x55d22ee0, 0x6c3ae1b0
Caught exception in looking up space point ptr... 0x6c3ae1b0, 0x6c3ae8f0
Caught exception in looking up space point ptr... 0xd908ba0, 0xd90b790
Caught exception in looking up space point ptr... 0xd905b10, 0xd908ba0
Caught exception in looking up space point ptr... 0x8c960080, 0x8c94e560
Caught exception in looking up space point ptr... 0x8c960210, 0x8c960080
Caught exception in looking up space point ptr... 0x33368cc0, 0x30d0daa0
Caught exception in looking up space point ptr... 0x30d0daa0, 0x397541a0
Caught exception in looking up space point ptr... 0x48c4b170, 0x3107e4f0
Caught exception in looking up space point ptr... 0x3107e4f0, 0x31085750
Caught exception in looking up space point ptr... 0x2af9ea00, 0x2af9cfa0
Caught exception in looking up space point ptr... 0x2af9cfa0, 0x2af9d230
Caught exception in looking up space point ptr... 0x1a92cc40, 0x54045180
Caught exception in looking up space point ptr... 0x5403b500, 0x1a92cc40
Caught exception in looking up space point ptr... 0x67a2f530, 0x67a2f3a0
Caught exception in looking up space point ptr... 0x67a2f3a0, 0x67a0d2a0
Caught exception in looking up space point ptr... 0x62ef7450, 0x332753b0
Caught exception in looking up space point ptr... 0x9c91760, 0x62ef7450
Caught exception in looking up space point ptr... 0x54b10df0, 0x8b4a3f20
Caught exception in looking up space point ptr... 0x8b4a3f20, 0x12eaeba0
Caught exception in looking up space point ptr... 0x32bd0c70, 0x2b9dd340
Caught exception in looking up space point ptr... 0x1897d7c0, 0x32bd0c70
Caught exception in looking up space point ptr... 0x44f60a10, 0x18b60820
Caught exception in looking up space point ptr... 0x44f60ba0, 0x44f60a10
Caught exception in looking up space point ptr... 0x18945660, 0x50a5c8b0
Caught exception in looking up space point ptr... 0x189457f0, 0x18945660
Caught exception in looking up space point ptr... 0x55d9ddd0, 0x55d9dc40
Caught exception in looking up space point ptr... 0x55d9dc40, 0x4b4141e0
Caught exception in looking up space point ptr... 0x87b66c0, 0x87b6590
Caught exception in looking up space point ptr... 0x87b6590, 0x12363080
Caught exception in looking up space point ptr... 0x447434a0, 0x4475b310
Caught exception in looking up space point ptr... 0x4475b310, 0x4475b4a0
Caught exception in looking up space point ptr... 0x4afa0760, 0x4af8e1a0
Caught exception in looking up space point ptr... 0x4afb2a00, 0x4afa0760
Caught exception in looking up space point ptr... 0x3484d130, 0x3485f240
Caught exception in looking up space point ptr... 0x3485f240, 0x3486e470
Caught exception in looking up space point ptr... 0x16485590, 0x3cf1d910
Caught exception in looking up space point ptr... 0x3cf1d910, 0x67f9a040
Caught exception in looking up space point ptr... 0x67f2a8e0, 0x3a67c760
Caught exception in looking up space point ptr... 0x3a67c760, 0x67f2a8e0
Caught exception in looking up space point ptr... 0xa4555c0, 0x309690f0
Caught exception in looking up space point ptr... 0x609521a0, 0xa4555c0
Caught exception in looking up space point ptr... 0x61035200, 0x1a2e17b0
Caught exception in looking up space point ptr... 0x1a2e17b0, 0x61035200
Caught exception in looking up space point ptr... 0x8169050, 0x3908d660
Caught exception in looking up space point ptr... 0x3fefdf10, 0x8169050
Caught exception in looking up space point ptr... 0x30bb8c90, 0x15d73a20
Caught exception in looking up space point ptr... 0x15d73a20, 0x3fb105b0
Caught exception in looking up space point ptr... 0x887cab0, 0x1252cc80
Caught exception in looking up space point ptr... 0x1252cc80, 0x887cab0
Caught exception in looking up space point ptr... 0x887cab0, 0x60a371f0
Caught exception in looking up space point ptr... 0x60a371f0, 0x887cab0
++++>>>> total num hits: 507714, num free: 496656
04-Feb-2026 02:17:08 GMT Closed output file "np02vd_raw_run042433_0565_df-s03-d1_dw_0_20260203T221651_reco_stage0_20260204T021708_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 350.552 450.778 551.096 457.984 57.5332 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000105969 0.000186939 0.000491 0.000151765 9.71962e-05 19
produce:tpcrawdecoder:PDVDTPCReader 136.136 211.372 297.893 206.72 37.0301 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.694331 1.09875 2.53214 1.00034 0.387393 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0196491 0.0255663 0.0641331 0.0221608 0.0108585 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0195627 0.0222814 0.0455935 0.0197369 0.0070006 19
produce:beamevent:BeamEvent 0.000105056 0.000257158 0.00141224 0.000193914 0.000273776 19
produce:pdvddaphne:DAPHNEReaderPDVD 12.3785 18.5099 23.6687 19.4624 3.21374 19
produce:ophit:OpHitFinder 0.0302236 0.0447668 0.0498515 0.0452524 0.00452155 19
produce:wclsdatavd:WireCellToolkit 114.275 141.472 163.268 139.579 13.9315 19
produce:gaushit:GausHitFinder 0.945649 2.56506 4.123 2.61363 0.94236 19
produce:nhitsfilter:NumberOfHitsFilter 0.00034179 0.000526812 0.00100625 0.00052299 0.000159737 19
produce:reco3d:SpacePointSolver 14.61 24.0497 38.6655 23.7128 7.16263 19
produce:hitpdune:DisambigFromSpacePoints 0.122294 0.367152 0.7255 0.299552 0.151063 19
produce:cluster3d:Cluster3D 1.82489 43.7802 84.1567 56.9136 31.5208 19
[art]:TriggerResults:TriggerResultInserter 3.1028e-05 5.08209e-05 0.00015505 4.2941e-05 2.69201e-05 19
end_path:out1:RootOutput 4.709e-06 1.08577e-05 3.6608e-05 9.378e-06 6.91944e-06 19
end_path:out1:RootOutput(write) 5.08527 7.41233 9.54359 7.07064 1.55921 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5559.6 MB
Peak resident set size usage (VmHWM): 3540.09 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0565_df-s03-d1_dw_0_20260203T221651_reco_stage0_20260204T021708_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0565_df-s03-d1_dw_0_20260203T221651_reco_stage0_20260204T021708_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0565_df-s03-d1_dw_0_20260203T221651_reco_stage0_20260204T021708_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162786.0,
"core.end_time": 1770171430.0,
"core.events": [
64419,
64425,
64431,
64437,
64443,
64449,
64455,
64461,
64467,
64473,
64479,
64485,
64491,
64497,
64503,
64509,
64515,
64521,
64527
],
"core.event_count": 19,
"core.first_event_number": 64419,
"core.last_event_number": 64527,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0565_df-s03-d1_dw_0_20260203T221651.hdf5"
}
]
} 