Jobsub ID 297919.124@dunegpschedd02.fnal.gov
| Jobsub ID | 297919.124@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:54:25 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce503 |
| Last heartbeat | 2026-02-04 00:08:52 |
| From worker node | Hostname | b9p02p6824.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:31:14 |
| Input files | vd-protodune:np02vd_raw_run042421_0059_df-s04-d0_dw_0_20260203T140257.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 35m (2122s) |
| CPU time | 34m (2040s = 96%) |
| Max RSS bytes | 2624049152 (2502 MiB) |
| Outputting started | 2026-02-04 00:06:37 |
| Output files | |
| Finished | 2026-02-04 00:08:52 |
| Saved logs | justin-logs:297919.124-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ng up space point ptr... 0x5bec0490, 0x5bec0600
Caught exception in looking up space point ptr... 0x5bec0600, 0x60a27270
Caught exception in looking up space point ptr... 0x35af7c30, 0x2798d280
Caught exception in looking up space point ptr... 0x2798d280, 0x35af7c30
Caught exception in looking up space point ptr... 0x15599da0, 0xf4cdfd0
Caught exception in looking up space point ptr... 0x328fa930, 0x15599da0
Caught exception in looking up space point ptr... 0x4b2af9c0, 0x4b2b9240
Caught exception in looking up space point ptr... 0x4b2b9240, 0x4b2b8b60
Caught exception in looking up space point ptr... 0x10bfa280, 0x119a8f20
Caught exception in looking up space point ptr... 0x119a8f20, 0x5851d7c0
Caught exception in looking up space point ptr... 0x108bf100, 0x108befd0
Caught exception in looking up space point ptr... 0x108ba1b0, 0x108bf100
Caught exception in looking up space point ptr... 0x5081c9b0, 0xdee74d0
Caught exception in looking up space point ptr... 0xdee74d0, 0x5081c820
Caught exception in looking up space point ptr... 0x5a684480, 0x50b19d40
Caught exception in looking up space point ptr... 0x50b19d40, 0x15599ef0
Caught exception in looking up space point ptr... 0x4ee54120, 0x4ee54aa0
Caught exception in looking up space point ptr... 0x4ee54aa0, 0x4ee57f40
Caught exception in looking up space point ptr... 0x35aef020, 0x35aef770
Caught exception in looking up space point ptr... 0x35aef770, 0x35aef020
Caught exception in looking up space point ptr... 0x35aef020, 0x35aeee80
Caught exception in looking up space point ptr... 0x35aeee80, 0x35aef020
Caught exception in looking up space point ptr... 0x3fabb360, 0x3321b010
Caught exception in looking up space point ptr... 0x351a15a0, 0x3fabb360
Caught exception in looking up space point ptr... 0x4b2a9d70, 0x4b2c5870
Caught exception in looking up space point ptr... 0x4b2b0b40, 0x4b2a9d70
Caught exception in looking up space point ptr... 0x5a235850, 0xa812ba0
Caught exception in looking up space point ptr... 0xa812ba0, 0x5a237450
Caught exception in looking up space point ptr... 0x24459070, 0xd7ce1f0
Caught exception in looking up space point ptr... 0xd7ce1f0, 0x24459070
Caught exception in looking up space point ptr... 0x16480d40, 0x54a56760
Caught exception in looking up space point ptr... 0x54a56760, 0xa9cc4b0
Caught exception in looking up space point ptr... 0x60cec6f0, 0x3162d890
Caught exception in looking up space point ptr... 0x5e777b30, 0x60cec6f0
Caught exception in looking up space point ptr... 0x25381130, 0x41fa24a0
Caught exception in looking up space point ptr... 0x41fa24a0, 0x12454d60
Caught exception in looking up space point ptr... 0xec740c0, 0xec73c10
Caught exception in looking up space point ptr... 0xec73c10, 0xec740c0
Caught exception in looking up space point ptr... 0xec74700, 0xec74a20
Caught exception in looking up space point ptr... 0xec74a20, 0xec74bb0
Caught exception in looking up space point ptr... 0x24f2c020, 0x24f2dae0
Caught exception in looking up space point ptr... 0x24f2dae0, 0x24f2db80
Caught exception in looking up space point ptr... 0xec6cc60, 0xec6c8c0
Caught exception in looking up space point ptr... 0xec6c8c0, 0xec6cc60
Caught exception in looking up space point ptr... 0x4b2b26d0, 0x4b2b2540
Caught exception in looking up space point ptr... 0x4b2b2540, 0x4b2b2220
Caught exception in looking up space point ptr... 0x16481840, 0x37c7f3b0
Caught exception in looking up space point ptr... 0x37c7f3b0, 0x4a4953f0
Caught exception in looking up space point ptr... 0x276a3a00, 0x276a34c0
Caught exception in looking up space point ptr... 0x276a34c0, 0x276a3a00
Caught exception in looking up space point ptr... 0x276a3a00, 0x276a38b0
Caught exception in looking up space point ptr... 0x276a38b0, 0x276a3a00
Caught exception in looking up space point ptr... 0xd562a70, 0xd55cce0
Caught exception in looking up space point ptr... 0xd55cce0, 0xd55d800
Caught exception in looking up space point ptr... 0x4a26e220, 0x1151bd20
Caught exception in looking up space point ptr... 0x1151bd20, 0x4a26e220
Caught exception in looking up space point ptr... 0x4cd86760, 0x35796fa0
Caught exception in looking up space point ptr... 0x35796fa0, 0x4cd86760
Caught exception in looking up space point ptr... 0x3e4e87c0, 0x3e4e8950
Caught exception in looking up space point ptr... 0x3e4e8950, 0x3e4e87c0
Caught exception in looking up space point ptr... 0x3f518910, 0x37c74690
Caught exception in looking up space point ptr... 0x37c74690, 0xd7a62c0
Caught exception in looking up space point ptr... 0x5a47c130, 0x5a47c390
Caught exception in looking up space point ptr... 0x5a47c390, 0x5a47c130
Caught exception in looking up space point ptr... 0x276a0cd0, 0x276a0930
Caught exception in looking up space point ptr... 0x276a0930, 0x276a0cd0
++++>>>> total num hits: 48536, num free: 46831
04-Feb-2026 01:06:28 CET Closed output file "np02vd_raw_run042421_0059_df-s04-d0_dw_0_20260203T140257_reco_stage0_20260204T000628_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 67.2394 76.1661 88.2362 75.561 4.96482 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.483e-05 8.21835e-05 0.000215751 6.414e-05 4.15377e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.59972 4.01119 4.36893 4.00697 0.193649 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00966118 0.0165416 0.0508943 0.0126767 0.00896768 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000405353 0.000499721 0.000750945 0.000482654 7.89641e-05 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00148898 0.0019838 0.00574699 0.00179144 0.000760604 27
produce:beamevent:BeamEvent 4.807e-05 0.000114209 0.000956567 7.7471e-05 0.000166203 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.02014 2.69553 3.33105 2.67643 0.345561 27
produce:ophit:OpHitFinder 0.0235267 0.0345171 0.0435717 0.0342072 0.00527557 27
produce:wclsdatavd:WireCellToolkit 50.8888 57.2946 65.5782 56.6383 3.80705 27
produce:gaushit:GausHitFinder 0.392209 0.732373 1.1418 0.680692 0.198966 27
produce:nhitsfilter:NumberOfHitsFilter 0.000128561 0.000186147 0.000537394 0.000169111 7.36063e-05 27
produce:reco3d:SpacePointSolver 3.0907 6.66213 10.0883 6.77228 1.59145 27
produce:hitpdune:DisambigFromSpacePoints 0.0351379 0.0702542 0.122653 0.0647612 0.0231604 27
produce:cluster3d:Cluster3D 0.457674 1.31032 2.50754 1.33482 0.459436 27
[art]:TriggerResults:TriggerResultInserter 1.639e-05 2.73801e-05 0.000148641 2.109e-05 2.4222e-05 27
end_path:out1:RootOutput 3.67e-06 7.33489e-06 2.447e-05 6.9e-06 3.885e-06 27
end_path:out1:RootOutput(write) 2.8323 3.32049 4.71198 3.11594 0.462917 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4533.68 MB
Peak resident set size usage (VmHWM): 2624.05 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0059_df-s04-d0_dw_0_20260203T140257_reco_stage0_20260204T000628_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0059_df-s04-d0_dw_0_20260203T140257_reco_stage0_20260204T000628_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0059_df-s04-d0_dw_0_20260203T140257_reco_stage0_20260204T000628_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161486.0,
"core.end_time": 1770163590.0,
"core.events": [
9616,
9622,
9628,
9634,
9640,
9646,
9652,
9658,
9664,
9670,
9676,
9682,
9688,
9694,
9700,
9706,
9712,
9718,
9724,
9730,
9736,
9742,
9748,
9754,
9760,
9766,
9772
],
"core.event_count": 27,
"core.first_event_number": 9616,
"core.last_event_number": 9772,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0059_df-s04-d0_dw_0_20260203T140257.hdf5"
}
]
} 