Jobsub ID 297923.95@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.95@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_RAL-PPD |
| Entry | CMSHTPC_T2_UK_SGrid_RALPP_hep206 |
| Last heartbeat | 2026-02-04 01:07:20 |
| From worker node | Hostname | heplnc153.pp.rl.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:00:35 |
| Input files | vd-protodune:np02vd_raw_run042433_0326_df-s03-d1_dw_0_20260203T204602.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (3848s) |
| CPU time | 58m (3498s = 90%) |
| Max RSS bytes | 3504451584 (3342 MiB) |
| Outputting started | 2026-02-04 01:04:45 |
| Output files | |
| Finished | 2026-02-04 01:07:20 |
| Saved logs | justin-logs:297923.95-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
point ptr... 0x473a9700, 0x4739d8f0
Caught exception in looking up space point ptr... 0x473a9c80, 0x473a9700
Caught exception in looking up space point ptr... 0x676ac1e0, 0x45c1eb80
Caught exception in looking up space point ptr... 0x45c1eb80, 0x13d48580
Caught exception in looking up space point ptr... 0xa01cb50, 0xa01b8d0
Caught exception in looking up space point ptr... 0xa01b8d0, 0x6f1df6e0
Caught exception in looking up space point ptr... 0x53e1d430, 0x53e1d190
Caught exception in looking up space point ptr... 0x53e1d190, 0x53e1d430
Caught exception in looking up space point ptr... 0x5ba08780, 0x663ddbe0
Caught exception in looking up space point ptr... 0x663ddbe0, 0x614c6830
Caught exception in looking up space point ptr... 0x29e08790, 0x29e082f0
Caught exception in looking up space point ptr... 0x29e082f0, 0x38bbf880
Caught exception in looking up space point ptr... 0x85457fb0, 0x29e055f0
Caught exception in looking up space point ptr... 0x29e05890, 0x85457fb0
Caught exception in looking up space point ptr... 0x19253b70, 0x46f6ebb0
Caught exception in looking up space point ptr... 0x46f6ebb0, 0x875724e0
Caught exception in looking up space point ptr... 0x70a167c0, 0x70a16950
Caught exception in looking up space point ptr... 0x70a16950, 0x70a18a00
Caught exception in looking up space point ptr... 0x85def10, 0x29adcf70
Caught exception in looking up space point ptr... 0x29adcf70, 0x29add260
Caught exception in looking up space point ptr... 0x83abe40, 0x704eeb40
Caught exception in looking up space point ptr... 0x704eeb40, 0x73f5ef10
Caught exception in looking up space point ptr... 0x29df55a0, 0x29df4fa0
Caught exception in looking up space point ptr... 0x29df4fa0, 0x854566f0
Caught exception in looking up space point ptr... 0x29aba7f0, 0x58415fc0
Caught exception in looking up space point ptr... 0x58415fc0, 0xf85b410
Caught exception in looking up space point ptr... 0x29ac0c20, 0x29aba7f0
Caught exception in looking up space point ptr... 0xaf1cda0, 0xaf1cca0
Caught exception in looking up space point ptr... 0xaf1cca0, 0xaf1cda0
Caught exception in looking up space point ptr... 0x9654770, 0x105d7800
Caught exception in looking up space point ptr... 0x105d7800, 0x9654770
Caught exception in looking up space point ptr... 0x7ba44b90, 0x48e2f090
Caught exception in looking up space point ptr... 0x48e2f090, 0x7ba44ce0
Caught exception in looking up space point ptr... 0x68a5e470, 0x4104b860
Caught exception in looking up space point ptr... 0x4104b860, 0x68a5e470
Caught exception in looking up space point ptr... 0x30d1f210, 0x30d1f300
Caught exception in looking up space point ptr... 0x30d1f300, 0x30d1f210
Caught exception in looking up space point ptr... 0x7625c490, 0x62ec5780
Caught exception in looking up space point ptr... 0x62ec5780, 0x7625c490
Caught exception in looking up space point ptr... 0x6f8bc5b0, 0x67ee4ca0
Caught exception in looking up space point ptr... 0x67ee4ca0, 0x6f8b4d70
Caught exception in looking up space point ptr... 0x5ff19ea0, 0x5ff1a0f0
Caught exception in looking up space point ptr... 0x5ff16390, 0x67b6a090
Caught exception in looking up space point ptr... 0x67b6a090, 0x5ff19ea0
Caught exception in looking up space point ptr... 0x5ff16860, 0x5ff16a50
Caught exception in looking up space point ptr... 0x5ff16a50, 0x5ff18880
Caught exception in looking up space point ptr... 0x3209ba30, 0x3209a030
Caught exception in looking up space point ptr... 0x3209a030, 0x3209ba30
Caught exception in looking up space point ptr... 0x390118f0, 0x2d64d360
Caught exception in looking up space point ptr... 0x2d64d360, 0x5ffc1670
Caught exception in looking up space point ptr... 0x81dc8480, 0x3e4d8740
Caught exception in looking up space point ptr... 0x3e4d8740, 0x81dc8480
Caught exception in looking up space point ptr... 0x303e8680, 0x303e8800
Caught exception in looking up space point ptr... 0x303e8800, 0x303e8680
Caught exception in looking up space point ptr... 0x474bdc90, 0x48e63cd0
Caught exception in looking up space point ptr... 0x18ddaa80, 0x474bdc90
Caught exception in looking up space point ptr... 0x120726e0, 0x120723a0
Caught exception in looking up space point ptr... 0x12072930, 0x120726e0
Caught exception in looking up space point ptr... 0x6f8b4c10, 0x704f33c0
Caught exception in looking up space point ptr... 0x704f33c0, 0x6f8b4c10
Caught exception in looking up space point ptr... 0x4a599c90, 0x4a599b40
Caught exception in looking up space point ptr... 0x4a599b40, 0x3d49cea0
Caught exception in looking up space point ptr... 0x1a497510, 0x769d64d0
Caught exception in looking up space point ptr... 0x769d64d0, 0x1a497510
Caught exception in looking up space point ptr... 0x73703280, 0x614c39a0
Caught exception in looking up space point ptr... 0x614c39a0, 0x44f6b5a0
Caught exception in looking up space point ptr... 0x44f6b5a0, 0x851e2e80
++++>>>> total num hits: 75032, num free: 72035
04-Feb-2026 01:04:36 GMT Closed output file "np02vd_raw_run042433_0326_df-s03-d1_dw_0_20260203T204602_reco_stage0_20260204T010436_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 170.104 198.16 264.737 196.813 20.6427 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.6842e-05 0.000133338 0.000200936 0.000120095 3.50609e-05 19
produce:tpcrawdecoder:PDVDTPCReader 15.1386 16.1062 22.1916 15.7154 1.49674 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.529018 0.554826 0.606246 0.553429 0.0190194 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0177086 0.0195526 0.0464911 0.01808 0.00635127 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0176679 0.0180646 0.0187167 0.0180718 0.00021426 19
produce:beamevent:BeamEvent 0.000118061 0.000245729 0.00106708 0.000179727 0.000213714 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.2188 3.81363 5.1607 3.79615 0.43398 19
produce:ophit:OpHitFinder 0.0334065 0.0468347 0.0710347 0.0457285 0.00796389 19
produce:wclsdatavd:WireCellToolkit 120.98 140.919 154.008 141.905 9.81643 19
produce:gaushit:GausHitFinder 1.06921 2.01151 3.86415 1.9146 0.626089 19
produce:nhitsfilter:NumberOfHitsFilter 0.000302146 0.000571859 0.00131286 0.000463167 0.000265144 19
produce:reco3d:SpacePointSolver 13.5967 21.5694 42.152 20.6893 6.82402 19
produce:hitpdune:DisambigFromSpacePoints 0.155344 0.284058 0.579859 0.253806 0.101121 19
produce:cluster3d:Cluster3D 1.80496 5.84652 45.6762 3.5446 9.44989 19
[art]:TriggerResults:TriggerResultInserter 2.5658e-05 4.69485e-05 0.000126748 4.0806e-05 2.39178e-05 19
end_path:out1:RootOutput 4.328e-06 1.0919e-05 3.6469e-05 8.776e-06 7.71988e-06 19
end_path:out1:RootOutput(write) 4.76291 6.89923 10.2908 6.96776 1.17601 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5514.37 MB
Peak resident set size usage (VmHWM): 3504.45 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0326_df-s03-d1_dw_0_20260203T204602_reco_stage0_20260204T010436_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0326_df-s03-d1_dw_0_20260203T204602_reco_stage0_20260204T010436_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0326_df-s03-d1_dw_0_20260203T204602_reco_stage0_20260204T010436_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163249.0,
"core.end_time": 1770167078.0,
"core.events": [
37173,
37179,
37185,
37191,
37197,
37203,
37209,
37215,
37221,
37227,
37233,
37239,
37245,
37251,
37257,
37263,
37269,
37275,
37281
],
"core.event_count": 19,
"core.first_event_number": 37173,
"core.last_event_number": 37281,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0326_df-s03-d1_dw_0_20260203T204602.hdf5"
}
]
} 