Jobsub ID 303653.185@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.185@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce504 |
| Last heartbeat | 2026-02-04 00:31:12 |
| From worker node | Hostname | b9p02p3882.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:48:15 |
| Input files | vd-protodune:np02vd_raw_run042421_0097_df-s03-d1_dw_0_20260203T142329.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 40m (2431s) |
| CPU time | 38m (2329s = 95%) |
| Max RSS bytes | 2624012288 (2502 MiB) |
| Outputting started | 2026-02-04 00:28:47 |
| Output files | |
| Finished | 2026-02-04 00:31:12 |
| Saved logs | justin-logs:303653.185-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
x41b85a50
Caught exception in looking up space point ptr... 0x41b85a50, 0x41b85be0
Caught exception in looking up space point ptr... 0x41b7a3a0, 0x41b7a210
Caught exception in looking up space point ptr... 0x41b7a210, 0x41b7c640
Caught exception in looking up space point ptr... 0x2a8e44b0, 0x203d9190
Caught exception in looking up space point ptr... 0x203d9190, 0xd856450
Caught exception in looking up space point ptr... 0x42bab4a0, 0x6441c0c0
Caught exception in looking up space point ptr... 0x592ea7d0, 0x42bab4a0
Caught exception in looking up space point ptr... 0x8530420, 0x852ff60
Caught exception in looking up space point ptr... 0x852ff60, 0x8530420
Caught exception in looking up space point ptr... 0x501ed5f0, 0x3c37f460
Caught exception in looking up space point ptr... 0x3c37f460, 0x3c37f700
Caught exception in looking up space point ptr... 0x21ec01e0, 0x21ec0090
Caught exception in looking up space point ptr... 0x21ec0090, 0x21ec01e0
Caught exception in looking up space point ptr... 0x4ad63bb0, 0x12e33db0
Caught exception in looking up space point ptr... 0x12e33db0, 0xaafe910
Caught exception in looking up space point ptr... 0xe36ab90, 0xe36ae70
Caught exception in looking up space point ptr... 0xe36ae70, 0xe367640
Caught exception in looking up space point ptr... 0x553563a0, 0x5534a0b0
Caught exception in looking up space point ptr... 0x11645130, 0x553560c0
Caught exception in looking up space point ptr... 0x553560c0, 0x55360db0
Caught exception in looking up space point ptr... 0x55355d30, 0x553563a0
Caught exception in looking up space point ptr... 0x4e395b30, 0x4ca7b210
Caught exception in looking up space point ptr... 0x4ca7b210, 0x4e395b30
Caught exception in looking up space point ptr... 0x58d74010, 0xcd29d60
Caught exception in looking up space point ptr... 0x58d73e80, 0x58d74010
Caught exception in looking up space point ptr... 0x28f216f0, 0x104dce10
Caught exception in looking up space point ptr... 0x104dce10, 0x28f216f0
Caught exception in looking up space point ptr... 0x4dbea490, 0x4dbea0a0
Caught exception in looking up space point ptr... 0x4dbea0a0, 0x4dbe9f50
Caught exception in looking up space point ptr... 0x1529c590, 0x2b450a10
Caught exception in looking up space point ptr... 0x45e2ffe0, 0x1529c590
Caught exception in looking up space point ptr... 0x7c27a20, 0x50407350
Caught exception in looking up space point ptr... 0x50407350, 0x7c27a20
Caught exception in looking up space point ptr... 0x27ce8860, 0x27ce89b0
Caught exception in looking up space point ptr... 0x27ce89b0, 0x27ce8860
Caught exception in looking up space point ptr... 0x27ce8860, 0x26d141e0
Caught exception in looking up space point ptr... 0x26d141e0, 0x27ce8860
Caught exception in looking up space point ptr... 0x37049560, 0xe7ff5e0
Caught exception in looking up space point ptr... 0xe7ff5e0, 0x37049560
Caught exception in looking up space point ptr... 0x37049560, 0x1241dbe0
Caught exception in looking up space point ptr... 0x1241dbe0, 0x37049560
Caught exception in looking up space point ptr... 0x4d750970, 0x46939f40
Caught exception in looking up space point ptr... 0x46939f40, 0x4d750970
Caught exception in looking up space point ptr... 0x28dbe4d0, 0x49671430
Caught exception in looking up space point ptr... 0x49671430, 0x27b6c3f0
Caught exception in looking up space point ptr... 0x2ce282d0, 0x30f4f8f0
Caught exception in looking up space point ptr... 0x30f4f8f0, 0x42a08ac0
Caught exception in looking up space point ptr... 0x51035340, 0x510351b0
Caught exception in looking up space point ptr... 0x510351b0, 0x51035340
Caught exception in looking up space point ptr... 0x348276b0, 0x2b5bbd60
Caught exception in looking up space point ptr... 0x2b5bbd60, 0x348276b0
Caught exception in looking up space point ptr... 0x348276b0, 0x559d96f0
Caught exception in looking up space point ptr... 0x559d96f0, 0x348276b0
Caught exception in looking up space point ptr... 0x258d54a0, 0x559ddac0
Caught exception in looking up space point ptr... 0x559ddac0, 0x258d51c0
Caught exception in looking up space point ptr... 0x13df3d30, 0x4d780740
Caught exception in looking up space point ptr... 0x4d780740, 0x13df3d30
Caught exception in looking up space point ptr... 0x2b5ba2c0, 0x2b5ba900
Caught exception in looking up space point ptr... 0x2b5ba900, 0x2b5ba2c0
Caught exception in looking up space point ptr... 0x22de29b0, 0x2d69ea50
Caught exception in looking up space point ptr... 0x2d69ea50, 0x47473050
Caught exception in looking up space point ptr... 0x12c70ff0, 0x33a52c40
Caught exception in looking up space point ptr... 0x33a52c40, 0x12c70ff0
Caught exception in looking up space point ptr... 0x59b3c8e0, 0x59b394f0
Caught exception in looking up space point ptr... 0x59b394f0, 0x59b3c8e0
++++>>>> total num hits: 49910, num free: 47836
04-Feb-2026 01:28:38 CET Closed output file "np02vd_raw_run042421_0097_df-s03-d1_dw_0_20260203T142329_reco_stage0_20260204T002838_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 72.621 87.7056 101.244 85.8392 7.20227 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.919e-05 0.000101317 0.000177762 8.7731e-05 3.55055e-05 27
produce:tpcrawdecoder:PDVDTPCReader 4.07758 4.57788 5.00395 4.59068 0.214505 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.0117613 0.0223443 0.221924 0.0134997 0.0394832 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000455635 0.000597367 0.000942091 0.000576257 0.000112313 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0015691 0.00194501 0.00269205 0.00190573 0.000221399 27
produce:beamevent:BeamEvent 7.8631e-05 0.000179936 0.00153234 0.000129801 0.00026886 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.06106 2.80229 3.42875 2.79891 0.353107 27
produce:ophit:OpHitFinder 0.0235101 0.0370569 0.0444167 0.0364272 0.00584687 27
produce:wclsdatavd:WireCellToolkit 55.6225 62.9527 76.506 62.664 5.58474 27
produce:gaushit:GausHitFinder 0.532849 0.912145 1.67698 0.865721 0.294725 27
produce:nhitsfilter:NumberOfHitsFilter 0.000163402 0.00024847 0.000418714 0.000225162 6.44715e-05 27
produce:reco3d:SpacePointSolver 3.63668 9.93524 16.6189 10.0517 3.07451 27
produce:hitpdune:DisambigFromSpacePoints 0.0433894 0.0942997 0.168392 0.084813 0.0333628 27
produce:cluster3d:Cluster3D 0.668335 2.38503 13.9635 1.90756 2.41806 27
[art]:TriggerResults:TriggerResultInserter 2.165e-05 3.26644e-05 7.6791e-05 2.873e-05 1.20105e-05 27
end_path:out1:RootOutput 3.27e-06 7.01415e-06 2.026e-05 6.27e-06 3.52652e-06 27
end_path:out1:RootOutput(write) 2.98138 3.95993 4.96102 3.96233 0.605641 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4588.7 MB
Peak resident set size usage (VmHWM): 2624.01 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0097_df-s03-d1_dw_0_20260203T142329_reco_stage0_20260204T002838_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0097_df-s03-d1_dw_0_20260203T142329_reco_stage0_20260204T002838_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0097_df-s03-d1_dw_0_20260203T142329_reco_stage0_20260204T002838_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162508.0,
"core.end_time": 1770164920.0,
"core.events": [
15783,
15789,
15795,
15801,
15807,
15813,
15819,
15825,
15831,
15837,
15843,
15849,
15855,
15861,
15867,
15873,
15879,
15885,
15891,
15897,
15903,
15909,
15915,
15921,
15927,
15933,
15939
],
"core.event_count": 27,
"core.first_event_number": 15783,
"core.last_event_number": 15939,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0097_df-s03-d1_dw_0_20260203T142329.hdf5"
}
]
} 