Jobsub ID 297916.144@dunegpschedd02.fnal.gov
| Jobsub ID | 297916.144@dunegpschedd02.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:46:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce505 |
| Last heartbeat | 2026-02-03 23:54:28 |
| From worker node | Hostname | b9p35p0031.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:07:32 |
| Input files | vd-protodune:np02vd_raw_run042422_0088_df-s02-d1_dw_0_20260203T160220.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 44m (2665s) |
| CPU time | 42m (2569s = 96%) |
| Max RSS bytes | 2766114816 (2637 MiB) |
| Outputting started | 2026-02-03 23:51:58 |
| Output files | |
| Finished | 2026-02-03 23:54:28 |
| Saved logs | justin-logs:297916.144-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
42c70
Caught exception in looking up space point ptr... 0x8e42c70, 0x257d0960
Caught exception in looking up space point ptr... 0x3fb911f0, 0x59507d10
Caught exception in looking up space point ptr... 0x59507d10, 0x2b3c5e80
Caught exception in looking up space point ptr... 0x2b3c5e80, 0x4c922a60
Caught exception in looking up space point ptr... 0x4c922a60, 0x3ac47d50
Caught exception in looking up space point ptr... 0x22a77d60, 0x526a74f0
Caught exception in looking up space point ptr... 0x526a74f0, 0x21116930
Caught exception in looking up space point ptr... 0x3893c780, 0x617e9780
Caught exception in looking up space point ptr... 0x617e9780, 0x45248720
Caught exception in looking up space point ptr... 0x5f7576c0, 0x1579b7b0
Caught exception in looking up space point ptr... 0x2bb4e0c0, 0x450eb340
Caught exception in looking up space point ptr... 0x450eb340, 0x5f757c20
Caught exception in looking up space point ptr... 0x5f757c20, 0x5f7576c0
Caught exception in looking up space point ptr... 0x2b0c2910, 0x2b0ae040
Caught exception in looking up space point ptr... 0x2b0ae040, 0x2b0c2910
Caught exception in looking up space point ptr... 0x2134d970, 0x2081a0c0
Caught exception in looking up space point ptr... 0x2081a0c0, 0x20813a10
Caught exception in looking up space point ptr... 0x926e670, 0x4485e710
Caught exception in looking up space point ptr... 0x2d9a8ab0, 0x926e670
Caught exception in looking up space point ptr... 0x3e1d1720, 0x3e1d1800
Caught exception in looking up space point ptr... 0x3e1d1800, 0x234776f0
Caught exception in looking up space point ptr... 0x60989660, 0x1180f320
Caught exception in looking up space point ptr... 0x609897f0, 0x60989660
Caught exception in looking up space point ptr... 0x2ea42210, 0x2ea42120
Caught exception in looking up space point ptr... 0x2ea42030, 0x2ea42210
Caught exception in looking up space point ptr... 0x54485400, 0x3883ac30
Caught exception in looking up space point ptr... 0x45c13a10, 0x54485400
Caught exception in looking up space point ptr... 0x30f89260, 0x30f76980
Caught exception in looking up space point ptr... 0x235d7000, 0x30f89260
Caught exception in looking up space point ptr... 0x235f23f0, 0x235dfb10
Caught exception in looking up space point ptr... 0x60956cb0, 0x235f23f0
Caught exception in looking up space point ptr... 0x4b6ba320, 0x5b92fae0
Caught exception in looking up space point ptr... 0x5b92fae0, 0x3ac4d810
Caught exception in looking up space point ptr... 0x2b1299d0, 0x3a5f9690
Caught exception in looking up space point ptr... 0x52560310, 0x2b1299d0
Caught exception in looking up space point ptr... 0x4e7b1740, 0xa507d30
Caught exception in looking up space point ptr... 0x44ac75b0, 0x4e7b1740
Caught exception in looking up space point ptr... 0x28a9b7d0, 0x28a893a0
Caught exception in looking up space point ptr... 0x28a28990, 0x28a9b7d0
Caught exception in looking up space point ptr... 0x3bac2590, 0x2d4c9950
Caught exception in looking up space point ptr... 0x2d4c9950, 0x3bac2720
Caught exception in looking up space point ptr... 0x61aade60, 0x61a9bd50
Caught exception in looking up space point ptr... 0x3930f530, 0x61aade60
Caught exception in looking up space point ptr... 0x488e3180, 0x2b34b220
Caught exception in looking up space point ptr... 0x2b34b220, 0x488e2ff0
Caught exception in looking up space point ptr... 0x4e345d40, 0x598a8360
Caught exception in looking up space point ptr... 0x598a8360, 0x4e345bb0
Caught exception in looking up space point ptr... 0x343e9660, 0x42b0a5f0
Caught exception in looking up space point ptr... 0x42b0a5f0, 0x581c10a0
Caught exception in looking up space point ptr... 0x28877440, 0x87502c0
Caught exception in looking up space point ptr... 0x87502c0, 0x28877440
Caught exception in looking up space point ptr... 0xe4e7580, 0x2b004ec0
Caught exception in looking up space point ptr... 0x2b004ec0, 0xc5c5e40
Caught exception in looking up space point ptr... 0x5f7588a0, 0x5f758640
Caught exception in looking up space point ptr... 0x5f758640, 0x5f7588a0
Caught exception in looking up space point ptr... 0x2bb2cef0, 0x655253e0
Caught exception in looking up space point ptr... 0x655253e0, 0x38a108f0
Caught exception in looking up space point ptr... 0x301196f0, 0xe1aaab0
Caught exception in looking up space point ptr... 0xe1aaab0, 0x25ae1e20
Caught exception in looking up space point ptr... 0x2abc7050, 0xc6aa690
Caught exception in looking up space point ptr... 0xc6aa690, 0x29464f40
Caught exception in looking up space point ptr... 0x45c37e40, 0x2b01a780
Caught exception in looking up space point ptr... 0x2b01a780, 0x45c37e40
Caught exception in looking up space point ptr... 0x47bad520, 0xe344e20
Caught exception in looking up space point ptr... 0xe344e20, 0x47bad520
++++>>>> total num hits: 320000, num free: 314776
04-Feb-2026 00:51:52 CET Closed output file "np02vd_raw_run042422_0088_df-s02-d1_dw_0_20260203T160220_reco_stage0_20260203T235152_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 60.7309 96.5681 115.357 103.164 17.0408 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.817e-05 7.90997e-05 0.00021869 7.487e-05 2.83122e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.95646 4.40645 5.0406 4.41925 0.277439 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00885157 0.0152143 0.0384325 0.0136671 0.00628989 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.00037555 0.000614728 0.00100417 0.00056243 0.000166611 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00120875 0.00179556 0.00433868 0.00171263 0.000565025 27
produce:beamevent:BeamEvent 6.807e-05 0.000109 0.00067253 8.108e-05 0.000112053 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.80322 2.08364 2.39257 2.05997 0.134348 27
produce:ophit:OpHitFinder 0.0236295 0.0330849 0.0385846 0.0334456 0.00388509 27
produce:wclsdatavd:WireCellToolkit 44.7629 51.0919 59.4492 50.952 3.5194 27
produce:gaushit:GausHitFinder 0.534546 0.94551 1.54279 0.973511 0.227002 27
produce:nhitsfilter:NumberOfHitsFilter 0.00012351 0.000185016 0.00049102 0.0001716 6.60326e-05 27
produce:reco3d:SpacePointSolver 3.04022 6.03765 10.9933 5.7615 1.95386 27
produce:hitpdune:DisambigFromSpacePoints 0.0420454 0.15102 0.346261 0.152565 0.074071 27
produce:cluster3d:Cluster3D 0.749431 27.7297 40.6652 35.605 15.3791 27
[art]:TriggerResults:TriggerResultInserter 2.469e-05 3.48781e-05 0.00010096 3.299e-05 1.37224e-05 27
end_path:out1:RootOutput 4.67e-06 6.51741e-06 2.467e-05 5.59e-06 3.65501e-06 27
end_path:out1:RootOutput(write) 3.00686 4.04142 4.92422 4.07755 0.492884 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4812.73 MB
Peak resident set size usage (VmHWM): 2766.11 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0088_df-s02-d1_dw_0_20260203T160220_reco_stage0_20260203T235152_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0088_df-s02-d1_dw_0_20260203T160220_reco_stage0_20260203T235152_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0088_df-s02-d1_dw_0_20260203T160220_reco_stage0_20260203T235152_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160060.0,
"core.end_time": 1770162713.0,
"core.events": [
14269,
14275,
14281,
14287,
14293,
14299,
14305,
14311,
14317,
14323,
14329,
14335,
14341,
14347,
14353,
14359,
14365,
14371,
14377,
14383,
14389,
14395,
14401,
14407,
14413,
14419,
14425
],
"core.event_count": 27,
"core.first_event_number": 14269,
"core.last_event_number": 14425,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0088_df-s02-d1_dw_0_20260203T160220.hdf5"
}
]
} 