Jobsub ID 297921.40@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.40@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce511 |
| Last heartbeat | 2026-02-04 00:34:15 |
| From worker node | Hostname | b9p02p3983.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:47:59 |
| Input files | vd-protodune:np02vd_raw_run042433_0544_df-s03-d1_dw_0_20260203T220854.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 44m (2644s) |
| CPU time | 42m (2543s = 96%) |
| Max RSS bytes | 3387842560 (3230 MiB) |
| Outputting started | 2026-02-04 00:32:05 |
| Output files | |
| Finished | 2026-02-04 00:34:15 |
| Saved logs | justin-logs:297921.40-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x4bb505a0, 0x49452d70
Caught exception in looking up space point ptr... 0x49452d70, 0x4bb505a0
Caught exception in looking up space point ptr... 0x150578e0, 0x150577e0
Caught exception in looking up space point ptr... 0x150425f0, 0x150578e0
Caught exception in looking up space point ptr... 0x77ff7020, 0x406ed820
Caught exception in looking up space point ptr... 0x406ed820, 0x406ec9e0
Caught exception in looking up space point ptr... 0x39d51520, 0x744187a0
Caught exception in looking up space point ptr... 0x3cfddf10, 0x39d51520
Caught exception in looking up space point ptr... 0x16818f00, 0x16818d70
Caught exception in looking up space point ptr... 0x16818d70, 0x16818f00
Caught exception in looking up space point ptr... 0x50482720, 0x18dcc540
Caught exception in looking up space point ptr... 0x18dcc540, 0x327ec8f0
Caught exception in looking up space point ptr... 0x6475f4a0, 0x50482720
Caught exception in looking up space point ptr... 0x4e3f20e0, 0x4e3fe980
Caught exception in looking up space point ptr... 0x4e3fe980, 0x4e3f20e0
Caught exception in looking up space point ptr... 0x4e3f20e0, 0x4e3fec20
Caught exception in looking up space point ptr... 0x4e3fec20, 0x4e3f20e0
Caught exception in looking up space point ptr... 0x4e3f20e0, 0x4e3f1f50
Caught exception in looking up space point ptr... 0x4e3f1f50, 0x4e3f20e0
Caught exception in looking up space point ptr... 0x181359b0, 0x1812dfd0
Caught exception in looking up space point ptr... 0x1812dfd0, 0x18134e50
Caught exception in looking up space point ptr... 0x15036660, 0x15033f80
Caught exception in looking up space point ptr... 0x15033f80, 0x15036660
Caught exception in looking up space point ptr... 0x15036660, 0x15033860
Caught exception in looking up space point ptr... 0x15033860, 0x15036660
Caught exception in looking up space point ptr... 0x4cef91c0, 0x4cef9070
Caught exception in looking up space point ptr... 0x4cef9070, 0x4cef91c0
Caught exception in looking up space point ptr... 0x4cef91c0, 0x4cef95b0
Caught exception in looking up space point ptr... 0x4cef95b0, 0x4cef91c0
Caught exception in looking up space point ptr... 0x19cbe4f0, 0x19cbe040
Caught exception in looking up space point ptr... 0x19cbe040, 0x19cbe1d0
Caught exception in looking up space point ptr... 0x7d7686c0, 0x7d7683a0
Caught exception in looking up space point ptr... 0x7d7683a0, 0x7d7686c0
Caught exception in looking up space point ptr... 0x683d36e0, 0x683d4060
Caught exception in looking up space point ptr... 0x683d4060, 0x683d36e0
Caught exception in looking up space point ptr... 0x13c71f90, 0x13c72150
Caught exception in looking up space point ptr... 0x13c72150, 0x13c71f90
Caught exception in looking up space point ptr... 0x137b5570, 0x137b5bb0
Caught exception in looking up space point ptr... 0x137b5bb0, 0x137b91c0
Caught exception in looking up space point ptr... 0x683d3940, 0x683d3350
Caught exception in looking up space point ptr... 0x683d3350, 0x683d3940
Caught exception in looking up space point ptr... 0x39d6bdb0, 0x4734a510
Caught exception in looking up space point ptr... 0x4734a510, 0x39d6bdb0
Caught exception in looking up space point ptr... 0x7d762a40, 0x7d7628b0
Caught exception in looking up space point ptr... 0x7d7628b0, 0x7d762030
Caught exception in looking up space point ptr... 0x356dae40, 0x356dd440
Caught exception in looking up space point ptr... 0x356dd440, 0x356dae40
Caught exception in looking up space point ptr... 0x356dae40, 0x356dff10
Caught exception in looking up space point ptr... 0x356dff10, 0x356dae40
Caught exception in looking up space point ptr... 0x4ced2800, 0x4ced1e00
Caught exception in looking up space point ptr... 0x4ced1e00, 0x4ced2990
Caught exception in looking up space point ptr... 0x5e6ab1a0, 0x5e6ab330
Caught exception in looking up space point ptr... 0x5e6ab330, 0x5e6ab1a0
Caught exception in looking up space point ptr... 0x5e6ab1a0, 0x5e6ab510
Caught exception in looking up space point ptr... 0x5e6ab510, 0x5e6ab1a0
Caught exception in looking up space point ptr... 0x535a9970, 0x6dc24680
Caught exception in looking up space point ptr... 0x6dc24680, 0x535a9970
Caught exception in looking up space point ptr... 0x11064b00, 0x110665e0
Caught exception in looking up space point ptr... 0x110665e0, 0x11064b00
Caught exception in looking up space point ptr... 0x1503ac80, 0x1503abb0
Caught exception in looking up space point ptr... 0x1503abb0, 0x1503ac80
Caught exception in looking up space point ptr... 0x1503ac80, 0x1503aa70
Caught exception in looking up space point ptr... 0x1503aa70, 0x1503ac80
Caught exception in looking up space point ptr... 0x43f56200, 0x43f563e0
Caught exception in looking up space point ptr... 0x43f563e0, 0x43f56980
Caught exception in looking up space point ptr... 0x3764eb50, 0x3764e350
Caught exception in looking up space point ptr... 0x3764e350, 0x37650220
++++>>>> total num hits: 71268, num free: 68242
04-Feb-2026 01:31:57 CET Closed output file "np02vd_raw_run042433_0544_df-s03-d1_dw_0_20260203T220854_reco_stage0_20260204T003157_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 120.205 136.283 158.744 135.486 9.76689 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.222e-05 8.76732e-05 0.00018256 7.951e-05 2.82863e-05 19
produce:tpcrawdecoder:PDVDTPCReader 5.97233 6.86537 14.1611 6.4452 1.759 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.00966352 0.0176817 0.0468593 0.0139398 0.00848943 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000442641 0.000530577 0.000836544 0.000499162 9.17648e-05 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000413701 0.000497248 0.000765553 0.000472271 7.82443e-05 19
produce:beamevent:BeamEvent 5.833e-05 0.000128417 0.000915994 8.174e-05 0.000186248 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.38233 2.88111 3.10253 2.89468 0.150216 19
produce:ophit:OpHitFinder 0.0254454 0.0364828 0.0423052 0.0374978 0.0045554 19
produce:wclsdatavd:WireCellToolkit 92.111 103.919 126.158 101.077 9.11791 19
produce:gaushit:GausHitFinder 0.757004 1.13369 1.70985 1.16252 0.243844 19
produce:nhitsfilter:NumberOfHitsFilter 0.00021171 0.000302118 0.000728292 0.00027204 0.000110972 19
produce:reco3d:SpacePointSolver 9.65265 14.067 20.3599 14.0238 3.14013 19
produce:hitpdune:DisambigFromSpacePoints 0.0820055 0.159421 0.247606 0.144684 0.0520538 19
produce:cluster3d:Cluster3D 1.25071 2.13813 6.43844 1.94619 1.13286 19
[art]:TriggerResults:TriggerResultInserter 2.16e-05 3.44916e-05 0.000123671 2.541e-05 2.33947e-05 19
end_path:out1:RootOutput 3.82e-06 7.46421e-06 3.376e-05 5.87e-06 6.31704e-06 19
end_path:out1:RootOutput(write) 4.22227 5.03537 5.86955 4.94154 0.475775 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5400.16 MB
Peak resident set size usage (VmHWM): 3387.84 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0544_df-s03-d1_dw_0_20260203T220854_reco_stage0_20260204T003157_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0544_df-s03-d1_dw_0_20260203T220854_reco_stage0_20260204T003157_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0544_df-s03-d1_dw_0_20260203T220854_reco_stage0_20260204T003157_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162490.0,
"core.end_time": 1770165118.0,
"core.events": [
62025,
62031,
62037,
62043,
62049,
62055,
62061,
62067,
62073,
62079,
62085,
62091,
62097,
62103,
62109,
62115,
62121,
62127,
62133
],
"core.event_count": 19,
"core.first_event_number": 62025,
"core.last_event_number": 62133,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0544_df-s03-d1_dw_0_20260203T220854.hdf5"
}
]
} 