Jobsub ID 297917.135@dunegpschedd02.fnal.gov
| Jobsub ID | 297917.135@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:25 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce505 |
| Last heartbeat | 2026-02-03 23:55:41 |
| From worker node | Hostname | b9p35p0031.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:23:08 |
| Input files | vd-protodune:np02vd_raw_run042421_0036_df-s02-d0_dw_0_20260203T135030.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 30m (1829s) |
| CPU time | 29m (1751s = 95%) |
| Max RSS bytes | 2648666112 (2525 MiB) |
| Outputting started | 2026-02-03 23:53:38 |
| Output files | |
| Finished | 2026-02-03 23:55:41 |
| Saved logs | justin-logs:297917.135-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
xception in looking up space point ptr... 0x25db08b0, 0x2a59caf0
Caught exception in looking up space point ptr... 0x2a59caf0, 0x2fa8f3c0
Caught exception in looking up space point ptr... 0x419666d0, 0x419663d0
Caught exception in looking up space point ptr... 0x419663d0, 0x419609a0
Caught exception in looking up space point ptr... 0x41960ca0, 0x419666d0
Caught exception in looking up space point ptr... 0xee4e4d0, 0xee4e1b0
Caught exception in looking up space point ptr... 0xee4e1b0, 0xee4e4d0
Caught exception in looking up space point ptr... 0xee4de90, 0xee4da60
Caught exception in looking up space point ptr... 0xee4da60, 0xee4de90
Caught exception in looking up space point ptr... 0xee4de90, 0xee4dbb0
Caught exception in looking up space point ptr... 0xee4dbb0, 0xee4de90
Caught exception in looking up space point ptr... 0xee478d0, 0xee47a60
Caught exception in looking up space point ptr... 0xee47a60, 0xee47bf0
Caught exception in looking up space point ptr... 0x13f22210, 0x13f223b0
Caught exception in looking up space point ptr... 0x13f223b0, 0x13f21f70
Caught exception in looking up space point ptr... 0x13f21e20, 0x13f2c860
Caught exception in looking up space point ptr... 0x13f2c860, 0x13f2ca40
Caught exception in looking up space point ptr... 0x5bd843a0, 0x49e57d60
Caught exception in looking up space point ptr... 0x49e57d60, 0x49e56940
Caught exception in looking up space point ptr... 0x608bf910, 0x608b5060
Caught exception in looking up space point ptr... 0x608b5060, 0x608b6e70
Caught exception in looking up space point ptr... 0x608b6e70, 0x608b64a0
Caught exception in looking up space point ptr... 0x168a6ef0, 0x168a71e0
Caught exception in looking up space point ptr... 0x168a71e0, 0x168a6ef0
Caught exception in looking up space point ptr... 0xdffc880, 0xdff9f10
Caught exception in looking up space point ptr... 0xdff9f10, 0x35a9ce80
Caught exception in looking up space point ptr... 0x415118b0, 0xeef7d30
Caught exception in looking up space point ptr... 0xeef7d30, 0x415118b0
Caught exception in looking up space point ptr... 0xee483c0, 0xee4d760
Caught exception in looking up space point ptr... 0xee4d760, 0xee4d860
Caught exception in looking up space point ptr... 0x9f3edc0, 0x3f7a0dd0
Caught exception in looking up space point ptr... 0x3f7a0dd0, 0x3bdcc840
Caught exception in looking up space point ptr... 0x811e130, 0x811df60
Caught exception in looking up space point ptr... 0x811df60, 0x811e280
Caught exception in looking up space point ptr... 0x13f2b910, 0x13f2b2d0
Caught exception in looking up space point ptr... 0x13f2b2d0, 0x13f2b140
Caught exception in looking up space point ptr... 0x13f2b140, 0x13f2b5f0
Caught exception in looking up space point ptr... 0x13f2b5f0, 0x13f2b910
Caught exception in looking up space point ptr... 0x49e583e0, 0x49e586a0
Caught exception in looking up space point ptr... 0x49e586a0, 0x49e583e0
Caught exception in looking up space point ptr... 0x41962d90, 0x41961440
Caught exception in looking up space point ptr... 0x41961440, 0x41962d90
Caught exception in looking up space point ptr... 0x4784f650, 0x47850780
Caught exception in looking up space point ptr... 0x47850780, 0x47851590
Caught exception in looking up space point ptr... 0x13e4d6d0, 0x44780970
Caught exception in looking up space point ptr... 0x44780970, 0x13e4d5f0
Caught exception in looking up space point ptr... 0x12a33040, 0x12a32b80
Caught exception in looking up space point ptr... 0x12a32b80, 0x12a33040
Caught exception in looking up space point ptr... 0x3fa0b150, 0x3fa0f590
Caught exception in looking up space point ptr... 0x3fa0b440, 0x3fa0b150
Caught exception in looking up space point ptr... 0x84cea10, 0x84ceba0
Caught exception in looking up space point ptr... 0x84ceba0, 0x84ce830
Caught exception in looking up space point ptr... 0x460ce510, 0x534e9950
Caught exception in looking up space point ptr... 0x534e9950, 0x460cdc00
Caught exception in looking up space point ptr... 0x5246b50, 0x52467e0
Caught exception in looking up space point ptr... 0x52467e0, 0x5246b50
Caught exception in looking up space point ptr... 0x13f2a430, 0x13f2a5d0
Caught exception in looking up space point ptr... 0x13f2a5d0, 0x13f2a430
Caught exception in looking up space point ptr... 0xe7dba30, 0xe7df8e0
Caught exception in looking up space point ptr... 0xe7de7f0, 0xe7dba30
Caught exception in looking up space point ptr... 0x2e7000f0, 0x2e700480
Caught exception in looking up space point ptr... 0x2e700480, 0x2e7000f0
Caught exception in looking up space point ptr... 0x3a7ea6f0, 0x3a7e5750
Caught exception in looking up space point ptr... 0x3a7e5750, 0x3a7ea6f0
Caught exception in looking up space point ptr... 0x42fa1200, 0x42fa16b0
Caught exception in looking up space point ptr... 0x42fa16b0, 0x42fa1200
++++>>>> total num hits: 42931, num free: 41384
04-Feb-2026 00:53:32 CET Closed output file "np02vd_raw_run042421_0036_df-s02-d0_dw_0_20260203T135030_reco_stage0_20260203T235332_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 59.2117 65.8704 74.0308 66.5228 4.03703 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.303e-05 7.86693e-05 0.0002291 7.431e-05 3.08085e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.76182 4.10408 4.91191 4.08968 0.210418 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00843876 0.0147941 0.0551489 0.0102064 0.0109988 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.00034718 0.000573481 0.00144568 0.00050749 0.000233927 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00118778 0.00161538 0.00291791 0.00153816 0.000357485 27
produce:beamevent:BeamEvent 5.883e-05 0.000118695 0.0008626 9.073e-05 0.000147114 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.67628 2.0586 2.45549 2.09095 0.181719 27
produce:ophit:OpHitFinder 0.0250063 0.0341238 0.0412357 0.0344392 0.00415669 27
produce:wclsdatavd:WireCellToolkit 42.3476 46.7687 54.128 45.9441 2.8893 27
produce:gaushit:GausHitFinder 0.342576 0.672891 1.05789 0.659006 0.192438 27
produce:nhitsfilter:NumberOfHitsFilter 0.0001047 0.000175638 0.00048569 0.000159651 7.46082e-05 27
produce:reco3d:SpacePointSolver 3.119 7.44271 11.9991 7.46918 2.1164 27
produce:hitpdune:DisambigFromSpacePoints 0.0306886 0.0707256 0.111921 0.0638103 0.0224228 27
produce:cluster3d:Cluster3D 0.447595 1.16506 2.42338 1.17594 0.450573 27
[art]:TriggerResults:TriggerResultInserter 2.199e-05 3.37726e-05 7.457e-05 3.305e-05 9.76376e-06 27
end_path:out1:RootOutput 4.44e-06 6.40407e-06 1.781e-05 5.61e-06 3.01779e-06 27
end_path:out1:RootOutput(write) 2.91419 3.50997 4.15025 3.46739 0.362048 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4650.54 MB
Peak resident set size usage (VmHWM): 2648.67 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0036_df-s02-d0_dw_0_20260203T135030_reco_stage0_20260203T235332_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0036_df-s02-d0_dw_0_20260203T135030_reco_stage0_20260203T235332_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0036_df-s02-d0_dw_0_20260203T135030_reco_stage0_20260203T235332_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160995.0,
"core.end_time": 1770162813.0,
"core.events": [
5880,
5886,
5892,
5898,
5904,
5910,
5916,
5922,
5928,
5934,
5940,
5946,
5952,
5958,
5964,
5970,
5976,
5982,
5988,
5994,
6000,
6006,
6012,
6018,
6024,
6030,
6036
],
"core.event_count": 27,
"core.first_event_number": 5880,
"core.last_event_number": 6036,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0036_df-s02-d0_dw_0_20260203T135030.hdf5"
}
]
} 