Jobsub ID 303656.43@dunegpschedd01.fnal.gov
| Jobsub ID | 303656.43@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:56:25 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce512 |
| Last heartbeat | 2026-02-04 01:31:14 |
| From worker node | Hostname | b9p10p5730.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:11:55 |
| Input files | vd-protodune:np02vd_raw_run042421_0012_df-s02-d0_dw_0_20260203T133729.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4551s) |
| CPU time | 1h (4378s = 96%) |
| Max RSS bytes | 10363928576 (9883 MiB) |
| Outputting started | 2026-02-04 01:27:49 |
| Output files | |
| Finished | 2026-02-04 01:31:14 |
| Saved logs | justin-logs:303656.43-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
point ptr... 0x10d3dbf0, 0x39699100
Caught exception in looking up space point ptr... 0x39699100, 0x28b40ce0
Caught exception in looking up space point ptr... 0x28b40ce0, 0x295ddd20
Caught exception in looking up space point ptr... 0x38f82710, 0xd6c1200
Caught exception in looking up space point ptr... 0xd6c1200, 0x4267f720
Caught exception in looking up space point ptr... 0x4267f720, 0xd6c1460
Caught exception in looking up space point ptr... 0xd6c1460, 0x3bd8b360
Caught exception in looking up space point ptr... 0x3bd8b360, 0x54ca49f0
Caught exception in looking up space point ptr... 0x54ca49f0, 0x2b5408b0
Caught exception in looking up space point ptr... 0x2b5408b0, 0x2b2bda00
Caught exception in looking up space point ptr... 0x2b2bda00, 0x12ebaa10
Caught exception in looking up space point ptr... 0x12ebaa10, 0x38f82710
Caught exception in looking up space point ptr... 0x64c60fa0, 0x35dc4660
Caught exception in looking up space point ptr... 0x35dc4660, 0x10f57100
Caught exception in looking up space point ptr... 0x2f1fc1e0, 0x64c60fa0
Caught exception in looking up space point ptr... 0x373a76a0, 0x54d053b0
Caught exception in looking up space point ptr... 0x140601e0, 0x373a76a0
Caught exception in looking up space point ptr... 0x2a406260, 0x3848d930
Caught exception in looking up space point ptr... 0x113071a0, 0x3c17d780
Caught exception in looking up space point ptr... 0x3c17d780, 0x4f6bbd60
Caught exception in looking up space point ptr... 0x4f6bbd60, 0x2a406260
Caught exception in looking up space point ptr... 0x3d021660, 0x2f515530
Caught exception in looking up space point ptr... 0x2f515530, 0x9d60aa0
Caught exception in looking up space point ptr... 0x4e2f56b0, 0x1fb5efc0
Caught exception in looking up space point ptr... 0x1fb5efc0, 0x474e2f70
Caught exception in looking up space point ptr... 0x10c467f0, 0x4e2f56b0
Caught exception in looking up space point ptr... 0xc41cf40, 0x586e2d30
Caught exception in looking up space point ptr... 0xc41cfe0, 0xc41cf40
Caught exception in looking up space point ptr... 0x28a6d3a0, 0x28a6d4d0
Caught exception in looking up space point ptr... 0x5d5ab5a0, 0x28a6d3a0
Caught exception in looking up space point ptr... 0x3210c1e0, 0x3210c310
Caught exception in looking up space point ptr... 0x3210c310, 0x44bd8c80
Caught exception in looking up space point ptr... 0x44ca6130, 0x14274520
Caught exception in looking up space point ptr... 0x14274520, 0x122280f0
Caught exception in looking up space point ptr... 0x122280f0, 0x393690d0
Caught exception in looking up space point ptr... 0xe9ec2c0, 0x38ff0a70
Caught exception in looking up space point ptr... 0x38ff0a70, 0x41237110
Caught exception in looking up space point ptr... 0x494b72f0, 0x42d2b540
Caught exception in looking up space point ptr... 0x42d2b540, 0xd76e0f0
Caught exception in looking up space point ptr... 0xd76e0f0, 0x32112010
Caught exception in looking up space point ptr... 0x32112010, 0x2a4e9410
Caught exception in looking up space point ptr... 0x4f698a90, 0x494b72f0
Caught exception in looking up space point ptr... 0x43fcbf70, 0x43fcc0a0
Caught exception in looking up space point ptr... 0x43fcc0a0, 0x1320cf30
Caught exception in looking up space point ptr... 0x39161590, 0x54cb1bc0
Caught exception in looking up space point ptr... 0x54cb1bc0, 0x39161270
Caught exception in looking up space point ptr... 0xcf4ee40, 0x2001ca40
Caught exception in looking up space point ptr... 0x2001ca40, 0x4ff368f0
Caught exception in looking up space point ptr... 0x1ffef9d0, 0x369f6660
Caught exception in looking up space point ptr... 0x369f6660, 0x1ffef9d0
Caught exception in looking up space point ptr... 0x1ffef9d0, 0xca59390
Caught exception in looking up space point ptr... 0xca59390, 0x1ffef9d0
Caught exception in looking up space point ptr... 0x4bc1c340, 0x1fbb9720
Caught exception in looking up space point ptr... 0x1fbb9720, 0x1fbb9900
Caught exception in looking up space point ptr... 0x48f88e90, 0x5884f6f0
Caught exception in looking up space point ptr... 0x5884f6f0, 0x3bfad030
Caught exception in looking up space point ptr... 0x3bfad030, 0x527823d0
Caught exception in looking up space point ptr... 0x527823d0, 0x2776c610
Caught exception in looking up space point ptr... 0x429e6290, 0x30033cf0
Caught exception in looking up space point ptr... 0x30033cf0, 0x30033aa0
Caught exception in looking up space point ptr... 0x120ce270, 0x5016f310
Caught exception in looking up space point ptr... 0x5016f310, 0x120ce270
Caught exception in looking up space point ptr... 0x64d07be0, 0x4cd76b90
Caught exception in looking up space point ptr... 0x4cd76b90, 0x12540fc0
Caught exception in looking up space point ptr... 0x4f5ec2f0, 0x44c903d0
Caught exception in looking up space point ptr... 0x44c903d0, 0x4f5ec2f0
++++>>>> total num hits: 35142, num free: 34205
04-Feb-2026 02:27:41 CET Closed output file "np02vd_raw_run042421_0012_df-s02-d0_dw_0_20260203T133729_reco_stage0_20260204T012741_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 67.4791 166.543 687.933 83.5535 187.267 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.3651e-05 8.07091e-05 0.000184342 6.7791e-05 3.58188e-05 27
produce:tpcrawdecoder:PDVDTPCReader 4.14261 5.48044 8.75888 5.17659 1.19558 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.0105245 0.0245312 0.121948 0.013289 0.0274521 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000418055 0.000515557 0.000661898 0.000522827 5.76136e-05 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00173401 0.00228769 0.00667682 0.00206228 0.000922876 27
produce:beamevent:BeamEvent 5.251e-05 0.000101694 0.000766099 6.8751e-05 0.000132455 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.96774 2.86052 3.64808 2.74297 0.488784 27
produce:ophit:OpHitFinder 0.0192584 0.0331409 0.043427 0.0339755 0.00618851 27
produce:wclsdatavd:WireCellToolkit 48.7164 57.5836 71.6784 55.0107 6.2396 27
produce:gaushit:GausHitFinder 0.402977 1.66578 6.5256 0.843622 1.85825 27
produce:nhitsfilter:NumberOfHitsFilter 0.000139422 0.000368826 0.00114663 0.000235353 0.00030683 27
produce:reco3d:SpacePointSolver 4.98721 22.4217 94.0601 12.2625 25.0306 27
produce:hitpdune:DisambigFromSpacePoints 0.0414158 0.831112 5.1986 0.0889321 1.62662 27
produce:cluster3d:Cluster3D 0.675316 70.1281 491.469 1.78727 151.225 27
[art]:TriggerResults:TriggerResultInserter 1.848e-05 3.17267e-05 8.0501e-05 2.472e-05 1.49641e-05 27
end_path:out1:RootOutput 3.06e-06 6.25489e-06 2.721e-05 5.57e-06 4.56262e-06 27
end_path:out1:RootOutput(write) 2.70966 5.48195 19.073 3.13415 4.85329 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 12968.5 MB
Peak resident set size usage (VmHWM): 10363.9 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0012_df-s02-d0_dw_0_20260203T133729_reco_stage0_20260204T012741_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0012_df-s02-d0_dw_0_20260203T133729_reco_stage0_20260204T012741_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0012_df-s02-d0_dw_0_20260203T133729_reco_stage0_20260204T012741_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163925.0,
"core.end_time": 1770168462.0,
"core.events": [
1974,
1980,
1986,
1992,
1998,
2004,
2010,
2016,
2022,
2028,
2034,
2040,
2046,
2052,
2058,
2064,
2070,
2076,
2082,
2088,
2094,
2100,
2106,
2112,
2118,
2124,
2130
],
"core.event_count": 27,
"core.first_event_number": 1974,
"core.last_event_number": 2130,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0012_df-s02-d0_dw_0_20260203T133729.hdf5"
}
]
} 