Jobsub ID 303651.173@dunegpschedd01.fnal.gov
| Jobsub ID | 303651.173@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:50:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce508 |
| Last heartbeat | 2026-02-03 23:57:38 |
| From worker node | Hostname | b9p34p0003.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:23:37 |
| Input files | vd-protodune:np02vd_raw_run042421_0076_df-s03-d0_dw_0_20260203T141210.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 31m (1907s) |
| CPU time | 30m (1811s = 94%) |
| Max RSS bytes | 2623475712 (2501 MiB) |
| Outputting started | 2026-02-03 23:55:26 |
| Output files | |
| Finished | 2026-02-03 23:57:38 |
| Saved logs | justin-logs:303651.173-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Caught exception in looking up space point ptr... 0x5a93cd40, 0x5a93ced0
Caught exception in looking up space point ptr... 0x29baf240, 0x41b49d20
Caught exception in looking up space point ptr... 0x41b49d20, 0x529b0770
Caught exception in looking up space point ptr... 0x29baf240, 0x753a660
Caught exception in looking up space point ptr... 0x753a660, 0x29baf240
Caught exception in looking up space point ptr... 0x3fc32410, 0x3fc32310
Caught exception in looking up space point ptr... 0x3fd08f60, 0x3fc32410
Caught exception in looking up space point ptr... 0x5307b970, 0x2f08bfc0
Caught exception in looking up space point ptr... 0x2f08bfc0, 0x5307b970
Caught exception in looking up space point ptr... 0x2971f110, 0x2971efc0
Caught exception in looking up space point ptr... 0x2971efc0, 0x43c9ff30
Caught exception in looking up space point ptr... 0x4e0d74a0, 0x4db18aa0
Caught exception in looking up space point ptr... 0x4db18aa0, 0x4e0d74a0
Caught exception in looking up space point ptr... 0x497e9fd0, 0x497e9dd0
Caught exception in looking up space point ptr... 0x497e9dd0, 0x46cdd7d0
Caught exception in looking up space point ptr... 0x445aa6c0, 0x1f9d17a0
Caught exception in looking up space point ptr... 0x1f9d17a0, 0x445aa6c0
Caught exception in looking up space point ptr... 0x3da5fe10, 0x3da5faa0
Caught exception in looking up space point ptr... 0x3da5faa0, 0x3da5fe10
Caught exception in looking up space point ptr... 0x41b5d3e0, 0x41b5b000
Caught exception in looking up space point ptr... 0x41b5b000, 0x41b5d3e0
Caught exception in looking up space point ptr... 0x4c0ed1d0, 0x14021e90
Caught exception in looking up space point ptr... 0x2ac3f6d0, 0x4c0ed1d0
Caught exception in looking up space point ptr... 0x46ccbd40, 0x2ac446b0
Caught exception in looking up space point ptr... 0x2ac446b0, 0x46ccbd40
Caught exception in looking up space point ptr... 0x3fd2e2e0, 0x29d85c20
Caught exception in looking up space point ptr... 0x5e5ba730, 0x3fd2e2e0
Caught exception in looking up space point ptr... 0x442e8330, 0x442e81e0
Caught exception in looking up space point ptr... 0x442e81e0, 0x442e8330
Caught exception in looking up space point ptr... 0x2e441cd0, 0x2e441a70
Caught exception in looking up space point ptr... 0x2e441a70, 0x2e441cd0
Caught exception in looking up space point ptr... 0x11ccaa70, 0x2aee8ae0
Caught exception in looking up space point ptr... 0x2aee8ae0, 0x14edc010
Caught exception in looking up space point ptr... 0x25a47250, 0x25a506f0
Caught exception in looking up space point ptr... 0x25a506f0, 0x25a4fa40
Caught exception in looking up space point ptr... 0xf2a54e0, 0x45dd96d0
Caught exception in looking up space point ptr... 0x45dd96d0, 0x4c1739f0
Caught exception in looking up space point ptr... 0x4d3d38b0, 0x4d3c7020
Caught exception in looking up space point ptr... 0x4d3c7020, 0x4d3d38b0
Caught exception in looking up space point ptr... 0x4c692d70, 0x4c69b840
Caught exception in looking up space point ptr... 0x4c69b840, 0x4c692d70
Caught exception in looking up space point ptr... 0x2ff1b640, 0x2ff1b470
Caught exception in looking up space point ptr... 0x2ff1b470, 0x2ff0bed0
Caught exception in looking up space point ptr... 0xc21e0d0, 0x5e2e2360
Caught exception in looking up space point ptr... 0x5e2e2360, 0x5e2e25d0
Caught exception in looking up space point ptr... 0x13487250, 0x1348d360
Caught exception in looking up space point ptr... 0x1348d360, 0x134873b0
Caught exception in looking up space point ptr... 0x29baee80, 0x29bba9d0
Caught exception in looking up space point ptr... 0x29bba9d0, 0x29badb80
Caught exception in looking up space point ptr... 0x14116d80, 0x141169f0
Caught exception in looking up space point ptr... 0x141169f0, 0x14116d80
Caught exception in looking up space point ptr... 0x36414a20, 0xf6c5f60
Caught exception in looking up space point ptr... 0xf6c5f60, 0x36414a20
Caught exception in looking up space point ptr... 0x50329580, 0x50329280
Caught exception in looking up space point ptr... 0x50329280, 0x50329380
Caught exception in looking up space point ptr... 0x45e55a80, 0x54a32010
Caught exception in looking up space point ptr... 0x54a32010, 0x45e55a80
Caught exception in looking up space point ptr... 0x58052b70, 0x514abce0
Caught exception in looking up space point ptr... 0x514abce0, 0x52828760
Caught exception in looking up space point ptr... 0x2e435cc0, 0x2e435a00
Caught exception in looking up space point ptr... 0x2e435a00, 0x2e435cc0
Caught exception in looking up space point ptr... 0x2af46670, 0x2af46770
Caught exception in looking up space point ptr... 0x2af46770, 0x2af46670
Caught exception in looking up space point ptr... 0x34370e90, 0x2094c3c0
Caught exception in looking up space point ptr... 0x2094c3c0, 0x34370e90
++++>>>> total num hits: 83037, num free: 79670
04-Feb-2026 00:55:19 CET Closed output file "np02vd_raw_run042421_0076_df-s03-d0_dw_0_20260203T141210_reco_stage0_20260203T235519_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 61.4005 68.5109 91.2496 67.4956 6.11465 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.647e-05 7.66146e-05 0.000188371 7.335e-05 2.29539e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.48587 4.51889 23.6445 3.78195 3.75742 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00862506 0.0137836 0.0296785 0.0112806 0.0056724 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000329572 0.00081348 0.00881161 0.000449562 0.00157351 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00107394 0.00148592 0.00257406 0.00144584 0.000296147 27
produce:beamevent:BeamEvent 6.016e-05 0.000107388 0.000639653 8.276e-05 0.00010569 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.57553 2.00623 2.32613 2.06226 0.187193 27
produce:ophit:OpHitFinder 0.020807 0.0339541 0.042071 0.0345107 0.00519283 27
produce:wclsdatavd:WireCellToolkit 43.8132 47.1097 53.2763 46.822 2.63031 27
produce:gaushit:GausHitFinder 0.561161 0.746735 1.28093 0.688525 0.171516 27
produce:nhitsfilter:NumberOfHitsFilter 0.000130571 0.000176248 0.000342712 0.000160031 4.59347e-05 27
produce:reco3d:SpacePointSolver 5.7899 8.63386 11.6311 8.42126 1.63923 27
produce:hitpdune:DisambigFromSpacePoints 0.0472379 0.0856062 0.137937 0.0795453 0.0259093 27
produce:cluster3d:Cluster3D 0.781185 1.42341 2.59649 1.42503 0.453105 27
[art]:TriggerResults:TriggerResultInserter 2.232e-05 3.15954e-05 8.9101e-05 3e-05 1.20493e-05 27
end_path:out1:RootOutput 4.31e-06 5.75485e-06 2.0071e-05 5.02e-06 2.88045e-06 27
end_path:out1:RootOutput(write) 2.90985 3.90802 5.01708 3.83381 0.549311 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4585.62 MB
Peak resident set size usage (VmHWM): 2623.48 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0076_df-s03-d0_dw_0_20260203T141210_reco_stage0_20260203T235519_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0076_df-s03-d0_dw_0_20260203T141210_reco_stage0_20260203T235519_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0076_df-s03-d0_dw_0_20260203T141210_reco_stage0_20260203T235519_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161026.0,
"core.end_time": 1770162920.0,
"core.events": [
12380,
12386,
12392,
12398,
12404,
12410,
12416,
12422,
12428,
12434,
12440,
12446,
12452,
12458,
12464,
12470,
12476,
12482,
12488,
12494,
12500,
12506,
12512,
12518,
12524,
12530,
12536
],
"core.event_count": 27,
"core.first_event_number": 12380,
"core.last_event_number": 12536,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0076_df-s03-d0_dw_0_20260203T141210.hdf5"
}
]
} 