Jobsub ID 297923.78@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.78@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce513 |
| Last heartbeat | 2026-02-04 01:10:16 |
| From worker node | Hostname | b9p35p0008.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:59:04 |
| Input files | vd-protodune:np02vd_raw_run042433_0046_df-s04-d0_dw_0_20260203T185936.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4120s) |
| CPU time | 1h (4008s = 97%) |
| Max RSS bytes | 12523278336 (11943 MiB) |
| Outputting started | 2026-02-04 01:07:47 |
| Output files | |
| Finished | 2026-02-04 01:10:16 |
| Saved logs | justin-logs:297923.78-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
x85a00ba0, 0x129acdb20
Caught exception in looking up space point ptr... 0xc12a9820, 0xe341a00
Caught exception in looking up space point ptr... 0x29548070, 0xc12a9820
Caught exception in looking up space point ptr... 0x12146f460, 0x43585d50
Caught exception in looking up space point ptr... 0x43585d50, 0x1220ef7e0
Caught exception in looking up space point ptr... 0x16fcf9620, 0x11c197a60
Caught exception in looking up space point ptr... 0x7f40ce70, 0x16fcf9620
Caught exception in looking up space point ptr... 0x60d009c0, 0x324561a0
Caught exception in looking up space point ptr... 0x324561a0, 0x60d00830
Caught exception in looking up space point ptr... 0x590e53c0, 0x150191f0
Caught exception in looking up space point ptr... 0x150191f0, 0x14f7aad0
Caught exception in looking up space point ptr... 0x50df1440, 0x1126b3640
Caught exception in looking up space point ptr... 0x1126b3640, 0xc4c355e0
Caught exception in looking up space point ptr... 0x293d3360, 0x293d3220
Caught exception in looking up space point ptr... 0x293d3220, 0x293d34a0
Caught exception in looking up space point ptr... 0x609ec260, 0x104fbfb0
Caught exception in looking up space point ptr... 0x104fbfb0, 0x52763de0
Caught exception in looking up space point ptr... 0x34ca23f0, 0x12b72020
Caught exception in looking up space point ptr... 0x12b72020, 0x29556c50
Caught exception in looking up space point ptr... 0x646c9510, 0x5c845d50
Caught exception in looking up space point ptr... 0x5c845d50, 0x646c9510
Caught exception in looking up space point ptr... 0x713da000, 0x3cb933a0
Caught exception in looking up space point ptr... 0x3cb933a0, 0x713da000
Caught exception in looking up space point ptr... 0x62cd2590, 0x16fe0ebd0
Caught exception in looking up space point ptr... 0x16fe0ebd0, 0x16fe1dea0
Caught exception in looking up space point ptr... 0xfbbad750, 0xfba88e40
Caught exception in looking up space point ptr... 0xfba88e40, 0xfbbad750
Caught exception in looking up space point ptr... 0x627a4720, 0x18496800
Caught exception in looking up space point ptr... 0x18496800, 0x627a4720
Caught exception in looking up space point ptr... 0x627a4720, 0x73c59110
Caught exception in looking up space point ptr... 0x73c59110, 0x627a4720
Caught exception in looking up space point ptr... 0x14a73730, 0x14a72be0
Caught exception in looking up space point ptr... 0x14a72be0, 0x14a73730
Caught exception in looking up space point ptr... 0x50def780, 0x5c63b350
Caught exception in looking up space point ptr... 0x5c63b350, 0x5c7664c0
Caught exception in looking up space point ptr... 0x1348c6a0, 0x7da6a5b0
Caught exception in looking up space point ptr... 0x7da6a5b0, 0x1348c6a0
Caught exception in looking up space point ptr... 0xfc4781a0, 0xfc2cfb80
Caught exception in looking up space point ptr... 0xfc2cfb80, 0x2a9e4aa0
Caught exception in looking up space point ptr... 0x2923f300, 0x2923ecc0
Caught exception in looking up space point ptr... 0x2923ecc0, 0x2923eb30
Caught exception in looking up space point ptr... 0x109a75d0, 0x109a7a80
Caught exception in looking up space point ptr... 0x109a7a80, 0x109a7c10
Caught exception in looking up space point ptr... 0xbcb3ca90, 0xbcb3e1a0
Caught exception in looking up space point ptr... 0xbcb3e1a0, 0xbcb3ca90
Caught exception in looking up space point ptr... 0xbcb3ca90, 0xbcb3f800
Caught exception in looking up space point ptr... 0xbcb3f800, 0xbcb3ca90
Caught exception in looking up space point ptr... 0xb5f040d0, 0x10f044730
Caught exception in looking up space point ptr... 0x10f044730, 0xb5f040d0
Caught exception in looking up space point ptr... 0xb5f040d0, 0x837bec50
Caught exception in looking up space point ptr... 0x837bec50, 0xb5f040d0
Caught exception in looking up space point ptr... 0x7c610f90, 0x18a581480
Caught exception in looking up space point ptr... 0x18a581480, 0x7c610f90
Caught exception in looking up space point ptr... 0x7c610f90, 0x7ca0e810
Caught exception in looking up space point ptr... 0x7ca0e810, 0x7c610f90
Caught exception in looking up space point ptr... 0xe5775230, 0xe57754c0
Caught exception in looking up space point ptr... 0xe57754c0, 0xe5774fa0
Caught exception in looking up space point ptr... 0x4ea3c790, 0x2adb0fc0
Caught exception in looking up space point ptr... 0x2adb0fc0, 0x12647e8f0
Caught exception in looking up space point ptr... 0x662f73e0, 0x662f0630
Caught exception in looking up space point ptr... 0x662f0630, 0x662f73e0
Caught exception in looking up space point ptr... 0x119f70260, 0x119f6ff40
Caught exception in looking up space point ptr... 0x119f6ff40, 0x119f700d0
Caught exception in looking up space point ptr... 0xb58e7080, 0x10b64a9f0
Caught exception in looking up space point ptr... 0x762d8ee0, 0x762d9020
Caught exception in looking up space point ptr... 0x762d9020, 0xb58e7210
Caught exception in looking up space point ptr... 0xb58e7210, 0xb58e7080
++++>>>> total num hits: 4386762, num free: 4275544
04-Feb-2026 02:07:40 CET Closed output file "np02vd_raw_run042433_0046_df-s04-d0_dw_0_20260203T185936_reco_stage0_20260204T010740_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 103.49 214.212 858.892 113.741 234.475 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.546e-05 7.55773e-05 0.000209721 7.1921e-05 3.25842e-05 19
produce:tpcrawdecoder:PDVDTPCReader 5.09994 7.30263 28.9449 6.039 5.12878 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.0083707 0.0152558 0.0370366 0.0117555 0.0085809 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000385112 0.000523643 0.000677313 0.000495753 7.98704e-05 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000325491 0.000446929 0.000592633 0.000418912 8.00965e-05 19
produce:beamevent:BeamEvent 6.3191e-05 0.000113747 0.000669623 8.525e-05 0.000131959 19
produce:pdvddaphne:DAPHNEReaderPDVD 1.65993 2.02341 2.42339 2.12176 0.213166 19
produce:ophit:OpHitFinder 0.0210632 0.0318723 0.0395782 0.0327689 0.00466731 19
produce:wclsdatavd:WireCellToolkit 71.8311 80.8722 89.6402 81.9511 4.64589 19
produce:gaushit:GausHitFinder 0.580644 1.74732 9.65456 1.19763 2.01887 19
produce:nhitsfilter:NumberOfHitsFilter 0.00014527 0.00027583 0.000663413 0.000218331 0.000139844 19
produce:reco3d:SpacePointSolver 6.88836 24.1478 100.818 16.0895 23.5088 19
produce:hitpdune:DisambigFromSpacePoints 0.0734673 0.470247 2.46398 0.162511 0.708786 19
produce:cluster3d:Cluster3D 0.853911 91.251 650.59 2.1049 208.092 19
[art]:TriggerResults:TriggerResultInserter 2.4681e-05 3.7365e-05 9.573e-05 3.18e-05 1.56568e-05 19
end_path:out1:RootOutput 4.37e-06 1.26154e-05 0.000124421 5.39e-06 2.66248e-05 19
end_path:out1:RootOutput(write) 4.14457 6.30066 17.3135 4.71785 3.66235 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 15079.2 MB
Peak resident set size usage (VmHWM): 12523.3 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0046_df-s04-d0_dw_0_20260203T185936_reco_stage0_20260204T010740_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0046_df-s04-d0_dw_0_20260203T185936_reco_stage0_20260204T010740_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0046_df-s04-d0_dw_0_20260203T185936_reco_stage0_20260204T010740_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163153.0,
"core.end_time": 1770167262.0,
"core.events": [
5254,
5260,
5266,
5272,
5278,
5284,
5290,
5296,
5302,
5308,
5314,
5320,
5326,
5332,
5338,
5344,
5350,
5356,
5362
],
"core.event_count": 19,
"core.first_event_number": 5254,
"core.last_event_number": 5362,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0046_df-s04-d0_dw_0_20260203T185936.hdf5"
}
]
} 