Jobsub ID 297917.167@dunegpschedd02.fnal.gov
| Jobsub ID | 297917.167@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:25 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce509 |
| Last heartbeat | 2026-02-04 01:00:50 |
| From worker node | Hostname | b9p04p3844.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:25:13 |
| Input files | vd-protodune:np02vd_raw_run042421_0027_df-s02-d1_dw_0_20260203T134536.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5564s) |
| CPU time | 1h (5310s = 95%) |
| Max RSS bytes | 8272994304 (7889 MiB) |
| Outputting started | 2026-02-04 00:57:59 |
| Output files | |
| Finished | 2026-02-04 01:00:50 |
| Saved logs | justin-logs:297917.167-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
x33698320, 0x51670870
Caught exception in looking up space point ptr... 0x28885a10, 0x28885c50
Caught exception in looking up space point ptr... 0x28885c50, 0x28887330
Caught exception in looking up space point ptr... 0x5ef1d770, 0x49542400
Caught exception in looking up space point ptr... 0x5ef1d670, 0x5ef1d770
Caught exception in looking up space point ptr... 0x42b6e200, 0x42b6e060
Caught exception in looking up space point ptr... 0x42b6e060, 0x42b6e200
Caught exception in looking up space point ptr... 0x2893a9b0, 0x2893a510
Caught exception in looking up space point ptr... 0x2893a510, 0x2ab36550
Caught exception in looking up space point ptr... 0xa06d5c50, 0xa06d57d0
Caught exception in looking up space point ptr... 0x37d67ba0, 0xa06d5c50
Caught exception in looking up space point ptr... 0x49eeb650, 0xd202670
Caught exception in looking up space point ptr... 0xd202670, 0x394af2e0
Caught exception in looking up space point ptr... 0x39f1b670, 0xcbe3fc0
Caught exception in looking up space point ptr... 0x29b27430, 0x39f1b670
Caught exception in looking up space point ptr... 0x2c00f470, 0x5bdae730
Caught exception in looking up space point ptr... 0x5bdae730, 0x2c00f190
Caught exception in looking up space point ptr... 0x34844c40, 0x34845490
Caught exception in looking up space point ptr... 0x34845490, 0x34844c40
Caught exception in looking up space point ptr... 0xf23aa30, 0xf2368f0
Caught exception in looking up space point ptr... 0xf23ab30, 0xf23aa30
Caught exception in looking up space point ptr... 0x49d18990, 0x49d1a2f0
Caught exception in looking up space point ptr... 0x49d1a2f0, 0x49d1a1a0
Caught exception in looking up space point ptr... 0x49d184e0, 0x49d18800
Caught exception in looking up space point ptr... 0x49d18800, 0x49d18990
Caught exception in looking up space point ptr... 0x69a0d400, 0x4f6a5420
Caught exception in looking up space point ptr... 0x347b1a40, 0x69a0d400
Caught exception in looking up space point ptr... 0x49360f30, 0x55de0470
Caught exception in looking up space point ptr... 0x55de0470, 0x560d05d0
Caught exception in looking up space point ptr... 0x30237090, 0xdb90c430
Caught exception in looking up space point ptr... 0xdb90c430, 0x699eb300
Caught exception in looking up space point ptr... 0x48e68760, 0x48e63ea0
Caught exception in looking up space point ptr... 0x48e63ea0, 0x48e64350
Caught exception in looking up space point ptr... 0x39519c50, 0x40343620
Caught exception in looking up space point ptr... 0x395198b0, 0x39519c50
Caught exception in looking up space point ptr... 0x2d05a250, 0x2d05a0c0
Caught exception in looking up space point ptr... 0x2d05a0c0, 0x2d05a250
Caught exception in looking up space point ptr... 0x562950f0, 0x56294ee0
Caught exception in looking up space point ptr... 0x10d5cd150, 0x562950f0
Caught exception in looking up space point ptr... 0x56467830, 0x564673a0
Caught exception in looking up space point ptr... 0x564673a0, 0x56467830
Caught exception in looking up space point ptr... 0xf6546560, 0x4ca8a310
Caught exception in looking up space point ptr... 0x4ca24280, 0xf6546560
Caught exception in looking up space point ptr... 0x5d326900, 0x22fa6b60
Caught exception in looking up space point ptr... 0x22fa6b60, 0x499a0150
Caught exception in looking up space point ptr... 0x39f25740, 0x581ca340
Caught exception in looking up space point ptr... 0xd20a380, 0x39f25740
Caught exception in looking up space point ptr... 0x4ca8f380, 0x34dabb80
Caught exception in looking up space point ptr... 0x34dabb80, 0x4ca8f480
Caught exception in looking up space point ptr... 0x4ca8f480, 0x34dabfd0
Caught exception in looking up space point ptr... 0x8740ffe0, 0xf6544170
Caught exception in looking up space point ptr... 0xf6544170, 0x8740ffe0
Caught exception in looking up space point ptr... 0x5bdabed0, 0x213204f0
Caught exception in looking up space point ptr... 0x213204f0, 0x21320360
Caught exception in looking up space point ptr... 0x4ca22ca0, 0x4ca227f0
Caught exception in looking up space point ptr... 0x4ca227f0, 0x4ca22ca0
Caught exception in looking up space point ptr... 0x2ff0ad20, 0x2ff0af70
Caught exception in looking up space point ptr... 0x4e755040, 0x2ff0ad20
Caught exception in looking up space point ptr... 0xd2140d0, 0xd2141d0
Caught exception in looking up space point ptr... 0xd2141d0, 0xd2140d0
Caught exception in looking up space point ptr... 0x2a69f5e0, 0x37ca55e0
Caught exception in looking up space point ptr... 0x37ca55e0, 0x2a69f5e0
Caught exception in looking up space point ptr... 0x2a69f5e0, 0x37ca57b0
Caught exception in looking up space point ptr... 0x37ca57b0, 0x2a69f5e0
Caught exception in looking up space point ptr... 0x2d1682f0, 0x2d166010
Caught exception in looking up space point ptr... 0x2d166010, 0x2d1682f0
++++>>>> total num hits: 69207, num free: 67023
04-Feb-2026 01:57:47 CET Closed output file "np02vd_raw_run042421_0027_df-s02-d1_dw_0_20260203T134536_reco_stage0_20260204T005747_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 66.4511 196.373 981.195 143.615 191.988 28
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.9991e-05 0.000117013 0.000290725 9.91265e-05 5.46302e-05 28
produce:tpcrawdecoder:PDVDTPCReader 4.2078 6.35634 8.36614 6.66673 1.10258 28
produce:triggerrawdecoder:PDVDTriggerReader4 0.00988182 0.0192985 0.0573249 0.0149026 0.0098171 28
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000415096 0.000649651 0.00119375 0.000605444 0.000195335 28
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00163887 0.00273039 0.0109895 0.00229353 0.00175989 28
produce:beamevent:BeamEvent 8.2551e-05 0.000174049 0.000766912 0.000133227 0.000129504 28
produce:pdvddaphne:DAPHNEReaderPDVD 2.21193 4.60367 6.40951 4.83162 1.15409 28
produce:ophit:OpHitFinder 0.0289198 0.0707851 0.276754 0.0561028 0.0539567 28
produce:wclsdatavd:WireCellToolkit 48.5803 101.686 127.254 109.224 21.7444 28
produce:gaushit:GausHitFinder 0.580447 3.50074 14.3066 1.60856 4.24977 28
produce:nhitsfilter:NumberOfHitsFilter 0.000132402 0.000547043 0.00253178 0.00029835 0.000562133 28
produce:reco3d:SpacePointSolver 5.38457 25.3336 150.51 12.9542 34.4278 25
produce:hitpdune:DisambigFromSpacePoints 0.0416781 1.0997 10.3539 0.110007 2.741 25
produce:cluster3d:Cluster3D 0.666675 54.2331 637.51 2.19781 147.638 25
[art]:TriggerResults:TriggerResultInserter 1.288e-05 4.74264e-05 8.1191e-05 4.32955e-05 1.72982e-05 28
end_path:out1:RootOutput 5.29e-06 3.35602e-05 0.000543278 1.296e-05 9.83408e-05 28
end_path:out1:RootOutput(write) 2.76271 8.07017 31.2924 6.62184 5.7561 28
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 10376.3 MB
Peak resident set size usage (VmHWM): 8272.99 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0027_df-s02-d1_dw_0_20260203T134536_reco_stage0_20260204T005747_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0027_df-s02-d1_dw_0_20260203T134536_reco_stage0_20260204T005747_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0027_df-s02-d1_dw_0_20260203T134536_reco_stage0_20260204T005747_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161127.0,
"core.end_time": 1770166670.0,
"core.events": [
4411,
4417,
4423,
4429,
4435,
4441,
4447,
4453,
4459,
4465,
4471,
4477,
4483,
4489,
4495,
4501,
4507,
4513,
4519,
4525,
4531,
4537,
4543,
4549,
4555,
4561,
4567,
4573
],
"core.event_count": 28,
"core.first_event_number": 4411,
"core.last_event_number": 4573,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0027_df-s02-d1_dw_0_20260203T134536.hdf5"
}
]
} 