Jobsub ID 297917.120@dunegpschedd02.fnal.gov
| Jobsub ID | 297917.120@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:25 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce505 |
| Last heartbeat | 2026-02-03 23:56:04 |
| From worker node | Hostname | b9p35p0031.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:22:56 |
| Input files | vd-protodune:np02vd_raw_run042421_0091_df-s02-d1_dw_0_20260203T142013.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 31m (1861s) |
| CPU time | 29m (1789s = 96%) |
| Max RSS bytes | 2632429568 (2510 MiB) |
| Outputting started | 2026-02-03 23:53:59 |
| Output files | |
| Finished | 2026-02-03 23:56:04 |
| Saved logs | justin-logs:297917.120-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Caught exception in looking up space point ptr... 0x2e7f6cd0, 0x2e7f7180
Caught exception in looking up space point ptr... 0x11ae29d0, 0x11ae2b20
Caught exception in looking up space point ptr... 0x11ae2b20, 0x11ae4070
Caught exception in looking up space point ptr... 0x10a3a4e0, 0x29f84ba0
Caught exception in looking up space point ptr... 0x29f84ba0, 0x10a3a4e0
Caught exception in looking up space point ptr... 0x369423e0, 0x3692da00
Caught exception in looking up space point ptr... 0x3692da00, 0x369423e0
Caught exception in looking up space point ptr... 0x11a70380, 0x11a706a0
Caught exception in looking up space point ptr... 0x11a706a0, 0x11a70510
Caught exception in looking up space point ptr... 0x57d99d80, 0x57d999a0
Caught exception in looking up space point ptr... 0x57d999a0, 0x57d99b20
Caught exception in looking up space point ptr... 0x5dae7bf0, 0x5dae78d0
Caught exception in looking up space point ptr... 0x5dae78d0, 0x5dae7bf0
Caught exception in looking up space point ptr... 0x213ec820, 0x213ecd70
Caught exception in looking up space point ptr... 0x213ecd70, 0x213ec820
Caught exception in looking up space point ptr... 0xd9fe090, 0xd9fe920
Caught exception in looking up space point ptr... 0xd9fe920, 0xd9fe090
Caught exception in looking up space point ptr... 0x158bdc70, 0x158bdb20
Caught exception in looking up space point ptr... 0x158bdb20, 0x158bdc70
Caught exception in looking up space point ptr... 0x2daf8b60, 0x2daf8cb0
Caught exception in looking up space point ptr... 0x2daf8cb0, 0x2daf8b60
Caught exception in looking up space point ptr... 0x2bfc33d0, 0x2bfc36c0
Caught exception in looking up space point ptr... 0x2bfc36c0, 0x2bfc3810
Caught exception in looking up space point ptr... 0x20a159f0, 0x20a19650
Caught exception in looking up space point ptr... 0x20a19650, 0x20a159f0
Caught exception in looking up space point ptr... 0xd999630, 0xd99ec60
Caught exception in looking up space point ptr... 0xd99ec60, 0xd999630
Caught exception in looking up space point ptr... 0x375e3a80, 0x375e3760
Caught exception in looking up space point ptr... 0x375e3760, 0x375e3a80
Caught exception in looking up space point ptr... 0x2d7eff10, 0x2d7f3680
Caught exception in looking up space point ptr... 0x2d7f3680, 0x2d7eff10
Caught exception in looking up space point ptr... 0x25c52440, 0x25c4a3b0
Caught exception in looking up space point ptr... 0x25c4a3b0, 0x25c52440
Caught exception in looking up space point ptr... 0x25c52440, 0x25c49e40
Caught exception in looking up space point ptr... 0x25c49e40, 0x25c52440
Caught exception in looking up space point ptr... 0x2399c750, 0x2399cb80
Caught exception in looking up space point ptr... 0x2399cb80, 0x2399c8a0
Caught exception in looking up space point ptr... 0x2e27ece0, 0x225bf590
Caught exception in looking up space point ptr... 0x225bf590, 0x2e27ece0
Caught exception in looking up space point ptr... 0x1320aa80, 0x1320abb0
Caught exception in looking up space point ptr... 0x1320abb0, 0x1320aa80
Caught exception in looking up space point ptr... 0x375f3080, 0x375f2ef0
Caught exception in looking up space point ptr... 0x375f2ef0, 0x375f3080
Caught exception in looking up space point ptr... 0x25cf4420, 0x25cf3c40
Caught exception in looking up space point ptr... 0x25cf45c0, 0x25cf4420
Caught exception in looking up space point ptr... 0x4b2676a0, 0x4b25ebd0
Caught exception in looking up space point ptr... 0x4b25ebd0, 0x4b2676a0
Caught exception in looking up space point ptr... 0x280d4630, 0x410af2b0
Caught exception in looking up space point ptr... 0x410af2b0, 0x280d4630
Caught exception in looking up space point ptr... 0x542979e0, 0x38437170
Caught exception in looking up space point ptr... 0x38437170, 0x54297b70
Caught exception in looking up space point ptr... 0x2e28c240, 0x225c05a0
Caught exception in looking up space point ptr... 0x225c05a0, 0x2e28c240
Caught exception in looking up space point ptr... 0x5b6b6320, 0x5b6b6500
Caught exception in looking up space point ptr... 0x5b6b6500, 0x5b6b6320
Caught exception in looking up space point ptr... 0x26a0fea0, 0x26a03380
Caught exception in looking up space point ptr... 0x26a03380, 0x26a04380
Caught exception in looking up space point ptr... 0x518f8020, 0x518f7c40
Caught exception in looking up space point ptr... 0x518f7c40, 0x518f8020
Caught exception in looking up space point ptr... 0x1320b700, 0x1320b830
Caught exception in looking up space point ptr... 0x1320b830, 0x1320b4a0
Caught exception in looking up space point ptr... 0x22295570, 0x4b1462d0
Caught exception in looking up space point ptr... 0x4b1462d0, 0x22295570
Caught exception in looking up space point ptr... 0x5d8b0590, 0x577b7350
Caught exception in looking up space point ptr... 0x577b7350, 0x132bc830
++++>>>> total num hits: 127521, num free: 123241
04-Feb-2026 00:53:53 CET Closed output file "np02vd_raw_run042421_0091_df-s02-d1_dw_0_20260203T142013_reco_stage0_20260203T235353_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 60.4729 67.0705 76.6978 67.5048 4.28852 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.271e-05 7.42826e-05 0.00022315 7.059e-05 3.05177e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.29295 3.99211 7.86934 3.67486 0.965524 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00783945 0.0146287 0.0424231 0.0111482 0.00814179 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.00032564 0.000556366 0.00112353 0.00055414 0.000184391 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00104804 0.00155708 0.00331712 0.00147142 0.000525149 27
produce:beamevent:BeamEvent 5.777e-05 0.000114616 0.00087116 7.703e-05 0.000149833 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.53885 1.98491 2.26487 1.99151 0.187983 27
produce:ophit:OpHitFinder 0.0222594 0.033019 0.0409203 0.0332499 0.00409123 27
produce:wclsdatavd:WireCellToolkit 41.83 47.119 55.4121 47.3436 2.8589 27
produce:gaushit:GausHitFinder 0.47514 0.734941 0.98946 0.757843 0.149598 27
produce:nhitsfilter:NumberOfHitsFilter 0.00013053 0.000183737 0.00035329 0.00016918 4.40273e-05 27
produce:reco3d:SpacePointSolver 4.28359 8.25287 13.9085 8.56003 2.22722 27
produce:hitpdune:DisambigFromSpacePoints 0.0428102 0.0762021 0.1367 0.0648805 0.0271045 27
produce:cluster3d:Cluster3D 0.611955 1.40861 5.9242 1.1558 1.00118 27
[art]:TriggerResults:TriggerResultInserter 2.252e-05 3.22841e-05 7.17e-05 3.117e-05 9.30509e-06 27
end_path:out1:RootOutput 4.81e-06 6.75593e-06 1.966e-05 5.82e-06 3.39752e-06 27
end_path:out1:RootOutput(write) 2.65979 3.42308 4.33935 3.28181 0.436867 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4623.98 MB
Peak resident set size usage (VmHWM): 2632.43 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0091_df-s02-d1_dw_0_20260203T142013_reco_stage0_20260203T235353_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0091_df-s02-d1_dw_0_20260203T142013_reco_stage0_20260203T235353_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0091_df-s02-d1_dw_0_20260203T142013_reco_stage0_20260203T235353_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160983.0,
"core.end_time": 1770162834.0,
"core.events": [
14797,
14803,
14809,
14815,
14821,
14827,
14833,
14839,
14845,
14851,
14857,
14863,
14869,
14875,
14881,
14887,
14893,
14899,
14905,
14911,
14917,
14923,
14929,
14935,
14941,
14947,
14953
],
"core.event_count": 27,
"core.first_event_number": 14797,
"core.last_event_number": 14953,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0091_df-s02-d1_dw_0_20260203T142013.hdf5"
}
]
} 