Jobsub ID 297916.44@dunegpschedd02.fnal.gov
| Jobsub ID | 297916.44@dunegpschedd02.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:46:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce505 |
| Last heartbeat | 2026-02-03 23:36:41 |
| From worker node | Hostname | b9p35p0031.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:47:36 |
| Input files | vd-protodune:np02vd_raw_run042422_0112_df-s04-d1_dw_0_20260203T161519.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 46m (2792s) |
| CPU time | 44m (2697s = 96%) |
| Max RSS bytes | 2745708544 (2618 MiB) |
| Outputting started | 2026-02-03 23:34:11 |
| Output files | |
| Finished | 2026-02-03 23:36:41 |
| Saved logs | justin-logs:297916.44-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
50
Caught exception in looking up space point ptr... 0x7a70380, 0x7a66ca0
Caught exception in looking up space point ptr... 0x5e024b80, 0x5e024d10
Caught exception in looking up space point ptr... 0x5e024d10, 0x5e024ea0
Caught exception in looking up space point ptr... 0x15069560, 0x1216c120
Caught exception in looking up space point ptr... 0x1216c120, 0x15069560
Caught exception in looking up space point ptr... 0x4537d170, 0x4537d300
Caught exception in looking up space point ptr... 0x4537d300, 0x4537d170
Caught exception in looking up space point ptr... 0x5e2d3890, 0x7a67ef0
Caught exception in looking up space point ptr... 0x7a67ef0, 0x641aa210
Caught exception in looking up space point ptr... 0x49b9d320, 0x4b9c16a0
Caught exception in looking up space point ptr... 0x4b9c16a0, 0x411a1cf0
Caught exception in looking up space point ptr... 0x5e19ed20, 0x37782c80
Caught exception in looking up space point ptr... 0x37782c80, 0x5e19ed20
Caught exception in looking up space point ptr... 0x5e19ed20, 0xdcc4860
Caught exception in looking up space point ptr... 0xdcc4860, 0x5e19ed20
Caught exception in looking up space point ptr... 0x641a85e0, 0x14ec4650
Caught exception in looking up space point ptr... 0x14ec4650, 0x14ec48e0
Caught exception in looking up space point ptr... 0x1131c0c0, 0xdc3a0c0
Caught exception in looking up space point ptr... 0xdc3a0c0, 0x1131c0c0
Caught exception in looking up space point ptr... 0x1131c0c0, 0x49d87e00
Caught exception in looking up space point ptr... 0x49d87e00, 0x1131c0c0
Caught exception in looking up space point ptr... 0x58c7b0d0, 0x58c7af40
Caught exception in looking up space point ptr... 0x58c7af40, 0x142943d0
Caught exception in looking up space point ptr... 0x55f318b0, 0x3799a4d0
Caught exception in looking up space point ptr... 0x55f31720, 0x55f318b0
Caught exception in looking up space point ptr... 0x3f8a9040, 0xdbe3860
Caught exception in looking up space point ptr... 0x3f8a91d0, 0x3f8a9040
Caught exception in looking up space point ptr... 0x3b666880, 0x3b672bd0
Caught exception in looking up space point ptr... 0x3394bcc0, 0x3b666880
Caught exception in looking up space point ptr... 0x15932270, 0x38585cd0
Caught exception in looking up space point ptr... 0x38585cd0, 0x159320e0
Caught exception in looking up space point ptr... 0x5b12d350, 0x5b12d150
Caught exception in looking up space point ptr... 0x49bcc380, 0x5b12d350
Caught exception in looking up space point ptr... 0x10705440, 0x106f2e80
Caught exception in looking up space point ptr... 0x50610870, 0x10705440
Caught exception in looking up space point ptr... 0x1468b890, 0x4a503900
Caught exception in looking up space point ptr... 0x4a503900, 0x1468ba20
Caught exception in looking up space point ptr... 0x5b1b9990, 0x5279f6a0
Caught exception in looking up space point ptr... 0x5279f6a0, 0x52790f40
Caught exception in looking up space point ptr... 0x33bc0630, 0x20cc0da0
Caught exception in looking up space point ptr... 0x33bc0780, 0x33bc0630
Caught exception in looking up space point ptr... 0x453d2b00, 0x453d2970
Caught exception in looking up space point ptr... 0x453d2970, 0x10c01490
Caught exception in looking up space point ptr... 0x105bf2e0, 0x105bf150
Caught exception in looking up space point ptr... 0x105bf150, 0x4d4bda30
Caught exception in looking up space point ptr... 0x602297f0, 0x25967070
Caught exception in looking up space point ptr... 0x6023bf40, 0x602297f0
Caught exception in looking up space point ptr... 0x120c5e60, 0x120b3530
Caught exception in looking up space point ptr... 0x3b0c0000, 0x120c5e60
Caught exception in looking up space point ptr... 0x4f767c00, 0x4f758e80
Caught exception in looking up space point ptr... 0x4f826f00, 0x4f767c00
Caught exception in looking up space point ptr... 0x4512b940, 0x451196a0
Caught exception in looking up space point ptr... 0x451196a0, 0x45a83000
Caught exception in looking up space point ptr... 0x385b0690, 0x385a1aa0
Caught exception in looking up space point ptr... 0x385a1aa0, 0x385b0500
Caught exception in looking up space point ptr... 0x3513d7c0, 0x400361e0
Caught exception in looking up space point ptr... 0x400361e0, 0x3513d7c0
Caught exception in looking up space point ptr... 0x3513d7c0, 0x400360e0
Caught exception in looking up space point ptr... 0x400360e0, 0x3513d7c0
Caught exception in looking up space point ptr... 0xd4167e0, 0x1fa6c840
Caught exception in looking up space point ptr... 0x1fa6c840, 0xd4167e0
Caught exception in looking up space point ptr... 0x1430e340, 0x529ba450
Caught exception in looking up space point ptr... 0x529ba450, 0x1430e340
Caught exception in looking up space point ptr... 0x15890840, 0x300d8f30
Caught exception in looking up space point ptr... 0x300d8f30, 0x15890840
++++>>>> total num hits: 301352, num free: 294917
04-Feb-2026 00:34:03 CET Closed output file "np02vd_raw_run042422_0112_df-s04-d1_dw_0_20260203T161519_reco_stage0_20260203T233403_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 65.2902 101.395 122.382 107.006 17.4258 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.807e-05 7.49026e-05 0.00017356 7.2121e-05 2.00573e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.91622 4.3952 5.34469 4.36524 0.287111 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00719385 0.0119048 0.0340243 0.00933986 0.0066033 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.00029231 0.000536251 0.00116266 0.00049091 0.000183613 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0010898 0.00156989 0.00354865 0.00148836 0.000458306 27
produce:beamevent:BeamEvent 5.834e-05 0.000118179 0.00080298 9.183e-05 0.000135451 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.77276 2.09872 2.41745 2.10661 0.144053 27
produce:ophit:OpHitFinder 0.0264147 0.0325545 0.0376314 0.0333665 0.0036347 27
produce:wclsdatavd:WireCellToolkit 47.2572 53.0249 60.5981 53.0239 3.13253 27
produce:gaushit:GausHitFinder 0.508916 1.02179 1.47861 0.984221 0.274549 27
produce:nhitsfilter:NumberOfHitsFilter 0.0001221 0.000201667 0.00034861 0.00020689 5.41396e-05 27
produce:reco3d:SpacePointSolver 3.10581 6.63585 9.96784 6.11543 1.7122 27
produce:hitpdune:DisambigFromSpacePoints 0.0490993 0.155848 0.267363 0.161316 0.0652226 27
produce:cluster3d:Cluster3D 0.844077 29.7847 42.7476 36.3144 15.4676 27
[art]:TriggerResults:TriggerResultInserter 2.4011e-05 3.55052e-05 9.691e-05 3.327e-05 1.32248e-05 27
end_path:out1:RootOutput 4.62e-06 6.5637e-06 2.41e-05 5.74e-06 3.55549e-06 27
end_path:out1:RootOutput(write) 3.39975 4.2007 4.91278 4.23066 0.4101 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4750.02 MB
Peak resident set size usage (VmHWM): 2745.71 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0112_df-s04-d1_dw_0_20260203T161519_reco_stage0_20260203T233403_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0112_df-s04-d1_dw_0_20260203T161519_reco_stage0_20260203T233403_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0112_df-s04-d1_dw_0_20260203T161519_reco_stage0_20260203T233403_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770158865.0,
"core.end_time": 1770161645.0,
"core.events": [
18161,
18167,
18173,
18179,
18185,
18191,
18197,
18203,
18209,
18215,
18221,
18227,
18233,
18239,
18245,
18251,
18257,
18263,
18269,
18275,
18281,
18287,
18293,
18299,
18305,
18311,
18317
],
"core.event_count": 27,
"core.first_event_number": 18161,
"core.last_event_number": 18317,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0112_df-s04-d1_dw_0_20260203T161519.hdf5"
}
]
} 