Jobsub ID 303650.31@dunegpschedd01.fnal.gov
| Jobsub ID | 303650.31@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:28 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce509 |
| Last heartbeat | 2026-02-04 00:46:24 |
| From worker node | Hostname | b9p04p3844.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:13:26 |
| Input files | vd-protodune:np02vd_raw_run042433_0592_df-s04-d0_dw_0_20260203T222707.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5334s) |
| CPU time | 1h (5116s = 95%) |
| Max RSS bytes | 7429009408 (7084 MiB) |
| Outputting started | 2026-02-04 00:42:24 |
| Output files | |
| Finished | 2026-02-04 00:46:24 |
| Saved logs | justin-logs:303650.31-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
tr... 0x4c3cff50, 0x4be99900
Caught exception in looking up space point ptr... 0x85c9ab70, 0x85c9c910
Caught exception in looking up space point ptr... 0x85c9c910, 0x85c9ab70
Caught exception in looking up space point ptr... 0x5c14de90, 0x5c14dda0
Caught exception in looking up space point ptr... 0x5c14dda0, 0x5c14de90
Caught exception in looking up space point ptr... 0x189aa980, 0x189bf490
Caught exception in looking up space point ptr... 0x189bf490, 0x189aa980
Caught exception in looking up space point ptr... 0x3f9526c0, 0x3f952590
Caught exception in looking up space point ptr... 0x3f952590, 0x3f9526c0
Caught exception in looking up space point ptr... 0x189b2220, 0x4865b1b0
Caught exception in looking up space point ptr... 0x4865b1b0, 0x38607fb0
Caught exception in looking up space point ptr... 0x616aa070, 0x616ac140
Caught exception in looking up space point ptr... 0x616ac140, 0x616aa070
Caught exception in looking up space point ptr... 0x6ee6e030, 0x6ee6e420
Caught exception in looking up space point ptr... 0x6ee6e420, 0x6ee6e030
Caught exception in looking up space point ptr... 0x189bd470, 0x48667c40
Caught exception in looking up space point ptr... 0x48667c40, 0x385f9b20
Caught exception in looking up space point ptr... 0x5882ade0, 0x5882ac70
Caught exception in looking up space point ptr... 0x5882ac70, 0x5882ade0
Caught exception in looking up space point ptr... 0x5c0963e0, 0x189a1c80
Caught exception in looking up space point ptr... 0x189a1c80, 0x5c0963e0
Caught exception in looking up space point ptr... 0x5c0963e0, 0x38601950
Caught exception in looking up space point ptr... 0x38601950, 0x5c0963e0
Caught exception in looking up space point ptr... 0x5c138d00, 0x5c132dd0
Caught exception in looking up space point ptr... 0x5c132dd0, 0x5c139430
Caught exception in looking up space point ptr... 0x499b8cc0, 0x499b8b30
Caught exception in looking up space point ptr... 0x499b8b30, 0xde6d470
Caught exception in looking up space point ptr... 0x6eff7090, 0x6eff6f00
Caught exception in looking up space point ptr... 0x6eff6f00, 0x6eff7090
Caught exception in looking up space point ptr... 0x3fc2cd00, 0x60ddb300
Caught exception in looking up space point ptr... 0x60ddb300, 0x3fc2cd00
Caught exception in looking up space point ptr... 0x9116480, 0xcdc4f00
Caught exception in looking up space point ptr... 0xcdc4f00, 0x800d9920
Caught exception in looking up space point ptr... 0x369e85e0, 0x369e8450
Caught exception in looking up space point ptr... 0x369e8450, 0x369e85e0
Caught exception in looking up space point ptr... 0x85c77a50, 0x85c77450
Caught exception in looking up space point ptr... 0x85c77450, 0x85c775a0
Caught exception in looking up space point ptr... 0x7fdb5ea0, 0x7fdb5cc0
Caught exception in looking up space point ptr... 0x7fdb5cc0, 0x7fdb5ea0
Caught exception in looking up space point ptr... 0x5c0ecec0, 0x5c0ecd70
Caught exception in looking up space point ptr... 0x5c0ecd70, 0x5c0ecec0
Caught exception in looking up space point ptr... 0x48a95350, 0x4948efa0
Caught exception in looking up space point ptr... 0x4948efa0, 0x60e697e0
Caught exception in looking up space point ptr... 0x49490220, 0x41257aa0
Caught exception in looking up space point ptr... 0x41257aa0, 0x49490220
Caught exception in looking up space point ptr... 0x36c0e940, 0x36c0ea90
Caught exception in looking up space point ptr... 0x36c0ea90, 0x36c0e940
Caught exception in looking up space point ptr... 0x40a61cf0, 0x40a61b60
Caught exception in looking up space point ptr... 0x40a61b60, 0x40a61840
Caught exception in looking up space point ptr... 0x801d6f30, 0x801d6810
Caught exception in looking up space point ptr... 0x801d6810, 0x801d6f30
Caught exception in looking up space point ptr... 0x38610b90, 0x3860b040
Caught exception in looking up space point ptr... 0x3860b040, 0x38610b90
Caught exception in looking up space point ptr... 0x38610b90, 0x38600200
Caught exception in looking up space point ptr... 0x38600200, 0x38610b90
Caught exception in looking up space point ptr... 0x4cdd2b60, 0x4cdd27f0
Caught exception in looking up space point ptr... 0x4cdd27f0, 0x4cdd2b60
Caught exception in looking up space point ptr... 0x72ce7e60, 0x48933240
Caught exception in looking up space point ptr... 0x48933240, 0x72ce7e60
Caught exception in looking up space point ptr... 0x41869910, 0x41869aa0
Caught exception in looking up space point ptr... 0x41869aa0, 0x41869910
Caught exception in looking up space point ptr... 0x36b2a300, 0x39f8cd80
Caught exception in looking up space point ptr... 0x39f8cd80, 0x36b2a300
Caught exception in looking up space point ptr... 0x2dbbb5d0, 0x3f92c3e0
Caught exception in looking up space point ptr... 0x3f92c3e0, 0x2dbbb760
Caught exception in looking up space point ptr... 0x38b14e70, 0x8fb4b090
Caught exception in looking up space point ptr... 0x8fb4b090, 0x39f8cf10
++++>>>> total num hits: 80726, num free: 76901
04-Feb-2026 01:42:08 CET Closed output file "np02vd_raw_run042433_0592_df-s04-d0_dw_0_20260203T222707_reco_stage0_20260204T004208_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 113.345 277.249 1231.68 127.095 283.241 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.611e-05 9.91557e-05 0.000280445 7.3041e-05 6.47389e-05 19
produce:tpcrawdecoder:PDVDTPCReader 7.06958 8.70473 12.7493 7.65771 1.87605 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.0120549 0.0379767 0.109227 0.0290124 0.0280929 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000460397 0.00572362 0.0631188 0.00060443 0.0147736 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000416856 0.00105262 0.00661248 0.000568809 0.00138217 19
produce:beamevent:BeamEvent 6.1891e-05 0.000237238 0.000963115 0.000111121 0.000281903 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.05799 3.19884 6.64407 2.67784 1.35445 19
produce:ophit:OpHitFinder 0.021204 0.0483532 0.206374 0.035101 0.0408119 19
produce:wclsdatavd:WireCellToolkit 86.9677 117.684 218.301 92.751 42.731 19
produce:gaushit:GausHitFinder 0.793315 4.32363 26.8577 1.28591 6.60809 19
produce:nhitsfilter:NumberOfHitsFilter 0.000209453 0.000475815 0.00185574 0.000306944 0.0004099 19
produce:reco3d:SpacePointSolver 9.35532 31.8878 109.916 15.4122 30.7524 19
produce:hitpdune:DisambigFromSpacePoints 0.0869018 1.03561 4.79944 0.18228 1.6137 19
produce:cluster3d:Cluster3D 1.23898 101.934 824.559 2.74142 205.838 19
[art]:TriggerResults:TriggerResultInserter 2.0321e-05 5.80296e-05 0.000312945 2.629e-05 6.77129e-05 19
end_path:out1:RootOutput 5.09e-06 1.84223e-05 0.000162493 8.36e-06 3.43371e-05 19
end_path:out1:RootOutput(write) 3.93218 8.33183 27.4143 4.53893 6.53368 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 9499.85 MB
Peak resident set size usage (VmHWM): 7429.01 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0592_df-s04-d0_dw_0_20260203T222707_reco_stage0_20260204T004208_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0592_df-s04-d0_dw_0_20260203T222707_reco_stage0_20260204T004208_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0592_df-s04-d0_dw_0_20260203T222707_reco_stage0_20260204T004208_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160420.0,
"core.end_time": 1770165730.0,
"core.events": [
67498,
67504,
67510,
67516,
67522,
67528,
67534,
67540,
67546,
67552,
67558,
67564,
67570,
67576,
67582,
67588,
67594,
67600,
67606
],
"core.event_count": 19,
"core.first_event_number": 67498,
"core.last_event_number": 67606,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0592_df-s04-d0_dw_0_20260203T222707.hdf5"
}
]
} 