Jobsub ID 297917.24@dunegpschedd02.fnal.gov
| Jobsub ID | 297917.24@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:25 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_klomp_multicore |
| Last heartbeat | 2026-02-04 01:02:36 |
| From worker node | Hostname | wn-sate-011.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7551P 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:10:15 |
| Input files | vd-protodune:np02vd_raw_run042421_0033_df-s03-d0_dw_0_20260203T134853.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6613s) |
| CPU time | 50m (3030s = 45%) |
| Max RSS bytes | 2600030208 (2479 MiB) |
| Outputting started | 2026-02-04 01:00:29 |
| Output files | |
| Finished | 2026-02-04 01:02:36 |
| Saved logs | justin-logs:297917.24-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
x3dc9c780, 0x5cfd9470
Caught exception in looking up space point ptr... 0x5cfd9470, 0x3dc9c780
Caught exception in looking up space point ptr... 0x7abf0f50, 0x5c1cfca0
Caught exception in looking up space point ptr... 0x5c1cfca0, 0x5c1cfaa0
Caught exception in looking up space point ptr... 0x676f4070, 0x8b95eda0
Caught exception in looking up space point ptr... 0x676f3a80, 0x676f4070
Caught exception in looking up space point ptr... 0x686b3be0, 0x891fe6f0
Caught exception in looking up space point ptr... 0x891fe6f0, 0x686b3be0
Caught exception in looking up space point ptr... 0x7ac14550, 0x7abffdb0
Caught exception in looking up space point ptr... 0x7abffdb0, 0x42fc92b0
Caught exception in looking up space point ptr... 0x42fc9440, 0x42fc95d0
Caught exception in looking up space point ptr... 0x42fc95d0, 0x7ac14550
Caught exception in looking up space point ptr... 0x3f2764b0, 0x3f297510
Caught exception in looking up space point ptr... 0x3f297510, 0x3f2764b0
Caught exception in looking up space point ptr... 0x7fb743e0, 0x7fb65d60
Caught exception in looking up space point ptr... 0x7fb65d60, 0x7fb743e0
Caught exception in looking up space point ptr... 0x676dc340, 0x5aa37b80
Caught exception in looking up space point ptr... 0x5aa37b80, 0x676dc340
Caught exception in looking up space point ptr... 0x676dc340, 0x578c8c90
Caught exception in looking up space point ptr... 0x578c8c90, 0x676dc340
Caught exception in looking up space point ptr... 0x5b8aa700, 0x81134a90
Caught exception in looking up space point ptr... 0x81134a90, 0x5b8aa700
Caught exception in looking up space point ptr... 0x5ab7ae80, 0x5ab75080
Caught exception in looking up space point ptr... 0x5ab75080, 0x39902940
Caught exception in looking up space point ptr... 0x738ba600, 0x3f2dd300
Caught exception in looking up space point ptr... 0x3f2dd300, 0x738cadf0
Caught exception in looking up space point ptr... 0x7acf7d40, 0x7acf7c40
Caught exception in looking up space point ptr... 0x7acf7c40, 0x7acf7b40
Caught exception in looking up space point ptr... 0x457fafe0, 0x8764e5c0
Caught exception in looking up space point ptr... 0x8764e5c0, 0x457fafe0
Caught exception in looking up space point ptr... 0x457fafe0, 0x6f42ce70
Caught exception in looking up space point ptr... 0x6f42ce70, 0x457fafe0
Caught exception in looking up space point ptr... 0x7fa6f240, 0x7fa6f560
Caught exception in looking up space point ptr... 0x7fa6f560, 0x7fa6f6f0
Caught exception in looking up space point ptr... 0x3f278000, 0x39e576f0
Caught exception in looking up space point ptr... 0x39e576f0, 0x3f278000
Caught exception in looking up space point ptr... 0x6f5ef350, 0x6f5fa5d0
Caught exception in looking up space point ptr... 0x6f5fa5d0, 0x6f5ef350
Caught exception in looking up space point ptr... 0x44a902a0, 0x67975910
Caught exception in looking up space point ptr... 0x67975910, 0x44a902a0
Caught exception in looking up space point ptr... 0x609ed010, 0x75f80010
Caught exception in looking up space point ptr... 0x75f80010, 0x609ed010
Caught exception in looking up space point ptr... 0x3de6c520, 0x3de6c780
Caught exception in looking up space point ptr... 0x3de6c780, 0x3de6c520
Caught exception in looking up space point ptr... 0x6f934960, 0x605fc8c0
Caught exception in looking up space point ptr... 0x605fc8c0, 0x7ed00a50
Caught exception in looking up space point ptr... 0x7ec7bca0, 0x811f87e0
Caught exception in looking up space point ptr... 0x811f87e0, 0x7ec7bca0
Caught exception in looking up space point ptr... 0x3e6e9cf0, 0x3e6e8d80
Caught exception in looking up space point ptr... 0x3e6e8d80, 0x3e6e9cf0
Caught exception in looking up space point ptr... 0x5fe4a5d0, 0x5fe4a4a0
Caught exception in looking up space point ptr... 0x5fe4a4a0, 0x5fe4a240
Caught exception in looking up space point ptr... 0x6000d1c0, 0x416d6580
Caught exception in looking up space point ptr... 0x416d6580, 0x6000d350
Caught exception in looking up space point ptr... 0x6c706e80, 0x6e5561c0
Caught exception in looking up space point ptr... 0x6e5561c0, 0x89a912f0
Caught exception in looking up space point ptr... 0x80198a60, 0x80198860
Caught exception in looking up space point ptr... 0x80198860, 0x801974b0
Caught exception in looking up space point ptr... 0x86ef37f0, 0x5b9fff90
Caught exception in looking up space point ptr... 0x5b9ffd90, 0x86ef37f0
Caught exception in looking up space point ptr... 0x62412ee0, 0x62412fe0
Caught exception in looking up space point ptr... 0x62412fe0, 0x62412ee0
Caught exception in looking up space point ptr... 0x42b16280, 0x8a1213d0
Caught exception in looking up space point ptr... 0x8a1213d0, 0x42b16280
Caught exception in looking up space point ptr... 0x5fe3e320, 0x5fe3f100
Caught exception in looking up space point ptr... 0x5fe3f100, 0x5fe3e450
++++>>>> total num hits: 102063, num free: 96450
04-Feb-2026 02:00:21 CET Closed output file "np02vd_raw_run042421_0033_df-s03-d0_dw_0_20260203T134853_reco_stage0_20260204T010021_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 187.613 241.298 321.263 233.929 30.7774 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.7037e-05 8.58111e-05 0.000239959 7.7125e-05 3.50802e-05 27
produce:tpcrawdecoder:PDVDTPCReader 75.4056 122.567 194.873 112.01 28.546 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.577938 0.781276 1.53909 0.732357 0.193506 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.017281 0.0292964 0.0817501 0.0240915 0.0156246 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0853019 0.0892837 0.124118 0.086476 0.0082008 27
produce:beamevent:BeamEvent 8.1593e-05 0.00016858 0.00101077 0.000123602 0.000170234 27
produce:pdvddaphne:DAPHNEReaderPDVD 8.24792 15.3135 23.3572 14.6877 3.73616 27
produce:ophit:OpHitFinder 0.0303946 0.0466422 0.0604935 0.0466425 0.00680358 27
produce:wclsdatavd:WireCellToolkit 76.6931 79.5771 83.6624 79.5653 1.75152 27
produce:gaushit:GausHitFinder 0.911202 1.19627 1.60576 1.16502 0.17632 27
produce:nhitsfilter:NumberOfHitsFilter 0.000269655 0.000408367 0.00078419 0.000406342 8.74978e-05 27
produce:reco3d:SpacePointSolver 8.51135 15.1408 21.3289 15.3663 3.03943 27
produce:hitpdune:DisambigFromSpacePoints 0.0847123 0.123795 0.178247 0.119504 0.022378 27
produce:cluster3d:Cluster3D 1.09379 1.90035 3.24825 1.73161 0.529655 27
[art]:TriggerResults:TriggerResultInserter 2.4105e-05 3.51377e-05 0.000110066 3.0187e-05 1.6171e-05 27
end_path:out1:RootOutput 7.313e-06 1.08908e-05 2.7622e-05 8.796e-06 4.76056e-06 27
end_path:out1:RootOutput(write) 4.20257 4.50349 4.82573 4.49576 0.162545 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4513.78 MB
Peak resident set size usage (VmHWM): 2600.03 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0033_df-s03-d0_dw_0_20260203T134853_reco_stage0_20260204T010021_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0033_df-s03-d0_dw_0_20260203T134853_reco_stage0_20260204T010021_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0033_df-s03-d0_dw_0_20260203T134853_reco_stage0_20260204T010021_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160231.0,
"core.end_time": 1770166822.0,
"core.events": [
5402,
5408,
5414,
5420,
5426,
5432,
5438,
5444,
5450,
5456,
5462,
5468,
5474,
5480,
5486,
5492,
5498,
5504,
5510,
5516,
5522,
5528,
5534,
5540,
5546,
5552,
5558
],
"core.event_count": 27,
"core.first_event_number": 5402,
"core.last_event_number": 5558,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0033_df-s03-d0_dw_0_20260203T134853.hdf5"
}
]
} 