Jobsub ID 297919.94@dunegpschedd02.fnal.gov
| Jobsub ID | 297919.94@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:54:25 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk_multicore |
| Last heartbeat | 2026-02-04 01:28:25 |
| From worker node | Hostname | wn-sate-009.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7551P 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:31:19 |
| Input files | vd-protodune:np02vd_raw_run042421_0063_df-s04-d1_dw_0_20260203T140508.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6894s) |
| CPU time | 48m (2900s = 42%) |
| Max RSS bytes | 2609213440 (2488 MiB) |
| Outputting started | 2026-02-04 01:26:14 |
| Output files | |
| Finished | 2026-02-04 01:28:25 |
| Saved logs | justin-logs:297919.94-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
cae0, 0x2222af10
Caught exception in looking up space point ptr... 0x2222af10, 0x3fec52e0
Caught exception in looking up space point ptr... 0x3fec52e0, 0x2222af10
Caught exception in looking up space point ptr... 0x85922a0, 0x46591140
Caught exception in looking up space point ptr... 0x8590ad0, 0x85922a0
Caught exception in looking up space point ptr... 0x2bfa2fc0, 0x2bfa2ac0
Caught exception in looking up space point ptr... 0x2bfa2ac0, 0x2bfa2c50
Caught exception in looking up space point ptr... 0x32e83900, 0xd724e10
Caught exception in looking up space point ptr... 0xd724e10, 0x32e83900
Caught exception in looking up space point ptr... 0x3782bbf0, 0x3782bd40
Caught exception in looking up space point ptr... 0x3782bd40, 0x3782bbf0
Caught exception in looking up space point ptr... 0x9de2890, 0x2ce96900
Caught exception in looking up space point ptr... 0x2ce96900, 0x9de3de0
Caught exception in looking up space point ptr... 0x21c997e0, 0xc736d90
Caught exception in looking up space point ptr... 0xc736d90, 0x21c997e0
Caught exception in looking up space point ptr... 0xa5ccc90, 0x14edae50
Caught exception in looking up space point ptr... 0x14edae50, 0x341b7bc0
Caught exception in looking up space point ptr... 0x3456a8d0, 0x103e26c0
Caught exception in looking up space point ptr... 0x103e26c0, 0x2669d320
Caught exception in looking up space point ptr... 0x2669d320, 0x103e2220
Caught exception in looking up space point ptr... 0x471c6e80, 0x26b52c90
Caught exception in looking up space point ptr... 0x26b52c90, 0x2ae8e870
Caught exception in looking up space point ptr... 0x646c2ed0, 0x646c1e20
Caught exception in looking up space point ptr... 0x646c1e20, 0x646c2520
Caught exception in looking up space point ptr... 0x8592be0, 0x8592990
Caught exception in looking up space point ptr... 0x8592990, 0xde82b70
Caught exception in looking up space point ptr... 0xde82b70, 0xde829b0
Caught exception in looking up space point ptr... 0x2cfb9180, 0x2cfb93d0
Caught exception in looking up space point ptr... 0x2cfb93d0, 0x2cfb9180
Caught exception in looking up space point ptr... 0x39ddec40, 0x39ddedd0
Caught exception in looking up space point ptr... 0x39ddedd0, 0x2b24e660
Caught exception in looking up space point ptr... 0x9fdf650, 0x46f3ea40
Caught exception in looking up space point ptr... 0x46f3ea40, 0x2b61bae0
Caught exception in looking up space point ptr... 0x2b66d370, 0xde814b0
Caught exception in looking up space point ptr... 0xde815b0, 0xde83e00
Caught exception in looking up space point ptr... 0xde83e00, 0xde817b0
Caught exception in looking up space point ptr... 0xde816b0, 0x2b66d370
Caught exception in looking up space point ptr... 0x4ec8d0f0, 0x3a6dd640
Caught exception in looking up space point ptr... 0x3a6dd640, 0x46f0d2f0
Caught exception in looking up space point ptr... 0x2cfc8020, 0x4ec8d0f0
Caught exception in looking up space point ptr... 0x3453b030, 0x3453b1c0
Caught exception in looking up space point ptr... 0x3453b1c0, 0x3453b030
Caught exception in looking up space point ptr... 0x2edec360, 0x2edec1d0
Caught exception in looking up space point ptr... 0x2edec1d0, 0x2edec360
Caught exception in looking up space point ptr... 0x4736cc00, 0x4736c8b0
Caught exception in looking up space point ptr... 0x4736c8b0, 0x4736cc00
Caught exception in looking up space point ptr... 0x26fdc700, 0x14a60e50
Caught exception in looking up space point ptr... 0x14a60e50, 0x14a60f50
Caught exception in looking up space point ptr... 0x2eb59000, 0x36db5730
Caught exception in looking up space point ptr... 0x36db5730, 0x2eb59000
Caught exception in looking up space point ptr... 0x3a69c4d0, 0x3a69cda0
Caught exception in looking up space point ptr... 0x3a69cda0, 0x3a69c4d0
Caught exception in looking up space point ptr... 0x61706c50, 0x61704090
Caught exception in looking up space point ptr... 0x61704090, 0x61706c50
Caught exception in looking up space point ptr... 0x3a69b7f0, 0x3a69d620
Caught exception in looking up space point ptr... 0x3a69d620, 0x3a69d770
Caught exception in looking up space point ptr... 0x14ab3550, 0x14ab3050
Caught exception in looking up space point ptr... 0x14ab3050, 0x14ab3550
Caught exception in looking up space point ptr... 0x540c3810, 0x3fea3b10
Caught exception in looking up space point ptr... 0x3fea4740, 0x540c3810
Caught exception in looking up space point ptr... 0x2bea9520, 0x2bea98b0
Caught exception in looking up space point ptr... 0x2bea98b0, 0x2bea9520
Caught exception in looking up space point ptr... 0x334a2e40, 0x535e56e0
Caught exception in looking up space point ptr... 0x535e56e0, 0x334a2e40
Caught exception in looking up space point ptr... 0x331556d0, 0x14c014f0
Caught exception in looking up space point ptr... 0x32935d20, 0x331556d0
++++>>>> total num hits: 61074, num free: 59065
04-Feb-2026 02:26:05 CET Closed output file "np02vd_raw_run042421_0063_df-s04-d1_dw_0_20260203T140508_reco_stage0_20260204T012605_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 199.072 251.884 316.505 250.228 30.6384 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.7206e-05 0.000117884 0.000250299 9.7743e-05 4.96276e-05 27
produce:tpcrawdecoder:PDVDTPCReader 94.4878 136.77 201.989 127.818 27.529 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.566457 0.84439 1.33682 0.846048 0.164487 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0174937 0.0232348 0.0386093 0.0216116 0.00544986 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0855961 0.0945061 0.151478 0.0867881 0.0165133 27
produce:beamevent:BeamEvent 0.000117771 0.000195967 0.0010901 0.000137618 0.000182754 27
produce:pdvddaphne:DAPHNEReaderPDVD 11.3 16.5015 22.5767 16.2638 3.19672 27
produce:ophit:OpHitFinder 0.0370053 0.0432304 0.0512135 0.0432351 0.00362053 27
produce:wclsdatavd:WireCellToolkit 74.4608 77.6729 81.3579 77.7891 1.61201 27
produce:gaushit:GausHitFinder 0.725991 1.09821 1.75641 1.05003 0.250525 27
produce:nhitsfilter:NumberOfHitsFilter 0.000208881 0.000356966 0.000758972 0.000359704 0.000100221 27
produce:reco3d:SpacePointSolver 5.01067 12.5531 22.4551 12.5578 4.29585 27
produce:hitpdune:DisambigFromSpacePoints 0.0665018 0.118172 0.267994 0.110597 0.0407533 27
produce:cluster3d:Cluster3D 0.844604 1.70064 3.64424 1.52012 0.618022 27
[art]:TriggerResults:TriggerResultInserter 2.131e-05 3.04373e-05 9.3696e-05 2.8423e-05 1.27704e-05 27
end_path:out1:RootOutput 6.522e-06 8.95489e-06 2.632e-05 8.385e-06 3.57183e-06 27
end_path:out1:RootOutput(write) 4.05664 4.43197 4.94843 4.45562 0.216973 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4517.78 MB
Peak resident set size usage (VmHWM): 2609.21 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0063_df-s04-d1_dw_0_20260203T140508_reco_stage0_20260204T012605_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0063_df-s04-d1_dw_0_20260203T140508_reco_stage0_20260204T012605_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0063_df-s04-d1_dw_0_20260203T140508_reco_stage0_20260204T012605_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161489.0,
"core.end_time": 1770168367.0,
"core.events": [
10271,
10277,
10283,
10289,
10295,
10301,
10307,
10313,
10319,
10325,
10331,
10337,
10343,
10349,
10355,
10361,
10367,
10373,
10379,
10385,
10391,
10397,
10403,
10409,
10415,
10421,
10427
],
"core.event_count": 27,
"core.first_event_number": 10271,
"core.last_event_number": 10427,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0063_df-s04-d1_dw_0_20260203T140508.hdf5"
}
]
} 