Jobsub ID 303650.102@dunegpschedd01.fnal.gov
| Jobsub ID | 303650.102@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:28 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk_multicore |
| Last heartbeat | 2026-02-04 01:15:31 |
| From worker node | Hostname | wn-pijl-029.farm.nikhef.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:15:24 |
| Input files | vd-protodune:np02vd_raw_run042433_0511_df-s03-d0_dw_0_20260203T215619.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (7059s) |
| CPU time | 54m (3293s = 46%) |
| Max RSS bytes | 3406917632 (3249 MiB) |
| Outputting started | 2026-02-04 01:13:04 |
| Output files | |
| Finished | 2026-02-04 01:15:17 |
| Saved logs | justin-logs:303650.102-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x59d1ed30, 0x302ab4e0
Caught exception in looking up space point ptr... 0x27b7cdb0, 0x27b7c6b0
Caught exception in looking up space point ptr... 0x27b7c6b0, 0x27b7cdb0
Caught exception in looking up space point ptr... 0x711d3f50, 0x711d4230
Caught exception in looking up space point ptr... 0x711d4ac0, 0x711d3f50
Caught exception in looking up space point ptr... 0x647e4b70, 0x717e4870
Caught exception in looking up space point ptr... 0x717e4870, 0x834afa40
Caught exception in looking up space point ptr... 0x606066f0, 0x606065a0
Caught exception in looking up space point ptr... 0x606065a0, 0x606069e0
Caught exception in looking up space point ptr... 0x7decb570, 0x7decb890
Caught exception in looking up space point ptr... 0x7decb890, 0x7decb570
Caught exception in looking up space point ptr... 0x711d2ad0, 0x711d2f00
Caught exception in looking up space point ptr... 0x711d2f00, 0x711d2c20
Caught exception in looking up space point ptr... 0x658e1620, 0x658e1ad0
Caught exception in looking up space point ptr... 0x658e1ad0, 0x658e1620
Caught exception in looking up space point ptr... 0x5344eff0, 0x5353a300
Caught exception in looking up space point ptr... 0x5353a300, 0x88def750
Caught exception in looking up space point ptr... 0x92eb3200, 0x30955340
Caught exception in looking up space point ptr... 0x30955340, 0x54e04d60
Caught exception in looking up space point ptr... 0x597f0a00, 0x597f0de0
Caught exception in looking up space point ptr... 0x597f0de0, 0x597f0a00
Caught exception in looking up space point ptr... 0x25315ad0, 0x555eeaa0
Caught exception in looking up space point ptr... 0x80bacd40, 0x25315ad0
Caught exception in looking up space point ptr... 0x5cc7b5e0, 0x5cc7b730
Caught exception in looking up space point ptr... 0x5cc7b730, 0x5cc7b5e0
Caught exception in looking up space point ptr... 0x6bab1780, 0x6ba92e00
Caught exception in looking up space point ptr... 0x6ba92e00, 0x6bab1780
Caught exception in looking up space point ptr... 0x2b5b8ab0, 0x22fa9b60
Caught exception in looking up space point ptr... 0x22fac390, 0x2b5b8ab0
Caught exception in looking up space point ptr... 0xa07845e0, 0xa078bea0
Caught exception in looking up space point ptr... 0xa078bea0, 0xa078cf40
Caught exception in looking up space point ptr... 0x60b05930, 0x60b057d0
Caught exception in looking up space point ptr... 0x60b057d0, 0x60b05930
Caught exception in looking up space point ptr... 0x4518acc0, 0x4518abe0
Caught exception in looking up space point ptr... 0x4518abe0, 0x4518acc0
Caught exception in looking up space point ptr... 0x2b560a10, 0x2b566f60
Caught exception in looking up space point ptr... 0x2b566f60, 0x2b562e10
Caught exception in looking up space point ptr... 0x6bde1ed0, 0x345574d0
Caught exception in looking up space point ptr... 0x65508430, 0x6bde1ed0
Caught exception in looking up space point ptr... 0x8d9d5100, 0x8d9d86c0
Caught exception in looking up space point ptr... 0x8d9d86c0, 0x8d9d5100
Caught exception in looking up space point ptr... 0x8ff04c60, 0x8ff04f50
Caught exception in looking up space point ptr... 0x8ff04f50, 0x8ff04e00
Caught exception in looking up space point ptr... 0x80f30890, 0x80f19b30
Caught exception in looking up space point ptr... 0x80f19b30, 0x80f30890
Caught exception in looking up space point ptr... 0x80f30890, 0x80f18fd0
Caught exception in looking up space point ptr... 0x80f18fd0, 0x80f30890
Caught exception in looking up space point ptr... 0x8d9b46e0, 0x8d9b3ef0
Caught exception in looking up space point ptr... 0x8d9b3ef0, 0x8d9b1000
Caught exception in looking up space point ptr... 0x5cc77ab0, 0x296b7950
Caught exception in looking up space point ptr... 0x296b7950, 0x296b7850
Caught exception in looking up space point ptr... 0x64ee0b30, 0x64ee1870
Caught exception in looking up space point ptr... 0x64ee1870, 0x64ee0b30
Caught exception in looking up space point ptr... 0x7817b160, 0x2eb6a750
Caught exception in looking up space point ptr... 0x2eb6a750, 0x7817b160
Caught exception in looking up space point ptr... 0x28944250, 0x289440c0
Caught exception in looking up space point ptr... 0x289440c0, 0x28944250
Caught exception in looking up space point ptr... 0x87fa4aa0, 0x87fa32f0
Caught exception in looking up space point ptr... 0x87fa32f0, 0x87fa4aa0
Caught exception in looking up space point ptr... 0x8ff1c2e0, 0x8ff1bfd0
Caught exception in looking up space point ptr... 0x8ff1bfd0, 0x8ff1c2e0
Caught exception in looking up space point ptr... 0x5039e250, 0x503a0300
Caught exception in looking up space point ptr... 0x503a0300, 0x5039e250
Caught exception in looking up space point ptr... 0x278f0db0, 0x278f63a0
Caught exception in looking up space point ptr... 0x278f63a0, 0x237c83b0
Caught exception in looking up space point ptr... 0x89c0bfc0, 0x89c11de0
Caught exception in looking up space point ptr... 0x89c11de0, 0x89c0bfc0
++++>>>> total num hits: 78345, num free: 74586
04-Feb-2026 02:12:52 CET Closed output file "np02vd_raw_run042433_0511_df-s03-d0_dw_0_20260203T215619_reco_stage0_20260204T011252_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 281.406 365.646 465.344 362.437 53.536 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.4568e-05 0.000109271 0.000298703 9.5895e-05 4.59458e-05 19
produce:tpcrawdecoder:PDVDTPCReader 119.807 190.118 279.457 180.454 45.8959 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.619403 1.05235 1.83479 0.992672 0.325214 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.017715 0.0245355 0.0777948 0.0214563 0.0129366 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.017622 0.0179136 0.0184962 0.017893 0.000205359 19
produce:beamevent:BeamEvent 0.00011212 0.000200967 0.00108659 0.000153703 0.000209502 19
produce:pdvddaphne:DAPHNEReaderPDVD 9.42938 16.167 25.8261 15.7159 3.6634 19
produce:ophit:OpHitFinder 0.0341979 0.046052 0.054229 0.0477732 0.00514663 19
produce:wclsdatavd:WireCellToolkit 103.041 126.077 145.472 126.63 12.4676 19
produce:gaushit:GausHitFinder 1.00604 1.49617 2.47407 1.34235 0.431436 19
produce:nhitsfilter:NumberOfHitsFilter 0.0002636 0.000789262 0.00161493 0.000762324 0.000332051 19
produce:reco3d:SpacePointSolver 8.05911 20.4529 34.9442 19.8218 6.95138 19
produce:hitpdune:DisambigFromSpacePoints 0.131231 0.239581 0.485396 0.210829 0.0873179 19
produce:cluster3d:Cluster3D 1.69171 3.4928 5.91572 3.30624 1.15536 19
[art]:TriggerResults:TriggerResultInserter 2.6991e-05 4.82394e-05 0.000120302 4.2675e-05 2.48173e-05 19
end_path:out1:RootOutput 4.637e-06 1.99888e-05 0.000251331 5.949e-06 5.47543e-05 19
end_path:out1:RootOutput(write) 4.97094 6.34858 7.73156 6.16836 1.02148 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5397.94 MB
Peak resident set size usage (VmHWM): 3406.92 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0511_df-s03-d0_dw_0_20260203T215619_reco_stage0_20260204T011252_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0511_df-s03-d0_dw_0_20260203T215619_reco_stage0_20260204T011252_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0511_df-s03-d0_dw_0_20260203T215619_reco_stage0_20260204T011252_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160538.0,
"core.end_time": 1770167575.0,
"core.events": [
58262,
58268,
58274,
58280,
58286,
58292,
58298,
58304,
58310,
58316,
58322,
58328,
58334,
58340,
58346,
58352,
58358,
58364,
58370
],
"core.event_count": 19,
"core.first_event_number": 58262,
"core.last_event_number": 58370,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0511_df-s03-d0_dw_0_20260203T215619.hdf5"
}
]
} 