Jobsub ID 297921.57@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.57@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_klomp_multicore |
| Last heartbeat | 2026-02-04 02:24:20 |
| From worker node | Hostname | wn-pijl-023.farm.nikhef.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:49:08 |
| Input files | vd-protodune:np02vd_raw_run042433_0165_df-s03-d1_dw_0_20260203T194449.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (9147s) |
| CPU time | 1h (4700s = 51%) |
| Max RSS bytes | 3613577216 (3446 MiB) |
| Outputting started | 2026-02-04 02:21:39 |
| Output files | |
| Finished | 2026-02-04 02:24:20 |
| Saved logs | justin-logs:297921.57-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x91d07fc0, 0x7be4bc50
Caught exception in looking up space point ptr... 0x63b66c20, 0x63aff6a0
Caught exception in looking up space point ptr... 0x63aff6a0, 0x63b66c20
Caught exception in looking up space point ptr... 0x6d1bd510, 0x799ada90
Caught exception in looking up space point ptr... 0x799ada90, 0x7f8086f0
Caught exception in looking up space point ptr... 0x6d1c25d0, 0x64f92ca0
Caught exception in looking up space point ptr... 0x64f92ca0, 0x6d1c25d0
Caught exception in looking up space point ptr... 0x790de3c0, 0x4058abc0
Caught exception in looking up space point ptr... 0x79909c30, 0x790de3c0
Caught exception in looking up space point ptr... 0x80997000, 0x80984d60
Caught exception in looking up space point ptr... 0x80997190, 0x80997000
Caught exception in looking up space point ptr... 0x7bb6c6a0, 0x7bb6c830
Caught exception in looking up space point ptr... 0x7bb5d150, 0x7bb6c6a0
Caught exception in looking up space point ptr... 0x80a587c0, 0x633f1030
Caught exception in looking up space point ptr... 0x633f1030, 0x633f0ea0
Caught exception in looking up space point ptr... 0x3c962a10, 0x9442f730
Caught exception in looking up space point ptr... 0x9442f730, 0x9442f5a0
Caught exception in looking up space point ptr... 0x65bd2dd0, 0x65bd2f60
Caught exception in looking up space point ptr... 0x65bd2f60, 0x65bd3280
Caught exception in looking up space point ptr... 0x3dc89e70, 0x3dc89930
Caught exception in looking up space point ptr... 0x3dc89930, 0x71ffc470
Caught exception in looking up space point ptr... 0x7656d8e0, 0x9fd8aff0
Caught exception in looking up space point ptr... 0x9fd8aff0, 0x9fd8b240
Caught exception in looking up space point ptr... 0x5c0b5c70, 0x62c7d920
Caught exception in looking up space point ptr... 0x62c7d920, 0x62597f50
Caught exception in looking up space point ptr... 0x6590e210, 0x6d0c6cf0
Caught exception in looking up space point ptr... 0x6d0c6cf0, 0x6590e210
Caught exception in looking up space point ptr... 0x72037b40, 0x3d623020
Caught exception in looking up space point ptr... 0x3d623020, 0x72035d30
Caught exception in looking up space point ptr... 0x72035d30, 0x3d623020
Caught exception in looking up space point ptr... 0x3d623020, 0x3dc69b20
Caught exception in looking up space point ptr... 0x8a4aecd0, 0x8a4a1080
Caught exception in looking up space point ptr... 0x8a4a1080, 0x8a493430
Caught exception in looking up space point ptr... 0x746ada10, 0x672172e0
Caught exception in looking up space point ptr... 0x672172e0, 0x672173e0
Caught exception in looking up space point ptr... 0x424306d0, 0x936c8760
Caught exception in looking up space point ptr... 0x936c8760, 0x936c88f0
Caught exception in looking up space point ptr... 0x8e162680, 0x41a0ca50
Caught exception in looking up space point ptr... 0x8e162810, 0x8e162680
Caught exception in looking up space point ptr... 0x42c76860, 0x408e7300
Caught exception in looking up space point ptr... 0x3943f690, 0x42c76860
Caught exception in looking up space point ptr... 0x62c086b0, 0x62bf6f00
Caught exception in looking up space point ptr... 0x62c19500, 0x62c086b0
Caught exception in looking up space point ptr... 0x938d3d80, 0x62de6030
Caught exception in looking up space point ptr... 0x62de6030, 0x62df69d0
Caught exception in looking up space point ptr... 0x8dcfa260, 0x8dceb990
Caught exception in looking up space point ptr... 0x8dceb990, 0x685bc9c0
Caught exception in looking up space point ptr... 0x8dcf95e0, 0x8dcead10
Caught exception in looking up space point ptr... 0x8dcead10, 0x685bbd40
Caught exception in looking up space point ptr... 0x683d1cf0, 0x683d1b90
Caught exception in looking up space point ptr... 0x683d1b90, 0x59a4d2e0
Caught exception in looking up space point ptr... 0x4101d950, 0x4101dc70
Caught exception in looking up space point ptr... 0x4101dc70, 0x4101d950
Caught exception in looking up space point ptr... 0x4101d950, 0x4101d7c0
Caught exception in looking up space point ptr... 0x4101d7c0, 0x4101d950
Caught exception in looking up space point ptr... 0xa88808a0, 0xb40b7140
Caught exception in looking up space point ptr... 0xb40b7140, 0xa88808a0
Caught exception in looking up space point ptr... 0x6b87f940, 0x7f7c3e90
Caught exception in looking up space point ptr... 0x6cfa93b0, 0x6b87f940
Caught exception in looking up space point ptr... 0x923f7560, 0x6590f490
Caught exception in looking up space point ptr... 0x6590f490, 0x6294d6f0
Caught exception in looking up space point ptr... 0x7762df50, 0x75375400
Caught exception in looking up space point ptr... 0x75375400, 0x7762df50
Caught exception in looking up space point ptr... 0x63a54110, 0x935d5320
Caught exception in looking up space point ptr... 0x935d5320, 0x63a54110
Caught exception in looking up space point ptr... 0x74e99be0, 0x6298d600
Caught exception in looking up space point ptr... 0x6298d600, 0x662cdea0
++++>>>> total num hits: 510060, num free: 499473
04-Feb-2026 03:21:27 CET Closed output file "np02vd_raw_run042433_0165_df-s03-d1_dw_0_20260203T194449_reco_stage0_20260204T022127_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 384.673 476.279 606.834 471.264 59.2442 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.1824e-05 0.000101964 0.00028531 9.1298e-05 4.35998e-05 19
produce:tpcrawdecoder:PDVDTPCReader 168.228 223.588 303.063 223.445 37.9469 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.691399 1.07367 1.72319 1.05441 0.249472 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0176017 0.0303939 0.0828602 0.0239212 0.0178925 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.017656 0.0178239 0.0181335 0.0177969 0.000110427 19
produce:beamevent:BeamEvent 0.000115565 0.000193015 0.00103441 0.000149055 0.000199008 19
produce:pdvddaphne:DAPHNEReaderPDVD 13.9614 19.2271 26.7228 19.3409 3.30936 19
produce:ophit:OpHitFinder 0.0268351 0.0470773 0.0631922 0.0484956 0.00776305 19
produce:wclsdatavd:WireCellToolkit 126.422 146.11 157.644 145.801 9.38622 19
produce:gaushit:GausHitFinder 2.01992 2.94889 3.9701 2.99037 0.590313 19
produce:nhitsfilter:NumberOfHitsFilter 0.000350289 0.000634843 0.00122951 0.000553325 0.000224795 19
produce:reco3d:SpacePointSolver 12.2048 23.1513 35.8235 22.4552 7.29347 19
produce:hitpdune:DisambigFromSpacePoints 0.272873 0.430628 0.644553 0.413714 0.110031 19
produce:cluster3d:Cluster3D 3.40431 50.7896 82.2916 70.7134 31.6806 19
[art]:TriggerResults:TriggerResultInserter 2.671e-05 4.43642e-05 0.000115404 3.5344e-05 2.02734e-05 19
end_path:out1:RootOutput 3.966e-06 1.95627e-05 0.000243427 5.578e-06 5.30071e-05 19
end_path:out1:RootOutput(write) 7.03186 8.77448 10.6492 8.58369 0.949178 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5574.06 MB
Peak resident set size usage (VmHWM): 3613.58 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0165_df-s03-d1_dw_0_20260203T194449_reco_stage0_20260204T022127_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0165_df-s03-d1_dw_0_20260203T194449_reco_stage0_20260204T022127_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0165_df-s03-d1_dw_0_20260203T194449_reco_stage0_20260204T022127_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162561.0,
"core.end_time": 1770171689.0,
"core.events": [
18819,
18825,
18831,
18837,
18843,
18849,
18855,
18861,
18867,
18873,
18879,
18885,
18891,
18897,
18903,
18909,
18915,
18921,
18927
],
"core.event_count": 19,
"core.first_event_number": 18819,
"core.last_event_number": 18927,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0165_df-s03-d1_dw_0_20260203T194449.hdf5"
}
]
} 