Jobsub ID 303653.173@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.173@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk_multicore |
| Last heartbeat | 2026-02-04 01:48:39 |
| From worker node | Hostname | wn-pijl-020.farm.nikhef.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:48:04 |
| Input files | vd-protodune:np02vd_raw_run042421_0093_df-s02-d1_dw_0_20260203T142118.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (7087s) |
| CPU time | 48m (2899s = 40%) |
| Max RSS bytes | 2566184960 (2447 MiB) |
| Outputting started | 2026-02-04 01:46:12 |
| Output files | |
| Finished | 2026-02-04 01:48:39 |
| Saved logs | justin-logs:303653.173-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x6c376330, 0x6c375e80
Caught exception in looking up space point ptr... 0x6c375e80, 0x6c376330
Caught exception in looking up space point ptr... 0x32127e30, 0x3212a6e0
Caught exception in looking up space point ptr... 0x4dba0240, 0x32129f30
Caught exception in looking up space point ptr... 0x32129f30, 0x4dba0be0
Caught exception in looking up space point ptr... 0x4dba0be0, 0x32127e30
Caught exception in looking up space point ptr... 0x4ae89e40, 0x4ae7dc50
Caught exception in looking up space point ptr... 0x4ae7dc50, 0x4ae89e40
Caught exception in looking up space point ptr... 0x31f2d400, 0x31f2d590
Caught exception in looking up space point ptr... 0x31f2d590, 0x6c1006a0
Caught exception in looking up space point ptr... 0x4ae92310, 0x4ae91e60
Caught exception in looking up space point ptr... 0x4ae91e60, 0x4ae92180
Caught exception in looking up space point ptr... 0x2d785c90, 0x2d786e60
Caught exception in looking up space point ptr... 0x2d786e60, 0x2d7823b0
Caught exception in looking up space point ptr... 0x44f2cd20, 0x6e47c8f0
Caught exception in looking up space point ptr... 0x6e47c8f0, 0x6301b200
Caught exception in looking up space point ptr... 0x70b6cd20, 0x3f050a10
Caught exception in looking up space point ptr... 0x70a3d820, 0x70b6cd20
Caught exception in looking up space point ptr... 0x3ff51ba0, 0x46fdc810
Caught exception in looking up space point ptr... 0x46fdc810, 0x3ff51ba0
Caught exception in looking up space point ptr... 0x477a9c80, 0x2ff05d80
Caught exception in looking up space point ptr... 0x2ff05d80, 0x41fb5400
Caught exception in looking up space point ptr... 0x2fc24f80, 0x4d379630
Caught exception in looking up space point ptr... 0x4d379630, 0x2905a290
Caught exception in looking up space point ptr... 0x338fd080, 0x338fd210
Caught exception in looking up space point ptr... 0x338fd210, 0x338fcef0
Caught exception in looking up space point ptr... 0x4e4b4170, 0x4e4b3480
Caught exception in looking up space point ptr... 0x4e4b3480, 0x4e4b4170
Caught exception in looking up space point ptr... 0x71efe330, 0x71efe1a0
Caught exception in looking up space point ptr... 0x71efe1a0, 0x71efe330
Caught exception in looking up space point ptr... 0x2fe81880, 0x5b9b3da0
Caught exception in looking up space point ptr... 0x5b9b3da0, 0x795ce6d0
Caught exception in looking up space point ptr... 0x70a3e1f0, 0x70a3e0f0
Caught exception in looking up space point ptr... 0x70a3e0f0, 0x70a3e1f0
Caught exception in looking up space point ptr... 0x4ae90d50, 0x6c0fc7d0
Caught exception in looking up space point ptr... 0x6c0fc7d0, 0x4ae90d50
Caught exception in looking up space point ptr... 0x32d8aa80, 0x6db918e0
Caught exception in looking up space point ptr... 0x6db918e0, 0x6db8eeb0
Caught exception in looking up space point ptr... 0x4d38a1d0, 0x2cb57af0
Caught exception in looking up space point ptr... 0x2cb57af0, 0x4d38a1d0
Caught exception in looking up space point ptr... 0x59109220, 0x59104550
Caught exception in looking up space point ptr... 0x59104550, 0x59109220
Caught exception in looking up space point ptr... 0x423a82a0, 0x423a81a0
Caught exception in looking up space point ptr... 0x423a81a0, 0x423a82a0
Caught exception in looking up space point ptr... 0x2d6d26c0, 0x2d6d2530
Caught exception in looking up space point ptr... 0x2d6d2530, 0x2d6d2850
Caught exception in looking up space point ptr... 0x2f3fc450, 0x2f40be90
Caught exception in looking up space point ptr... 0x2f40be90, 0x709e1cc0
Caught exception in looking up space point ptr... 0x423abf10, 0x423abe10
Caught exception in looking up space point ptr... 0x423abe10, 0x423abf10
Caught exception in looking up space point ptr... 0x2d6c9e90, 0x48108470
Caught exception in looking up space point ptr... 0x48108470, 0x2d6c9e90
Caught exception in looking up space point ptr... 0x2d6c9e90, 0x48108780
Caught exception in looking up space point ptr... 0x48108780, 0x2d6c9e90
Caught exception in looking up space point ptr... 0x2d6c9e90, 0x48107720
Caught exception in looking up space point ptr... 0x48107720, 0x2d6c9e90
Caught exception in looking up space point ptr... 0x42818270, 0x428183f0
Caught exception in looking up space point ptr... 0x428183f0, 0x42817fc0
Caught exception in looking up space point ptr... 0x7a901af0, 0x7a901c90
Caught exception in looking up space point ptr... 0x7a901c90, 0x7a901af0
Caught exception in looking up space point ptr... 0x7d357040, 0x33579680
Caught exception in looking up space point ptr... 0x33579680, 0x4a6ccf00
Caught exception in looking up space point ptr... 0x4b0c9510, 0x64b28a50
Caught exception in looking up space point ptr... 0x4816bd80, 0x70548fe0
Caught exception in looking up space point ptr... 0x70548fe0, 0x4b0c9510
++++>>>> total num hits: 67236, num free: 64139
04-Feb-2026 02:45:59 CET Closed output file "np02vd_raw_run042421_0093_df-s02-d1_dw_0_20260203T142118_reco_stage0_20260204T014559_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 185.617 257.387 337.628 246.402 35.4882 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.617e-05 9.94312e-05 0.000264811 9.212e-05 3.46276e-05 27
produce:tpcrawdecoder:PDVDTPCReader 85.7512 141.834 215.884 132.344 31.1433 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.634402 0.885674 1.57408 0.828781 0.23414 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0176834 0.0280581 0.0702498 0.0211912 0.0148365 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.086988 0.0896947 0.105288 0.0881136 0.00481087 27
produce:beamevent:BeamEvent 0.000109065 0.000181601 0.00125156 0.000139862 0.000210525 27
produce:pdvddaphne:DAPHNEReaderPDVD 11.4653 17.7868 27.2298 17.4365 3.65181 27
produce:ophit:OpHitFinder 0.0335208 0.0475895 0.0582626 0.0481577 0.0056629 27
produce:wclsdatavd:WireCellToolkit 69.6163 77.0774 82.8894 77.5334 2.98204 27
produce:gaushit:GausHitFinder 0.507568 1.23251 1.90391 1.25412 0.340934 27
produce:nhitsfilter:NumberOfHitsFilter 0.000152841 0.00037176 0.00087256 0.000330951 0.000142682 27
produce:reco3d:SpacePointSolver 5.31867 10.0912 16.1627 9.85164 2.5934 27
produce:hitpdune:DisambigFromSpacePoints 0.0789088 0.132134 0.229224 0.123077 0.0405177 27
produce:cluster3d:Cluster3D 1.15945 2.69646 3.86289 2.64791 0.781422 27
[art]:TriggerResults:TriggerResultInserter 2.7092e-05 4.03595e-05 0.000114914 3.3781e-05 1.91369e-05 27
end_path:out1:RootOutput 4.016e-06 1.40094e-05 0.000230269 4.818e-06 4.25287e-05 27
end_path:out1:RootOutput(write) 4.47683 5.42887 6.22274 5.3741 0.414204 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4537.48 MB
Peak resident set size usage (VmHWM): 2566.18 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0093_df-s02-d1_dw_0_20260203T142118_reco_stage0_20260204T014559_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0093_df-s02-d1_dw_0_20260203T142118_reco_stage0_20260204T014559_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0093_df-s02-d1_dw_0_20260203T142118_reco_stage0_20260204T014559_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162499.0,
"core.end_time": 1770169561.0,
"core.events": [
15121,
15127,
15133,
15139,
15145,
15151,
15157,
15163,
15169,
15175,
15181,
15187,
15193,
15199,
15205,
15211,
15217,
15223,
15229,
15235,
15241,
15247,
15253,
15259,
15265,
15271,
15277
],
"core.event_count": 27,
"core.first_event_number": 15121,
"core.last_event_number": 15277,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0093_df-s02-d1_dw_0_20260203T142118.hdf5"
}
]
} 