Jobsub ID 303649.23@dunegpschedd01.fnal.gov
| Jobsub ID | 303649.23@dunegpschedd01.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:26 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_klomp_multicore |
| Last heartbeat | 2026-02-04 01:15:32 |
| From worker node | Hostname | wn-snel-032.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7H12 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:56:36 |
| Input files | vd-protodune:np02vd_raw_run042422_0065_df-s04-d0_dw_0_20260203T154955.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8177s) |
| CPU time | 1h (4228s = 51%) |
| Max RSS bytes | 2751971328 (2624 MiB) |
| Outputting started | 2026-02-04 01:12:55 |
| Output files | |
| Finished | 2026-02-04 01:15:32 |
| Saved logs | justin-logs:303649.23-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
xception in looking up space point ptr... 0x4528f6a0, 0x36b4df60
Caught exception in looking up space point ptr... 0x36b4df60, 0x4528f6a0
Caught exception in looking up space point ptr... 0x4528f6a0, 0x3b519750
Caught exception in looking up space point ptr... 0x3b519750, 0x4528f6a0
Caught exception in looking up space point ptr... 0x4c664920, 0x3b53c830
Caught exception in looking up space point ptr... 0x3b53c830, 0x4c664920
Caught exception in looking up space point ptr... 0x4c664920, 0x3b5386e0
Caught exception in looking up space point ptr... 0x3b5386e0, 0x4c664920
Caught exception in looking up space point ptr... 0x708c1020, 0x3b51b570
Caught exception in looking up space point ptr... 0x3b51b570, 0x708c1020
Caught exception in looking up space point ptr... 0x708c1020, 0x7089f840
Caught exception in looking up space point ptr... 0x7089f840, 0x708c1020
Caught exception in looking up space point ptr... 0x338acbf0, 0x338bed00
Caught exception in looking up space point ptr... 0x338bed00, 0x338bee90
Caught exception in looking up space point ptr... 0x6f412e10, 0x6f402920
Caught exception in looking up space point ptr... 0x5bceb1b0, 0x6f412e10
Caught exception in looking up space point ptr... 0x5be6d780, 0x5be6d2d0
Caught exception in looking up space point ptr... 0x5bcea3a0, 0x5be6d780
Caught exception in looking up space point ptr... 0x49e676d0, 0x6ba353e0
Caught exception in looking up space point ptr... 0x6ba353e0, 0x53dd96c0
Caught exception in looking up space point ptr... 0x6d26c4c0, 0x6d25ab80
Caught exception in looking up space point ptr... 0x6d25ab80, 0x6f1a93e0
Caught exception in looking up space point ptr... 0x33763b60, 0x337515a0
Caught exception in looking up space point ptr... 0x3d5f9120, 0x33763b60
Caught exception in looking up space point ptr... 0x230820a0, 0x23070440
Caught exception in looking up space point ptr... 0x43dd8b40, 0x230820a0
Caught exception in looking up space point ptr... 0x45204df0, 0x4b6eb3c0
Caught exception in looking up space point ptr... 0x451f5d50, 0x45204df0
Caught exception in looking up space point ptr... 0x20d3ca70, 0x6b405280
Caught exception in looking up space point ptr... 0x20d3cc00, 0x20d3ca70
Caught exception in looking up space point ptr... 0x582944d0, 0x55d49920
Caught exception in looking up space point ptr... 0x55d49920, 0x6af0b460
Caught exception in looking up space point ptr... 0x38d79730, 0x5dab0000
Caught exception in looking up space point ptr... 0x5dab0000, 0x6673b9d0
Caught exception in looking up space point ptr... 0x35162de0, 0x3ba68750
Caught exception in looking up space point ptr... 0x3ba68750, 0x308c4c30
Caught exception in looking up space point ptr... 0x47581c00, 0x47573fb0
Caught exception in looking up space point ptr... 0x4758f6c0, 0x47581c00
Caught exception in looking up space point ptr... 0x372108f0, 0x3f913600
Caught exception in looking up space point ptr... 0x3f913600, 0x3f911df0
Caught exception in looking up space point ptr... 0x706841c0, 0x2260d4e0
Caught exception in looking up space point ptr... 0x2260d4e0, 0x706841c0
Caught exception in looking up space point ptr... 0x633dded0, 0x63512690
Caught exception in looking up space point ptr... 0x63512690, 0x47dc0e00
Caught exception in looking up space point ptr... 0x3b53f510, 0x62fe02c0
Caught exception in looking up space point ptr... 0x62fe02c0, 0x3b53dd10
Caught exception in looking up space point ptr... 0x3b53dd10, 0x708ac230
Caught exception in looking up space point ptr... 0x63078fa0, 0x4723e210
Caught exception in looking up space point ptr... 0x4723e210, 0x63078fa0
Caught exception in looking up space point ptr... 0x60ee1670, 0x43f44080
Caught exception in looking up space point ptr... 0x43f44080, 0x60ee1670
Caught exception in looking up space point ptr... 0x4a999f70, 0x46af72f0
Caught exception in looking up space point ptr... 0x46af72f0, 0x4a999f70
Caught exception in looking up space point ptr... 0x3949a6f0, 0x64790bf0
Caught exception in looking up space point ptr... 0x64790bf0, 0x3949a6f0
Caught exception in looking up space point ptr... 0x3949a6f0, 0x45165e00
Caught exception in looking up space point ptr... 0x45165e00, 0x3949a6f0
Caught exception in looking up space point ptr... 0x67ee89a0, 0x40baf300
Caught exception in looking up space point ptr... 0x40baf300, 0x38fdb7a0
Caught exception in looking up space point ptr... 0x5a5e5e10, 0x18b1b0a0
Caught exception in looking up space point ptr... 0x18b1b0a0, 0x399827e0
Caught exception in looking up space point ptr... 0x5ab5f830, 0x3e29fb10
Caught exception in looking up space point ptr... 0x3e29fb10, 0x4cefb390
Caught exception in looking up space point ptr... 0x40380c80, 0x391625a0
Caught exception in looking up space point ptr... 0x391625a0, 0x70770870
++++>>>> total num hits: 302152, num free: 296300
04-Feb-2026 02:12:44 CET Closed output file "np02vd_raw_run042422_0065_df-s04-d0_dw_0_20260203T154955_reco_stage0_20260204T011244_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 204.41 299.323 379.658 302.416 41.0292 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.1313e-05 0.00010994 0.000277209 0.000103283 3.36276e-05 27
produce:tpcrawdecoder:PDVDTPCReader 86.3177 136.128 208.974 130.255 30.4399 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.588285 0.844859 1.64434 0.758273 0.22682 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0175901 0.0261294 0.0679175 0.0229748 0.011531 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0851343 0.0915929 0.138975 0.0872289 0.0114774 27
produce:beamevent:BeamEvent 9.599e-05 0.000184318 0.00138449 0.000140974 0.000236735 27
produce:pdvddaphne:DAPHNEReaderPDVD 11.8287 16.9987 25.7681 17.0327 3.41767 27
produce:ophit:OpHitFinder 0.0325023 0.0426315 0.0580008 0.0431662 0.005204 27
produce:wclsdatavd:WireCellToolkit 73.0236 85.6066 100.178 85.3988 8.0546 27
produce:gaushit:GausHitFinder 0.711745 1.54195 2.48234 1.58402 0.462957 27
produce:nhitsfilter:NumberOfHitsFilter 0.000458478 0.000729534 0.0011994 0.000672007 0.00017016 27
produce:reco3d:SpacePointSolver 6.64575 12.3199 18.8166 12.0053 3.70008 27
produce:hitpdune:DisambigFromSpacePoints 0.0704927 0.255095 0.47701 0.250413 0.110252 27
produce:cluster3d:Cluster3D 1.69299 39.8051 66.5486 48.4588 22.8845 27
[art]:TriggerResults:TriggerResultInserter 2.4806e-05 3.44616e-05 0.00010172 2.9285e-05 1.57205e-05 27
end_path:out1:RootOutput 3.947e-06 6.04837e-06 2.5287e-05 4.91e-06 4.26167e-06 27
end_path:out1:RootOutput(write) 3.82619 5.6213 7.03889 5.7013 0.730932 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4701.78 MB
Peak resident set size usage (VmHWM): 2751.97 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0065_df-s04-d0_dw_0_20260203T154955_reco_stage0_20260204T011244_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0065_df-s04-d0_dw_0_20260203T154955_reco_stage0_20260204T011244_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0065_df-s04-d0_dw_0_20260203T154955_reco_stage0_20260204T011244_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770159409.0,
"core.end_time": 1770167567.0,
"core.events": [
10540,
10546,
10552,
10558,
10564,
10570,
10576,
10582,
10588,
10594,
10600,
10606,
10612,
10618,
10624,
10630,
10636,
10642,
10648,
10654,
10660,
10666,
10672,
10678,
10684,
10690,
10696
],
"core.event_count": 27,
"core.first_event_number": 10540,
"core.last_event_number": 10696,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0065_df-s04-d0_dw_0_20260203T154955.hdf5"
}
]
} 