Jobsub ID 297917.148@dunegpschedd02.fnal.gov
| Jobsub ID | 297917.148@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:25 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_klomp_multicore |
| Last heartbeat | 2026-02-04 00:20:36 |
| From worker node | Hostname | wn-snel-001.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7H12 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:24:19 |
| Input files | vd-protodune:np02vd_raw_run042421_0127_df-s02-d1_dw_0_20260203T143941.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 54m (3241s) |
| CPU time | 49m (2968s = 91%) |
| Max RSS bytes | 2602070016 (2481 MiB) |
| Outputting started | 2026-02-04 00:18:21 |
| Output files | |
| Finished | 2026-02-04 00:20:36 |
| Saved logs | justin-logs:297917.148-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x883be340, 0x883be840
Caught exception in looking up space point ptr... 0x8806edd0, 0x8806e2b0
Caught exception in looking up space point ptr... 0x8806e2b0, 0x8806d200
Caught exception in looking up space point ptr... 0x883d2f70, 0x883cd010
Caught exception in looking up space point ptr... 0x883cd010, 0x883d2f70
Caught exception in looking up space point ptr... 0x4adbf3e0, 0x4adbf070
Caught exception in looking up space point ptr... 0x4adbf070, 0x4adbf3e0
Caught exception in looking up space point ptr... 0x4adbf3e0, 0x4adbf250
Caught exception in looking up space point ptr... 0x4adbf250, 0x4adbf3e0
Caught exception in looking up space point ptr... 0x5aaa99c0, 0x5aaa9890
Caught exception in looking up space point ptr... 0x5aaa9890, 0x5aaa99c0
Caught exception in looking up space point ptr... 0x60bcba50, 0x60bcb900
Caught exception in looking up space point ptr... 0x60bcb900, 0x60bcba50
Caught exception in looking up space point ptr... 0x60bc6c70, 0x60bc6860
Caught exception in looking up space point ptr... 0x60bc6860, 0x60bc6b00
Caught exception in looking up space point ptr... 0x778251f0, 0x77825010
Caught exception in looking up space point ptr... 0x77825010, 0x778251f0
Caught exception in looking up space point ptr... 0x6e139de0, 0x6e13a330
Caught exception in looking up space point ptr... 0x6e13a330, 0x6e139de0
Caught exception in looking up space point ptr... 0x6426e050, 0x47b5b2f0
Caught exception in looking up space point ptr... 0x47b5b2f0, 0x5e4728b0
Caught exception in looking up space point ptr... 0x61061720, 0x61061a90
Caught exception in looking up space point ptr... 0x61061a90, 0x61061720
Caught exception in looking up space point ptr... 0x6ae02a10, 0x3fea0510
Caught exception in looking up space point ptr... 0x3fea0510, 0x6ae02a10
Caught exception in looking up space point ptr... 0x777700b0, 0x7776bf40
Caught exception in looking up space point ptr... 0x7776bf40, 0x7776f940
Caught exception in looking up space point ptr... 0x82038470, 0x88707420
Caught exception in looking up space point ptr... 0x88707420, 0x68253f40
Caught exception in looking up space point ptr... 0x4adb3db0, 0x4adb6000
Caught exception in looking up space point ptr... 0x4adb6000, 0x4adba040
Caught exception in looking up space point ptr... 0x7b9d81d0, 0x7b9d86d0
Caught exception in looking up space point ptr... 0x7b9d86d0, 0x7b9d81d0
Caught exception in looking up space point ptr... 0x4cc3a9a0, 0x4cc42900
Caught exception in looking up space point ptr... 0x4cc42900, 0x4cc3a9a0
Caught exception in looking up space point ptr... 0x61060230, 0x610603c0
Caught exception in looking up space point ptr... 0x610603c0, 0x610600a0
Caught exception in looking up space point ptr... 0x7b9d7800, 0x7b9d7760
Caught exception in looking up space point ptr... 0x7b9d7760, 0x7b9d7800
Caught exception in looking up space point ptr... 0x6105fba0, 0x6105fd30
Caught exception in looking up space point ptr... 0x6105fd30, 0x6105fa10
Caught exception in looking up space point ptr... 0x7b9d7d60, 0x7b9d7bc0
Caught exception in looking up space point ptr... 0x7b9d7bc0, 0x7b9d7d60
Caught exception in looking up space point ptr... 0x886514d0, 0x88650a20
Caught exception in looking up space point ptr... 0x88650a20, 0x886514d0
Caught exception in looking up space point ptr... 0x61060dc0, 0x61060be0
Caught exception in looking up space point ptr... 0x61060be0, 0x61060f50
Caught exception in looking up space point ptr... 0x67a07320, 0x67a07190
Caught exception in looking up space point ptr... 0x67a07190, 0x67a07320
Caught exception in looking up space point ptr... 0x7777c7e0, 0x7777c620
Caught exception in looking up space point ptr... 0x7777c620, 0x7777c7e0
Caught exception in looking up space point ptr... 0x886533b0, 0x88651f80
Caught exception in looking up space point ptr... 0x88651f80, 0x886533b0
Caught exception in looking up space point ptr... 0x88651a50, 0x777770b0
Caught exception in looking up space point ptr... 0x777770b0, 0x88651a50
Caught exception in looking up space point ptr... 0x886520b0, 0x88651990
Caught exception in looking up space point ptr... 0x88651990, 0x886520b0
Caught exception in looking up space point ptr... 0x8864eda0, 0x88652a30
Caught exception in looking up space point ptr... 0x88652a30, 0x8864eda0
Caught exception in looking up space point ptr... 0x88652440, 0x77769df0
Caught exception in looking up space point ptr... 0x77769df0, 0x88652440
Caught exception in looking up space point ptr... 0x77774f70, 0x77774e20
Caught exception in looking up space point ptr... 0x77774e20, 0x77774f70
Caught exception in looking up space point ptr... 0x7777be90, 0x7777d970
Caught exception in looking up space point ptr... 0x7777d970, 0x7777be90
++++>>>> total num hits: 82938, num free: 79188
04-Feb-2026 01:18:09 CET Closed output file "np02vd_raw_run042421_0127_df-s02-d1_dw_0_20260203T143941_reco_stage0_20260204T001809_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 100.273 115.819 133.524 115.485 9.08147 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.8788e-05 0.000110032 0.000341372 9.9367e-05 4.75617e-05 27
produce:tpcrawdecoder:PDVDTPCReader 11.7187 11.9647 12.519 11.9435 0.166025 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.520763 0.536143 0.569417 0.538737 0.011024 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0173149 0.0176687 0.0183387 0.0177086 0.000207767 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0860145 0.091539 0.104537 0.0874193 0.00746477 27
produce:beamevent:BeamEvent 9.0841e-05 0.000172746 0.00144824 0.000123502 0.000250939 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.43643 3.85356 4.10778 3.86655 0.183902 27
produce:ophit:OpHitFinder 0.0320338 0.0431856 0.0700239 0.0440129 0.00694979 27
produce:wclsdatavd:WireCellToolkit 68.8946 78.3917 93.7255 75.9759 6.48922 27
produce:gaushit:GausHitFinder 0.679141 1.09584 1.98288 1.02105 0.315115 27
produce:nhitsfilter:NumberOfHitsFilter 0.000237546 0.000474666 0.000774586 0.00049493 0.000132255 27
produce:reco3d:SpacePointSolver 7.36813 12.0435 19.2299 11.9742 3.51164 27
produce:hitpdune:DisambigFromSpacePoints 0.0756243 0.126694 0.197269 0.12133 0.0371422 27
produce:cluster3d:Cluster3D 1.18918 2.65528 4.60971 2.5121 0.900347 27
[art]:TriggerResults:TriggerResultInserter 2.3514e-05 3.30347e-05 0.000120697 2.9376e-05 1.75299e-05 27
end_path:out1:RootOutput 4.208e-06 5.79089e-06 3.0668e-05 4.929e-06 4.8966e-06 27
end_path:out1:RootOutput(write) 3.90757 4.97126 5.92349 5.0211 0.494598 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4527.13 MB
Peak resident set size usage (VmHWM): 2602.07 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0127_df-s02-d1_dw_0_20260203T143941_reco_stage0_20260204T001809_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0127_df-s02-d1_dw_0_20260203T143941_reco_stage0_20260204T001809_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0127_df-s02-d1_dw_0_20260203T143941_reco_stage0_20260204T001809_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161073.0,
"core.end_time": 1770164291.0,
"core.events": [
20635,
20641,
20647,
20653,
20659,
20665,
20671,
20677,
20683,
20689,
20695,
20701,
20707,
20713,
20719,
20725,
20731,
20737,
20743,
20749,
20755,
20761,
20767,
20773,
20779,
20785,
20791
],
"core.event_count": 27,
"core.first_event_number": 20635,
"core.last_event_number": 20791,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0127_df-s02-d1_dw_0_20260203T143941.hdf5"
}
]
} 