Jobsub ID 303650.17@dunegpschedd01.fnal.gov
| Jobsub ID | 303650.17@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:28 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_dissel_multicore |
| Last heartbeat | 2026-02-04 00:41:00 |
| From worker node | Hostname | wn-pijl-028.farm.nikhef.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:13:01 |
| Input files | vd-protodune:np02vd_raw_run042433_0582_df-s02-d1_dw_0_20260203T222318.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5066s) |
| CPU time | 1h (4765s = 94%) |
| Max RSS bytes | 3644530688 (3475 MiB) |
| Outputting started | 2026-02-04 00:37:36 |
| Output files | |
| Finished | 2026-02-04 00:41:00 |
| Saved logs | justin-logs:303650.17-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x78525840, 0xba983110
Caught exception in looking up space point ptr... 0xba983110, 0x4d6b5db0
Caught exception in looking up space point ptr... 0x6f1fa590, 0x78525840
Caught exception in looking up space point ptr... 0x6da91f40, 0x6daa3d30
Caught exception in looking up space point ptr... 0x6daa3d30, 0x6daa3ec0
Caught exception in looking up space point ptr... 0x5209c7f0, 0x883133e0
Caught exception in looking up space point ptr... 0x883133e0, 0x88313250
Caught exception in looking up space point ptr... 0x7276c1d0, 0x74559e00
Caught exception in looking up space point ptr... 0x74559e00, 0x74559c70
Caught exception in looking up space point ptr... 0x74130010, 0x6903d060
Caught exception in looking up space point ptr... 0x6903d060, 0x74130010
Caught exception in looking up space point ptr... 0x74130010, 0x84c3d4e0
Caught exception in looking up space point ptr... 0x84c3d4e0, 0x74130010
Caught exception in looking up space point ptr... 0x9f99ef30, 0x9f99f0c0
Caught exception in looking up space point ptr... 0x9f97b030, 0x9f99ef30
Caught exception in looking up space point ptr... 0x53d834e0, 0x53d845a0
Caught exception in looking up space point ptr... 0x53d845a0, 0x883e5be0
Caught exception in looking up space point ptr... 0x738e25b0, 0x738d3890
Caught exception in looking up space point ptr... 0x8a319220, 0x738e25b0
Caught exception in looking up space point ptr... 0x523e3580, 0x9c9e25d0
Caught exception in looking up space point ptr... 0x93613980, 0x523e3580
Caught exception in looking up space point ptr... 0x723c8310, 0x8d63b600
Caught exception in looking up space point ptr... 0x8d63acc0, 0x723c8310
Caught exception in looking up space point ptr... 0x4bb0b950, 0x4bae48e0
Caught exception in looking up space point ptr... 0x4bb0bae0, 0x4bb0b950
Caught exception in looking up space point ptr... 0x48022d20, 0x74561e00
Caught exception in looking up space point ptr... 0x74561e00, 0x74561f90
Caught exception in looking up space point ptr... 0x84a76db0, 0x84a76c20
Caught exception in looking up space point ptr... 0x84a76c20, 0x84a606a0
Caught exception in looking up space point ptr... 0xb50a3440, 0x8c805ac0
Caught exception in looking up space point ptr... 0x8c805ac0, 0x8843cba0
Caught exception in looking up space point ptr... 0x4df9d180, 0x4dfafa60
Caught exception in looking up space point ptr... 0x4dfafa60, 0x4dfc2390
Caught exception in looking up space point ptr... 0x7462d800, 0x4ad37070
Caught exception in looking up space point ptr... 0x813278e0, 0x7462d800
Caught exception in looking up space point ptr... 0x7c4a22a0, 0x7c48fce0
Caught exception in looking up space point ptr... 0x7c48fce0, 0x7c47d220
Caught exception in looking up space point ptr... 0x9367c550, 0x8d6cb7b0
Caught exception in looking up space point ptr... 0x4dbfe600, 0x9367c550
Caught exception in looking up space point ptr... 0x7559d950, 0x7559da90
Caught exception in looking up space point ptr... 0x7559da90, 0x6e488650
Caught exception in looking up space point ptr... 0x6ccfa700, 0x4da5c7c0
Caught exception in looking up space point ptr... 0x4da5c7c0, 0x93635200
Caught exception in looking up space point ptr... 0x6fc627b0, 0x9dce4a30
Caught exception in looking up space point ptr... 0x9dce4a30, 0xc5f4d3b0
Caught exception in looking up space point ptr... 0xbeb56930, 0x863222a0
Caught exception in looking up space point ptr... 0x863222a0, 0x8c54a340
Caught exception in looking up space point ptr... 0x67be5390, 0x67be5200
Caught exception in looking up space point ptr... 0x67be5200, 0x67be5070
Caught exception in looking up space point ptr... 0x5700d620, 0x5089b770
Caught exception in looking up space point ptr... 0x5089b770, 0x5700d620
Caught exception in looking up space point ptr... 0x55bd0d80, 0x9fe14ef0
Caught exception in looking up space point ptr... 0x9fe14ef0, 0x9fe15040
Caught exception in looking up space point ptr... 0x9eda38e0, 0x69a68ba0
Caught exception in looking up space point ptr... 0x69a68ba0, 0x9cca49d0
Caught exception in looking up space point ptr... 0x8edf19b0, 0x84fe5590
Caught exception in looking up space point ptr... 0x84fe5590, 0x84fe5690
Caught exception in looking up space point ptr... 0x4ffb8cb0, 0x7bd6bc40
Caught exception in looking up space point ptr... 0x7bd6bc40, 0x4ffb8990
Caught exception in looking up space point ptr... 0x7086dcc0, 0x95f277d0
Caught exception in looking up space point ptr... 0x95f277d0, 0x7086dcc0
Caught exception in looking up space point ptr... 0x514a1380, 0xaacf5ff0
Caught exception in looking up space point ptr... 0xaacf5ff0, 0x514a1380
Caught exception in looking up space point ptr... 0x78e96cb0, 0x782ca820
Caught exception in looking up space point ptr... 0x782ca820, 0xa111b9d0
Caught exception in looking up space point ptr... 0x78733930, 0x7d874d50
Caught exception in looking up space point ptr... 0x7d874d50, 0x6e468b80
++++>>>> total num hits: 555896, num free: 547245
04-Feb-2026 01:37:18 CET Closed output file "np02vd_raw_run042433_0582_df-s02-d1_dw_0_20260203T222318_reco_stage0_20260204T003718_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 198.611 260.46 323.896 260.85 34.5331 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.241e-05 0.000146869 0.000390751 0.000127032 6.6114e-05 19
produce:tpcrawdecoder:PDVDTPCReader 16.8653 19.4556 23.1851 19.1188 1.33921 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.526494 0.61656 1.92175 0.538227 0.308361 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0176132 0.0186759 0.0284211 0.018059 0.00232458 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0178578 0.0183498 0.0195293 0.0182927 0.000437954 19
produce:beamevent:BeamEvent 0.000117027 0.000310121 0.00132506 0.000285141 0.000256636 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.62223 4.03396 4.79874 4.04008 0.317594 19
produce:ophit:OpHitFinder 0.0361307 0.0525004 0.0897793 0.0514149 0.0108945 19
produce:wclsdatavd:WireCellToolkit 114.222 137.878 158.224 139.181 13.2081 19
produce:gaushit:GausHitFinder 1.33371 2.52638 3.99028 2.3533 0.690407 19
produce:nhitsfilter:NumberOfHitsFilter 0.000359473 0.00173127 0.00446509 0.00138187 0.00125179 19
produce:reco3d:SpacePointSolver 15.6806 24.5067 45.08 22.9403 7.58359 19
produce:hitpdune:DisambigFromSpacePoints 0.23566 0.391701 0.67335 0.370782 0.115519 19
produce:cluster3d:Cluster3D 4.16288 62.5235 90.4383 69.0959 26.0618 19
[art]:TriggerResults:TriggerResultInserter 2.8323e-05 7.26514e-05 0.000223748 5.2319e-05 5.21712e-05 19
end_path:out1:RootOutput 4.367e-06 1.18489e-05 6.1223e-05 6.61e-06 1.3593e-05 19
end_path:out1:RootOutput(write) 5.99389 8.33526 10.9221 8.16567 1.47985 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5640.72 MB
Peak resident set size usage (VmHWM): 3644.53 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0582_df-s02-d1_dw_0_20260203T222318_reco_stage0_20260204T003718_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0582_df-s02-d1_dw_0_20260203T222318_reco_stage0_20260204T003718_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0582_df-s02-d1_dw_0_20260203T222318_reco_stage0_20260204T003718_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160399.0,
"core.end_time": 1770165441.0,
"core.events": [
66355,
66361,
66367,
66373,
66379,
66385,
66391,
66397,
66403,
66409,
66415,
66421,
66427,
66433,
66439,
66445,
66451,
66457,
66463
],
"core.event_count": 19,
"core.first_event_number": 66355,
"core.last_event_number": 66463,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0582_df-s02-d1_dw_0_20260203T222318.hdf5"
}
]
} 