Jobsub ID 303649.52@dunegpschedd01.fnal.gov
| Jobsub ID | 303649.52@dunegpschedd01.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:26 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_klomp_multicore |
| Last heartbeat | 2026-02-04 00:19:54 |
| From worker node | Hostname | wn-snel-012.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7H12 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:59:13 |
| Input files | vd-protodune:np02vd_raw_run042422_0120_df-s04-d0_dw_0_20260203T161939.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4676s) |
| CPU time | 1h (4338s = 92%) |
| Max RSS bytes | 2739511296 (2612 MiB) |
| Outputting started | 2026-02-04 00:17:11 |
| Output files | |
| Finished | 2026-02-04 00:19:54 |
| Saved logs | justin-logs:303649.52-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
xception in looking up space point ptr... 0x37e24ae0, 0x662e99f0
Caught exception in looking up space point ptr... 0x24df6be0, 0x24df65a0
Caught exception in looking up space point ptr... 0x24df65a0, 0x24df6a50
Caught exception in looking up space point ptr... 0x24df6a50, 0x567c2230
Caught exception in looking up space point ptr... 0x24df6d70, 0x24df6be0
Caught exception in looking up space point ptr... 0x24d35770, 0x4de6d260
Caught exception in looking up space point ptr... 0x4de6d260, 0x24d35770
Caught exception in looking up space point ptr... 0x24d35770, 0x4de6d1c0
Caught exception in looking up space point ptr... 0x4de6d1c0, 0x24d35770
Caught exception in looking up space point ptr... 0x6873b6a0, 0x5e3484f0
Caught exception in looking up space point ptr... 0x5e3484f0, 0x5e348360
Caught exception in looking up space point ptr... 0x6bc3d750, 0x6bc2b140
Caught exception in looking up space point ptr... 0x3bec89f0, 0x6bc3d750
Caught exception in looking up space point ptr... 0x40bf77c0, 0x652987c0
Caught exception in looking up space point ptr... 0x652987c0, 0x40bf77c0
Caught exception in looking up space point ptr... 0x659e1be0, 0x473bb280
Caught exception in looking up space point ptr... 0x659f4060, 0x659e1be0
Caught exception in looking up space point ptr... 0x659e34e0, 0x473bcb80
Caught exception in looking up space point ptr... 0x659f5960, 0x659e34e0
Caught exception in looking up space point ptr... 0x473cd070, 0x473bac40
Caught exception in looking up space point ptr... 0x659f3a20, 0x473cd070
Caught exception in looking up space point ptr... 0x2b3e01b0, 0x44c82ec0
Caught exception in looking up space point ptr... 0x44c82ec0, 0x2b3e0020
Caught exception in looking up space point ptr... 0x633ecb60, 0x29408910
Caught exception in looking up space point ptr... 0x633fcd30, 0x633ecb60
Caught exception in looking up space point ptr... 0x633ece80, 0x29408c30
Caught exception in looking up space point ptr... 0x633fd050, 0x633ece80
Caught exception in looking up space point ptr... 0x5f7d6b00, 0x535cbec0
Caught exception in looking up space point ptr... 0x5f7b3fd0, 0x5f7d6b00
Caught exception in looking up space point ptr... 0x734e0d80, 0x725f6270
Caught exception in looking up space point ptr... 0x734e0f10, 0x734e0d80
Caught exception in looking up space point ptr... 0x3ddd0480, 0x5493a740
Caught exception in looking up space point ptr... 0x3ddcd9c0, 0x3ddd0480
Caught exception in looking up space point ptr... 0x42ba25f0, 0x7ed37a10
Caught exception in looking up space point ptr... 0x42ba1260, 0x42ba25f0
Caught exception in looking up space point ptr... 0x748e3e20, 0x748e3b00
Caught exception in looking up space point ptr... 0x748e3b00, 0x5763f7f0
Caught exception in looking up space point ptr... 0x2dae5980, 0x45a0a0e0
Caught exception in looking up space point ptr... 0x45a0a0e0, 0x68006450
Caught exception in looking up space point ptr... 0x4e6140f0, 0x4e601950
Caught exception in looking up space point ptr... 0x4e601950, 0x4e5ef070
Caught exception in looking up space point ptr... 0x5e34ac00, 0x4e25d860
Caught exception in looking up space point ptr... 0x4e25d860, 0x5e34aa70
Caught exception in looking up space point ptr... 0x657f9410, 0x6cfe0b40
Caught exception in looking up space point ptr... 0x6cfe0b40, 0x657f9410
Caught exception in looking up space point ptr... 0x25ac5e50, 0x5fde5640
Caught exception in looking up space point ptr... 0x5fde5640, 0x25ac5e50
Caught exception in looking up space point ptr... 0x748c24f0, 0x748c21d0
Caught exception in looking up space point ptr... 0x748c21d0, 0x748c24f0
Caught exception in looking up space point ptr... 0x72cbec40, 0x72a056d0
Caught exception in looking up space point ptr... 0x72a056d0, 0x72cbec40
Caught exception in looking up space point ptr... 0x6f557140, 0x6d931290
Caught exception in looking up space point ptr... 0x6d931290, 0x6f557140
Caught exception in looking up space point ptr... 0x5c005e60, 0x262fad90
Caught exception in looking up space point ptr... 0x262fad90, 0x5c005e60
Caught exception in looking up space point ptr... 0x38a084b0, 0x703d4480
Caught exception in looking up space point ptr... 0x703d4480, 0x38a08710
Caught exception in looking up space point ptr... 0x6f45e530, 0x6f45e7d0
Caught exception in looking up space point ptr... 0x6f45e7d0, 0x6f45e530
Caught exception in looking up space point ptr... 0x5570ca70, 0x582e7eb0
Caught exception in looking up space point ptr... 0x582e7eb0, 0x5570ca70
Caught exception in looking up space point ptr... 0x5570ca70, 0x67d8b010
Caught exception in looking up space point ptr... 0x67d8b010, 0x5570ca70
Caught exception in looking up space point ptr... 0x5ba2d010, 0x5ba2d160
Caught exception in looking up space point ptr... 0x5ba2d160, 0x5ba2d2f0
++++>>>> total num hits: 311414, num free: 304631
04-Feb-2026 01:16:59 CET Closed output file "np02vd_raw_run042422_0120_df-s04-d0_dw_0_20260203T161939_reco_stage0_20260204T001659_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 118.827 169.221 207.392 178.046 23.6511 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.8316e-05 0.00011226 0.000344907 0.000104426 4.62551e-05 27
produce:tpcrawdecoder:PDVDTPCReader 12.5015 14.6669 44.403 13.1943 6.19547 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.501754 0.548954 0.600373 0.55073 0.0264351 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0171912 0.020726 0.0543619 0.0177171 0.00805647 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0856622 0.0926461 0.105334 0.0874121 0.00813823 27
produce:beamevent:BeamEvent 9.9497e-05 0.000183495 0.00142133 0.000131126 0.000244669 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.42718 3.94086 4.33839 3.94658 0.212397 27
produce:ophit:OpHitFinder 0.0352073 0.0437936 0.0532217 0.0428322 0.00469542 27
produce:wclsdatavd:WireCellToolkit 79.0913 92.4112 105.675 89.9043 6.51829 27
produce:gaushit:GausHitFinder 0.828995 1.54168 2.12753 1.5277 0.363451 27
produce:nhitsfilter:NumberOfHitsFilter 0.000228309 0.000662309 0.00105908 0.00068738 0.000223877 27
produce:reco3d:SpacePointSolver 5.05193 8.69314 14.2046 8.40316 1.84761 27
produce:hitpdune:DisambigFromSpacePoints 0.0611492 0.25607 0.381616 0.268031 0.101105 27
produce:cluster3d:Cluster3D 0.92717 40.7937 65.9328 50.5187 23.5244 27
[art]:TriggerResults:TriggerResultInserter 2.6109e-05 4.14678e-05 0.000120586 3.3593e-05 2.08037e-05 27
end_path:out1:RootOutput 4.258e-06 6.57567e-06 2.1601e-05 5.43e-06 3.60752e-06 27
end_path:out1:RootOutput(write) 4.02591 6.17567 7.15458 6.19035 0.724649 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4702.52 MB
Peak resident set size usage (VmHWM): 2739.51 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0120_df-s04-d0_dw_0_20260203T161939_reco_stage0_20260204T001659_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0120_df-s04-d0_dw_0_20260203T161939_reco_stage0_20260204T001659_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0120_df-s04-d0_dw_0_20260203T161939_reco_stage0_20260204T001659_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770159568.0,
"core.end_time": 1770164221.0,
"core.events": [
19462,
19468,
19474,
19480,
19486,
19492,
19498,
19504,
19510,
19516,
19522,
19528,
19534,
19540,
19546,
19552,
19558,
19564,
19570,
19576,
19582,
19588,
19594,
19600,
19606,
19612,
19618
],
"core.event_count": 27,
"core.first_event_number": 19462,
"core.last_event_number": 19618,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0120_df-s04-d0_dw_0_20260203T161939.hdf5"
}
]
} 