Jobsub ID 298040.1@dunegpschedd02.fnal.gov
| Jobsub ID | 298040.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-04 02:16:32 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_klomp |
| Last heartbeat | 2026-02-04 04:12:30 |
| From worker node | Hostname | wn-snel-010.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7H12 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 02:17:03 |
| Input files | vd-protodune:np02vd_raw_run042421_0163_df-s03-d0_dw_0_20260203T145912.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6784s) |
| CPU time | 57m (3437s = 50%) |
| Max RSS bytes | 2606551040 (2485 MiB) |
| Outputting started | 2026-02-04 04:10:09 |
| Output files | |
| Finished | 2026-02-04 04:12:30 |
| Saved logs | justin-logs:298040.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x91bef9c0, 0x6e36a190
Caught exception in looking up space point ptr... 0x6e36a190, 0x476d7de0
Caught exception in looking up space point ptr... 0x4049e220, 0x7b439e20
Caught exception in looking up space point ptr... 0x4049e3b0, 0x4049e220
Caught exception in looking up space point ptr... 0x7b437880, 0x7b437780
Caught exception in looking up space point ptr... 0x47488c10, 0x7b437880
Caught exception in looking up space point ptr... 0x72bd7300, 0x67731010
Caught exception in looking up space point ptr... 0x67731010, 0x72bd7300
Caught exception in looking up space point ptr... 0x85ab94d0, 0x85abf790
Caught exception in looking up space point ptr... 0x85ab92d0, 0x85ab94d0
Caught exception in looking up space point ptr... 0x3eff2ee0, 0x3eff2c40
Caught exception in looking up space point ptr... 0x3eff2c40, 0x3eff2ee0
Caught exception in looking up space point ptr... 0x3eff2ee0, 0x3eff2d90
Caught exception in looking up space point ptr... 0x3eff2d90, 0x3eff2ee0
Caught exception in looking up space point ptr... 0x71d5f570, 0x71d5f250
Caught exception in looking up space point ptr... 0x71d5f250, 0x71d5f570
Caught exception in looking up space point ptr... 0x4b4df820, 0x6781b520
Caught exception in looking up space point ptr... 0x6781b520, 0x4b4df820
Caught exception in looking up space point ptr... 0x7fa34cc0, 0x7fa34df0
Caught exception in looking up space point ptr... 0x7fa34df0, 0x7fa35050
Caught exception in looking up space point ptr... 0x6e3b4560, 0x6e3444f0
Caught exception in looking up space point ptr... 0x6e3444f0, 0x480ed410
Caught exception in looking up space point ptr... 0x476d3de0, 0x6e3b4560
Caught exception in looking up space point ptr... 0x5fb46130, 0x7d182d80
Caught exception in looking up space point ptr... 0x7d182d80, 0x5fb46130
Caught exception in looking up space point ptr... 0x8580e6a0, 0x4e202e20
Caught exception in looking up space point ptr... 0x4e202e20, 0x8580e6a0
Caught exception in looking up space point ptr... 0x8580e6a0, 0x64817da0
Caught exception in looking up space point ptr... 0x64817da0, 0x8580e6a0
Caught exception in looking up space point ptr... 0x91e15880, 0x91e0bd90
Caught exception in looking up space point ptr... 0x91e156f0, 0x91e15880
Caught exception in looking up space point ptr... 0x70a09110, 0x445f1470
Caught exception in looking up space point ptr... 0x445f1470, 0x70a09110
Caught exception in looking up space point ptr... 0x6744c490, 0x67445410
Caught exception in looking up space point ptr... 0x6744c300, 0x6744c490
Caught exception in looking up space point ptr... 0x3eb64490, 0x3eb646e0
Caught exception in looking up space point ptr... 0x3eb646e0, 0x3eb51280
Caught exception in looking up space point ptr... 0x6e44edb0, 0x6e43d1b0
Caught exception in looking up space point ptr... 0x6e43d1b0, 0x6e44edb0
Caught exception in looking up space point ptr... 0x7fa34800, 0x7fa34a60
Caught exception in looking up space point ptr... 0x7fa34a60, 0x7fa34b90
Caught exception in looking up space point ptr... 0x431f09c0, 0x431f30b0
Caught exception in looking up space point ptr... 0x431f30b0, 0x431f2690
Caught exception in looking up space point ptr... 0x7f5de660, 0x4b541070
Caught exception in looking up space point ptr... 0x4b541070, 0x7ec12310
Caught exception in looking up space point ptr... 0x43c7dee0, 0x40c3f380
Caught exception in looking up space point ptr... 0x40c3f380, 0x71d6c410
Caught exception in looking up space point ptr... 0x487816c0, 0x434bf660
Caught exception in looking up space point ptr... 0x434bf660, 0x487816c0
Caught exception in looking up space point ptr... 0x91e4dd90, 0x91e3c1c0
Caught exception in looking up space point ptr... 0x91e3c1c0, 0x91e53c70
Caught exception in looking up space point ptr... 0x6e441e70, 0x9a6f0fb0
Caught exception in looking up space point ptr... 0x9a6f0fb0, 0x6e441e70
Caught exception in looking up space point ptr... 0x7fa346d0, 0x7fa345a0
Caught exception in looking up space point ptr... 0x7fa345a0, 0x7fa31fc0
Caught exception in looking up space point ptr... 0x7b440be0, 0x7b45b220
Caught exception in looking up space point ptr... 0x7b45b220, 0x45368040
Caught exception in looking up space point ptr... 0x7b455150, 0x5d8e8050
Caught exception in looking up space point ptr... 0x5d8e8050, 0x7b455150
Caught exception in looking up space point ptr... 0x7b455150, 0x3f5c6560
Caught exception in looking up space point ptr... 0x3f5c6560, 0x7b455150
Caught exception in looking up space point ptr... 0x83f79a30, 0x5dc4cf90
Caught exception in looking up space point ptr... 0x5dc4cf90, 0x83f79a30
Caught exception in looking up space point ptr... 0x96cfeef0, 0x96d0f200
Caught exception in looking up space point ptr... 0x96d0f200, 0x83f75ea0
++++>>>> total num hits: 78442, num free: 75979
04-Feb-2026 05:09:59 CET Closed output file "np02vd_raw_run042421_0163_df-s03-d0_dw_0_20260203T145912_reco_stage0_20260204T040959_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 204.717 247.128 284.798 250.166 22.0045 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.9318e-05 0.000107757 0.000298871 9.8855e-05 3.83517e-05 27
produce:tpcrawdecoder:PDVDTPCReader 78.8106 113.82 138.666 116.534 17.0178 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.588983 0.733695 1.0214 0.729613 0.0947773 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0175105 0.0221147 0.0410763 0.0193517 0.00606319 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.08632 0.0891895 0.103486 0.0871603 0.00504707 27
produce:beamevent:BeamEvent 9.014e-05 0.000166235 0.0013294 0.000118783 0.000229148 27
produce:pdvddaphne:DAPHNEReaderPDVD 9.59161 15.104 18.8123 15.8532 2.40093 27
produce:ophit:OpHitFinder 0.0357781 0.0459606 0.0529529 0.0461837 0.00366187 27
produce:wclsdatavd:WireCellToolkit 75.1283 88.9998 97.8175 91.1118 5.61212 27
produce:gaushit:GausHitFinder 0.714105 1.28787 2.17168 1.23792 0.333596 27
produce:nhitsfilter:NumberOfHitsFilter 0.000336993 0.000542306 0.000764766 0.000536708 0.00011896 27
produce:reco3d:SpacePointSolver 8.36493 16.221 25.0062 16.4779 4.27834 27
produce:hitpdune:DisambigFromSpacePoints 0.0680084 0.155459 0.325459 0.148512 0.0544686 27
produce:cluster3d:Cluster3D 1.55123 3.50154 5.72993 3.40094 1.08051 27
[art]:TriggerResults:TriggerResultInserter 2.6058e-05 3.53377e-05 0.000131096 3.1599e-05 1.92603e-05 27
end_path:out1:RootOutput 4.027e-06 6.04733e-06 3.2771e-05 4.97e-06 5.26656e-06 27
end_path:out1:RootOutput(write) 5.96126 7.11519 8.16639 7.246 0.586869 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4542.73 MB
Peak resident set size usage (VmHWM): 2606.55 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0163_df-s03-d0_dw_0_20260203T145912_reco_stage0_20260204T040959_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0163_df-s03-d0_dw_0_20260203T145912_reco_stage0_20260204T040959_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0163_df-s03-d0_dw_0_20260203T145912_reco_stage0_20260204T040959_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770171437.0,
"core.end_time": 1770178201.0,
"core.events": [
26492,
26498,
26504,
26510,
26516,
26522,
26528,
26534,
26540,
26546,
26552,
26558,
26564,
26570,
26576,
26582,
26588,
26594,
26600,
26606,
26612,
26618,
26624,
26630,
26636,
26642,
26648
],
"core.event_count": 27,
"core.first_event_number": 26492,
"core.last_event_number": 26648,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0163_df-s03-d0_dw_0_20260203T145912.hdf5"
}
]
} 