Jobsub ID 303653.27@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.27@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce515 |
| Last heartbeat | 2026-02-04 00:27:11 |
| From worker node | Hostname | b9p35p0043.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:37:54 |
| Input files | vd-protodune:np02vd_raw_run042421_0071_df-s02-d1_dw_0_20260203T140926.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 46m (2810s) |
| CPU time | 45m (2719s = 96%) |
| Max RSS bytes | 2712363008 (2586 MiB) |
| Outputting started | 2026-02-04 00:24:46 |
| Output files | |
| Finished | 2026-02-04 00:27:11 |
| Saved logs | justin-logs:303653.27-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
e0
Caught exception in looking up space point ptr... 0x2887b6b0, 0x11cd4eb0
Caught exception in looking up space point ptr... 0x11cd4eb0, 0x11cd4d20
Caught exception in looking up space point ptr... 0x117c93b0, 0x50171ce0
Caught exception in looking up space point ptr... 0x117c9540, 0x117c93b0
Caught exception in looking up space point ptr... 0x43ddc9e0, 0x14be6ec0
Caught exception in looking up space point ptr... 0x43ddc850, 0x43ddc9e0
Caught exception in looking up space point ptr... 0x28694950, 0x28854940
Caught exception in looking up space point ptr... 0x286947c0, 0x28694950
Caught exception in looking up space point ptr... 0x154ef8c0, 0x4c0b9400
Caught exception in looking up space point ptr... 0x4c0b9400, 0x4c0b9710
Caught exception in looking up space point ptr... 0x4c0b9710, 0xb525540
Caught exception in looking up space point ptr... 0x57b5f9e0, 0x57b4d420
Caught exception in looking up space point ptr... 0x57b4d290, 0x57b5f9e0
Caught exception in looking up space point ptr... 0xfe39cb0, 0x25384b60
Caught exception in looking up space point ptr... 0x25384b60, 0xfe39b20
Caught exception in looking up space point ptr... 0x57285ca0, 0x156ed630
Caught exception in looking up space point ptr... 0x156ed630, 0x578dff10
Caught exception in looking up space point ptr... 0x30773e40, 0xbba9a60
Caught exception in looking up space point ptr... 0xbba9a60, 0x16ea9560
Caught exception in looking up space point ptr... 0x367d3ed0, 0x367d3de0
Caught exception in looking up space point ptr... 0x367d3de0, 0x288f4b80
Caught exception in looking up space point ptr... 0x590027f0, 0x57049440
Caught exception in looking up space point ptr... 0x590120b0, 0x590027f0
Caught exception in looking up space point ptr... 0x590093c0, 0x58ff6ae0
Caught exception in looking up space point ptr... 0x59018c80, 0x590093c0
Caught exception in looking up space point ptr... 0x253bc520, 0x253abea0
Caught exception in looking up space point ptr... 0x253ceae0, 0x253bc520
Caught exception in looking up space point ptr... 0x256a0970, 0x2568e3b0
Caught exception in looking up space point ptr... 0x256b3110, 0x256a0970
Caught exception in looking up space point ptr... 0x5e4cb090, 0x5e4ba0b0
Caught exception in looking up space point ptr... 0x2bf698d0, 0x5e4cb090
Caught exception in looking up space point ptr... 0x34d324b0, 0x5719cea0
Caught exception in looking up space point ptr... 0x34d32640, 0x34d324b0
Caught exception in looking up space point ptr... 0x4fb34770, 0x5af81fc0
Caught exception in looking up space point ptr... 0x231600c0, 0x4fb34770
Caught exception in looking up space point ptr... 0x2283ab20, 0x35901940
Caught exception in looking up space point ptr... 0x2283ac90, 0x2283ab20
Caught exception in looking up space point ptr... 0x5a2f2970, 0x500ba660
Caught exception in looking up space point ptr... 0x500ba660, 0xe423780
Caught exception in looking up space point ptr... 0x410e52c0, 0x410d2e40
Caught exception in looking up space point ptr... 0x410d2e40, 0x410e5130
Caught exception in looking up space point ptr... 0x5a31dd10, 0x2ab3d3c0
Caught exception in looking up space point ptr... 0x2ab3d3c0, 0x5a31db80
Caught exception in looking up space point ptr... 0xbdd9ed0, 0xbdc99e0
Caught exception in looking up space point ptr... 0xbdc99e0, 0x57a789e0
Caught exception in looking up space point ptr... 0x2340f3b0, 0x51c64a40
Caught exception in looking up space point ptr... 0x51c64a40, 0x2340f3b0
Caught exception in looking up space point ptr... 0x2340f3b0, 0x31838a40
Caught exception in looking up space point ptr... 0x31838a40, 0x2340f3b0
Caught exception in looking up space point ptr... 0x3ac19160, 0x37c7eae0
Caught exception in looking up space point ptr... 0x37c7eae0, 0x22b8cb80
Caught exception in looking up space point ptr... 0x55429320, 0x285c9ed0
Caught exception in looking up space point ptr... 0x285c9ed0, 0x55429320
Caught exception in looking up space point ptr... 0x5f8a7f70, 0x5f8a7d90
Caught exception in looking up space point ptr... 0x5f8a7d90, 0xf040240
Caught exception in looking up space point ptr... 0x30be5f20, 0x30be6020
Caught exception in looking up space point ptr... 0x30be6020, 0x30be5f20
Caught exception in looking up space point ptr... 0x5b005b10, 0x43e40e80
Caught exception in looking up space point ptr... 0x43e40e80, 0x2b219630
Caught exception in looking up space point ptr... 0x437da400, 0x14b9b740
Caught exception in looking up space point ptr... 0x14b9b740, 0x437da400
Caught exception in looking up space point ptr... 0x56994680, 0x45deb160
Caught exception in looking up space point ptr... 0x45deb160, 0x56994680
Caught exception in looking up space point ptr... 0x44efabf0, 0x3752ef20
Caught exception in looking up space point ptr... 0x3752ef20, 0x3752edf0
++++>>>> total num hits: 318433, num free: 311991
04-Feb-2026 01:24:39 CET Closed output file "np02vd_raw_run042421_0071_df-s02-d1_dw_0_20260203T140926_reco_stage0_20260204T002439_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 64.6382 101.862 127.082 108.172 18.5681 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.758e-05 7.72244e-05 0.00020202 7.157e-05 2.46878e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.38472 3.97002 5.57496 3.82576 0.479869 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00916553 0.0203926 0.0764294 0.0130662 0.0175852 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000399771 0.0016417 0.0108538 0.0006155 0.00279045 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00121502 0.00192592 0.00529749 0.00171802 0.000747936 27
produce:beamevent:BeamEvent 6.263e-05 0.000115399 0.00079481 8.895e-05 0.000134374 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.80416 2.18081 2.90259 2.18678 0.223789 27
produce:ophit:OpHitFinder 0.0223412 0.0344015 0.0423115 0.0350856 0.00469884 27
produce:wclsdatavd:WireCellToolkit 48.9113 54.5019 61.2583 54.6509 3.41368 27
produce:gaushit:GausHitFinder 0.458749 1.03385 1.67854 1.00544 0.266961 27
produce:nhitsfilter:NumberOfHitsFilter 0.0001217 0.000213479 0.00046614 0.00019317 6.82326e-05 27
produce:reco3d:SpacePointSolver 2.85916 7.0711 13.1854 5.88039 2.79604 27
produce:hitpdune:DisambigFromSpacePoints 0.0439285 0.155092 0.35747 0.145761 0.0781079 27
produce:cluster3d:Cluster3D 0.741547 28.5315 43.1052 35.7214 16.3499 27
[art]:TriggerResults:TriggerResultInserter 2.298e-05 3.27737e-05 8.119e-05 3.062e-05 1.00484e-05 27
end_path:out1:RootOutput 4.29e-06 6.36074e-06 1.967e-05 5.6e-06 3.19214e-06 27
end_path:out1:RootOutput(write) 2.87077 4.3278 5.93413 4.30866 0.643306 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4695.3 MB
Peak resident set size usage (VmHWM): 2712.36 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0071_df-s02-d1_dw_0_20260203T140926_reco_stage0_20260204T002439_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0071_df-s02-d1_dw_0_20260203T140926_reco_stage0_20260204T002439_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0071_df-s02-d1_dw_0_20260203T140926_reco_stage0_20260204T002439_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161882.0,
"core.end_time": 1770164681.0,
"core.events": [
11557,
11563,
11569,
11575,
11581,
11587,
11593,
11599,
11605,
11611,
11617,
11623,
11629,
11635,
11641,
11647,
11653,
11659,
11665,
11671,
11677,
11683,
11689,
11695,
11701,
11707,
11713
],
"core.event_count": 27,
"core.first_event_number": 11557,
"core.last_event_number": 11713,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0071_df-s02-d1_dw_0_20260203T140926.hdf5"
}
]
} 