Jobsub ID 297923.44@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.44@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce505 |
| Last heartbeat | 2026-02-04 00:36:58 |
| From worker node | Hostname | b9p35p0031.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:59:25 |
| Input files | vd-protodune:np02vd_raw_run042433_0453_df-s03-d1_dw_0_20260203T213418.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 35m (2112s) |
| CPU time | 33m (2033s = 96%) |
| Max RSS bytes | 3407806464 (3249 MiB) |
| Outputting started | 2026-02-04 00:34:39 |
| Output files | |
| Finished | 2026-02-04 00:36:58 |
| Saved logs | justin-logs:297923.44-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ace point ptr... 0x51984d20, 0x5534a310
Caught exception in looking up space point ptr... 0x5534a310, 0x7e7ac290
Caught exception in looking up space point ptr... 0x7e7ac290, 0x5534a310
Caught exception in looking up space point ptr... 0x5e4a29d0, 0x5e4a25e0
Caught exception in looking up space point ptr... 0x5e4a25e0, 0x5e4a2880
Caught exception in looking up space point ptr... 0x63c79450, 0x755b8970
Caught exception in looking up space point ptr... 0x755b8970, 0x2f7cbc80
Caught exception in looking up space point ptr... 0x49c4bb50, 0x5f3f23f0
Caught exception in looking up space point ptr... 0x5f3f23f0, 0x49c4bb50
Caught exception in looking up space point ptr... 0x77a60900, 0x4bd113b0
Caught exception in looking up space point ptr... 0x4bd113b0, 0x48b035f0
Caught exception in looking up space point ptr... 0x40d78e70, 0x7aeeaf20
Caught exception in looking up space point ptr... 0x7aeeaf20, 0x40d78e70
Caught exception in looking up space point ptr... 0x48baa260, 0x14cdbbe0
Caught exception in looking up space point ptr... 0x14cdbbe0, 0xf6f0a80
Caught exception in looking up space point ptr... 0x110a51a0, 0x110a54c0
Caught exception in looking up space point ptr... 0x110a54c0, 0x110a51a0
Caught exception in looking up space point ptr... 0x48852a90, 0x2a208780
Caught exception in looking up space point ptr... 0x40b82c70, 0x48852a90
Caught exception in looking up space point ptr... 0x4bcfa800, 0x4bcfa670
Caught exception in looking up space point ptr... 0x4bcfa670, 0x58f25600
Caught exception in looking up space point ptr... 0x48f3be50, 0x48f3bbb0
Caught exception in looking up space point ptr... 0x48f3bbb0, 0x48f3be50
Caught exception in looking up space point ptr... 0x48f3be50, 0x48f3ba10
Caught exception in looking up space point ptr... 0x48f3ba10, 0x48f3be50
Caught exception in looking up space point ptr... 0x646dc6f0, 0x3c833590
Caught exception in looking up space point ptr... 0x3c833590, 0x646dc6f0
Caught exception in looking up space point ptr... 0x15036330, 0xeb58e70
Caught exception in looking up space point ptr... 0xeb58e70, 0x140848b0
Caught exception in looking up space point ptr... 0x7bb55a0, 0x7bb5410
Caught exception in looking up space point ptr... 0x7bb5410, 0x7bb55a0
Caught exception in looking up space point ptr... 0x588d8720, 0x588d8110
Caught exception in looking up space point ptr... 0x588d8110, 0x588d8720
Caught exception in looking up space point ptr... 0x150344f0, 0x3ac04430
Caught exception in looking up space point ptr... 0x3ac04430, 0x55c3e910
Caught exception in looking up space point ptr... 0x3ae92490, 0x3ae91980
Caught exception in looking up space point ptr... 0x3ae91980, 0x3ae92490
Caught exception in looking up space point ptr... 0x4ee4a8e0, 0x4ee4a680
Caught exception in looking up space point ptr... 0x4ee4a680, 0x4ee4a8e0
Caught exception in looking up space point ptr... 0x156fb4e0, 0x156fafe0
Caught exception in looking up space point ptr... 0x156fafe0, 0x156fb3b0
Caught exception in looking up space point ptr... 0xe1b41d0, 0xe1b4340
Caught exception in looking up space point ptr... 0xe1b4340, 0xe1b41d0
Caught exception in looking up space point ptr... 0x51a82870, 0x845f1d60
Caught exception in looking up space point ptr... 0x845f1d60, 0x51a82940
Caught exception in looking up space point ptr... 0x38498fe0, 0x387b9530
Caught exception in looking up space point ptr... 0x387b9530, 0x5f47e110
Caught exception in looking up space point ptr... 0x4e688a60, 0x3712dae0
Caught exception in looking up space point ptr... 0x3712dae0, 0x4e688a60
Caught exception in looking up space point ptr... 0x788e6250, 0x3c76e9f0
Caught exception in looking up space point ptr... 0x3c76e9f0, 0x5f2d3c50
Caught exception in looking up space point ptr... 0x9600ef0, 0x5cbf87f0
Caught exception in looking up space point ptr... 0x5cbf87f0, 0x9600ef0
Caught exception in looking up space point ptr... 0x3ae17d20, 0x5d1a7cb0
Caught exception in looking up space point ptr... 0x5d1a7cb0, 0x3ae17d20
Caught exception in looking up space point ptr... 0x37c42690, 0x4e27c780
Caught exception in looking up space point ptr... 0x4e27c780, 0x37683e40
Caught exception in looking up space point ptr... 0x553d4b00, 0x5f35cdd0
Caught exception in looking up space point ptr... 0x5f35cdd0, 0x553d4b00
Caught exception in looking up space point ptr... 0x1059dda0, 0xfc30350
Caught exception in looking up space point ptr... 0xfc30350, 0x1059dda0
Caught exception in looking up space point ptr... 0x3855ee90, 0x39e326f0
Caught exception in looking up space point ptr... 0x39e326f0, 0x3855ee90
Caught exception in looking up space point ptr... 0x52c0fe90, 0x40a27820
Caught exception in looking up space point ptr... 0x40a27820, 0x52c0fe90
Caught exception in looking up space point ptr... 0x1713d5b0, 0x2a84ba40
Caught exception in looking up space point ptr... 0x2a84ba40, 0x1713d5b0
++++>>>> total num hits: 60979, num free: 58247
04-Feb-2026 01:34:32 CET Closed output file "np02vd_raw_run042433_0453_df-s03-d1_dw_0_20260203T213418_reco_stage0_20260204T003432_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 96.8394 108.062 124.931 109.301 6.94472 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.744e-05 7.72195e-05 0.00020707 7.269e-05 3.13494e-05 19
produce:tpcrawdecoder:PDVDTPCReader 5.74559 6.19907 6.70715 6.16281 0.221337 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.00801197 0.0184565 0.0758639 0.010499 0.0170945 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.00035662 0.000606652 0.0011592 0.00062354 0.000173121 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00030263 0.000534508 0.00118099 0.00052377 0.000203933 19
produce:beamevent:BeamEvent 5.839e-05 0.000129033 0.00077778 9.141e-05 0.000154883 19
produce:pdvddaphne:DAPHNEReaderPDVD 1.76179 2.0374 2.34743 2.06851 0.167738 19
produce:ophit:OpHitFinder 0.0246778 0.0319618 0.0400563 0.0317056 0.00401959 19
produce:wclsdatavd:WireCellToolkit 70.8296 79.5881 96.8236 79.6916 6.28472 19
produce:gaushit:GausHitFinder 0.631184 1.04572 1.51097 1.07223 0.238934 19
produce:nhitsfilter:NumberOfHitsFilter 0.00015984 0.000208527 0.0003858 0.00019366 5.18329e-05 19
produce:reco3d:SpacePointSolver 7.12771 12.0144 16.821 12.5155 2.36449 19
produce:hitpdune:DisambigFromSpacePoints 0.0606943 0.153682 0.258979 0.136531 0.0571051 19
produce:cluster3d:Cluster3D 0.747843 1.90461 3.12892 1.73098 0.692551 19
[art]:TriggerResults:TriggerResultInserter 2.705e-05 3.71805e-05 0.0001119 3.385e-05 1.80169e-05 19
end_path:out1:RootOutput 4.86e-06 6.74421e-06 2.558e-05 5.47e-06 4.51406e-06 19
end_path:out1:RootOutput(write) 3.9963 5.0228 6.62359 4.98883 0.743917 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5397.05 MB
Peak resident set size usage (VmHWM): 3407.81 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0453_df-s03-d1_dw_0_20260203T213418_reco_stage0_20260204T003432_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0453_df-s03-d1_dw_0_20260203T213418_reco_stage0_20260204T003432_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0453_df-s03-d1_dw_0_20260203T213418_reco_stage0_20260204T003432_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163174.0,
"core.end_time": 1770165274.0,
"core.events": [
51651,
51657,
51663,
51669,
51675,
51681,
51687,
51693,
51699,
51705,
51711,
51717,
51723,
51729,
51735,
51741,
51747,
51753,
51759
],
"core.event_count": 19,
"core.first_event_number": 51651,
"core.last_event_number": 51759,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0453_df-s03-d1_dw_0_20260203T213418.hdf5"
}
]
} 