Jobsub ID 303647.155@dunegpschedd01.fnal.gov
| Jobsub ID | 303647.155@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:46:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce506 |
| Last heartbeat | 2026-02-03 23:35:27 |
| From worker node | Hostname | b9p06p2822.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:46:51 |
| Input files | vd-protodune:np02vd_raw_run042421_0068_df-s02-d1_dw_0_20260203T140747.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 45m (2759s) |
| CPU time | 43m (2633s = 95%) |
| Max RSS bytes | 2702794752 (2577 MiB) |
| Outputting started | 2026-02-03 23:32:52 |
| Output files | |
| Finished | 2026-02-03 23:35:27 |
| Saved logs | justin-logs:303647.155-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Caught exception in looking up space point ptr... 0x14b26df0, 0x54b681e0
Caught exception in looking up space point ptr... 0x54b681e0, 0x14b27110
Caught exception in looking up space point ptr... 0x14b27110, 0x54b681e0
Caught exception in looking up space point ptr... 0x2ae36e80, 0x14b260d0
Caught exception in looking up space point ptr... 0x14b260d0, 0x2ae36e80
Caught exception in looking up space point ptr... 0x2ae36e80, 0x14b263f0
Caught exception in looking up space point ptr... 0x14b263f0, 0x2ae36e80
Caught exception in looking up space point ptr... 0xf94dce0, 0x376f25d0
Caught exception in looking up space point ptr... 0x376f25d0, 0x3770c7c0
Caught exception in looking up space point ptr... 0x3770c7c0, 0x375d7b80
Caught exception in looking up space point ptr... 0x375d7b80, 0xf94e070
Caught exception in looking up space point ptr... 0xf94e070, 0xf94df40
Caught exception in looking up space point ptr... 0xf94df40, 0xf94de10
Caught exception in looking up space point ptr... 0xf94de10, 0xf94dce0
Caught exception in looking up space point ptr... 0x116aa6e0, 0x38a71b10
Caught exception in looking up space point ptr... 0x47332620, 0x116aa6e0
Caught exception in looking up space point ptr... 0x533e4180, 0x585d8ba0
Caught exception in looking up space point ptr... 0x585d8ba0, 0x233e75b0
Caught exception in looking up space point ptr... 0x233e75b0, 0x4183c7b0
Caught exception in looking up space point ptr... 0x2ae43fe0, 0x533e4180
Caught exception in looking up space point ptr... 0x5a2d50b0, 0x5a2d8080
Caught exception in looking up space point ptr... 0x5a2d8080, 0x5a2d50b0
Caught exception in looking up space point ptr... 0x16bc5c40, 0x16bc5650
Caught exception in looking up space point ptr... 0x16bc5650, 0x16bc5c40
Caught exception in looking up space point ptr... 0x2f3ca980, 0x2f3c6430
Caught exception in looking up space point ptr... 0x2f3c6430, 0x2f3ca980
Caught exception in looking up space point ptr... 0x2f3ca980, 0x2f3c8700
Caught exception in looking up space point ptr... 0x2f3c8700, 0x2f3ca980
Caught exception in looking up space point ptr... 0x2bb1b620, 0x35329870
Caught exception in looking up space point ptr... 0x35329870, 0x2bb1b620
Caught exception in looking up space point ptr... 0x57bf3230, 0x57bf33c0
Caught exception in looking up space point ptr... 0x57bf33c0, 0x57bf3230
Caught exception in looking up space point ptr... 0x2be30830, 0x2be330c0
Caught exception in looking up space point ptr... 0x2be33320, 0x2be331f0
Caught exception in looking up space point ptr... 0x2be331f0, 0x2be34460
Caught exception in looking up space point ptr... 0x2be34460, 0x2be30830
Caught exception in looking up space point ptr... 0x51b8df10, 0x51b88e00
Caught exception in looking up space point ptr... 0x51b88e00, 0x51b8dc70
Caught exception in looking up space point ptr... 0x42eebd00, 0x42eeb760
Caught exception in looking up space point ptr... 0x2f0b1460, 0x42eebd00
Caught exception in looking up space point ptr... 0x2cc55c80, 0x54abdf70
Caught exception in looking up space point ptr... 0x54abdf70, 0x57e5fc10
Caught exception in looking up space point ptr... 0x57e5fc10, 0x2cc55960
Caught exception in looking up space point ptr... 0x492bfdf0, 0x5a301940
Caught exception in looking up space point ptr... 0x5a301940, 0x372056e0
Caught exception in looking up space point ptr... 0x4190f950, 0x4190f7c0
Caught exception in looking up space point ptr... 0x4190f7c0, 0x29d5bc70
Caught exception in looking up space point ptr... 0x5a2d6020, 0x5a2d6280
Caught exception in looking up space point ptr... 0x5a2d6280, 0x5a2d6020
Caught exception in looking up space point ptr... 0x5a2d6020, 0x5a2d7ae0
Caught exception in looking up space point ptr... 0x5a2d7ae0, 0x5a2d6020
Caught exception in looking up space point ptr... 0x229f70a0, 0x229f6f50
Caught exception in looking up space point ptr... 0x229f6f50, 0x229f70a0
Caught exception in looking up space point ptr... 0x5e760670, 0x26955a30
Caught exception in looking up space point ptr... 0x26955a30, 0x5e760670
Caught exception in looking up space point ptr... 0x14b2c2f0, 0x14b2be40
Caught exception in looking up space point ptr... 0x14b2be40, 0x14b2c2f0
Caught exception in looking up space point ptr... 0x2efd6d70, 0x3a542310
Caught exception in looking up space point ptr... 0x3a542310, 0x2efd6d70
Caught exception in looking up space point ptr... 0x29e8a6b0, 0x2a29a4a0
Caught exception in looking up space point ptr... 0x2a29a4a0, 0x2e6887e0
Caught exception in looking up space point ptr... 0x2bfc3760, 0x489f0a50
Caught exception in looking up space point ptr... 0x489f0a50, 0x2ad34c00
Caught exception in looking up space point ptr... 0x4fb11fd0, 0x2283aff0
Caught exception in looking up space point ptr... 0x2283aff0, 0x4fb11fd0
++++>>>> total num hits: 204907, num free: 199486
04-Feb-2026 00:32:45 CET Closed output file "np02vd_raw_run042421_0068_df-s02-d1_dw_0_20260203T140747_reco_stage0_20260203T233245_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 73.8699 100.032 122.307 101.686 13.1886 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.137e-05 0.000107065 0.000266541 8.831e-05 5.29456e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.35958 4.13009 4.63759 4.10844 0.266358 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00987927 0.0176662 0.0642975 0.0129435 0.0114971 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000389642 0.000614476 0.00210472 0.000501803 0.000321123 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00147439 0.00192877 0.00342882 0.00187525 0.000360682 27
produce:beamevent:BeamEvent 6.266e-05 0.000130432 0.000831175 0.000104071 0.000139583 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.2106 2.74308 3.39796 2.8163 0.281508 27
produce:ophit:OpHitFinder 0.0270877 0.0349467 0.0416743 0.0344689 0.00383682 27
produce:wclsdatavd:WireCellToolkit 54.0684 64.4435 76.9583 62.7157 5.73511 27
produce:gaushit:GausHitFinder 0.516552 1.06868 2.19722 1.03691 0.313267 27
produce:nhitsfilter:NumberOfHitsFilter 0.000177941 0.000275736 0.000516212 0.000249391 7.89506e-05 27
produce:reco3d:SpacePointSolver 4.32083 7.51188 15.747 7.58534 2.3153 27
produce:hitpdune:DisambigFromSpacePoints 0.0484431 0.138989 0.272831 0.137818 0.0558284 27
produce:cluster3d:Cluster3D 0.655154 15.8296 30.1265 19.3119 9.90677 27
[art]:TriggerResults:TriggerResultInserter 1.967e-05 3.33623e-05 0.00010453 2.921e-05 1.53163e-05 27
end_path:out1:RootOutput 4.83e-06 9.14378e-06 2.848e-05 8.25e-06 4.54316e-06 27
end_path:out1:RootOutput(write) 3.16356 4.0843 5.56427 3.94725 0.732709 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4709.6 MB
Peak resident set size usage (VmHWM): 2702.79 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0068_df-s02-d1_dw_0_20260203T140747_reco_stage0_20260203T233245_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0068_df-s02-d1_dw_0_20260203T140747_reco_stage0_20260203T233245_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0068_df-s02-d1_dw_0_20260203T140747_reco_stage0_20260203T233245_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770158822.0,
"core.end_time": 1770161566.0,
"core.events": [
11071,
11077,
11083,
11089,
11095,
11101,
11107,
11113,
11119,
11125,
11131,
11137,
11143,
11149,
11155,
11161,
11167,
11173,
11179,
11185,
11191,
11197,
11203,
11209,
11215,
11221,
11227
],
"core.event_count": 27,
"core.first_event_number": 11071,
"core.last_event_number": 11227,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0068_df-s02-d1_dw_0_20260203T140747.hdf5"
}
]
} 