Jobsub ID 303654.31@dunegpschedd01.fnal.gov
| Jobsub ID | 303654.31@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce514 |
| Last heartbeat | 2026-02-04 00:55:16 |
| From worker node | Hostname | b9p08p6650.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:51:14 |
| Input files | vd-protodune:np02vd_raw_run042433_0058_df-s03-d0_dw_0_20260203T190409.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (3676s) |
| CPU time | 59m (3557s = 96%) |
| Max RSS bytes | 3608354816 (3441 MiB) |
| Outputting started | 2026-02-04 00:52:33 |
| Output files | |
| Finished | 2026-02-04 00:55:16 |
| Saved logs | justin-logs:303654.31-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
in looking up space point ptr... 0x3e4666b0, 0x3e4787c0
Caught exception in looking up space point ptr... 0x3e454be0, 0x3e4666b0
Caught exception in looking up space point ptr... 0x121dc720, 0x121dcc70
Caught exception in looking up space point ptr... 0x121dcc70, 0x121dc720
Caught exception in looking up space point ptr... 0x3f13a550, 0x53376620
Caught exception in looking up space point ptr... 0x53376620, 0x6ea83e50
Caught exception in looking up space point ptr... 0x3f441080, 0x825a8380
Caught exception in looking up space point ptr... 0x825a8380, 0x825a7d90
Caught exception in looking up space point ptr... 0x825ade90, 0x15978e00
Caught exception in looking up space point ptr... 0x15978e00, 0x356b98c0
Caught exception in looking up space point ptr... 0x1078bac0, 0x1078b950
Caught exception in looking up space point ptr... 0x1078b950, 0x6ee18df0
Caught exception in looking up space point ptr... 0xdbe4a40, 0x7a732ab0
Caught exception in looking up space point ptr... 0x1b7777e0, 0xdbe4a40
Caught exception in looking up space point ptr... 0xde8f530, 0xdb34d20
Caught exception in looking up space point ptr... 0xdb6b4f0, 0xde8f530
Caught exception in looking up space point ptr... 0x687cec10, 0x687ae4d0
Caught exception in looking up space point ptr... 0x687ceda0, 0x687cec10
Caught exception in looking up space point ptr... 0x34a4af80, 0x35209450
Caught exception in looking up space point ptr... 0x35209450, 0x8007f950
Caught exception in looking up space point ptr... 0xdb93b10, 0x51fcd120
Caught exception in looking up space point ptr... 0x46629e20, 0xdb93b10
Caught exception in looking up space point ptr... 0x4eebee80, 0x59aa2ee0
Caught exception in looking up space point ptr... 0x59aa2ee0, 0x43d10d20
Caught exception in looking up space point ptr... 0x174c6c80, 0x12735ca0
Caught exception in looking up space point ptr... 0x12735ca0, 0x7a78d4d0
Caught exception in looking up space point ptr... 0x3c647640, 0x3c635d00
Caught exception in looking up space point ptr... 0x3c658df0, 0x3c647640
Caught exception in looking up space point ptr... 0x87a47070, 0x87a36860
Caught exception in looking up space point ptr... 0x87a36860, 0x87a47200
Caught exception in looking up space point ptr... 0x71567270, 0x71555c50
Caught exception in looking up space point ptr... 0x71578700, 0x71567270
Caught exception in looking up space point ptr... 0x6a828220, 0x7f3d2a00
Caught exception in looking up space point ptr... 0x6a838d50, 0x6a828220
Caught exception in looking up space point ptr... 0x3efa96b0, 0x3cae1e80
Caught exception in looking up space point ptr... 0x3cae1e80, 0x3eff0b60
Caught exception in looking up space point ptr... 0x4ee08050, 0x5b0177f0
Caught exception in looking up space point ptr... 0x5b0177f0, 0x485081e0
Caught exception in looking up space point ptr... 0x3cfd0d80, 0x3cfd0f10
Caught exception in looking up space point ptr... 0x3cfd0f10, 0xf28c880
Caught exception in looking up space point ptr... 0x3cfd0d80, 0x16faf430
Caught exception in looking up space point ptr... 0x16faf430, 0x3cfd0d80
Caught exception in looking up space point ptr... 0x6c1999e0, 0x3415cd20
Caught exception in looking up space point ptr... 0x3415cd20, 0x6c1999e0
Caught exception in looking up space point ptr... 0x7aa0cba0, 0x3ca110e0
Caught exception in looking up space point ptr... 0x3ca110e0, 0x7aa0cba0
Caught exception in looking up space point ptr... 0x66c0f070, 0x5e759030
Caught exception in looking up space point ptr... 0x5e759030, 0x5e7587d0
Caught exception in looking up space point ptr... 0x5e7587d0, 0x5e7591d0
Caught exception in looking up space point ptr... 0x565a03d0, 0x565a05b0
Caught exception in looking up space point ptr... 0x565a05b0, 0x565a01f0
Caught exception in looking up space point ptr... 0x5b03fe00, 0x5b040140
Caught exception in looking up space point ptr... 0x5b040140, 0x5b03ffa0
Caught exception in looking up space point ptr... 0x78ed4d60, 0x57ff6780
Caught exception in looking up space point ptr... 0x57ff6780, 0x63312af0
Caught exception in looking up space point ptr... 0x35100b60, 0x35100e80
Caught exception in looking up space point ptr... 0x35100e80, 0x35100b60
Caught exception in looking up space point ptr... 0x5ae89fe0, 0x5ae8a1c0
Caught exception in looking up space point ptr... 0x5ae8a1c0, 0x5ae89fe0
Caught exception in looking up space point ptr... 0x3f72f200, 0x6d25beb0
Caught exception in looking up space point ptr... 0x6d25beb0, 0x3f72f200
Caught exception in looking up space point ptr... 0x3f72f200, 0x97830f0
Caught exception in looking up space point ptr... 0x97830f0, 0x3f72f200
Caught exception in looking up space point ptr... 0x6d3da6d0, 0x57a4c8e0
Caught exception in looking up space point ptr... 0x57a4c8e0, 0x97842e0
Caught exception in looking up space point ptr... 0x69674f90, 0x69674e00
Caught exception in looking up space point ptr... 0x69674e00, 0x72b81680
++++>>>> total num hits: 538843, num free: 529655
04-Feb-2026 01:52:24 CET Closed output file "np02vd_raw_run042433_0058_df-s03-d0_dw_0_20260203T190409_reco_stage0_20260204T005224_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 138.782 189.952 241.599 189.398 28.2319 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.559e-05 0.000113707 0.000288133 0.000104431 5.29537e-05 19
produce:tpcrawdecoder:PDVDTPCReader 6.30269 7.00009 12.5032 6.64149 1.32323 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.0136902 0.0225478 0.0440156 0.0204233 0.00821447 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000473996 0.000661364 0.00130734 0.000594457 0.000219759 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000458365 0.000525953 0.000754239 0.000508416 6.38498e-05 19
produce:beamevent:BeamEvent 8.8431e-05 0.000165767 0.00103991 0.000121852 0.000206642 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.75629 3.04694 3.53041 3.06012 0.170603 19
produce:ophit:OpHitFinder 0.0299317 0.0406191 0.0455841 0.040946 0.0037691 19
produce:wclsdatavd:WireCellToolkit 98.7326 116.434 132.083 115.048 10.3132 19
produce:gaushit:GausHitFinder 0.794302 2.15564 3.24782 1.85569 0.723257 19
produce:nhitsfilter:NumberOfHitsFilter 0.000261233 0.000424457 0.000586987 0.000452126 9.15637e-05 19
produce:reco3d:SpacePointSolver 7.1689 19.8456 31.3155 20.1747 5.71922 19
produce:hitpdune:DisambigFromSpacePoints 0.127584 0.265287 0.467893 0.231663 0.110855 19
produce:cluster3d:Cluster3D 1.71577 35.1443 65.4452 44.8412 22.8429 19
[art]:TriggerResults:TriggerResultInserter 2.528e-05 3.40752e-05 0.000109641 3.003e-05 1.8075e-05 19
end_path:out1:RootOutput 7.23e-06 1.06938e-05 3.204e-05 8.52e-06 6.71056e-06 19
end_path:out1:RootOutput(write) 4.29765 5.96137 8.56975 5.83841 1.04201 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5569.21 MB
Peak resident set size usage (VmHWM): 3608.35 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0058_df-s03-d0_dw_0_20260203T190409_reco_stage0_20260204T005224_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0058_df-s03-d0_dw_0_20260203T190409_reco_stage0_20260204T005224_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0058_df-s03-d0_dw_0_20260203T190409_reco_stage0_20260204T005224_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162688.0,
"core.end_time": 1770166345.0,
"core.events": [
6620,
6626,
6632,
6638,
6644,
6650,
6656,
6662,
6668,
6674,
6680,
6686,
6692,
6698,
6704,
6710,
6716,
6722,
6728
],
"core.event_count": 19,
"core.first_event_number": 6620,
"core.last_event_number": 6728,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0058_df-s03-d0_dw_0_20260203T190409.hdf5"
}
]
} 