Jobsub ID 303647.145@dunegpschedd01.fnal.gov
| Jobsub ID | 303647.145@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:46:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce512 |
| Last heartbeat | 2026-02-03 23:32:17 |
| From worker node | Hostname | b9g24p4713.cern.ch |
| cpuinfo | AMD EPYC 7302 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:47:37 |
| Input files | vd-protodune:np02vd_raw_run042421_0071_df-s02-d0_dw_0_20260203T140926.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 42m (2540s) |
| CPU time | 40m (2425s = 95%) |
| Max RSS bytes | 2607529984 (2486 MiB) |
| Outputting started | 2026-02-03 23:30:00 |
| Output files | |
| Finished | 2026-02-03 23:32:17 |
| Saved logs | justin-logs:303647.145-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x52bd3690, 0x52bd5640
Caught exception in looking up space point ptr... 0x52bd5640, 0x52bd44f0
Caught exception in looking up space point ptr... 0x11332260, 0x113320d0
Caught exception in looking up space point ptr... 0x113320d0, 0x131ff030
Caught exception in looking up space point ptr... 0x131ff030, 0x11331f40
Caught exception in looking up space point ptr... 0x5d80ce20, 0x657b7d40
Caught exception in looking up space point ptr... 0x50bb3070, 0x5d80ce20
Caught exception in looking up space point ptr... 0x6227ab30, 0x6227a950
Caught exception in looking up space point ptr... 0x6227a950, 0x6227acc0
Caught exception in looking up space point ptr... 0x5f4df190, 0x27da56b0
Caught exception in looking up space point ptr... 0x27da56b0, 0x5f4df190
Caught exception in looking up space point ptr... 0x5f4df190, 0x255ac480
Caught exception in looking up space point ptr... 0x255ac480, 0x5f4df190
Caught exception in looking up space point ptr... 0x45ee2a20, 0x12483300
Caught exception in looking up space point ptr... 0x12483300, 0x12483090
Caught exception in looking up space point ptr... 0x12483090, 0x37e04b10
Caught exception in looking up space point ptr... 0x37e04b10, 0x45ee2a20
Caught exception in looking up space point ptr... 0x13203870, 0x60b19020
Caught exception in looking up space point ptr... 0x60b19020, 0x13203870
Caught exception in looking up space point ptr... 0x3b959c10, 0x3b9598a0
Caught exception in looking up space point ptr... 0x3b9598a0, 0x3b959c10
Caught exception in looking up space point ptr... 0x5e142770, 0x5e1375b0
Caught exception in looking up space point ptr... 0x5e1375b0, 0x5e13a320
Caught exception in looking up space point ptr... 0x16adbc90, 0x328cd5a0
Caught exception in looking up space point ptr... 0x328cd5a0, 0x16adbc90
Caught exception in looking up space point ptr... 0x276fe450, 0x276fe250
Caught exception in looking up space point ptr... 0x276fe250, 0x53181920
Caught exception in looking up space point ptr... 0x276fe150, 0x276fe350
Caught exception in looking up space point ptr... 0x276fe350, 0x276fe450
Caught exception in looking up space point ptr... 0x3b8c5850, 0x11c95780
Caught exception in looking up space point ptr... 0x11c95780, 0x50ee2170
Caught exception in looking up space point ptr... 0x31748970, 0x31749040
Caught exception in looking up space point ptr... 0x31749040, 0x31748970
Caught exception in looking up space point ptr... 0x528e6b50, 0x528e5340
Caught exception in looking up space point ptr... 0x528e5340, 0x528e6b50
Caught exception in looking up space point ptr... 0x11feda00, 0x11fed8d0
Caught exception in looking up space point ptr... 0x11fed8d0, 0x11fed4f0
Caught exception in looking up space point ptr... 0x3a677930, 0x3a6745d0
Caught exception in looking up space point ptr... 0x3a6745d0, 0x3a677930
Caught exception in looking up space point ptr... 0x4354b700, 0x29954920
Caught exception in looking up space point ptr... 0x29954920, 0x4354b700
Caught exception in looking up space point ptr... 0x5d538170, 0x132885f0
Caught exception in looking up space point ptr... 0x132885f0, 0x5d538170
Caught exception in looking up space point ptr... 0x4f9c5710, 0x4f9c5580
Caught exception in looking up space point ptr... 0x4f9c5580, 0x4f9c5710
Caught exception in looking up space point ptr... 0x4b640dd0, 0x132cc110
Caught exception in looking up space point ptr... 0x132cc110, 0x4b640dd0
Caught exception in looking up space point ptr... 0x29e31c40, 0x399a7ef0
Caught exception in looking up space point ptr... 0x399a7b80, 0x29e31c40
Caught exception in looking up space point ptr... 0x62290970, 0x62290820
Caught exception in looking up space point ptr... 0x62290820, 0x62290970
Caught exception in looking up space point ptr... 0x68e38b00, 0x68e38420
Caught exception in looking up space point ptr... 0x68e38420, 0x68e38b00
Caught exception in looking up space point ptr... 0x68e38b00, 0x68e389b0
Caught exception in looking up space point ptr... 0x68e389b0, 0x68e38b00
Caught exception in looking up space point ptr... 0x40672cc0, 0x40672b90
Caught exception in looking up space point ptr... 0x40672b90, 0x40672cc0
Caught exception in looking up space point ptr... 0x40672cc0, 0x40672160
Caught exception in looking up space point ptr... 0x40672160, 0x40672cc0
Caught exception in looking up space point ptr... 0x1144b400, 0x1144b580
Caught exception in looking up space point ptr... 0x1144b580, 0x1144b400
Caught exception in looking up space point ptr... 0x5d5241f0, 0x5d524060
Caught exception in looking up space point ptr... 0x5d524060, 0x5d5241f0
Caught exception in looking up space point ptr... 0x2985c880, 0x61d2d980
Caught exception in looking up space point ptr... 0x61d2d980, 0x5f109d50
++++>>>> total num hits: 61270, num free: 58354
04-Feb-2026 00:29:52 CET Closed output file "np02vd_raw_run042421_0071_df-s02-d0_dw_0_20260203T140926_reco_stage0_20260203T232952_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 74.0916 91.4761 103.589 92.1634 7.29417 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.8541e-05 0.000101028 0.000312787 8.5422e-05 5.76791e-05 27
produce:tpcrawdecoder:PDVDTPCReader 4.83132 5.27102 6.90283 5.19273 0.436764 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00824136 0.0197696 0.0752776 0.0114571 0.0195183 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000332697 0.000516208 0.00158746 0.000456399 0.000228029 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00120993 0.0018489 0.00462188 0.0015406 0.000741638 27
produce:beamevent:BeamEvent 5.8241e-05 0.000149464 0.00161774 9.0241e-05 0.00028873 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.38178 2.82318 3.71856 2.791 0.302239 27
produce:ophit:OpHitFinder 0.023724 0.0365117 0.0463271 0.0361895 0.00526623 27
produce:wclsdatavd:WireCellToolkit 58.5254 67.4669 77.8169 68.2085 5.186 27
produce:gaushit:GausHitFinder 0.359309 0.838299 1.30197 0.778971 0.21303 27
produce:nhitsfilter:NumberOfHitsFilter 0.000162703 0.000279517 0.000425028 0.000275315 6.29114e-05 27
produce:reco3d:SpacePointSolver 3.43927 9.35597 20.7752 9.18026 3.18327 27
produce:hitpdune:DisambigFromSpacePoints 0.0323888 0.103426 0.196338 0.0964419 0.0340577 27
produce:cluster3d:Cluster3D 0.648956 1.75169 3.36435 1.60033 0.64157 27
[art]:TriggerResults:TriggerResultInserter 2.2291e-05 3.06227e-05 9.5622e-05 2.7821e-05 1.31404e-05 27
end_path:out1:RootOutput 3.65e-06 8.67163e-06 2.9191e-05 8.42e-06 4.33335e-06 27
end_path:out1:RootOutput(write) 3.06439 3.78783 4.59355 3.77229 0.372465 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4547.83 MB
Peak resident set size usage (VmHWM): 2607.53 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0071_df-s02-d0_dw_0_20260203T140926_reco_stage0_20260203T232952_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0071_df-s02-d0_dw_0_20260203T140926_reco_stage0_20260203T232952_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0071_df-s02-d0_dw_0_20260203T140926_reco_stage0_20260203T232952_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770158869.0,
"core.end_time": 1770161394.0,
"core.events": [
11562,
11568,
11574,
11580,
11586,
11592,
11598,
11604,
11610,
11616,
11622,
11628,
11634,
11640,
11646,
11652,
11658,
11664,
11670,
11676,
11682,
11688,
11694,
11700,
11706,
11712,
11718
],
"core.event_count": 27,
"core.first_event_number": 11562,
"core.last_event_number": 11718,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0071_df-s02-d0_dw_0_20260203T140926.hdf5"
}
]
} 