Jobsub ID 297916.26@dunegpschedd02.fnal.gov
| Jobsub ID | 297916.26@dunegpschedd02.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:46:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce505 |
| Last heartbeat | 2026-02-03 23:22:13 |
| From worker node | Hostname | b9p35p0031.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:47:59 |
| Input files | vd-protodune:np02vd_raw_run042422_0096_df-s03-d0_dw_0_20260203T160641.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 32m (1928s) |
| CPU time | 30m (1850s = 95%) |
| Max RSS bytes | 2593079296 (2472 MiB) |
| Outputting started | 2026-02-03 23:20:08 |
| Output files | |
| Finished | 2026-02-03 23:22:13 |
| Saved logs | justin-logs:297916.26-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x2b654230
Caught exception in looking up space point ptr... 0x2b654230, 0x2b653f10
Caught exception in looking up space point ptr... 0x375bc580, 0x375bca30
Caught exception in looking up space point ptr... 0x375bca30, 0x375bc8a0
Caught exception in looking up space point ptr... 0x29a004b0, 0x3a0097f0
Caught exception in looking up space point ptr... 0x3a007f10, 0x29a004b0
Caught exception in looking up space point ptr... 0x3de1b6d0, 0x3de1b540
Caught exception in looking up space point ptr... 0x2daf5a70, 0x3de1b6d0
Caught exception in looking up space point ptr... 0x2b86bfc0, 0x2b86bca0
Caught exception in looking up space point ptr... 0x2b86bca0, 0x2b86bfc0
Caught exception in looking up space point ptr... 0x213ffa10, 0x253300f0
Caught exception in looking up space point ptr... 0x253300f0, 0x213ff510
Caught exception in looking up space point ptr... 0x4a529d20, 0x4a530bb0
Caught exception in looking up space point ptr... 0x4a530bb0, 0x4a529d20
Caught exception in looking up space point ptr... 0x388fa520, 0x388f3690
Caught exception in looking up space point ptr... 0x388f3690, 0x388f30b0
Caught exception in looking up space point ptr... 0x2518c0f0, 0x410437f0
Caught exception in looking up space point ptr... 0x410437f0, 0x410432e0
Caught exception in looking up space point ptr... 0x610075a0, 0x610078c0
Caught exception in looking up space point ptr... 0x610078c0, 0x61007a50
Caught exception in looking up space point ptr... 0x33e92db0, 0x33e97110
Caught exception in looking up space point ptr... 0x33e97110, 0x33e92db0
Caught exception in looking up space point ptr... 0x2ca6abc0, 0x2ca69880
Caught exception in looking up space point ptr... 0x2ca69880, 0x2ca68a50
Caught exception in looking up space point ptr... 0x5fef06b0, 0x5feef320
Caught exception in looking up space point ptr... 0x5feef320, 0x5fef06b0
Caught exception in looking up space point ptr... 0x31d8e0e0, 0x31d8de90
Caught exception in looking up space point ptr... 0x31d8d9f0, 0x31d8e0e0
Caught exception in looking up space point ptr... 0x48117800, 0x28fd0470
Caught exception in looking up space point ptr... 0x28fd0470, 0x28fd0650
Caught exception in looking up space point ptr... 0x2b646070, 0x2b643a00
Caught exception in looking up space point ptr... 0x2b643a00, 0x2b653990
Caught exception in looking up space point ptr... 0x2b646070, 0x2b6536f0
Caught exception in looking up space point ptr... 0x2b6536f0, 0x2b646070
Caught exception in looking up space point ptr... 0x413e3920, 0x413e34a0
Caught exception in looking up space point ptr... 0x413e34a0, 0x413e3920
Caught exception in looking up space point ptr... 0x2775f490, 0x2775f300
Caught exception in looking up space point ptr... 0x2775f300, 0x2775f490
Caught exception in looking up space point ptr... 0x1054e000, 0x1054de70
Caught exception in looking up space point ptr... 0x1054de70, 0x1054e000
Caught exception in looking up space point ptr... 0x8a6f430, 0x2f3c23a0
Caught exception in looking up space point ptr... 0x2f3c23a0, 0x8a6f430
Caught exception in looking up space point ptr... 0x2bc91e70, 0x2bc91bd0
Caught exception in looking up space point ptr... 0x2bc91bd0, 0x2bc91d20
Caught exception in looking up space point ptr... 0xf3c94b0, 0xf3c9750
Caught exception in looking up space point ptr... 0xf3c9750, 0xf3cf490
Caught exception in looking up space point ptr... 0x2e4e7220, 0x56236720
Caught exception in looking up space point ptr... 0x56236720, 0x2e4e7220
Caught exception in looking up space point ptr... 0x77ec7a0, 0x3ccd8ee0
Caught exception in looking up space point ptr... 0x3ccd8ee0, 0x3ccdd940
Caught exception in looking up space point ptr... 0x2bd2f160, 0x46e2a770
Caught exception in looking up space point ptr... 0x46e2a770, 0x2bd2f160
Caught exception in looking up space point ptr... 0x137c9090, 0x2a36cc20
Caught exception in looking up space point ptr... 0x2a36cc20, 0x137c9090
Caught exception in looking up space point ptr... 0x9da03f0, 0x9da07b0
Caught exception in looking up space point ptr... 0x9da07b0, 0x9da03f0
Caught exception in looking up space point ptr... 0x7a0b4c0, 0x7a0b650
Caught exception in looking up space point ptr... 0x7a0b650, 0x7a0b970
Caught exception in looking up space point ptr... 0x277796e0, 0x27777c50
Caught exception in looking up space point ptr... 0x27777c50, 0x2f042d50
Caught exception in looking up space point ptr... 0x834e5b0, 0x54517aa0
Caught exception in looking up space point ptr... 0x54517aa0, 0x834e5b0
Caught exception in looking up space point ptr... 0x37429130, 0x544794f0
Caught exception in looking up space point ptr... 0x544794f0, 0x37429130
Caught exception in looking up space point ptr... 0x46e09f40, 0x46e0a040
Caught exception in looking up space point ptr... 0x46e0a040, 0x46e09f40
++++>>>> total num hits: 160385, num free: 152546
04-Feb-2026 00:20:02 CET Closed output file "np02vd_raw_run042422_0096_df-s03-d0_dw_0_20260203T160641_reco_stage0_20260203T232002_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 59.0165 69.363 78.3247 69.3802 3.85762 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.5761e-05 7.60182e-05 0.00020214 7.172e-05 2.50767e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.60756 4.18124 8.28471 3.94374 0.867603 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.0094459 0.0210737 0.10822 0.0132896 0.02046 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000371821 0.00242319 0.0237995 0.00056793 0.00505932 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00120646 0.00172651 0.00279927 0.00168047 0.000308685 27
produce:beamevent:BeamEvent 6.329e-05 0.00011876 0.00089689 8.631e-05 0.000153477 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.76462 2.14808 2.53773 2.15172 0.184963 27
produce:ophit:OpHitFinder 0.0311672 0.0374982 0.0437374 0.0378597 0.00370785 27
produce:wclsdatavd:WireCellToolkit 44.2552 48.5988 54.9181 48.1672 2.47021 27
produce:gaushit:GausHitFinder 0.345623 0.738748 1.22665 0.752151 0.195533 27
produce:nhitsfilter:NumberOfHitsFilter 9.911e-05 0.000182579 0.00034123 0.00017363 4.59293e-05 27
produce:reco3d:SpacePointSolver 3.55538 8.58092 13.672 8.81392 2.60903 27
produce:hitpdune:DisambigFromSpacePoints 0.0327053 0.0738888 0.143232 0.0699575 0.0231386 27
produce:cluster3d:Cluster3D 0.581282 1.40264 4.31343 1.18444 0.756557 27
[art]:TriggerResults:TriggerResultInserter 2.254e-05 3.27463e-05 9.932e-05 2.956e-05 1.39611e-05 27
end_path:out1:RootOutput 4.44e-06 6.30741e-06 2.316e-05 5.13e-06 3.83575e-06 27
end_path:out1:RootOutput(write) 2.73332 3.55146 4.42688 3.51138 0.418628 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4593 MB
Peak resident set size usage (VmHWM): 2593.08 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0096_df-s03-d0_dw_0_20260203T160641_reco_stage0_20260203T232002_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0096_df-s03-d0_dw_0_20260203T160641_reco_stage0_20260203T232002_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0096_df-s03-d0_dw_0_20260203T160641_reco_stage0_20260203T232002_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770158886.0,
"core.end_time": 1770160804.0,
"core.events": [
15566,
15572,
15578,
15584,
15590,
15596,
15602,
15608,
15614,
15620,
15626,
15632,
15638,
15644,
15650,
15656,
15662,
15668,
15674,
15680,
15686,
15692,
15698,
15704,
15710,
15716,
15722
],
"core.event_count": 27,
"core.first_event_number": 15566,
"core.last_event_number": 15722,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0096_df-s03-d0_dw_0_20260203T160641.hdf5"
}
]
} 