Jobsub ID 303671.0@dunegpschedd01.fnal.gov
| Jobsub ID | 303671.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:36:25 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce510 |
| Last heartbeat | 2026-02-04 00:47:51 |
| From worker node | Hostname | b9p35p0023.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:18:14 |
| Input files | vd-protodune:np02vd_raw_run042422_0052_df-s04-d1_dw_0_20260203T154254.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 27m (1653s) |
| CPU time | 26m (1586s = 95%) |
| Max RSS bytes | 2609795072 (2488 MiB) |
| Outputting started | 2026-02-04 00:45:48 |
| Output files | |
| Finished | 2026-02-04 00:47:51 |
| Saved logs | justin-logs:303671.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
on in looking up space point ptr... 0x8b4f730, 0x8b502d0
Caught exception in looking up space point ptr... 0xa6c3430, 0xa6c32a0
Caught exception in looking up space point ptr... 0xa6c32a0, 0xa6c3430
Caught exception in looking up space point ptr... 0xa6c3430, 0xa6c2f80
Caught exception in looking up space point ptr... 0xa6c2f80, 0xa6c3430
Caught exception in looking up space point ptr... 0x3d7b6bc0, 0x3d7b6ac0
Caught exception in looking up space point ptr... 0x3d7b6ac0, 0x3d7b7cc0
Caught exception in looking up space point ptr... 0x3d7b7cc0, 0x3d7b7d90
Caught exception in looking up space point ptr... 0x3d7b8b60, 0x3d7b6bc0
Caught exception in looking up space point ptr... 0x36f42780, 0x36f425f0
Caught exception in looking up space point ptr... 0x36f42aa0, 0x36f42780
Caught exception in looking up space point ptr... 0x2662eb00, 0x5dd2e6f0
Caught exception in looking up space point ptr... 0x5dd2e6f0, 0x2662eb00
Caught exception in looking up space point ptr... 0x2effa1f0, 0x28929bd0
Caught exception in looking up space point ptr... 0x28929bd0, 0x2effa1f0
Caught exception in looking up space point ptr... 0x11ed7a80, 0x325c7080
Caught exception in looking up space point ptr... 0x325c7080, 0x4be4ad60
Caught exception in looking up space point ptr... 0x41cbeca0, 0x11bf2800
Caught exception in looking up space point ptr... 0x11bf2800, 0x41cc3cb0
Caught exception in looking up space point ptr... 0x7aa42b0, 0x4be3fa60
Caught exception in looking up space point ptr... 0x4be3fa60, 0x7aa42b0
Caught exception in looking up space point ptr... 0x41f1f310, 0x41f10dc0
Caught exception in looking up space point ptr... 0x41f10dc0, 0x41f1f310
Caught exception in looking up space point ptr... 0x3046d2b0, 0x286076d0
Caught exception in looking up space point ptr... 0x286076d0, 0x8056490
Caught exception in looking up space point ptr... 0x4b74fb60, 0x4d3fe0c0
Caught exception in looking up space point ptr... 0x4d3fe0c0, 0x3046d2b0
Caught exception in looking up space point ptr... 0x14a40ae0, 0x2b4801f0
Caught exception in looking up space point ptr... 0x2b4801f0, 0x150d07b0
Caught exception in looking up space point ptr... 0x9b007a0, 0x2d1a91d0
Caught exception in looking up space point ptr... 0x2d1a91d0, 0x320b9270
Caught exception in looking up space point ptr... 0x320b9270, 0x25252be0
Caught exception in looking up space point ptr... 0x2723e150, 0x27233770
Caught exception in looking up space point ptr... 0x27233770, 0x27233670
Caught exception in looking up space point ptr... 0x2840c7e0, 0x320bb290
Caught exception in looking up space point ptr... 0x320bb290, 0x2840c7e0
Caught exception in looking up space point ptr... 0x299de0e0, 0x219726f0
Caught exception in looking up space point ptr... 0x219726f0, 0x50911cc0
Caught exception in looking up space point ptr... 0xd3db910, 0xd3db810
Caught exception in looking up space point ptr... 0xd3db810, 0xd3db910
Caught exception in looking up space point ptr... 0x90433f0, 0x21a5a600
Caught exception in looking up space point ptr... 0x21a5a600, 0x21a5a6a0
Caught exception in looking up space point ptr... 0x8b5fd70, 0x8b5fc20
Caught exception in looking up space point ptr... 0x8b5fc20, 0x8b5fd70
Caught exception in looking up space point ptr... 0x8b3b3a0, 0x3b78b7d0
Caught exception in looking up space point ptr... 0x3b78b7d0, 0x4b9756d0
Caught exception in looking up space point ptr... 0x43deaca0, 0x1310f980
Caught exception in looking up space point ptr... 0x1310f980, 0x43deaca0
Caught exception in looking up space point ptr... 0x2a181b50, 0x49b261d0
Caught exception in looking up space point ptr... 0x49b261d0, 0x52176ba0
Caught exception in looking up space point ptr... 0x51633840, 0x51633ae0
Caught exception in looking up space point ptr... 0x51633ae0, 0x51633840
Caught exception in looking up space point ptr... 0xedcdb50, 0x7ddaa60
Caught exception in looking up space point ptr... 0x7ddaa60, 0xedcdb50
Caught exception in looking up space point ptr... 0x7d835d0, 0x7d83830
Caught exception in looking up space point ptr... 0x7d83830, 0x7d834a0
Caught exception in looking up space point ptr... 0xca6eb60, 0x49fe6690
Caught exception in looking up space point ptr... 0x49fe6690, 0xca6eb60
Caught exception in looking up space point ptr... 0xc16f620, 0x3c963cf0
Caught exception in looking up space point ptr... 0x3c963cf0, 0x152758f0
Caught exception in looking up space point ptr... 0x444db420, 0x28094db0
Caught exception in looking up space point ptr... 0x28094db0, 0x444db420
Caught exception in looking up space point ptr... 0x2e73b310, 0x2e73b5a0
Caught exception in looking up space point ptr... 0x2e73b5a0, 0x2e73b310
Caught exception in looking up space point ptr... 0x102ad6d0, 0x11c163b0
Caught exception in looking up space point ptr... 0x11c163b0, 0x102ad6d0
++++>>>> total num hits: 61545, num free: 58382
04-Feb-2026 01:45:42 CET Closed output file "np02vd_raw_run042422_0052_df-s04-d1_dw_0_20260203T154254_reco_stage0_20260204T004542_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 48.2204 59.5629 73.4816 58.6986 5.89801 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.538e-05 6.52813e-05 0.00019615 5.817e-05 2.71449e-05 27
produce:tpcrawdecoder:PDVDTPCReader 2.80881 3.46974 4.14892 3.52171 0.284931 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00772625 0.00968513 0.0140303 0.00960554 0.00132575 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000320191 0.000462194 0.00174825 0.000406951 0.000257821 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00105538 0.0013748 0.0019993 0.00132505 0.000263927 27
produce:beamevent:BeamEvent 5.369e-05 9.66911e-05 0.000722562 7.1831e-05 0.000123189 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.36993 1.78492 2.08929 1.8198 0.209678 27
produce:ophit:OpHitFinder 0.0196007 0.0286149 0.0356357 0.0298994 0.00404567 27
produce:wclsdatavd:WireCellToolkit 35.1344 42.2637 50.7987 41.6552 3.72765 27
produce:gaushit:GausHitFinder 0.392786 0.602789 0.893524 0.591648 0.119747 27
produce:nhitsfilter:NumberOfHitsFilter 0.000108281 0.00015163 0.000322491 0.000149201 3.77144e-05 27
produce:reco3d:SpacePointSolver 3.27925 6.85343 11.632 6.80932 1.84537 27
produce:hitpdune:DisambigFromSpacePoints 0.0335603 0.0636201 0.116315 0.0597663 0.021397 27
produce:cluster3d:Cluster3D 0.461358 1.12465 2.46117 1.19065 0.441565 27
[art]:TriggerResults:TriggerResultInserter 1.92e-05 2.75387e-05 7.181e-05 2.6311e-05 9.46968e-06 27
end_path:out1:RootOutput 4.061e-06 5.3797e-06 1.724e-05 4.95e-06 2.35988e-06 27
end_path:out1:RootOutput(write) 2.37014 3.34019 4.37517 3.30126 0.526496 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4664.63 MB
Peak resident set size usage (VmHWM): 2609.8 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0052_df-s04-d1_dw_0_20260203T154254_reco_stage0_20260204T004542_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0052_df-s04-d1_dw_0_20260203T154254_reco_stage0_20260204T004542_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0052_df-s04-d1_dw_0_20260203T154254_reco_stage0_20260204T004542_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770164300.0,
"core.end_time": 1770165943.0,
"core.events": [
8435,
8441,
8447,
8453,
8459,
8465,
8471,
8477,
8483,
8489,
8495,
8501,
8507,
8513,
8519,
8525,
8531,
8537,
8543,
8549,
8555,
8561,
8567,
8573,
8579,
8585,
8591
],
"core.event_count": 27,
"core.first_event_number": 8435,
"core.last_event_number": 8591,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0052_df-s04-d1_dw_0_20260203T154254.hdf5"
}
]
} 