Jobsub ID 297922.18@dunegpschedd02.fnal.gov
| Jobsub ID | 297922.18@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:24 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce03 |
| Last heartbeat | 2026-02-04 00:57:45 |
| From worker node | Hostname | dune001-1535466.0-lcg2695.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:57:22 |
| Input files | vd-protodune:np02vd_raw_run042421_0027_df-s04-d1_dw_0_20260203T134537.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 58m (3495s) |
| CPU time | 51m (3070s = 87%) |
| Max RSS bytes | 2839625728 (2708 MiB) |
| Outputting started | 2026-02-04 00:55:39 |
| Output files | |
| Finished | 2026-02-04 00:57:45 |
| Saved logs | justin-logs:297922.18-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x854e5ad0
Caught exception in looking up space point ptr... 0x854e5ad0, 0x7fd6c730
Caught exception in looking up space point ptr... 0x7fd6c730, 0x959d69f0
Caught exception in looking up space point ptr... 0x959d69f0, 0x73bd65e0
Caught exception in looking up space point ptr... 0x73bd65e0, 0x959d76c0
Caught exception in looking up space point ptr... 0x46e64c60, 0x75ac5d00
Caught exception in looking up space point ptr... 0x75ac5d00, 0x75ac56c0
Caught exception in looking up space point ptr... 0x75ac56c0, 0x8576ec90
Caught exception in looking up space point ptr... 0x66254a80, 0x46e64c60
Caught exception in looking up space point ptr... 0x95d44a00, 0x95d44f50
Caught exception in looking up space point ptr... 0x95d44f50, 0x95d44be0
Caught exception in looking up space point ptr... 0x95d44be0, 0x752d8490
Caught exception in looking up space point ptr... 0x752d8490, 0x72dc6350
Caught exception in looking up space point ptr... 0x72dc6670, 0x95d44a00
Caught exception in looking up space point ptr... 0x987bbe20, 0x697dc3d0
Caught exception in looking up space point ptr... 0x697dc3d0, 0x987bbe20
Caught exception in looking up space point ptr... 0x694cc800, 0x95d40d60
Caught exception in looking up space point ptr... 0x95d40d60, 0x7236c800
Caught exception in looking up space point ptr... 0x72e35990, 0x5ebc1690
Caught exception in looking up space point ptr... 0x6f698460, 0x72e35990
Caught exception in looking up space point ptr... 0x7285db30, 0x72accb10
Caught exception in looking up space point ptr... 0x72accb10, 0x6ba266d0
Caught exception in looking up space point ptr... 0x6ba266d0, 0x72accb10
Caught exception in looking up space point ptr... 0x72accb10, 0x9374c190
Caught exception in looking up space point ptr... 0x9d9a48e0, 0x788037e0
Caught exception in looking up space point ptr... 0x788037e0, 0xa0476100
Caught exception in looking up space point ptr... 0x95df59d0, 0x98c18990
Caught exception in looking up space point ptr... 0x95df5b20, 0x95df59d0
Caught exception in looking up space point ptr... 0x88641890, 0x88641b30
Caught exception in looking up space point ptr... 0x88641b30, 0x88641890
Caught exception in looking up space point ptr... 0x8576e280, 0x8576dfa0
Caught exception in looking up space point ptr... 0x8576dfa0, 0x9030d290
Caught exception in looking up space point ptr... 0x7a5e41d0, 0x7a837530
Caught exception in looking up space point ptr... 0x7a837530, 0x7a5e41d0
Caught exception in looking up space point ptr... 0x7a5e41d0, 0x71081210
Caught exception in looking up space point ptr... 0x71081210, 0x7a5e41d0
Caught exception in looking up space point ptr... 0x53f17760, 0x53f17960
Caught exception in looking up space point ptr... 0x53f17960, 0x53f17860
Caught exception in looking up space point ptr... 0x6a375dc0, 0x6a375c30
Caught exception in looking up space point ptr... 0x6a375c30, 0x6a375dc0
Caught exception in looking up space point ptr... 0x53ecdc70, 0x7e14e930
Caught exception in looking up space point ptr... 0x7e14e930, 0x53ecdc70
Caught exception in looking up space point ptr... 0x53ecdc70, 0x9bac1710
Caught exception in looking up space point ptr... 0x9bac1710, 0x53ecdc70
Caught exception in looking up space point ptr... 0x53ecdc70, 0x94fcab70
Caught exception in looking up space point ptr... 0x94fcab70, 0x53ecdc70
Caught exception in looking up space point ptr... 0x8b91e6c0, 0x85ad6960
Caught exception in looking up space point ptr... 0x85ad6960, 0x8b91e6c0
Caught exception in looking up space point ptr... 0x72c62bd0, 0x726dcad0
Caught exception in looking up space point ptr... 0x726dcad0, 0x72c62bd0
Caught exception in looking up space point ptr... 0x474f3a40, 0x4b23fe20
Caught exception in looking up space point ptr... 0x474f31e0, 0x474f3a40
Caught exception in looking up space point ptr... 0x6f69b090, 0x7a2b9400
Caught exception in looking up space point ptr... 0x7a2b9400, 0x6f69b090
Caught exception in looking up space point ptr... 0x75ac1f30, 0x4809aab0
Caught exception in looking up space point ptr... 0x4809aab0, 0x75ac1f30
Caught exception in looking up space point ptr... 0x75ac1f30, 0x6958df00
Caught exception in looking up space point ptr... 0x6958df00, 0x75ac1f30
Caught exception in looking up space point ptr... 0x9892bee0, 0x79ae2870
Caught exception in looking up space point ptr... 0x79ae2870, 0x9892bee0
Caught exception in looking up space point ptr... 0x4f69e7b0, 0x4782a8c0
Caught exception in looking up space point ptr... 0x4782a8c0, 0x4f69e7b0
Caught exception in looking up space point ptr... 0x8917f390, 0x884e4010
Caught exception in looking up space point ptr... 0x884e4010, 0x8917f390
Caught exception in looking up space point ptr... 0x671fd570, 0x93e44ee0
Caught exception in looking up space point ptr... 0x93e44ee0, 0x6726bdf0
++++>>>> total num hits: 28691, num free: 27475
04-Feb-2026 00:55:30 UTC Closed output file "np02vd_raw_run042421_0027_df-s04-d1_dw_0_20260203T134537_reco_stage0_20260204T005530_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 90.9873 121.738 154.175 118.131 19.59 28
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.2665e-05 0.000116054 0.00024582 9.8413e-05 4.40833e-05 28
produce:tpcrawdecoder:PDVDTPCReader 13.3388 14.1945 17.5984 13.9575 0.930651 28
produce:triggerrawdecoder:PDVDTriggerReader4 0.687597 0.721278 0.807659 0.712171 0.0251746 28
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229483 0.0257259 0.0423575 0.0233146 0.00539445 28
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.113232 0.117545 0.13815 0.114792 0.00725819 28
produce:beamevent:BeamEvent 0.000116005 0.000238112 0.00117804 0.000174989 0.000243934 28
produce:pdvddaphne:DAPHNEReaderPDVD 3.25033 3.63558 3.90044 3.67952 0.193723 28
produce:ophit:OpHitFinder 0.028468 0.0406223 0.0492828 0.0417475 0.00399421 28
produce:wclsdatavd:WireCellToolkit 54.3726 70.8388 83.6201 71.3024 6.96465 28
produce:gaushit:GausHitFinder 0.480998 2.19244 8.52664 1.29199 2.35421 28
produce:nhitsfilter:NumberOfHitsFilter 0.000142605 0.000469399 0.00174032 0.000271044 0.000471232 28
produce:reco3d:SpacePointSolver 3.99316 6.3036 10.5361 6.31629 1.5155 23
produce:hitpdune:DisambigFromSpacePoints 0.0400334 0.166042 0.328351 0.16969 0.0835966 23
produce:cluster3d:Cluster3D 0.63059 24.6473 43.5085 33.4855 17.4935 23
[art]:TriggerResults:TriggerResultInserter 2.8813e-05 5.1319e-05 0.000124357 4.3325e-05 2.28936e-05 28
end_path:out1:RootOutput 5.087e-06 2.04233e-05 0.000266271 1.12425e-05 4.75851e-05 28
end_path:out1:RootOutput(write) 2.6927 4.37116 5.9044 4.22657 0.843212 28
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5149.82 MB
Peak resident set size usage (VmHWM): 2839.63 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0027_df-s04-d1_dw_0_20260203T134537_reco_stage0_20260204T005530_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0027_df-s04-d1_dw_0_20260203T134537_reco_stage0_20260204T005530_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0027_df-s04-d1_dw_0_20260203T134537_reco_stage0_20260204T005530_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163053.0,
"core.end_time": 1770166532.0,
"core.events": [
4421,
4427,
4433,
4439,
4445,
4451,
4457,
4463,
4469,
4475,
4481,
4487,
4493,
4499,
4505,
4511,
4517,
4523,
4529,
4535,
4541,
4547,
4553,
4559,
4565,
4571,
4577,
4583
],
"core.event_count": 28,
"core.first_event_number": 4421,
"core.last_event_number": 4583,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0027_df-s04-d1_dw_0_20260203T134537.hdf5"
}
]
} 