Jobsub ID 297922.22@dunegpschedd02.fnal.gov
| Jobsub ID | 297922.22@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:24 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce01 |
| Last heartbeat | 2026-02-04 00:59:47 |
| From worker node | Hostname | dune001-1527526.0-lcg2704.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:57:09 |
| Input files | vd-protodune:np02vd_raw_run042421_0135_df-s02-d1_dw_0_20260203T144400.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (3641s) |
| CPU time | 53m (3222s = 88%) |
| Max RSS bytes | 2706366464 (2580 MiB) |
| Outputting started | 2026-02-04 00:57:52 |
| Output files | |
| Finished | 2026-02-04 00:59:47 |
| Saved logs | justin-logs:297922.22-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
xception in looking up space point ptr... 0x5f3e10d0, 0x2adc1d00
Caught exception in looking up space point ptr... 0x2adc1d00, 0x2adc1b80
Caught exception in looking up space point ptr... 0x74193830, 0x2adc12e0
Caught exception in looking up space point ptr... 0x2adc12e0, 0x2adc1160
Caught exception in looking up space point ptr... 0x479f4f40, 0x2adc0660
Caught exception in looking up space point ptr... 0x2adc0660, 0x479f4f40
Caught exception in looking up space point ptr... 0x479f4f40, 0x2adc0910
Caught exception in looking up space point ptr... 0x2adc0910, 0x479f4f40
Caught exception in looking up space point ptr... 0x69e0adf0, 0x2adbf570
Caught exception in looking up space point ptr... 0x2adbf570, 0x69df9860
Caught exception in looking up space point ptr... 0x479eedd0, 0x2adbfc90
Caught exception in looking up space point ptr... 0x2adbfc90, 0x2adbff40
Caught exception in looking up space point ptr... 0x2adbff40, 0x479e8530
Caught exception in looking up space point ptr... 0x2a91d590, 0x62795850
Caught exception in looking up space point ptr... 0x62795850, 0x410efca0
Caught exception in looking up space point ptr... 0x410efca0, 0x2f671210
Caught exception in looking up space point ptr... 0x410e5880, 0x7e8d58c0
Caught exception in looking up space point ptr... 0x7e8d58c0, 0x7e8db560
Caught exception in looking up space point ptr... 0x7e8db560, 0x274ea3a0
Caught exception in looking up space point ptr... 0x274ea3a0, 0x47c0dce0
Caught exception in looking up space point ptr... 0x6e74e610, 0x68b705f0
Caught exception in looking up space point ptr... 0x69b0b790, 0x6e74e610
Caught exception in looking up space point ptr... 0x6f4e73b0, 0x718640e0
Caught exception in looking up space point ptr... 0x5ba615a0, 0x6f4e73b0
Caught exception in looking up space point ptr... 0x6919b070, 0x69195840
Caught exception in looking up space point ptr... 0x69195840, 0x6918fd40
Caught exception in looking up space point ptr... 0x4752dfe0, 0x26ec2550
Caught exception in looking up space point ptr... 0x4752e170, 0x4752dfe0
Caught exception in looking up space point ptr... 0x2714f960, 0x2714faf0
Caught exception in looking up space point ptr... 0x2713de90, 0x2714f960
Caught exception in looking up space point ptr... 0x76f60e40, 0x64dfdf70
Caught exception in looking up space point ptr... 0x64dfdf70, 0x76f60e40
Caught exception in looking up space point ptr... 0x48390100, 0x64e09070
Caught exception in looking up space point ptr... 0x64e09070, 0x4bfe0d40
Caught exception in looking up space point ptr... 0x76fa0830, 0x56130ef0
Caught exception in looking up space point ptr... 0x56130ef0, 0x26c64d20
Caught exception in looking up space point ptr... 0x26c64d20, 0x26c641f0
Caught exception in looking up space point ptr... 0x26c641f0, 0x76fa0ad0
Caught exception in looking up space point ptr... 0x76fa0ad0, 0x76fa0830
Caught exception in looking up space point ptr... 0x626cded0, 0x62492c80
Caught exception in looking up space point ptr... 0x62492c80, 0x62492b30
Caught exception in looking up space point ptr... 0x5ac16760, 0x5ac05a50
Caught exception in looking up space point ptr... 0x5ac27100, 0x5ac16760
Caught exception in looking up space point ptr... 0x623df640, 0x581cdf00
Caught exception in looking up space point ptr... 0x623df7d0, 0x623df640
Caught exception in looking up space point ptr... 0x3f4135a0, 0x24fb40b0
Caught exception in looking up space point ptr... 0x3f413730, 0x3f4135a0
Caught exception in looking up space point ptr... 0x2758fa80, 0x461236e0
Caught exception in looking up space point ptr... 0x6f0e19e0, 0x2758fa80
Caught exception in looking up space point ptr... 0x29fddb80, 0x29fdd220
Caught exception in looking up space point ptr... 0x29fdd220, 0x29fdc730
Caught exception in looking up space point ptr... 0x3ffe2da0, 0x47b23210
Caught exception in looking up space point ptr... 0x3fff5090, 0x3ffe2da0
Caught exception in looking up space point ptr... 0x2c44ebf0, 0x2c43d5d0
Caught exception in looking up space point ptr... 0x5996adf0, 0x2c44ebf0
Caught exception in looking up space point ptr... 0x5aebf0b0, 0x51d05100
Caught exception in looking up space point ptr... 0x32151350, 0x5aebf0b0
Caught exception in looking up space point ptr... 0x5b99c1c0, 0x766fb2d0
Caught exception in looking up space point ptr... 0x766fb2d0, 0x71b3bee0
Caught exception in looking up space point ptr... 0x2e0ec6a0, 0x2e0ec9a0
Caught exception in looking up space point ptr... 0x2e0ec9a0, 0x2e0ecc00
Caught exception in looking up space point ptr... 0x4d9706c0, 0x27898e40
Caught exception in looking up space point ptr... 0x27898e40, 0x44c1ed70
Caught exception in looking up space point ptr... 0x43a9e290, 0x764aaa40
Caught exception in looking up space point ptr... 0x764aaa40, 0x43a9e290
++++>>>> total num hits: 279797, num free: 274419
04-Feb-2026 00:57:43 UTC Closed output file "np02vd_raw_run042421_0135_df-s02-d1_dw_0_20260203T144400_reco_stage0_20260204T005743_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 88.2353 131.771 161.646 136.585 22.8503 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.9666e-05 0.000105531 0.000280935 8.8213e-05 5.04854e-05 27
produce:tpcrawdecoder:PDVDTPCReader 13.8868 14.3958 15.8146 14.3127 0.452815 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.681584 0.70791 0.784392 0.705135 0.0218169 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.022847 0.0230572 0.023346 0.023031 0.000139114 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.113009 0.116362 0.137351 0.113859 0.00724095 27
produce:beamevent:BeamEvent 9.6506e-05 0.000180471 0.00120374 0.000128524 0.000213887 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.20598 3.4804 3.74922 3.49637 0.155379 27
produce:ophit:OpHitFinder 0.0292336 0.0369327 0.0421786 0.0370468 0.00355932 27
produce:wclsdatavd:WireCellToolkit 53.6402 68.0414 78.0695 66.6829 6.89692 27
produce:gaushit:GausHitFinder 0.495854 1.2698 2.05415 1.29435 0.379816 27
produce:nhitsfilter:NumberOfHitsFilter 0.000156306 0.00032705 0.000943548 0.000319363 0.000151549 27
produce:reco3d:SpacePointSolver 5.77968 8.9683 12.9828 9.20383 1.82904 27
produce:hitpdune:DisambigFromSpacePoints 0.0460219 0.201157 0.400947 0.206623 0.0821757 27
produce:cluster3d:Cluster3D 0.593086 30.1813 49.737 36.9536 17.5353 27
[art]:TriggerResults:TriggerResultInserter 1.7146e-05 3.71294e-05 0.000113512 3.4022e-05 1.73572e-05 27
end_path:out1:RootOutput 3.966e-06 9.25293e-06 3.1978e-05 8.613e-06 5.00435e-06 27
end_path:out1:RootOutput(write) 2.61353 4.3111 5.47332 4.43775 0.905303 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5003.61 MB
Peak resident set size usage (VmHWM): 2706.37 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0135_df-s02-d1_dw_0_20260203T144400_reco_stage0_20260204T005743_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0135_df-s02-d1_dw_0_20260203T144400_reco_stage0_20260204T005743_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0135_df-s02-d1_dw_0_20260203T144400_reco_stage0_20260204T005743_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163039.0,
"core.end_time": 1770166665.0,
"core.events": [
21931,
21937,
21943,
21949,
21955,
21961,
21967,
21973,
21979,
21985,
21991,
21997,
22003,
22009,
22015,
22021,
22027,
22033,
22039,
22045,
22051,
22057,
22063,
22069,
22075,
22081,
22087
],
"core.event_count": 27,
"core.first_event_number": 21931,
"core.last_event_number": 22087,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0135_df-s02-d1_dw_0_20260203T144400.hdf5"
}
]
} 