Jobsub ID 297921.132@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.132@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 00:52:51 |
| From worker node | Hostname | dune002-1603637.0-lcg2700.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:56:09 |
| Input files | vd-protodune:np02vd_raw_run042433_0468_df-s04-d1_dw_0_20260203T214000.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 55m (3302s) |
| CPU time | 49m (2961s = 89%) |
| Max RSS bytes | 3423023104 (3264 MiB) |
| Outputting started | 2026-02-04 00:51:12 |
| Output files | |
| Finished | 2026-02-04 00:52:51 |
| Saved logs | justin-logs:297921.132-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x83a36810, 0x83a36680
Caught exception in looking up space point ptr... 0x83a36680, 0x83a36810
Caught exception in looking up space point ptr... 0x31ee9ec0, 0x31ee9dc0
Caught exception in looking up space point ptr... 0x31ee9dc0, 0x31ee9ec0
Caught exception in looking up space point ptr... 0x70665790, 0x7ea7f2b0
Caught exception in looking up space point ptr... 0x7ea7f2b0, 0x70665790
Caught exception in looking up space point ptr... 0x57674610, 0x57e67e00
Caught exception in looking up space point ptr... 0x57e67e00, 0x57e677c0
Caught exception in looking up space point ptr... 0x87195480, 0x871950f0
Caught exception in looking up space point ptr... 0x871950f0, 0x87195480
Caught exception in looking up space point ptr... 0x87195480, 0x87195220
Caught exception in looking up space point ptr... 0x87195220, 0x87195480
Caught exception in looking up space point ptr... 0x517dc790, 0x26675350
Caught exception in looking up space point ptr... 0x26675350, 0x9a9f34e0
Caught exception in looking up space point ptr... 0x99833880, 0x998336f0
Caught exception in looking up space point ptr... 0x998336f0, 0x99833560
Caught exception in looking up space point ptr... 0x7ea954a0, 0x7ea96200
Caught exception in looking up space point ptr... 0x7ea96200, 0x7ea954a0
Caught exception in looking up space point ptr... 0x48de6730, 0x78688310
Caught exception in looking up space point ptr... 0x78688310, 0x48de6730
Caught exception in looking up space point ptr... 0x707f48c0, 0x2bf58c60
Caught exception in looking up space point ptr... 0x514b96e0, 0x2bf589c0
Caught exception in looking up space point ptr... 0x2bf589c0, 0x707f48c0
Caught exception in looking up space point ptr... 0x9984a570, 0x99849bb0
Caught exception in looking up space point ptr... 0x99849bb0, 0x9984a570
Caught exception in looking up space point ptr... 0x30e0f600, 0x30e11fc0
Caught exception in looking up space point ptr... 0x30e11fc0, 0x30e0f600
Caught exception in looking up space point ptr... 0x4570aa40, 0x789b7990
Caught exception in looking up space point ptr... 0x789b7990, 0x4570aa40
Caught exception in looking up space point ptr... 0x30e324c0, 0x30e31f70
Caught exception in looking up space point ptr... 0x30e31f70, 0x30e32150
Caught exception in looking up space point ptr... 0x7b7278f0, 0x7b727c10
Caught exception in looking up space point ptr... 0x7b727c10, 0x7b7278f0
Caught exception in looking up space point ptr... 0x53082210, 0x53082110
Caught exception in looking up space point ptr... 0x53082110, 0x59dcc650
Caught exception in looking up space point ptr... 0x8385a540, 0x8385a3f0
Caught exception in looking up space point ptr... 0x8385a3f0, 0x838574c0
Caught exception in looking up space point ptr... 0x4c18d590, 0x4c18d490
Caught exception in looking up space point ptr... 0x4c18d490, 0x4c18d7e0
Caught exception in looking up space point ptr... 0x7eb32d80, 0x7eb34350
Caught exception in looking up space point ptr... 0x7eb34350, 0x7eb32d80
Caught exception in looking up space point ptr... 0x7eb32d80, 0x7eb2d5c0
Caught exception in looking up space point ptr... 0x7eb2d5c0, 0x7eb32d80
Caught exception in looking up space point ptr... 0x7eb32d80, 0x7eb345f0
Caught exception in looking up space point ptr... 0x7eb345f0, 0x7eb32d80
Caught exception in looking up space point ptr... 0x5ff323a0, 0x5ff32210
Caught exception in looking up space point ptr... 0x5ff32210, 0x5ff323a0
Caught exception in looking up space point ptr... 0x2b660620, 0x2b65d0a0
Caught exception in looking up space point ptr... 0x2b65d0a0, 0x2b660620
Caught exception in looking up space point ptr... 0x20ce3890, 0x7ea82ee0
Caught exception in looking up space point ptr... 0x7ea82ee0, 0x20ce3890
Caught exception in looking up space point ptr... 0x7062c110, 0x7062b940
Caught exception in looking up space point ptr... 0x7062b940, 0x7062c110
Caught exception in looking up space point ptr... 0x7062c110, 0x7062bdf0
Caught exception in looking up space point ptr... 0x7062bdf0, 0x7062c110
Caught exception in looking up space point ptr... 0x71a06a60, 0x71a067c0
Caught exception in looking up space point ptr... 0x71a067c0, 0x71a06a60
Caught exception in looking up space point ptr... 0x4c18bba0, 0x4fafd720
Caught exception in looking up space point ptr... 0x4c19bc10, 0x4c18bba0
Caught exception in looking up space point ptr... 0x227f9c40, 0x227f7a70
Caught exception in looking up space point ptr... 0x227f7a70, 0x227f9c40
Caught exception in looking up space point ptr... 0x9982c6a0, 0x9982c380
Caught exception in looking up space point ptr... 0x9982c380, 0x9982c1a0
Caught exception in looking up space point ptr... 0x850d58d0, 0x850d4100
Caught exception in looking up space point ptr... 0x850d4100, 0x850d5db0
Caught exception in looking up space point ptr... 0x5ff2dcb0, 0x5ff2d8a0
Caught exception in looking up space point ptr... 0x5ff2d8a0, 0x5ff2da80
++++>>>> total num hits: 98823, num free: 94895
04-Feb-2026 00:51:04 UTC Closed output file "np02vd_raw_run042433_0468_df-s04-d1_dw_0_20260203T214000_reco_stage0_20260204T005104_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 154.09 169.711 183.778 168.902 9.10914 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.1167e-05 0.000146235 0.000296485 0.000117206 6.3945e-05 19
produce:tpcrawdecoder:PDVDTPCReader 16.8951 18.2639 21.8956 17.7063 1.40116 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.690556 0.784876 1.99274 0.708286 0.28625 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0232604 0.0265505 0.0518068 0.0233757 0.00707517 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.023125 0.0233358 0.0238046 0.0233343 0.000152657 19
produce:beamevent:BeamEvent 0.000137677 0.000264318 0.00116243 0.00021349 0.000216962 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.34106 3.6475 4.36396 3.59067 0.228246 19
produce:ophit:OpHitFinder 0.0332942 0.0414869 0.050785 0.0425269 0.00511919 19
produce:wclsdatavd:WireCellToolkit 105.433 119.862 130.391 121.349 6.88805 19
produce:gaushit:GausHitFinder 0.956732 1.59896 2.32693 1.61012 0.302929 19
produce:nhitsfilter:NumberOfHitsFilter 0.0002133 0.000369587 0.000724588 0.000359289 0.000103292 19
produce:reco3d:SpacePointSolver 10.2241 16.2103 24.5393 15.9844 3.19426 19
produce:hitpdune:DisambigFromSpacePoints 0.118401 0.243736 0.358036 0.239794 0.0486446 19
produce:cluster3d:Cluster3D 1.77299 2.83419 5.26615 2.77315 0.766772 19
[art]:TriggerResults:TriggerResultInserter 3.2489e-05 4.57156e-05 0.000127732 4.1813e-05 1.97748e-05 19
end_path:out1:RootOutput 6.62e-06 1.13133e-05 3.1978e-05 1.1868e-05 5.44689e-06 19
end_path:out1:RootOutput(write) 5.01091 6.1162 6.8842 6.15946 0.417325 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5647.75 MB
Peak resident set size usage (VmHWM): 3423.02 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0468_df-s04-d1_dw_0_20260203T214000_reco_stage0_20260204T005104_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0468_df-s04-d1_dw_0_20260203T214000_reco_stage0_20260204T005104_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0468_df-s04-d1_dw_0_20260203T214000_reco_stage0_20260204T005104_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162979.0,
"core.end_time": 1770166266.0,
"core.events": [
53363,
53369,
53375,
53381,
53387,
53393,
53399,
53405,
53411,
53417,
53423,
53429,
53435,
53441,
53447,
53453,
53459,
53465,
53471
],
"core.event_count": 19,
"core.first_event_number": 53363,
"core.last_event_number": 53471,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0468_df-s04-d1_dw_0_20260203T214000.hdf5"
}
]
} 