Jobsub ID 303656.29@dunegpschedd01.fnal.gov
| Jobsub ID | 303656.29@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:56:25 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce03 |
| Last heartbeat | 2026-02-04 01:15:15 |
| From worker node | Hostname | dune001-1535833.0-lcg2727.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:11:06 |
| Input files | vd-protodune:np02vd_raw_run042421_0106_df-s03-d0_dw_0_20260203T142823.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (3733s) |
| CPU time | 55m (3307s = 88%) |
| Max RSS bytes | 2687176704 (2562 MiB) |
| Outputting started | 2026-02-04 01:13:21 |
| Output files | |
| Finished | 2026-02-04 01:15:15 |
| Saved logs | justin-logs:303656.29-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
xception in looking up space point ptr... 0x67000a20, 0x66fce670
Caught exception in looking up space point ptr... 0x53d49c50, 0x131acd20
Caught exception in looking up space point ptr... 0x131acd20, 0x5855ff20
Caught exception in looking up space point ptr... 0x40e8fa30, 0x544c5720
Caught exception in looking up space point ptr... 0x544c5720, 0x544c58b0
Caught exception in looking up space point ptr... 0x4b1565e0, 0x389d2f60
Caught exception in looking up space point ptr... 0x380e9a90, 0x4b1565e0
Caught exception in looking up space point ptr... 0x1f1ec1e0, 0x3acaa360
Caught exception in looking up space point ptr... 0x3acaa360, 0x1f1ec1e0
Caught exception in looking up space point ptr... 0x1f1ec1e0, 0x33f44010
Caught exception in looking up space point ptr... 0x33f44010, 0x1f1ec1e0
Caught exception in looking up space point ptr... 0x4dce35e0, 0x51c9a390
Caught exception in looking up space point ptr... 0x51c9a390, 0x4dce35e0
Caught exception in looking up space point ptr... 0x4dce35e0, 0x4e00cce0
Caught exception in looking up space point ptr... 0x4e00cce0, 0x4dce35e0
Caught exception in looking up space point ptr... 0x54d12f60, 0x13900540
Caught exception in looking up space point ptr... 0x13900540, 0x6868ffa0
Caught exception in looking up space point ptr... 0x6868ffa0, 0x1e7a3080
Caught exception in looking up space point ptr... 0x33f3e920, 0x1e7b8000
Caught exception in looking up space point ptr... 0x1e7b8000, 0x1e7b7d70
Caught exception in looking up space point ptr... 0x131e9450, 0x33f3e920
Caught exception in looking up space point ptr... 0x60c114b0, 0x4dced680
Caught exception in looking up space point ptr... 0x4dced680, 0x499ee190
Caught exception in looking up space point ptr... 0x3a577370, 0x1a5822b0
Caught exception in looking up space point ptr... 0x1a5822b0, 0x60c114b0
Caught exception in looking up space point ptr... 0x2ea63000, 0x6750a180
Caught exception in looking up space point ptr... 0x6750a180, 0x57961530
Caught exception in looking up space point ptr... 0x3c82d370, 0x3b34aef0
Caught exception in looking up space point ptr... 0x3b34aef0, 0x3b34b080
Caught exception in looking up space point ptr... 0x4fb594e0, 0x4fb59350
Caught exception in looking up space point ptr... 0x4fb59350, 0x4fb591c0
Caught exception in looking up space point ptr... 0x396c2aa0, 0x5fbb7e80
Caught exception in looking up space point ptr... 0x396d5060, 0x396c2aa0
Caught exception in looking up space point ptr... 0x292e3780, 0x555ee130
Caught exception in looking up space point ptr... 0x292e3910, 0x292e3780
Caught exception in looking up space point ptr... 0x2e0de300, 0x11e2a2e0
Caught exception in looking up space point ptr... 0x2e0de490, 0x2e0de300
Caught exception in looking up space point ptr... 0x53ab5280, 0x53ab50f0
Caught exception in looking up space point ptr... 0x53ab50f0, 0x4e211ff0
Caught exception in looking up space point ptr... 0x4cec0170, 0x4cecbb00
Caught exception in looking up space point ptr... 0x337ec700, 0x4cec0170
Caught exception in looking up space point ptr... 0x36ed4590, 0x53dddb90
Caught exception in looking up space point ptr... 0x36ee6380, 0x36ed4590
Caught exception in looking up space point ptr... 0x4e81ae50, 0x6aa1a6c0
Caught exception in looking up space point ptr... 0x6aa1a6c0, 0x56238390
Caught exception in looking up space point ptr... 0x4e5b5cc0, 0x4e5c8280
Caught exception in looking up space point ptr... 0x4e5c8280, 0x4e5da840
Caught exception in looking up space point ptr... 0x3bc30640, 0x110f6c20
Caught exception in looking up space point ptr... 0x110f6c20, 0x3bc30640
Caught exception in looking up space point ptr... 0x4fa45410, 0x5b18e3b0
Caught exception in looking up space point ptr... 0x5b18e3b0, 0x5fd3abb0
Caught exception in looking up space point ptr... 0x3af38000, 0x5ecf4d60
Caught exception in looking up space point ptr... 0x5ecf4d60, 0x3af38000
Caught exception in looking up space point ptr... 0x1c076e20, 0x5654cde0
Caught exception in looking up space point ptr... 0x5654cde0, 0x1c078720
Caught exception in looking up space point ptr... 0x39b24870, 0x39b25200
Caught exception in looking up space point ptr... 0x39b25200, 0x39b24870
Caught exception in looking up space point ptr... 0x19632650, 0x63a222c0
Caught exception in looking up space point ptr... 0x63a222c0, 0x4c501620
Caught exception in looking up space point ptr... 0x5fec5980, 0x2b56a6f0
Caught exception in looking up space point ptr... 0x2b56a6f0, 0x5fec5980
Caught exception in looking up space point ptr... 0x40bbf030, 0x40bbe150
Caught exception in looking up space point ptr... 0x40bbe150, 0x544b1820
Caught exception in looking up space point ptr... 0x5789d9f0, 0x37fd82a0
Caught exception in looking up space point ptr... 0x37fd82a0, 0x5789d9f0
++++>>>> total num hits: 279727, num free: 272962
04-Feb-2026 01:13:13 UTC Closed output file "np02vd_raw_run042421_0106_df-s03-d0_dw_0_20260203T142823_reco_stage0_20260204T011313_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 98.8915 135.186 169.594 144.618 21.2584 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.6966e-05 0.000143305 0.000320434 0.000102114 6.91797e-05 27
produce:tpcrawdecoder:PDVDTPCReader 13.6243 14.8914 33.9983 14.2053 3.7574 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.679957 0.830468 4.0986 0.709225 0.641075 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0227583 0.0245678 0.0407564 0.0232044 0.00457368 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.112894 0.116947 0.13796 0.114349 0.00728983 27
produce:beamevent:BeamEvent 0.000120172 0.000223118 0.00129711 0.000182186 0.000213374 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.98767 3.33864 3.72681 3.36027 0.183073 27
produce:ophit:OpHitFinder 0.0302928 0.0398455 0.0461539 0.0397551 0.00357922 27
produce:wclsdatavd:WireCellToolkit 64.0945 71.3254 78.8383 71.6173 4.54689 27
produce:gaushit:GausHitFinder 0.582753 1.35099 1.77297 1.34781 0.341758 27
produce:nhitsfilter:NumberOfHitsFilter 0.000168124 0.000320971 0.000608529 0.000328406 8.57768e-05 27
produce:reco3d:SpacePointSolver 4.47194 8.95598 14.5744 8.28542 2.80166 27
produce:hitpdune:DisambigFromSpacePoints 0.0591841 0.210695 0.351342 0.210292 0.088534 27
produce:cluster3d:Cluster3D 1.11613 29.6777 49.8829 39.8507 18.5118 27
[art]:TriggerResults:TriggerResultInserter 2.2674e-05 4.41883e-05 0.00011939 4.0681e-05 1.86459e-05 27
end_path:out1:RootOutput 4.136e-06 9.19467e-06 3.347e-05 8.573e-06 5.42386e-06 27
end_path:out1:RootOutput(write) 2.85294 4.37988 5.47009 4.18309 0.762615 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4893.47 MB
Peak resident set size usage (VmHWM): 2687.18 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0106_df-s03-d0_dw_0_20260203T142823_reco_stage0_20260204T011313_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0106_df-s03-d0_dw_0_20260203T142823_reco_stage0_20260204T011313_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0106_df-s03-d0_dw_0_20260203T142823_reco_stage0_20260204T011313_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163878.0,
"core.end_time": 1770167594.0,
"core.events": [
17246,
17252,
17258,
17264,
17270,
17276,
17282,
17288,
17294,
17300,
17306,
17312,
17318,
17324,
17330,
17336,
17342,
17348,
17354,
17360,
17366,
17372,
17378,
17384,
17390,
17396,
17402
],
"core.event_count": 27,
"core.first_event_number": 17246,
"core.last_event_number": 17402,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0106_df-s03-d0_dw_0_20260203T142823.hdf5"
}
]
} 