Jobsub ID 297922.13@dunegpschedd02.fnal.gov
| Jobsub ID | 297922.13@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:24 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce03 |
| Last heartbeat | 2026-02-04 00:42:38 |
| From worker node | Hostname | dune001-1535465.0-lcg2711.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:57:22 |
| Input files | vd-protodune:np02vd_raw_run042421_0034_df-s03-d0_dw_0_20260203T134925.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 43m (2622s) |
| CPU time | 36m (2183s = 83%) |
| Max RSS bytes | 2517958656 (2401 MiB) |
| Outputting started | 2026-02-04 00:41:05 |
| Output files | |
| Finished | 2026-02-04 00:42:38 |
| Saved logs | justin-logs:297922.13-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x4f0958b0, 0x4f0946e0
Caught exception in looking up space point ptr... 0x4f0946e0, 0x4f094550
Caught exception in looking up space point ptr... 0x5c8be930, 0x2d566240
Caught exception in looking up space point ptr... 0x2d566240, 0x2c7fede0
Caught exception in looking up space point ptr... 0x28ebcb90, 0x4f40ffb0
Caught exception in looking up space point ptr... 0x4f40ffb0, 0x28ebc8f0
Caught exception in looking up space point ptr... 0x6e286600, 0x5f9f1f00
Caught exception in looking up space point ptr... 0x5f9f1f00, 0x6e286600
Caught exception in looking up space point ptr... 0x53e6eeb0, 0x6b7b5330
Caught exception in looking up space point ptr... 0x53e6f7f0, 0x53e6eeb0
Caught exception in looking up space point ptr... 0x4ad179b0, 0x549d59f0
Caught exception in looking up space point ptr... 0x549d59f0, 0x4ad179b0
Caught exception in looking up space point ptr... 0x79b7b9b0, 0x79b7bb00
Caught exception in looking up space point ptr... 0x79b7bb00, 0x79b7b710
Caught exception in looking up space point ptr... 0x6a6f3180, 0x6a6f0cd0
Caught exception in looking up space point ptr... 0x6a6f0cd0, 0x6a6f3180
Caught exception in looking up space point ptr... 0x4f0b1390, 0x4f0b16d0
Caught exception in looking up space point ptr... 0x4f0b16d0, 0x4f0b1510
Caught exception in looking up space point ptr... 0x30f1a4c0, 0x60e6aa40
Caught exception in looking up space point ptr... 0x60e6aa40, 0x30f1a4c0
Caught exception in looking up space point ptr... 0x79b7bda0, 0x79b7c190
Caught exception in looking up space point ptr... 0x79b7c190, 0x79b7bda0
Caught exception in looking up space point ptr... 0x4c21c560, 0x6b70c020
Caught exception in looking up space point ptr... 0x6b70c020, 0x4c21c560
Caught exception in looking up space point ptr... 0x2cb31970, 0x2cb31ec0
Caught exception in looking up space point ptr... 0x2cb31ec0, 0x2cb31970
Caught exception in looking up space point ptr... 0x2cb31970, 0x2cb321e0
Caught exception in looking up space point ptr... 0x2cb321e0, 0x2cb31970
Caught exception in looking up space point ptr... 0x2cb31970, 0x2cb31ce0
Caught exception in looking up space point ptr... 0x2cb31ce0, 0x2cb31970
Caught exception in looking up space point ptr... 0x5ac7e960, 0x5ac7e7d0
Caught exception in looking up space point ptr... 0x5ac7e7d0, 0x5ac7e960
Caught exception in looking up space point ptr... 0x5ac7e960, 0x5ac7e640
Caught exception in looking up space point ptr... 0x5ac7e640, 0x5ac7e960
Caught exception in looking up space point ptr... 0x2c8abfc0, 0x2c8ac250
Caught exception in looking up space point ptr... 0x2c8ac250, 0x4f19fce0
Caught exception in looking up space point ptr... 0x4f0b2e40, 0x4f0b2f20
Caught exception in looking up space point ptr... 0x4f0b2f20, 0x4f0b2e40
Caught exception in looking up space point ptr... 0x509743c0, 0x766e5970
Caught exception in looking up space point ptr... 0x766e5970, 0x509743c0
Caught exception in looking up space point ptr... 0x6240e010, 0x6241ae00
Caught exception in looking up space point ptr... 0x6241ae00, 0x6241af00
Caught exception in looking up space point ptr... 0x2ee7e390, 0x2ee7e070
Caught exception in looking up space point ptr... 0x2ee7e070, 0x2ee7e390
Caught exception in looking up space point ptr... 0x79af6ea0, 0x79af7000
Caught exception in looking up space point ptr... 0x79af7000, 0x4f581d30
Caught exception in looking up space point ptr... 0x2c8a1c20, 0x2c8a2ac0
Caught exception in looking up space point ptr... 0x2c8a2ac0, 0x4f19d230
Caught exception in looking up space point ptr... 0x66a7a580, 0x66a7a410
Caught exception in looking up space point ptr... 0x66a7a410, 0x66a7a580
Caught exception in looking up space point ptr... 0x5c8cc430, 0x5c8d6040
Caught exception in looking up space point ptr... 0x5c8d6040, 0x5c8cc430
Caught exception in looking up space point ptr... 0x5b4c7040, 0x5b4c6e10
Caught exception in looking up space point ptr... 0x5b4c3670, 0x5b4c7040
Caught exception in looking up space point ptr... 0x2c7778e0, 0x2c7851a0
Caught exception in looking up space point ptr... 0x2c7851a0, 0x2c785440
Caught exception in looking up space point ptr... 0x4f0b1970, 0x4f0b17b0
Caught exception in looking up space point ptr... 0x4f0b17b0, 0x4f0b1890
Caught exception in looking up space point ptr... 0x50f1a6b0, 0x50f1a560
Caught exception in looking up space point ptr... 0x50f1a560, 0x50f1a6b0
Caught exception in looking up space point ptr... 0x50f1a260, 0x50f1a460
Caught exception in looking up space point ptr... 0x50f1a460, 0x50f1a360
Caught exception in looking up space point ptr... 0x4f0aecb0, 0x4f0aef50
Caught exception in looking up space point ptr... 0x4f0aef50, 0x4f0aecb0
Caught exception in looking up space point ptr... 0x4478cbb0, 0x4478cd40
Caught exception in looking up space point ptr... 0x4478cd40, 0x4478cbb0
++++>>>> total num hits: 63336, num free: 60661
04-Feb-2026 00:40:57 UTC Closed output file "np02vd_raw_run042421_0034_df-s03-d0_dw_0_20260203T134925_reco_stage0_20260204T004057_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 77.1353 93.9736 114.256 94.9528 8.16425 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.9896e-05 0.000103328 0.000305121 8.8123e-05 5.20732e-05 27
produce:tpcrawdecoder:PDVDTPCReader 13.5414 15.5984 26.988 14.6023 2.83202 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.705741 0.80742 0.942772 0.807542 0.0664692 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.022939 0.0356839 0.0861504 0.0308894 0.0154583 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.113127 0.122364 0.162506 0.115113 0.0127373 27
produce:beamevent:BeamEvent 9.273e-05 0.000179708 0.00138852 0.000126511 0.000238638 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.08344 3.53036 4.39209 3.47295 0.304215 27
produce:ophit:OpHitFinder 0.0291692 0.0384679 0.0491505 0.0394753 0.00464722 27
produce:wclsdatavd:WireCellToolkit 47.5216 60.4379 68.9156 61.6918 6.04437 27
produce:gaushit:GausHitFinder 0.441194 0.827762 1.30666 0.842836 0.204712 27
produce:nhitsfilter:NumberOfHitsFilter 0.000141824 0.000216331 0.000586756 0.000203167 8.39528e-05 27
produce:reco3d:SpacePointSolver 4.79956 7.51781 12.109 7.5757 1.59988 27
produce:hitpdune:DisambigFromSpacePoints 0.0419776 0.0858078 0.141983 0.0826039 0.0240851 27
produce:cluster3d:Cluster3D 0.681964 1.47399 3.80177 1.38813 0.561919 27
[art]:TriggerResults:TriggerResultInserter 2.3896e-05 3.84488e-05 0.000126982 3.4322e-05 1.92149e-05 27
end_path:out1:RootOutput 3.966e-06 7.32474e-06 3.4923e-05 5.598e-06 5.72585e-06 27
end_path:out1:RootOutput(write) 2.69694 3.46877 4.2437 3.63659 0.543811 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4823.36 MB
Peak resident set size usage (VmHWM): 2517.96 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0034_df-s03-d0_dw_0_20260203T134925_reco_stage0_20260204T004057_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0034_df-s03-d0_dw_0_20260203T134925_reco_stage0_20260204T004057_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0034_df-s03-d0_dw_0_20260203T134925_reco_stage0_20260204T004057_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163052.0,
"core.end_time": 1770165659.0,
"core.events": [
5564,
5570,
5576,
5582,
5588,
5594,
5600,
5606,
5612,
5618,
5624,
5630,
5636,
5642,
5648,
5654,
5660,
5666,
5672,
5678,
5684,
5690,
5696,
5702,
5708,
5714,
5720
],
"core.event_count": 27,
"core.first_event_number": 5564,
"core.last_event_number": 5720,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0034_df-s03-d0_dw_0_20260203T134925.hdf5"
}
]
} 