Jobsub ID 303656.55@dunegpschedd01.fnal.gov
| Jobsub ID | 303656.55@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:56:25 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce03 |
| Last heartbeat | 2026-02-04 02:21:56 |
| From worker node | Hostname | dune001-1535840.0-lcg2726.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:11:39 |
| Input files | vd-protodune:np02vd_raw_run042421_0058_df-s04-d0_dw_0_20260203T140225.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7646s) |
| CPU time | 1h (7106s = 92%) |
| Max RSS bytes | 9876312064 (9418 MiB) |
| Outputting started | 2026-02-04 02:19:10 |
| Output files | |
| Finished | 2026-02-04 02:21:56 |
| Saved logs | justin-logs:303656.55-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
40b0, 0x513258c0
Caught exception in looking up space point ptr... 0x513258c0, 0x513255f0
Caught exception in looking up space point ptr... 0x56d9fcb0, 0x56e24320
Caught exception in looking up space point ptr... 0x56e14510, 0x56d9fcb0
Caught exception in looking up space point ptr... 0x33b3b7c0, 0x3e782180
Caught exception in looking up space point ptr... 0x3e782180, 0x3588d410
Caught exception in looking up space point ptr... 0x8575c8c0, 0x8579a040
Caught exception in looking up space point ptr... 0x8572bf00, 0x8575c8c0
Caught exception in looking up space point ptr... 0xeeaa6aa0, 0xeeaa6530
Caught exception in looking up space point ptr... 0xeeaa6530, 0xeeaa6250
Caught exception in looking up space point ptr... 0x358ffc10, 0x472ad460
Caught exception in looking up space point ptr... 0xc4d95a20, 0x358ffc10
Caught exception in looking up space point ptr... 0xd22611c0, 0xd2261490
Caught exception in looking up space point ptr... 0xd23cf810, 0xd22611c0
Caught exception in looking up space point ptr... 0x440eef20, 0x440e3ff0
Caught exception in looking up space point ptr... 0x440e3ff0, 0x440ede40
Caught exception in looking up space point ptr... 0xcf1472e0, 0xa57c56d0
Caught exception in looking up space point ptr... 0xa57c56d0, 0xa5801e20
Caught exception in looking up space point ptr... 0xa55cb1b0, 0x7452fb70
Caught exception in looking up space point ptr... 0xa55db840, 0xa55cb1b0
Caught exception in looking up space point ptr... 0x6d35c990, 0x5809a660
Caught exception in looking up space point ptr... 0x6d3ca2c0, 0x6d35c990
Caught exception in looking up space point ptr... 0x230fbd80, 0x18c73d80
Caught exception in looking up space point ptr... 0x18c73d80, 0x230fbbc0
Caught exception in looking up space point ptr... 0xaf68a1c0, 0xafb17830
Caught exception in looking up space point ptr... 0xafb17830, 0x743952f0
Caught exception in looking up space point ptr... 0x6721e980, 0x671ecf50
Caught exception in looking up space point ptr... 0x1b2daeb0, 0x6721e980
Caught exception in looking up space point ptr... 0xd51b8240, 0xd5084460
Caught exception in looking up space point ptr... 0xd5144d70, 0xd51b8240
Caught exception in looking up space point ptr... 0x3d4c5ac0, 0x3d4a2100
Caught exception in looking up space point ptr... 0x3d4a2100, 0x33aa2960
Caught exception in looking up space point ptr... 0x42539750, 0x425399e0
Caught exception in looking up space point ptr... 0x42539c70, 0x42539750
Caught exception in looking up space point ptr... 0xee3d50b0, 0xee3d5340
Caught exception in looking up space point ptr... 0xee3d55d0, 0xee3d50b0
Caught exception in looking up space point ptr... 0xe1cabb60, 0xe1c399e0
Caught exception in looking up space point ptr... 0xe1c399e0, 0xe1c43f00
Caught exception in looking up space point ptr... 0x559f0660, 0x559efe60
Caught exception in looking up space point ptr... 0x559efe60, 0x559f03d0
Caught exception in looking up space point ptr... 0x1021822f0, 0x4fa3d220
Caught exception in looking up space point ptr... 0x4fa3d220, 0xacf182c0
Caught exception in looking up space point ptr... 0x6f516ac0, 0x16c40650
Caught exception in looking up space point ptr... 0x16c40650, 0x6f516ac0
Caught exception in looking up space point ptr... 0x35fdddd0, 0x35fde060
Caught exception in looking up space point ptr... 0x35fde060, 0x35fddb40
Caught exception in looking up space point ptr... 0xa1d15b20, 0xa8f11d60
Caught exception in looking up space point ptr... 0xa8f11d60, 0xa53125a0
Caught exception in looking up space point ptr... 0x16b81110, 0x5687f9e0
Caught exception in looking up space point ptr... 0x1c927490, 0x16b81110
Caught exception in looking up space point ptr... 0x1ebeb460, 0x1ec1c380
Caught exception in looking up space point ptr... 0x1cb62440, 0x1ebeb460
Caught exception in looking up space point ptr... 0xd1d542f0, 0x639a3e10
Caught exception in looking up space point ptr... 0x63c149d0, 0xd1d542f0
Caught exception in looking up space point ptr... 0x854203c0, 0x854674d0
Caught exception in looking up space point ptr... 0x854674d0, 0x8541e960
Caught exception in looking up space point ptr... 0x74495bb0, 0x74165940
Caught exception in looking up space point ptr... 0x74165940, 0x74495bb0
Caught exception in looking up space point ptr... 0x3cae56b0, 0x3cada920
Caught exception in looking up space point ptr... 0x3cada920, 0x3cae3470
Caught exception in looking up space point ptr... 0x1019cb830, 0x6f11c4d0
Caught exception in looking up space point ptr... 0x6f11c4d0, 0xedc26ac0
Caught exception in looking up space point ptr... 0x4f1cea40, 0x4f1ce8b0
Caught exception in looking up space point ptr... 0x4f1ce8b0, 0x4f1cea40
Caught exception in looking up space point ptr... 0x3caec680, 0x3caec7d0
Caught exception in looking up space point ptr... 0x3caec7d0, 0x3caed0b0
++++>>>> total num hits: 2791022, num free: 2706327
04-Feb-2026 02:18:54 UTC Closed output file "np02vd_raw_run042421_0058_df-s04-d0_dw_0_20260203T140225_reco_stage0_20260204T021854_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 117.845 279.37 1015.17 170.184 264.689 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.4518e-05 0.000143627 0.000288876 0.000115044 6.43385e-05 27
produce:tpcrawdecoder:PDVDTPCReader 14.1636 15.9187 35.4885 15.068 3.89729 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.688674 0.731287 0.818742 0.7169 0.0317505 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0230391 0.0271199 0.0502201 0.023431 0.00753264 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.113382 0.116581 0.138453 0.114862 0.00611286 27
produce:beamevent:BeamEvent 0.000117967 0.000241156 0.00142903 0.000186291 0.000239226 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.44178 3.87949 4.14319 3.94138 0.183698 27
produce:ophit:OpHitFinder 0.0389848 0.0471628 0.0534092 0.0478692 0.00401581 27
produce:wclsdatavd:WireCellToolkit 78.409 84.1336 92.0706 83.4582 3.61994 27
produce:gaushit:GausHitFinder 1.02022 2.96928 13.6592 1.69531 3.1386 27
produce:nhitsfilter:NumberOfHitsFilter 0.000216136 0.000469957 0.00101485 0.000372081 0.000231668 27
produce:reco3d:SpacePointSolver 5.19372 22.2157 81.169 11.2443 24.4808 27
produce:hitpdune:DisambigFromSpacePoints 0.0853261 0.792123 4.06324 0.272325 1.19602 27
produce:cluster3d:Cluster3D 1.452 140.755 797.817 49.5914 229.834 27
[art]:TriggerResults:TriggerResultInserter 3.281e-05 5.18066e-05 9.1038e-05 5.0556e-05 1.643e-05 27
end_path:out1:RootOutput 5.268e-06 1.28964e-05 2.683e-05 1.2579e-05 5.26929e-06 27
end_path:out1:RootOutput(write) 3.59484 7.73073 21.8088 6.05104 5.08909 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 12683.2 MB
Peak resident set size usage (VmHWM): 9876.31 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0058_df-s04-d0_dw_0_20260203T140225_reco_stage0_20260204T021854_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0058_df-s04-d0_dw_0_20260203T140225_reco_stage0_20260204T021854_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0058_df-s04-d0_dw_0_20260203T140225_reco_stage0_20260204T021854_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163912.0,
"core.end_time": 1770171537.0,
"core.events": [
9454,
9460,
9466,
9472,
9478,
9484,
9490,
9496,
9502,
9508,
9514,
9520,
9526,
9532,
9538,
9544,
9550,
9556,
9562,
9568,
9574,
9580,
9586,
9592,
9598,
9604,
9610
],
"core.event_count": 27,
"core.first_event_number": 9454,
"core.last_event_number": 9610,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0058_df-s04-d0_dw_0_20260203T140225.hdf5"
}
]
} 