Jobsub ID 297921.129@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.129@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 00:48:53 |
| From worker node | Hostname | dune002-1603632.0-lcg2705.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:56:37 |
| Input files | vd-protodune:np02vd_raw_run042433_0087_df-s04-d1_dw_0_20260203T191511.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 50m (3040s) |
| CPU time | 44m (2673s = 87%) |
| Max RSS bytes | 3393601536 (3236 MiB) |
| Outputting started | 2026-02-04 00:47:18 |
| Output files | |
| Finished | 2026-02-04 00:48:53 |
| Saved logs | justin-logs:297921.129-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
e point ptr... 0x660955f0, 0x6609a210
Caught exception in looking up space point ptr... 0x3c476730, 0x9a83c8c0
Caught exception in looking up space point ptr... 0x9a83c8c0, 0x3c476730
Caught exception in looking up space point ptr... 0x65f330a0, 0xacfbb6a0
Caught exception in looking up space point ptr... 0xacfbb6a0, 0x65f330a0
Caught exception in looking up space point ptr... 0x42687380, 0x7c4661d0
Caught exception in looking up space point ptr... 0x7c4661d0, 0x42687040
Caught exception in looking up space point ptr... 0x3ac69ec0, 0x3ac6bdf0
Caught exception in looking up space point ptr... 0x3ac6bdf0, 0x3ac72f20
Caught exception in looking up space point ptr... 0x62600b30, 0x372f61a0
Caught exception in looking up space point ptr... 0x372f61a0, 0x62600b30
Caught exception in looking up space point ptr... 0x872bfc80, 0x872bfe10
Caught exception in looking up space point ptr... 0x872bfe10, 0x872bffa0
Caught exception in looking up space point ptr... 0x3c492350, 0x3c492560
Caught exception in looking up space point ptr... 0x3c492560, 0x3c492350
Caught exception in looking up space point ptr... 0x86b56c50, 0x86b56de0
Caught exception in looking up space point ptr... 0x86b56de0, 0x71d8f710
Caught exception in looking up space point ptr... 0x395902f0, 0x9a858270
Caught exception in looking up space point ptr... 0x9a858270, 0x9a857cc0
Caught exception in looking up space point ptr... 0x90d139a0, 0x71d71db0
Caught exception in looking up space point ptr... 0x71d71db0, 0x90d139a0
Caught exception in looking up space point ptr... 0x3619f520, 0x7fd0fbb0
Caught exception in looking up space point ptr... 0x7fd0fbb0, 0x3619f520
Caught exception in looking up space point ptr... 0x9688da10, 0x57f22150
Caught exception in looking up space point ptr... 0x57f22150, 0x9688da10
Caught exception in looking up space point ptr... 0x9688da10, 0x9688d910
Caught exception in looking up space point ptr... 0x9688d910, 0x9688da10
Caught exception in looking up space point ptr... 0x3d67ede0, 0x3d67ec50
Caught exception in looking up space point ptr... 0x3d67ec50, 0x3d67ede0
Caught exception in looking up space point ptr... 0x3f2cc270, 0x3f2cb9e0
Caught exception in looking up space point ptr... 0x3f2cb9e0, 0x3f2cc270
Caught exception in looking up space point ptr... 0x3ac61ea0, 0x3ac62100
Caught exception in looking up space point ptr... 0x3ac62100, 0x3ac61ea0
Caught exception in looking up space point ptr... 0x6608ba80, 0x66095170
Caught exception in looking up space point ptr... 0x66095170, 0x6608ba80
Caught exception in looking up space point ptr... 0x9054be60, 0x9054c7c0
Caught exception in looking up space point ptr... 0x9054c7c0, 0x9054be60
Caught exception in looking up space point ptr... 0x75652750, 0x65f43220
Caught exception in looking up space point ptr... 0x65f43220, 0x75652750
Caught exception in looking up space point ptr... 0x41fa75f0, 0x41fa7770
Caught exception in looking up space point ptr... 0x41fa7770, 0x41fa75f0
Caught exception in looking up space point ptr... 0x372f6a90, 0x372f6860
Caught exception in looking up space point ptr... 0x372f6860, 0x81e61110
Caught exception in looking up space point ptr... 0x59bd8ff0, 0x59bd8e60
Caught exception in looking up space point ptr... 0x59bd8e60, 0x59bd8ff0
Caught exception in looking up space point ptr... 0x3d923840, 0x40b5f3e0
Caught exception in looking up space point ptr... 0x40b5f3e0, 0x3076ad80
Caught exception in looking up space point ptr... 0x37c21e90, 0x37c22070
Caught exception in looking up space point ptr... 0x37c22070, 0x37c21e90
Caught exception in looking up space point ptr... 0x8407df30, 0x5e546440
Caught exception in looking up space point ptr... 0x5e546440, 0x84083550
Caught exception in looking up space point ptr... 0xa5bc7640, 0xa5bd6af0
Caught exception in looking up space point ptr... 0xa5bd6af0, 0xa5bd6c40
Caught exception in looking up space point ptr... 0x41f95890, 0x41f95fd0
Caught exception in looking up space point ptr... 0x41f95fd0, 0x41f96070
Caught exception in looking up space point ptr... 0x37cf6400, 0x41e574f0
Caught exception in looking up space point ptr... 0x41e574f0, 0x8c31ba00
Caught exception in looking up space point ptr... 0x7bb26490, 0x7bb21c70
Caught exception in looking up space point ptr... 0x7bb21c70, 0x7bb21b70
Caught exception in looking up space point ptr... 0x66094cb0, 0x66094f10
Caught exception in looking up space point ptr... 0x66094f10, 0x66094cb0
Caught exception in looking up space point ptr... 0x3d7d4f00, 0x3d7d7c70
Caught exception in looking up space point ptr... 0x3d7d7c70, 0x3d7d4f00
Caught exception in looking up space point ptr... 0xa184d220, 0x3ac4b780
Caught exception in looking up space point ptr... 0x3ac4b780, 0xa184d180
Caught exception in looking up space point ptr... 0x6283a3d0, 0x52c39190
Caught exception in looking up space point ptr... 0x52c39190, 0x6283a3d0
++++>>>> total num hits: 100712, num free: 96605
04-Feb-2026 00:47:09 UTC Closed output file "np02vd_raw_run042433_0087_df-s04-d1_dw_0_20260203T191511_reco_stage0_20260204T004709_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 135.083 155.271 189.212 151.681 10.7797 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.243e-05 0.000122935 0.000262907 9.251e-05 5.47561e-05 19
produce:tpcrawdecoder:PDVDTPCReader 14.7544 19.1461 39.2929 18.8721 4.92893 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.683056 0.706456 0.752129 0.707604 0.0176885 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0228356 0.0238953 0.0282825 0.023168 0.00162809 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0228267 0.0232189 0.0241027 0.0231265 0.000338319 19
produce:beamevent:BeamEvent 0.000102935 0.00019213 0.00113392 0.000138649 0.000223878 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.00459 3.36772 3.82955 3.33785 0.213162 19
produce:ophit:OpHitFinder 0.0327965 0.0405389 0.0523787 0.0405127 0.00503634 19
produce:wclsdatavd:WireCellToolkit 93.0531 108.144 123.554 107.218 8.47605 19
produce:gaushit:GausHitFinder 0.706322 1.28207 2.05722 1.37508 0.347002 19
produce:nhitsfilter:NumberOfHitsFilter 0.000160302 0.000333866 0.000853998 0.000313543 0.000152245 19
produce:reco3d:SpacePointSolver 8.32468 15.2361 24.7414 15.2576 4.51978 19
produce:hitpdune:DisambigFromSpacePoints 0.0841959 0.17653 0.277772 0.188637 0.0489061 19
produce:cluster3d:Cluster3D 1.11918 2.13599 3.55368 2.07915 0.556917 19
[art]:TriggerResults:TriggerResultInserter 2.5749e-05 3.77596e-05 0.000107352 3.4272e-05 1.72448e-05 19
end_path:out1:RootOutput 3.465e-06 6.82695e-06 2.9224e-05 4.306e-06 5.63221e-06 19
end_path:out1:RootOutput(write) 3.83025 4.94364 5.98198 5.12756 0.715075 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5558.92 MB
Peak resident set size usage (VmHWM): 3393.6 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0087_df-s04-d1_dw_0_20260203T191511_reco_stage0_20260204T004709_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0087_df-s04-d1_dw_0_20260203T191511_reco_stage0_20260204T004709_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0087_df-s04-d1_dw_0_20260203T191511_reco_stage0_20260204T004709_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163009.0,
"core.end_time": 1770166031.0,
"core.events": [
9929,
9935,
9941,
9947,
9953,
9959,
9965,
9971,
9977,
9983,
9989,
9995,
10001,
10007,
10013,
10019,
10025,
10031,
10037
],
"core.event_count": 19,
"core.first_event_number": 9929,
"core.last_event_number": 10037,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0087_df-s04-d1_dw_0_20260203T191511.hdf5"
}
]
} 