Jobsub ID 297921.36@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.36@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 00:46:08 |
| From worker node | Hostname | dune002-1603253.0-lcg2709.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:48:07 |
| Input files | vd-protodune:np02vd_raw_run042433_0426_df-s04-d0_dw_0_20260203T212402.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 56m (3382s) |
| CPU time | 47m (2828s = 83%) |
| Max RSS bytes | 3402723328 (3245 MiB) |
| Outputting started | 2026-02-04 00:44:31 |
| Output files | |
| Finished | 2026-02-04 00:46:08 |
| Saved logs | justin-logs:297921.36-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x68615ea0, 0x68615d10
Caught exception in looking up space point ptr... 0x68615d10, 0x68615ea0
Caught exception in looking up space point ptr... 0x5d7f6a30, 0x8a527360
Caught exception in looking up space point ptr... 0x79c5f6e0, 0x5d7f6a30
Caught exception in looking up space point ptr... 0x88a2bac0, 0x4ea708b0
Caught exception in looking up space point ptr... 0x4ea708b0, 0x4ea70b00
Caught exception in looking up space point ptr... 0x6d318020, 0x6d31d400
Caught exception in looking up space point ptr... 0x6d31d400, 0x6d3232c0
Caught exception in looking up space point ptr... 0x4fa79610, 0x4fa76200
Caught exception in looking up space point ptr... 0x4fa76200, 0x4c64d230
Caught exception in looking up space point ptr... 0x813c4d30, 0x813c2e70
Caught exception in looking up space point ptr... 0x813c2e70, 0x56c677f0
Caught exception in looking up space point ptr... 0x606dfb80, 0x5ff83090
Caught exception in looking up space point ptr... 0x5ff83090, 0x606dfb80
Caught exception in looking up space point ptr... 0x58d27600, 0x5f23d7b0
Caught exception in looking up space point ptr... 0x7a368ae0, 0x58d27600
Caught exception in looking up space point ptr... 0x88a2e2c0, 0x88a2e610
Caught exception in looking up space point ptr... 0x88a2e610, 0x88a2e030
Caught exception in looking up space point ptr... 0x3702f620, 0x37025190
Caught exception in looking up space point ptr... 0x37025190, 0x3702f9b0
Caught exception in looking up space point ptr... 0x6cfc89a0, 0x7831e1b0
Caught exception in looking up space point ptr... 0x7831e1b0, 0x6cfc89a0
Caught exception in looking up space point ptr... 0x8ca27440, 0x8ca27c40
Caught exception in looking up space point ptr... 0x56c5f7f0, 0x312a6490
Caught exception in looking up space point ptr... 0x312a6490, 0x8ca27440
Caught exception in looking up space point ptr... 0x6d6bf3e0, 0x39a218c0
Caught exception in looking up space point ptr... 0x59091940, 0xa403e1a0
Caught exception in looking up space point ptr... 0xa403e1a0, 0x66ecfd80
Caught exception in looking up space point ptr... 0x66ecfd80, 0x58ee6090
Caught exception in looking up space point ptr... 0x58ee6090, 0x6d6bf3e0
Caught exception in looking up space point ptr... 0x729c3780, 0x729c1f20
Caught exception in looking up space point ptr... 0x729c1f20, 0x729c38d0
Caught exception in looking up space point ptr... 0x57adb8e0, 0x57adba10
Caught exception in looking up space point ptr... 0x57adba10, 0x57ac9cf0
Caught exception in looking up space point ptr... 0x6fa98a30, 0x6fa98390
Caught exception in looking up space point ptr... 0x6fa98390, 0x6fa98a30
Caught exception in looking up space point ptr... 0x5858d5f0, 0x30e22b50
Caught exception in looking up space point ptr... 0x73cf3cb0, 0x5858d5f0
Caught exception in looking up space point ptr... 0x2a804000, 0x2a8041a0
Caught exception in looking up space point ptr... 0x2a8041a0, 0x2a804490
Caught exception in looking up space point ptr... 0x2a804490, 0x2a804630
Caught exception in looking up space point ptr... 0x8a91ae80, 0x7ec47860
Caught exception in looking up space point ptr... 0x7ec47860, 0x312af480
Caught exception in looking up space point ptr... 0x729dccd0, 0x729dc980
Caught exception in looking up space point ptr... 0x729db480, 0x729dccd0
Caught exception in looking up space point ptr... 0x729c9300, 0x729c90a0
Caught exception in looking up space point ptr... 0x729c90a0, 0x336095b0
Caught exception in looking up space point ptr... 0xa7077e10, 0xa7077410
Caught exception in looking up space point ptr... 0xa7077410, 0xa7077c10
Caught exception in looking up space point ptr... 0xa07b7530, 0x6f797350
Caught exception in looking up space point ptr... 0x6f797350, 0xa07b7530
Caught exception in looking up space point ptr... 0x5ff2e240, 0x6fb56d10
Caught exception in looking up space point ptr... 0x6fb56d10, 0x5ff2e240
Caught exception in looking up space point ptr... 0x2d48c160, 0x2d491f20
Caught exception in looking up space point ptr... 0x2d491f20, 0x2d48c810
Caught exception in looking up space point ptr... 0x82757dc0, 0xa2fe0600
Caught exception in looking up space point ptr... 0x73c749c0, 0x82757dc0
Caught exception in looking up space point ptr... 0x706873b0, 0x70686570
Caught exception in looking up space point ptr... 0x70686570, 0x70685460
Caught exception in looking up space point ptr... 0x56c58780, 0x7bda1e70
Caught exception in looking up space point ptr... 0x312a6760, 0x56c58780
Caught exception in looking up space point ptr... 0x4f98f7c0, 0x823b9d80
Caught exception in looking up space point ptr... 0x823b9d80, 0x4f98f7c0
Caught exception in looking up space point ptr... 0x67855880, 0x5954e340
Caught exception in looking up space point ptr... 0x5954e340, 0x67855880
Caught exception in looking up space point ptr... 0x95a10490, 0x5854d470
Caught exception in looking up space point ptr... 0x5854d470, 0x58cc1ed0
++++>>>> total num hits: 76006, num free: 73536
04-Feb-2026 00:44:21 UTC Closed output file "np02vd_raw_run042433_0426_df-s04-d0_dw_0_20260203T212402_reco_stage0_20260204T004421_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 152.602 173.401 222.732 169.873 14.8372 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.1608e-05 0.00013468 0.000324189 0.000101623 7.42129e-05 19
produce:tpcrawdecoder:PDVDTPCReader 18.8251 28.4809 59.2531 25.3857 10.8506 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.686427 0.712757 0.776841 0.703311 0.0260375 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.023229 0.0268311 0.0758357 0.0234861 0.0117686 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0230666 0.0233574 0.0237626 0.0233465 0.000177908 19
produce:beamevent:BeamEvent 0.000141474 0.000253025 0.00115522 0.000203037 0.000215256 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.41687 4.58393 7.16974 3.89505 1.17231 19
produce:ophit:OpHitFinder 0.031798 0.0409436 0.0442704 0.041542 0.00282784 19
produce:wclsdatavd:WireCellToolkit 89.7126 110.252 121.732 112.855 8.82121 19
produce:gaushit:GausHitFinder 0.828822 1.39216 1.75423 1.41758 0.251505 19
produce:nhitsfilter:NumberOfHitsFilter 0.00025172 0.000380483 0.000758626 0.000365112 0.000103008 19
produce:reco3d:SpacePointSolver 13.1818 19.3999 30.0816 17.8711 5.09562 19
produce:hitpdune:DisambigFromSpacePoints 0.123372 0.207016 0.394735 0.187471 0.0657214 19
produce:cluster3d:Cluster3D 1.30492 2.65713 4.66312 2.48062 0.871228 19
[art]:TriggerResults:TriggerResultInserter 3.2078e-05 5.39063e-05 0.000202005 3.965e-05 4.26896e-05 19
end_path:out1:RootOutput 4.066e-06 7.92684e-06 3.4563e-05 5.058e-06 6.67371e-06 19
end_path:out1:RootOutput(write) 4.16272 5.56607 6.4838 5.83552 0.704696 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5607.58 MB
Peak resident set size usage (VmHWM): 3402.72 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0426_df-s04-d0_dw_0_20260203T212402_reco_stage0_20260204T004421_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0426_df-s04-d0_dw_0_20260203T212402_reco_stage0_20260204T004421_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0426_df-s04-d0_dw_0_20260203T212402_reco_stage0_20260204T004421_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162498.0,
"core.end_time": 1770165863.0,
"core.events": [
48574,
48580,
48586,
48592,
48598,
48604,
48610,
48616,
48622,
48628,
48634,
48640,
48646,
48652,
48658,
48664,
48670,
48676,
48682
],
"core.event_count": 19,
"core.first_event_number": 48574,
"core.last_event_number": 48682,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0426_df-s04-d0_dw_0_20260203T212402.hdf5"
}
]
} 