Jobsub ID 297923.34@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.34@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2026-02-04 01:32:27 |
| From worker node | Hostname | dune001-1520393.0-lcg2566.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:58:54 |
| Input files | vd-protodune:np02vd_raw_run042433_0565_df-s04-d1_dw_0_20260203T221651.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5470s) |
| CPU time | 1h (5128s = 93%) |
| Max RSS bytes | 3575738368 (3410 MiB) |
| Outputting started | 2026-02-04 01:30:07 |
| Output files | |
| Finished | 2026-02-04 01:32:27 |
| Saved logs | justin-logs:297923.34-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x81c0c7f0, 0x81c0c340
Caught exception in looking up space point ptr... 0x37aba930, 0x2d22b570
Caught exception in looking up space point ptr... 0x2d22b570, 0x37aba930
Caught exception in looking up space point ptr... 0x715b6230, 0x91c2e2c0
Caught exception in looking up space point ptr... 0x91c2e2c0, 0x715b6230
Caught exception in looking up space point ptr... 0x646d4470, 0x9ef6d200
Caught exception in looking up space point ptr... 0x9ef6d200, 0x3cd9fd70
Caught exception in looking up space point ptr... 0x92ea0450, 0x36bbb260
Caught exception in looking up space point ptr... 0x36bbb260, 0x92ea0450
Caught exception in looking up space point ptr... 0x8d666620, 0x8d666940
Caught exception in looking up space point ptr... 0x8d666300, 0x8d666620
Caught exception in looking up space point ptr... 0x92e18300, 0x64c65a90
Caught exception in looking up space point ptr... 0x620e9e60, 0x92e18300
Caught exception in looking up space point ptr... 0x92af5ff0, 0x787e3a60
Caught exception in looking up space point ptr... 0x787e3a60, 0x3a5b1680
Caught exception in looking up space point ptr... 0x3a5b1680, 0x5b404fa0
Caught exception in looking up space point ptr... 0x331d0f90, 0x7110b980
Caught exception in looking up space point ptr... 0x7110b980, 0x714be6d0
Caught exception in looking up space point ptr... 0x714be6d0, 0x9402e1d0
Caught exception in looking up space point ptr... 0x7c49c5c0, 0x7c49cc00
Caught exception in looking up space point ptr... 0x7c49cc00, 0x7c49ca70
Caught exception in looking up space point ptr... 0x8482a3d0, 0xa33d7250
Caught exception in looking up space point ptr... 0xa33d7250, 0xa33d7000
Caught exception in looking up space point ptr... 0x5ad00790, 0x7d4ebf60
Caught exception in looking up space point ptr... 0x7d4ebf60, 0x5ad00790
Caught exception in looking up space point ptr... 0x2c4436e0, 0x8a28b110
Caught exception in looking up space point ptr... 0x9c849110, 0x2c4436e0
Caught exception in looking up space point ptr... 0x72bca280, 0x72bcb380
Caught exception in looking up space point ptr... 0x72bcb380, 0x72bcb250
Caught exception in looking up space point ptr... 0x4edf8f70, 0x2ba0dca0
Caught exception in looking up space point ptr... 0x2ba0dca0, 0x920409e0
Caught exception in looking up space point ptr... 0x81475770, 0x81475400
Caught exception in looking up space point ptr... 0x81475400, 0x81475770
Caught exception in looking up space point ptr... 0x4edf0c10, 0x4edee9a0
Caught exception in looking up space point ptr... 0x3b542e60, 0x4edf0c10
Caught exception in looking up space point ptr... 0xa77d99a0, 0x6f333450
Caught exception in looking up space point ptr... 0x6f333450, 0x6f334690
Caught exception in looking up space point ptr... 0x919e9fd0, 0x91ed34e0
Caught exception in looking up space point ptr... 0x5c6cb980, 0x919e9fd0
Caught exception in looking up space point ptr... 0x35adfe20, 0x35adf6e0
Caught exception in looking up space point ptr... 0x35adf6e0, 0x35adfe20
Caught exception in looking up space point ptr... 0x302ed270, 0x5b2b9a40
Caught exception in looking up space point ptr... 0x5b2b9a40, 0x5b2b9860
Caught exception in looking up space point ptr... 0x52a3efa0, 0x52a40240
Caught exception in looking up space point ptr... 0x71ceca30, 0x52a3efa0
Caught exception in looking up space point ptr... 0x7598a8d0, 0x2d8eb8a0
Caught exception in looking up space point ptr... 0x2d8eb8a0, 0x7598a8d0
Caught exception in looking up space point ptr... 0x5c689470, 0x6424fbd0
Caught exception in looking up space point ptr... 0x6424fbd0, 0x5c689470
Caught exception in looking up space point ptr... 0x5c65f3c0, 0x5c65f460
Caught exception in looking up space point ptr... 0x5c65f460, 0x5c65f3c0
Caught exception in looking up space point ptr... 0x5ef35520, 0x919cc230
Caught exception in looking up space point ptr... 0x919cc230, 0x5ef35520
Caught exception in looking up space point ptr... 0x5c6c22c0, 0x74901e80
Caught exception in looking up space point ptr... 0x74901e80, 0x5c6c22c0
Caught exception in looking up space point ptr... 0x71564090, 0x2a00c810
Caught exception in looking up space point ptr... 0x2a00c810, 0x71564090
Caught exception in looking up space point ptr... 0x92a7faf0, 0x92a7fc40
Caught exception in looking up space point ptr... 0x92a7fc40, 0x5b88f7c0
Caught exception in looking up space point ptr... 0x972091f0, 0x97209380
Caught exception in looking up space point ptr... 0x2c662bd0, 0x972091f0
Caught exception in looking up space point ptr... 0x649d57c0, 0x649d89b0
Caught exception in looking up space point ptr... 0x649d89b0, 0x649d57c0
Caught exception in looking up space point ptr... 0x90cd7ca0, 0x90cd5f40
Caught exception in looking up space point ptr... 0x90cd5f40, 0x90cd7ca0
Caught exception in looking up space point ptr... 0x64a9cf90, 0x8eba6bf0
Caught exception in looking up space point ptr... 0x8eba6bf0, 0x633645c0
++++>>>> total num hits: 78812, num free: 75943
04-Feb-2026 01:29:53 UTC Closed output file "np02vd_raw_run042433_0565_df-s04-d1_dw_0_20260203T221651_reco_stage0_20260204T012953_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 206.328 281.512 322.89 300.336 38.1528 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000108131 0.000158646 0.000321194 0.000133881 5.91965e-05 19
produce:tpcrawdecoder:PDVDTPCReader 18.0336 18.679 19.6138 18.62 0.372483 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.68345 0.707766 0.754422 0.696226 0.0228224 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.023015 0.0244085 0.0369453 0.0232387 0.00350426 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0230264 0.0233019 0.0240299 0.0232059 0.000289108 19
produce:beamevent:BeamEvent 0.000155472 0.000304029 0.00216802 0.000205552 0.000440091 19
produce:pdvddaphne:DAPHNEReaderPDVD 4.00505 4.42023 4.84933 4.38845 0.221241 19
produce:ophit:OpHitFinder 0.039057 0.0519004 0.0706495 0.0517993 0.00854233 19
produce:wclsdatavd:WireCellToolkit 145.221 160.147 171.186 158.479 6.53792 19
produce:gaushit:GausHitFinder 1.56776 2.81897 4.18886 2.72223 0.827025 19
produce:nhitsfilter:NumberOfHitsFilter 0.000436645 0.00058905 0.000749819 0.000574407 9.49701e-05 19
produce:reco3d:SpacePointSolver 17.6855 26.0027 34.3894 26.5855 3.79239 19
produce:hitpdune:DisambigFromSpacePoints 0.222698 0.406722 0.533152 0.426907 0.0960706 19
produce:cluster3d:Cluster3D 2.88284 59.3259 91.2876 77.029 33.8767 19
[art]:TriggerResults:TriggerResultInserter 3.695e-05 6.3934e-05 0.000160242 5.8191e-05 2.77028e-05 19
end_path:out1:RootOutput 3.85e-06 1.14184e-05 3.949e-05 8.281e-06 7.81991e-06 19
end_path:out1:RootOutput(write) 6.71463 8.83402 10.8212 8.95175 1.05191 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5760.15 MB
Peak resident set size usage (VmHWM): 3575.74 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0565_df-s04-d1_dw_0_20260203T221651_reco_stage0_20260204T012953_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0565_df-s04-d1_dw_0_20260203T221651_reco_stage0_20260204T012953_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0565_df-s04-d1_dw_0_20260203T221651_reco_stage0_20260204T012953_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163149.0,
"core.end_time": 1770168596.0,
"core.events": [
64421,
64427,
64433,
64439,
64445,
64451,
64457,
64463,
64469,
64475,
64481,
64487,
64493,
64499,
64505,
64511,
64517,
64523,
64529
],
"core.event_count": 19,
"core.first_event_number": 64421,
"core.last_event_number": 64529,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0565_df-s04-d1_dw_0_20260203T221651.hdf5"
}
]
} 