Jobsub ID 297923.103@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.103@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce03 |
| Last heartbeat | 2026-02-04 00:57:24 |
| From worker node | Hostname | dune001-1535670.0-lcg2714.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:03:05 |
| Input files | vd-protodune:np02vd_raw_run042433_0438_df-s02-d0_dw_0_20260203T212836.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 52m (3160s) |
| CPU time | 45m (2717s = 85%) |
| Max RSS bytes | 3369369600 (3213 MiB) |
| Outputting started | 2026-02-04 00:55:46 |
| Output files | |
| Finished | 2026-02-04 00:57:24 |
| Saved logs | justin-logs:297923.103-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x6f7f5c30, 0x6f7f5b70
Caught exception in looking up space point ptr... 0x580cf3c0, 0x7bcfd1a0
Caught exception in looking up space point ptr... 0x7bcfd1a0, 0x4f367730
Caught exception in looking up space point ptr... 0x7d0b5d30, 0x6f6a39c0
Caught exception in looking up space point ptr... 0x6f6a39c0, 0x7d0b5d30
Caught exception in looking up space point ptr... 0x6a5dbc40, 0x6a5dbb40
Caught exception in looking up space point ptr... 0x56e670b0, 0x6a5dbc40
Caught exception in looking up space point ptr... 0x3357a7a0, 0x33579530
Caught exception in looking up space point ptr... 0x33579530, 0x33579bf0
Caught exception in looking up space point ptr... 0x33579bf0, 0x3357cdc0
Caught exception in looking up space point ptr... 0x3357cdc0, 0x3357a7a0
Caught exception in looking up space point ptr... 0x2645a3e0, 0x2645a200
Caught exception in looking up space point ptr... 0x2645a200, 0x2645a3e0
Caught exception in looking up space point ptr... 0x3410f070, 0x586787d0
Caught exception in looking up space point ptr... 0x586787d0, 0x51259850
Caught exception in looking up space point ptr... 0x347b99d0, 0x90df06b0
Caught exception in looking up space point ptr... 0x90df06b0, 0x90df05b0
Caught exception in looking up space point ptr... 0x56f53e20, 0x9fca21e0
Caught exception in looking up space point ptr... 0x9fca21e0, 0x52f4ec30
Caught exception in looking up space point ptr... 0x8253f430, 0x8253f5c0
Caught exception in looking up space point ptr... 0x8253f5c0, 0x73ec5910
Caught exception in looking up space point ptr... 0x70ef71e0, 0x9fca24d0
Caught exception in looking up space point ptr... 0x9fca24d0, 0x54442770
Caught exception in looking up space point ptr... 0x82198f40, 0x542e2ae0
Caught exception in looking up space point ptr... 0x542e2ae0, 0x82198f40
Caught exception in looking up space point ptr... 0x350045e0, 0x3500f1d0
Caught exception in looking up space point ptr... 0x3500f1d0, 0x350045e0
Caught exception in looking up space point ptr... 0x350045e0, 0x2c0466b0
Caught exception in looking up space point ptr... 0x2c0466b0, 0x350045e0
Caught exception in looking up space point ptr... 0x5804ec70, 0x4d65a770
Caught exception in looking up space point ptr... 0x4d65a770, 0x2e598180
Caught exception in looking up space point ptr... 0x2fd5b7b0, 0x2fd5c8c0
Caught exception in looking up space point ptr... 0x2fd5c8c0, 0x2fd5b7b0
Caught exception in looking up space point ptr... 0x8407a410, 0x84083f70
Caught exception in looking up space point ptr... 0x84083f70, 0x8407a410
Caught exception in looking up space point ptr... 0x7bb55940, 0x7bb53070
Caught exception in looking up space point ptr... 0x7bb53070, 0x7bb53ad0
Caught exception in looking up space point ptr... 0x7dfb21e0, 0x7dfb1ec0
Caught exception in looking up space point ptr... 0x7dfb1ec0, 0x7dfb1d30
Caught exception in looking up space point ptr... 0x45c9e0e0, 0x5d740ca0
Caught exception in looking up space point ptr... 0x5d740ca0, 0x73e51a70
Caught exception in looking up space point ptr... 0x5007ede0, 0x90cfd710
Caught exception in looking up space point ptr... 0x90cfd710, 0x5007ede0
Caught exception in looking up space point ptr... 0x7e427e40, 0x64f88430
Caught exception in looking up space point ptr... 0x64f88430, 0x7e427e40
Caught exception in looking up space point ptr... 0x8829fc00, 0x882a5e10
Caught exception in looking up space point ptr... 0x882a5e10, 0x882a0790
Caught exception in looking up space point ptr... 0x557bf570, 0x73ee6f90
Caught exception in looking up space point ptr... 0x73ee6f90, 0x557bf570
Caught exception in looking up space point ptr... 0x2c16ef50, 0x2c16e360
Caught exception in looking up space point ptr... 0x2c16e360, 0x2c16ef50
Caught exception in looking up space point ptr... 0x51291260, 0x56dfa240
Caught exception in looking up space point ptr... 0x56dfa240, 0x51291260
Caught exception in looking up space point ptr... 0x4f5d4810, 0x4f5d4990
Caught exception in looking up space point ptr... 0x4f5d4990, 0x4f5d4b10
Caught exception in looking up space point ptr... 0x565062f0, 0x6e8f7740
Caught exception in looking up space point ptr... 0x6e8f7740, 0x565064e0
Caught exception in looking up space point ptr... 0x6fc77570, 0x502e4f70
Caught exception in looking up space point ptr... 0x502e4f70, 0x6fc7c360
Caught exception in looking up space point ptr... 0x51675a20, 0x51677150
Caught exception in looking up space point ptr... 0x51677150, 0x51675a20
Caught exception in looking up space point ptr... 0x51675a20, 0x51675890
Caught exception in looking up space point ptr... 0x51675890, 0x51675a20
Caught exception in looking up space point ptr... 0x51675a20, 0x51677f10
Caught exception in looking up space point ptr... 0x51677f10, 0x51675a20
Caught exception in looking up space point ptr... 0x4f5c06b0, 0x4f5c1cb0
Caught exception in looking up space point ptr... 0x4f5c1cb0, 0x4f5c06b0
++++>>>> total num hits: 80176, num free: 76471
04-Feb-2026 00:55:39 UTC Closed output file "np02vd_raw_run042433_0438_df-s02-d0_dw_0_20260203T212836_reco_stage0_20260204T005539_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 146.652 161.779 176.413 161.709 8.46312 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.5354e-05 0.00010582 0.000333743 8.1653e-05 6.65319e-05 19
produce:tpcrawdecoder:PDVDTPCReader 18.182 23.119 34.1499 21.0073 4.07835 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.684632 0.700085 0.747599 0.69693 0.0166663 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0228032 0.023112 0.023701 0.0230881 0.000200009 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0227452 0.0236092 0.028593 0.0230949 0.00140472 19
produce:beamevent:BeamEvent 9.2169e-05 0.00019902 0.00106341 0.000149376 0.000206388 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.3437 3.72676 4.20971 3.67532 0.245137 19
produce:ophit:OpHitFinder 0.0220542 0.0387317 0.0473344 0.0398512 0.00554322 19
produce:wclsdatavd:WireCellToolkit 98.6438 108.892 117.71 109.478 6.05458 19
produce:gaushit:GausHitFinder 0.766388 1.42499 1.98754 1.4469 0.296937 19
produce:nhitsfilter:NumberOfHitsFilter 0.000194032 0.000390604 0.000792825 0.000346041 0.000140948 19
produce:reco3d:SpacePointSolver 9.57433 16.1711 23.9697 16.2396 3.41086 19
produce:hitpdune:DisambigFromSpacePoints 0.0953916 0.179108 0.286898 0.168696 0.0488434 19
produce:cluster3d:Cluster3D 1.0779 2.42494 4.02441 2.20707 0.736546 19
[art]:TriggerResults:TriggerResultInserter 2.3666e-05 3.69737e-05 0.000111038 2.9254e-05 2.52473e-05 19
end_path:out1:RootOutput 4.337e-06 2.36072e-05 0.000296257 5.979e-06 6.46142e-05 19
end_path:out1:RootOutput(write) 4.01883 5.00209 6.06228 5.09853 0.682931 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5606.91 MB
Peak resident set size usage (VmHWM): 3369.37 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0438_df-s02-d0_dw_0_20260203T212836_reco_stage0_20260204T005539_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0438_df-s02-d0_dw_0_20260203T212836_reco_stage0_20260204T005539_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0438_df-s02-d0_dw_0_20260203T212836_reco_stage0_20260204T005539_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163397.0,
"core.end_time": 1770166540.0,
"core.events": [
49938,
49944,
49950,
49956,
49962,
49968,
49974,
49980,
49986,
49992,
49998,
50004,
50010,
50016,
50022,
50028,
50034,
50040,
50046
],
"core.event_count": 19,
"core.first_event_number": 49938,
"core.last_event_number": 50046,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0438_df-s02-d0_dw_0_20260203T212836.hdf5"
}
]
} 