Jobsub ID 297921.133@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.133@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce03 |
| Last heartbeat | 2026-02-04 01:36:03 |
| From worker node | Hostname | dune001-1535460.0-lcg2721.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:55:56 |
| Input files | vd-protodune:np02vd_raw_run042433_0074_df-s03-d0_dw_0_20260203T191014.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5875s) |
| CPU time | 1h (5500s = 93%) |
| Max RSS bytes | 13841543168 (13200 MiB) |
| Outputting started | 2026-02-04 01:33:54 |
| Output files | |
| Finished | 2026-02-04 01:36:00 |
| Saved logs | justin-logs:297921.133-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
4ea81fe0
Caught exception in looking up space point ptr... 0x4ea81fe0, 0x4ea82110
Caught exception in looking up space point ptr... 0x47897350, 0x14cc52e30
Caught exception in looking up space point ptr... 0x14cc52e30, 0x47897350
Caught exception in looking up space point ptr... 0x47897350, 0xf1bf3980
Caught exception in looking up space point ptr... 0xf1bf3980, 0x47897350
Caught exception in looking up space point ptr... 0x10775a630, 0xfbb3ba30
Caught exception in looking up space point ptr... 0xfbb3ba30, 0x10775a630
Caught exception in looking up space point ptr... 0x74fae310, 0x15be15fb0
Caught exception in looking up space point ptr... 0x15be15fb0, 0x74fae310
Caught exception in looking up space point ptr... 0x764b7640, 0x15da8e620
Caught exception in looking up space point ptr... 0x15da8e620, 0x77f66680
Caught exception in looking up space point ptr... 0x77f66680, 0x76ae59d0
Caught exception in looking up space point ptr... 0x76ae59d0, 0x768ef3e0
Caught exception in looking up space point ptr... 0x75dbb180, 0x15be1c820
Caught exception in looking up space point ptr... 0x15be1c820, 0x75dbb180
Caught exception in looking up space point ptr... 0x56cd1100, 0x56cd0d70
Caught exception in looking up space point ptr... 0x56cd0d70, 0x56cd09e0
Caught exception in looking up space point ptr... 0x74e91c80, 0x7b423b30
Caught exception in looking up space point ptr... 0xf1a4e5e0, 0x74e91c80
Caught exception in looking up space point ptr... 0x8358c900, 0x8358e7b0
Caught exception in looking up space point ptr... 0x8358e7b0, 0x8358f810
Caught exception in looking up space point ptr... 0xfbb0b390, 0x77c34e50
Caught exception in looking up space point ptr... 0x772631f0, 0xfbb0b390
Caught exception in looking up space point ptr... 0x74dace50, 0x4bb90d60
Caught exception in looking up space point ptr... 0x4bb90d60, 0x74dace50
Caught exception in looking up space point ptr... 0x76afdaa0, 0x1446a64d0
Caught exception in looking up space point ptr... 0x4a7394c0, 0x76afdaa0
Caught exception in looking up space point ptr... 0x4a8a8950, 0x4a8a6140
Caught exception in looking up space point ptr... 0x4a8a6140, 0x4a8a81e0
Caught exception in looking up space point ptr... 0x138402010, 0x138401b40
Caught exception in looking up space point ptr... 0x138401b40, 0x138401020
Caught exception in looking up space point ptr... 0x138401020, 0x1384012f0
Caught exception in looking up space point ptr... 0xa129c570, 0x760ac9e0
Caught exception in looking up space point ptr... 0x149ad1300, 0xa129c570
Caught exception in looking up space point ptr... 0x76d1d5f0, 0x140314610
Caught exception in looking up space point ptr... 0x140314610, 0x76d1d5f0
Caught exception in looking up space point ptr... 0x1452a67f0, 0x53a08f10
Caught exception in looking up space point ptr... 0x53a07a30, 0x1452a67f0
Caught exception in looking up space point ptr... 0x76fb03a0, 0x54329670
Caught exception in looking up space point ptr... 0x54329670, 0x76fb03a0
Caught exception in looking up space point ptr... 0x556248a0, 0x55624700
Caught exception in looking up space point ptr... 0x55624700, 0x55624b40
Caught exception in looking up space point ptr... 0x568af0f0, 0x774dc990
Caught exception in looking up space point ptr... 0x774dc990, 0x568af0f0
Caught exception in looking up space point ptr... 0xa12d5880, 0xa12d56c0
Caught exception in looking up space point ptr... 0xa12d56c0, 0xa12d5880
Caught exception in looking up space point ptr... 0x9cb72900, 0x4cd22bc0
Caught exception in looking up space point ptr... 0x4cd22bc0, 0xea857510
Caught exception in looking up space point ptr... 0x7b39e190, 0x74fc75e0
Caught exception in looking up space point ptr... 0x74fc75e0, 0x14934d210
Caught exception in looking up space point ptr... 0x501e17e0, 0x1516d90a0
Caught exception in looking up space point ptr... 0x1516d90a0, 0x501e17e0
Caught exception in looking up space point ptr... 0x501e17e0, 0x1271f1cf0
Caught exception in looking up space point ptr... 0x1271f1cf0, 0x501e17e0
Caught exception in looking up space point ptr... 0x11bc58470, 0x11bc583a0
Caught exception in looking up space point ptr... 0x11bc583a0, 0x11bc58470
Caught exception in looking up space point ptr... 0x7609ef20, 0x5469a430
Caught exception in looking up space point ptr... 0x5469a430, 0x5469a310
Caught exception in looking up space point ptr... 0x766cc420, 0xfe23a0a0
Caught exception in looking up space point ptr... 0xfe23a0a0, 0x766cc420
Caught exception in looking up space point ptr... 0x15f48f0b0, 0x77c06340
Caught exception in looking up space point ptr... 0x77c06340, 0x749d3230
Caught exception in looking up space point ptr... 0x1491a4720, 0x13284f6d0
Caught exception in looking up space point ptr... 0x13284f6d0, 0x1491a4720
Caught exception in looking up space point ptr... 0x764709c0, 0x7b4289f0
Caught exception in looking up space point ptr... 0x7b4289f0, 0x1203a6ab0
++++>>>> total num hits: 57360, num free: 55037
04-Feb-2026 01:33:43 UTC Closed output file "np02vd_raw_run042433_0074_df-s03-d0_dw_0_20260203T191014_reco_stage0_20260204T013343_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 141.191 305.303 1306.57 165.518 338.487 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.5945e-05 0.000158091 0.000380494 0.000111057 8.22759e-05 19
produce:tpcrawdecoder:PDVDTPCReader 15.1288 18.2283 20.7095 18.2978 1.14708 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.686878 0.698236 0.715686 0.691203 0.0108748 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0230999 0.0232887 0.0241579 0.0232122 0.000239863 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0230574 0.0232904 0.0238355 0.0232195 0.000239521 19
produce:beamevent:BeamEvent 0.000137878 0.000241764 0.00132341 0.000162535 0.000263977 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.29604 3.64061 4.02719 3.69388 0.199024 19
produce:ophit:OpHitFinder 0.0353335 0.0425808 0.0495052 0.0424127 0.00345122 19
produce:wclsdatavd:WireCellToolkit 93.2268 113.558 131.909 113.395 8.89028 19
produce:gaushit:GausHitFinder 0.828957 2.85249 14.4329 1.35765 3.67375 19
produce:nhitsfilter:NumberOfHitsFilter 0.000203838 0.000425248 0.00120764 0.000326693 0.000288308 19
produce:reco3d:SpacePointSolver 11.9408 33.9539 157.136 15.6028 40.5405 19
produce:hitpdune:DisambigFromSpacePoints 0.109023 1.1293 7.47955 0.22541 2.14425 19
produce:cluster3d:Cluster3D 1.58817 123.164 958.895 3.1451 282.654 19
[art]:TriggerResults:TriggerResultInserter 3.0025e-05 5.25362e-05 0.000159261 4.023e-05 3.31659e-05 19
end_path:out1:RootOutput 7.622e-06 1.15712e-05 2.9024e-05 1.0316e-05 4.91364e-06 19
end_path:out1:RootOutput(write) 4.02408 7.90451 23.8564 5.52812 6.05135 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 16520.5 MB
Peak resident set size usage (VmHWM): 13841.5 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0074_df-s03-d0_dw_0_20260203T191014_reco_stage0_20260204T013343_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0074_df-s03-d0_dw_0_20260203T191014_reco_stage0_20260204T013343_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0074_df-s03-d0_dw_0_20260203T191014_reco_stage0_20260204T013343_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162965.0,
"core.end_time": 1770168825.0,
"core.events": [
8444,
8450,
8456,
8462,
8468,
8474,
8480,
8486,
8492,
8498,
8504,
8510,
8516,
8522,
8528,
8534,
8540,
8546,
8552
],
"core.event_count": 19,
"core.first_event_number": 8444,
"core.last_event_number": 8552,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0074_df-s03-d0_dw_0_20260203T191014.hdf5"
}
]
} 