Jobsub ID 297919.20@dunegpschedd02.fnal.gov
| Jobsub ID | 297919.20@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:54:25 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2026-02-04 01:54:10 |
| From worker node | Hostname | dune001-1519800.0-lcg2568.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:29:38 |
| Input files | vd-protodune:np02vd_raw_run042421_0154_df-s02-d1_dw_0_20260203T145417.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8483s) |
| CPU time | 2h (7977s = 94%) |
| Max RSS bytes | 11078406144 (10565 MiB) |
| Outputting started | 2026-02-04 01:51:13 |
| Output files | |
| Finished | 2026-02-04 01:54:10 |
| Saved logs | justin-logs:297919.20-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
looking up space point ptr... 0x3663e1b0, 0x4a82e080
Caught exception in looking up space point ptr... 0x4a82e080, 0x3663e1b0
Caught exception in looking up space point ptr... 0xe45ee3c0, 0x102a056a0
Caught exception in looking up space point ptr... 0x102a056a0, 0xe45ee3c0
Caught exception in looking up space point ptr... 0x3ec50750, 0x112155bf0
Caught exception in looking up space point ptr... 0x112155bf0, 0x3ec50750
Caught exception in looking up space point ptr... 0x568ec930, 0x363b5d80
Caught exception in looking up space point ptr... 0x363b5d80, 0x7a738080
Caught exception in looking up space point ptr... 0x5354d2a0, 0x3e985030
Caught exception in looking up space point ptr... 0x3e985030, 0x596b9500
Caught exception in looking up space point ptr... 0xb1332990, 0xb1332cb0
Caught exception in looking up space point ptr... 0xb1332cb0, 0xb13327b0
Caught exception in looking up space point ptr... 0xb1332490, 0xb1332990
Caught exception in looking up space point ptr... 0xb90a4360, 0x59630350
Caught exception in looking up space point ptr... 0x58b25250, 0xb90a4360
Caught exception in looking up space point ptr... 0x783965c0, 0x36981b40
Caught exception in looking up space point ptr... 0x36981b40, 0x783965c0
Caught exception in looking up space point ptr... 0x783965c0, 0x65872e40
Caught exception in looking up space point ptr... 0x65872e40, 0x783965c0
Caught exception in looking up space point ptr... 0x77cc9ca0, 0x6661fbe0
Caught exception in looking up space point ptr... 0x6661fbe0, 0x77cc9ca0
Caught exception in looking up space point ptr... 0x3e33e5c0, 0x7b70ada0
Caught exception in looking up space point ptr... 0x7b70ada0, 0x3e33e5c0
Caught exception in looking up space point ptr... 0x3e33e5c0, 0x7d59bf30
Caught exception in looking up space point ptr... 0x7d59bf30, 0x3e33e5c0
Caught exception in looking up space point ptr... 0x6575a060, 0xd5ee2110
Caught exception in looking up space point ptr... 0xd5ee2110, 0x6575a060
Caught exception in looking up space point ptr... 0x7997fdd0, 0x109590860
Caught exception in looking up space point ptr... 0x109590860, 0x658830b0
Caught exception in looking up space point ptr... 0x1120e3160, 0x112061a90
Caught exception in looking up space point ptr... 0x112061a90, 0x112061960
Caught exception in looking up space point ptr... 0xafc41c00, 0x524ffac0
Caught exception in looking up space point ptr... 0x524ffac0, 0xafc41c00
Caught exception in looking up space point ptr... 0x741c1ad0, 0x56874d30
Caught exception in looking up space point ptr... 0x56874d30, 0xba6afe60
Caught exception in looking up space point ptr... 0x5b6cc050, 0x6545d110
Caught exception in looking up space point ptr... 0x6545d110, 0x5b6cc050
Caught exception in looking up space point ptr... 0x3da2c940, 0xe24ff070
Caught exception in looking up space point ptr... 0xe24ff070, 0x3da2c940
Caught exception in looking up space point ptr... 0x7ba4d720, 0x4a91ebd0
Caught exception in looking up space point ptr... 0x6584b060, 0x7ba4d720
Caught exception in looking up space point ptr... 0x5962a850, 0x5962a750
Caught exception in looking up space point ptr... 0x5962a750, 0x5962a850
Caught exception in looking up space point ptr... 0x3e924f20, 0x69e9eca0
Caught exception in looking up space point ptr... 0x69e9eca0, 0x7848fdb0
Caught exception in looking up space point ptr... 0xb0b78a00, 0x7852e240
Caught exception in looking up space point ptr... 0x7852e240, 0xb0b78a00
Caught exception in looking up space point ptr... 0xb0b78a00, 0x7852e380
Caught exception in looking up space point ptr... 0x7852e380, 0xb0b78a00
Caught exception in looking up space point ptr... 0xe26b04e0, 0x36931a60
Caught exception in looking up space point ptr... 0x36931a60, 0xe26b04e0
Caught exception in looking up space point ptr... 0xb856a320, 0x609c1750
Caught exception in looking up space point ptr... 0x609c1750, 0x6092bf10
Caught exception in looking up space point ptr... 0x6ff0a3e0, 0x69dde160
Caught exception in looking up space point ptr... 0x69dde160, 0x6ff0a3e0
Caught exception in looking up space point ptr... 0x365a48f0, 0x365a47f0
Caught exception in looking up space point ptr... 0x365a47f0, 0x654e0c90
Caught exception in looking up space point ptr... 0xe4aa9010, 0xe4aa8cf0
Caught exception in looking up space point ptr... 0xe4aa8cf0, 0xe4aa9010
Caught exception in looking up space point ptr... 0x7825b780, 0x828018a0
Caught exception in looking up space point ptr... 0x828018a0, 0x7825b780
Caught exception in looking up space point ptr... 0x7854fd50, 0x78550050
Caught exception in looking up space point ptr... 0x78550050, 0x7854fe50
Caught exception in looking up space point ptr... 0x111c169f0, 0x111c161e0
Caught exception in looking up space point ptr... 0x111c161e0, 0x111c169f0
++++>>>> total num hits: 44272, num free: 42545
04-Feb-2026 01:50:49 UTC Closed output file "np02vd_raw_run042421_0154_df-s02-d1_dw_0_20260203T145417_reco_stage0_20260204T015049_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 142.201 309.363 1415.8 156.082 342.912 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.6851e-05 0.000268457 0.00343063 0.000122183 0.000622069 27
produce:tpcrawdecoder:PDVDTPCReader 14.5189 15.0046 16.0208 14.9131 0.332534 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.688514 0.709123 0.738705 0.711204 0.0107492 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0231036 0.0236029 0.0305909 0.0233162 0.00137683 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.113657 0.115778 0.137668 0.114833 0.00435521 27
produce:beamevent:BeamEvent 0.000154103 0.000250534 0.00124968 0.000217014 0.000199548 27
produce:pdvddaphne:DAPHNEReaderPDVD 4.08997 4.65549 5.14286 4.67157 0.297389 27
produce:ophit:OpHitFinder 0.0321171 0.0554974 0.0825068 0.0565842 0.00888686 27
produce:wclsdatavd:WireCellToolkit 102.752 111.53 117.422 111.659 3.09635 27
produce:gaushit:GausHitFinder 0.857596 2.94723 12.7671 1.65884 3.17992 27
produce:nhitsfilter:NumberOfHitsFilter 0.000332026 0.000578483 0.00139212 0.000434519 0.00032513 27
produce:reco3d:SpacePointSolver 5.24079 27.0139 145.539 12.7625 33.4533 27
produce:hitpdune:DisambigFromSpacePoints 0.0924681 1.06275 6.61276 0.156002 1.9164 27
produce:cluster3d:Cluster3D 0.989379 136.647 1087.65 2.63796 296.902 27
[art]:TriggerResults:TriggerResultInserter 3.353e-05 5.97912e-05 0.000198164 4.5731e-05 3.81801e-05 27
end_path:out1:RootOutput 5.53e-06 2.52998e-05 0.000399758 1.0031e-05 7.36479e-05 27
end_path:out1:RootOutput(write) 4.96194 9.54518 34.8328 6.04204 7.9953 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 13331.7 MB
Peak resident set size usage (VmHWM): 11078.4 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0154_df-s02-d1_dw_0_20260203T145417_reco_stage0_20260204T015049_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0154_df-s02-d1_dw_0_20260203T145417_reco_stage0_20260204T015049_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0154_df-s02-d1_dw_0_20260203T145417_reco_stage0_20260204T015049_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161395.0,
"core.end_time": 1770169853.0,
"core.events": [
25015,
25021,
25027,
25033,
25039,
25045,
25051,
25057,
25063,
25069,
25075,
25081,
25087,
25093,
25099,
25105,
25111,
25117,
25123,
25129,
25135,
25141,
25147,
25153,
25159,
25165,
25171
],
"core.event_count": 27,
"core.first_event_number": 25015,
"core.last_event_number": 25171,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0154_df-s02-d1_dw_0_20260203T145417.hdf5"
}
]
} 