Jobsub ID 297921.16@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.16@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-PPD |
| Entry | CMSHTPC_T2_UK_SGrid_RALPP_hep206 |
| Last heartbeat | 2026-02-04 00:43:32 |
| From worker node | Hostname | heplnc171.pp.rl.ac.uk |
| cpuinfo | AMD EPYC 9534 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:45:14 |
| Input files | vd-protodune:np02vd_raw_run042433_0497_df-s04-d1_dw_0_20260203T215103.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 55m (3356s) |
| CPU time | 51m (3084s = 91%) |
| Max RSS bytes | 3411824640 (3253 MiB) |
| Outputting started | 2026-02-04 00:41:11 |
| Output files | |
| Finished | 2026-02-04 00:43:32 |
| Saved logs | justin-logs:297921.16-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ptr... 0x79619860, 0x7e702460
Caught exception in looking up space point ptr... 0x5dc555f0, 0x42688dd0
Caught exception in looking up space point ptr... 0x42688dd0, 0x390d3940
Caught exception in looking up space point ptr... 0x29c41c10, 0x117db3d0
Caught exception in looking up space point ptr... 0x53ca4900, 0x29c41c10
Caught exception in looking up space point ptr... 0x5dda2590, 0x6c7ab9a0
Caught exception in looking up space point ptr... 0x6c7ab9a0, 0x5dda2590
Caught exception in looking up space point ptr... 0x3c2c9450, 0x3c2c0a40
Caught exception in looking up space point ptr... 0x3c2c0a40, 0x3c2c9580
Caught exception in looking up space point ptr... 0x3c2c9580, 0x3c2c0bc0
Caught exception in looking up space point ptr... 0x33885cc0, 0x7ef9dd50
Caught exception in looking up space point ptr... 0x7ef9dd50, 0x33885cc0
Caught exception in looking up space point ptr... 0x37cecdd0, 0x37ceca10
Caught exception in looking up space point ptr... 0x37ceca10, 0x37cee920
Caught exception in looking up space point ptr... 0x61ed7180, 0x835fefe0
Caught exception in looking up space point ptr... 0x835fefe0, 0x55ba1450
Caught exception in looking up space point ptr... 0x29db8140, 0x382edad0
Caught exception in looking up space point ptr... 0x382edad0, 0x29db8140
Caught exception in looking up space point ptr... 0x7e3f7540, 0x7e3f76d0
Caught exception in looking up space point ptr... 0x7e3f76d0, 0x7e3fdec0
Caught exception in looking up space point ptr... 0x5464b6d0, 0x5464aea0
Caught exception in looking up space point ptr... 0x5464aea0, 0x5464b6d0
Caught exception in looking up space point ptr... 0x63393c20, 0x95bef70
Caught exception in looking up space point ptr... 0x95bd8f0, 0x63393c20
Caught exception in looking up space point ptr... 0x487f6690, 0x487f5f50
Caught exception in looking up space point ptr... 0x487f5f50, 0x487f6550
Caught exception in looking up space point ptr... 0x38250410, 0x380cebe0
Caught exception in looking up space point ptr... 0x380cebe0, 0x3be0fc60
Caught exception in looking up space point ptr... 0x380376b0, 0x53d3cea0
Caught exception in looking up space point ptr... 0x53d3cea0, 0x380376b0
Caught exception in looking up space point ptr... 0x29cafaa0, 0x401c6770
Caught exception in looking up space point ptr... 0x401c6770, 0x29cafaa0
Caught exception in looking up space point ptr... 0x402de890, 0xad740f0
Caught exception in looking up space point ptr... 0x5fc7b070, 0x402de890
Caught exception in looking up space point ptr... 0x40025970, 0x3fbfb020
Caught exception in looking up space point ptr... 0x3fbfb020, 0x391782e0
Caught exception in looking up space point ptr... 0x391782e0, 0x40026260
Caught exception in looking up space point ptr... 0x33ba4890, 0x3d5dfbf0
Caught exception in looking up space point ptr... 0x3d5dfbf0, 0x3d5e06d0
Caught exception in looking up space point ptr... 0x6ddc9850, 0x600a7ec0
Caught exception in looking up space point ptr... 0x600a7ec0, 0x6ddc9850
Caught exception in looking up space point ptr... 0xfb71cf0, 0x55be9520
Caught exception in looking up space point ptr... 0x55be9520, 0x383b0ba0
Caught exception in looking up space point ptr... 0x383b0ba0, 0x67ab4d10
Caught exception in looking up space point ptr... 0x67ab4d10, 0xfb71cf0
Caught exception in looking up space point ptr... 0x173c2350, 0x173c1b90
Caught exception in looking up space point ptr... 0x173c1b90, 0x173c2350
Caught exception in looking up space point ptr... 0x1958af70, 0x330c0220
Caught exception in looking up space point ptr... 0x330c0220, 0x1958af70
Caught exception in looking up space point ptr... 0x5fc7d7d0, 0x369aa2f0
Caught exception in looking up space point ptr... 0x369aa2f0, 0x10af1330
Caught exception in looking up space point ptr... 0x15fe18f0, 0x15fe17a0
Caught exception in looking up space point ptr... 0x15fe17a0, 0x15fe18f0
Caught exception in looking up space point ptr... 0x1a8e0b90, 0x368c07d0
Caught exception in looking up space point ptr... 0x368c07d0, 0x1a8e0b90
Caught exception in looking up space point ptr... 0x3670caa0, 0x3670d510
Caught exception in looking up space point ptr... 0x3670d510, 0x3670caa0
Caught exception in looking up space point ptr... 0x39381540, 0x19653c40
Caught exception in looking up space point ptr... 0x19653c40, 0x3beb67c0
Caught exception in looking up space point ptr... 0x5050ee20, 0x40045920
Caught exception in looking up space point ptr... 0x40045920, 0x1991e900
Caught exception in looking up space point ptr... 0x511abb50, 0x6deebf10
Caught exception in looking up space point ptr... 0x6deebf10, 0x511abb50
Caught exception in looking up space point ptr... 0x37b834c0, 0x3a99b390
Caught exception in looking up space point ptr... 0x3a99b390, 0x37b834c0
Caught exception in looking up space point ptr... 0x3295ff60, 0x363dfd30
Caught exception in looking up space point ptr... 0x363dfd30, 0x589ebe70
++++>>>> total num hits: 72744, num free: 70238
04-Feb-2026 00:41:03 GMT Closed output file "np02vd_raw_run042433_0497_df-s04-d1_dw_0_20260203T215103_reco_stage0_20260204T004103_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 156.254 172.763 187.271 171.932 7.92229 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.3331e-05 0.00013551 0.000263073 0.000115152 5.38837e-05 19
produce:tpcrawdecoder:PDVDTPCReader 13.9633 14.7094 15.2134 14.6944 0.315001 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.526895 0.550262 0.5837 0.549184 0.0157182 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.017579 0.0179907 0.0191284 0.0179285 0.000307504 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0175999 0.0179744 0.0193042 0.017879 0.000357479 19
produce:beamevent:BeamEvent 0.000104241 0.000209809 0.00100088 0.000160632 0.000191004 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.85834 3.3778 4.04487 3.38798 0.268052 19
produce:ophit:OpHitFinder 0.0366493 0.0419535 0.0494752 0.0419638 0.00369073 19
produce:wclsdatavd:WireCellToolkit 109.553 119.098 126.197 118.857 4.31503 19
produce:gaushit:GausHitFinder 0.953474 1.72001 2.4883 1.80495 0.375173 19
produce:nhitsfilter:NumberOfHitsFilter 0.000253723 0.000443099 0.000650669 0.000428836 8.27543e-05 19
produce:reco3d:SpacePointSolver 17.2333 23.6565 32.7891 23.4777 4.37114 19
produce:hitpdune:DisambigFromSpacePoints 0.138492 0.268281 0.390646 0.262563 0.0618173 19
produce:cluster3d:Cluster3D 1.63055 3.39229 5.29713 3.35304 1.03598 19
[art]:TriggerResults:TriggerResultInserter 2.5461e-05 3.93618e-05 0.000117182 3.5681e-05 1.91693e-05 19
end_path:out1:RootOutput 5.281e-06 1.00975e-05 2.933e-05 9.55e-06 4.79912e-06 19
end_path:out1:RootOutput(write) 4.50656 5.84532 6.82572 6.18694 0.770816 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5394.88 MB
Peak resident set size usage (VmHWM): 3411.82 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0497_df-s04-d1_dw_0_20260203T215103_reco_stage0_20260204T004103_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0497_df-s04-d1_dw_0_20260203T215103_reco_stage0_20260204T004103_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0497_df-s04-d1_dw_0_20260203T215103_reco_stage0_20260204T004103_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162326.0,
"core.end_time": 1770165665.0,
"core.events": [
56669,
56675,
56681,
56687,
56693,
56699,
56705,
56711,
56717,
56723,
56729,
56735,
56741,
56747,
56753,
56759,
56765,
56771,
56777
],
"core.event_count": 19,
"core.first_event_number": 56669,
"core.last_event_number": 56777,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0497_df-s04-d1_dw_0_20260203T215103.hdf5"
}
]
} 