Jobsub ID 297921.122@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.122@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce05 |
| Last heartbeat | 2026-02-04 00:50:44 |
| From worker node | Hostname | dune001-1845820.0-lcg2711.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:55:48 |
| Input files | vd-protodune:np02vd_raw_run042433_0233_df-s02-d1_dw_0_20260203T201041.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 53m (3181s) |
| CPU time | 47m (2831s = 88%) |
| Max RSS bytes | 3447410688 (3287 MiB) |
| Outputting started | 2026-02-04 00:48:51 |
| Output files | |
| Finished | 2026-02-04 00:50:44 |
| Saved logs | justin-logs:297921.122-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x58375b30, 0x4705b790
Caught exception in looking up space point ptr... 0x33f42960, 0x33f44a70
Caught exception in looking up space point ptr... 0x33f44a70, 0x33f44cc0
Caught exception in looking up space point ptr... 0x267c8170, 0x267c7090
Caught exception in looking up space point ptr... 0x267c7090, 0x267c8170
Caught exception in looking up space point ptr... 0x2ddb1f40, 0x4cedd850
Caught exception in looking up space point ptr... 0x4cedd850, 0x2ddb1f40
Caught exception in looking up space point ptr... 0x6baaff70, 0x6baafac0
Caught exception in looking up space point ptr... 0x6baafac0, 0x6baafde0
Caught exception in looking up space point ptr... 0x34f6ee40, 0x34f6ce60
Caught exception in looking up space point ptr... 0x34f6ce60, 0x34f6ee40
Caught exception in looking up space point ptr... 0x773c37e0, 0x773d8830
Caught exception in looking up space point ptr... 0x5e448110, 0x773c37e0
Caught exception in looking up space point ptr... 0x945bc2f0, 0x7fe8ce80
Caught exception in looking up space point ptr... 0x7fe8ce80, 0x945bc2f0
Caught exception in looking up space point ptr... 0x945bc2f0, 0xa27b2270
Caught exception in looking up space point ptr... 0xa27b2270, 0x945bc2f0
Caught exception in looking up space point ptr... 0x9d500eb0, 0x9d501300
Caught exception in looking up space point ptr... 0x9d501300, 0x9d505e80
Caught exception in looking up space point ptr... 0x9f8812e0, 0x9f886200
Caught exception in looking up space point ptr... 0x9f886200, 0x31dc2140
Caught exception in looking up space point ptr... 0x799697b0, 0x79969620
Caught exception in looking up space point ptr... 0x79969620, 0x799697b0
Caught exception in looking up space point ptr... 0x33112520, 0x744c9bd0
Caught exception in looking up space point ptr... 0x744c9bd0, 0x24d8c2c0
Caught exception in looking up space point ptr... 0x764e75a0, 0x764e74c0
Caught exception in looking up space point ptr... 0x764e74c0, 0x764e6aa0
Caught exception in looking up space point ptr... 0x2ebf3aa0, 0x2ebf3c30
Caught exception in looking up space point ptr... 0x2ebf3c30, 0x2ebf3aa0
Caught exception in looking up space point ptr... 0x31ddba60, 0x9f8811b0
Caught exception in looking up space point ptr... 0x9f8811b0, 0x31ddba60
Caught exception in looking up space point ptr... 0x2d2f6a60, 0x9200ebc0
Caught exception in looking up space point ptr... 0x9200ebc0, 0x2d2f6a60
Caught exception in looking up space point ptr... 0x772c1ff0, 0x772c2310
Caught exception in looking up space point ptr... 0x772c2310, 0x772c2630
Caught exception in looking up space point ptr... 0x60d63e50, 0x66b920d0
Caught exception in looking up space point ptr... 0x66b920d0, 0x5e42c900
Caught exception in looking up space point ptr... 0x5e42c900, 0x4706daa0
Caught exception in looking up space point ptr... 0x4706daa0, 0x60d63e50
Caught exception in looking up space point ptr... 0x773d67c0, 0x773cfe90
Caught exception in looking up space point ptr... 0x773cfe90, 0x773d67c0
Caught exception in looking up space point ptr... 0x4cee7a70, 0x4cee77d0
Caught exception in looking up space point ptr... 0x4cee77d0, 0x4cee7a70
Caught exception in looking up space point ptr... 0x95ec03b0, 0x3180b380
Caught exception in looking up space point ptr... 0x3180b380, 0x95ec0240
Caught exception in looking up space point ptr... 0x5e001fe0, 0x5e002b70
Caught exception in looking up space point ptr... 0x5e002b70, 0x5e000530
Caught exception in looking up space point ptr... 0x2b2469e0, 0x2b24a760
Caught exception in looking up space point ptr... 0x2b24a760, 0x2b2469e0
Caught exception in looking up space point ptr... 0x2b2469e0, 0x2b239060
Caught exception in looking up space point ptr... 0x2b239060, 0x2b2469e0
Caught exception in looking up space point ptr... 0x8b068430, 0x8b067390
Caught exception in looking up space point ptr... 0x8b067e40, 0x8b068430
Caught exception in looking up space point ptr... 0x359583a0, 0x35958250
Caught exception in looking up space point ptr... 0x35958250, 0x3595b530
Caught exception in looking up space point ptr... 0x9cb962f0, 0x9cb95b10
Caught exception in looking up space point ptr... 0x9cb96060, 0x9cb962f0
Caught exception in looking up space point ptr... 0x572b3e00, 0x4ff9d4f0
Caught exception in looking up space point ptr... 0x4ff9d4f0, 0x572b3e00
Caught exception in looking up space point ptr... 0x81ca54e0, 0x81ca6970
Caught exception in looking up space point ptr... 0x81ca6970, 0x5dfa05a0
Caught exception in looking up space point ptr... 0x518916f0, 0x7bcebb70
Caught exception in looking up space point ptr... 0x7bcebb70, 0x518916f0
Caught exception in looking up space point ptr... 0x319e3890, 0x62b740c0
Caught exception in looking up space point ptr... 0x62b740c0, 0x319e3890
Caught exception in looking up space point ptr... 0x82b15de0, 0x31faacb0
Caught exception in looking up space point ptr... 0x31faacb0, 0x82b15de0
++++>>>> total num hits: 111765, num free: 107655
04-Feb-2026 00:48:43 UTC Closed output file "np02vd_raw_run042433_0233_df-s02-d1_dw_0_20260203T201041_reco_stage0_20260204T004843_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 135.848 163.182 198.281 165.296 14.1206 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.9745e-05 0.000205043 0.00184879 9.5504e-05 0.000388953 19
produce:tpcrawdecoder:PDVDTPCReader 15.0956 19.0656 20.493 19.3625 1.24448 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.661446 0.694087 0.723287 0.687801 0.0145037 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229135 0.0231411 0.0235935 0.0231371 0.000140135 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0229102 0.0230992 0.0237437 0.0230671 0.000182763 19
produce:beamevent:BeamEvent 0.000111469 0.000222448 0.00107636 0.000168044 0.000203554 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.02489 3.54358 3.91563 3.62783 0.231385 19
produce:ophit:OpHitFinder 0.032941 0.0395682 0.0456859 0.0396789 0.00386506 19
produce:wclsdatavd:WireCellToolkit 93.8243 111.274 122.056 114.565 9.5404 19
produce:gaushit:GausHitFinder 0.868677 1.5326 1.96138 1.59552 0.31715 19
produce:nhitsfilter:NumberOfHitsFilter 0.000200994 0.000332011 0.000579425 0.000341816 9.36458e-05 19
produce:reco3d:SpacePointSolver 10.7211 17.3051 26.1008 16.9594 3.31358 19
produce:hitpdune:DisambigFromSpacePoints 0.13198 0.234191 0.4597 0.238833 0.073542 19
produce:cluster3d:Cluster3D 1.54779 3.90651 19.8897 3.0904 3.81738 19
[art]:TriggerResults:TriggerResultInserter 2.3115e-05 3.35689e-05 0.000104007 2.8773e-05 1.70015e-05 19
end_path:out1:RootOutput 5.248e-06 9.97105e-06 3.0456e-05 1.0066e-05 5.20465e-06 19
end_path:out1:RootOutput(write) 4.10995 5.48442 6.6558 5.77963 0.771763 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5724.66 MB
Peak resident set size usage (VmHWM): 3447.41 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0233_df-s02-d1_dw_0_20260203T201041_reco_stage0_20260204T004843_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0233_df-s02-d1_dw_0_20260203T201041_reco_stage0_20260204T004843_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0233_df-s02-d1_dw_0_20260203T201041_reco_stage0_20260204T004843_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162959.0,
"core.end_time": 1770166124.0,
"core.events": [
26569,
26575,
26581,
26587,
26593,
26599,
26605,
26611,
26617,
26623,
26629,
26635,
26641,
26647,
26653,
26659,
26665,
26671,
26677
],
"core.event_count": 19,
"core.first_event_number": 26569,
"core.last_event_number": 26677,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0233_df-s02-d1_dw_0_20260203T201041.hdf5"
}
]
} 