Jobsub ID 297921.123@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.123@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 00:46:53 |
| From worker node | Hostname | dune002-1603635.0-lcg2711.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:56:05 |
| Input files | vd-protodune:np02vd_raw_run042433_0417_df-s02-d1_dw_0_20260203T212036.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 48m (2936s) |
| CPU time | 43m (2638s = 89%) |
| Max RSS bytes | 3408891904 (3250 MiB) |
| Outputting started | 2026-02-04 00:45:02 |
| Output files | |
| Finished | 2026-02-04 00:46:53 |
| Saved logs | justin-logs:297921.123-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x8f510a90, 0x8f50c2f0
Caught exception in looking up space point ptr... 0x8c4e7820, 0x8c4e8230
Caught exception in looking up space point ptr... 0x8c4e12a0, 0x8c4e7820
Caught exception in looking up space point ptr... 0x45a31aa0, 0x89370b70
Caught exception in looking up space point ptr... 0x89370b70, 0x45a31aa0
Caught exception in looking up space point ptr... 0x466f0a80, 0x377acab0
Caught exception in looking up space point ptr... 0x216b5f50, 0x466f0a80
Caught exception in looking up space point ptr... 0x838242a0, 0x3d508800
Caught exception in looking up space point ptr... 0x3d508800, 0x838242a0
Caught exception in looking up space point ptr... 0x1553fe70, 0x3c6565d0
Caught exception in looking up space point ptr... 0x3c6565d0, 0x1553fe70
Caught exception in looking up space point ptr... 0x16285cd0, 0x8f343470
Caught exception in looking up space point ptr... 0x8f343470, 0x16285cd0
Caught exception in looking up space point ptr... 0x669c1470, 0x7666d170
Caught exception in looking up space point ptr... 0x7666d170, 0x15efe2a0
Caught exception in looking up space point ptr... 0x8b114a90, 0x1f6adac0
Caught exception in looking up space point ptr... 0x1f6adac0, 0x182fcaa0
Caught exception in looking up space point ptr... 0x387d8290, 0x387db700
Caught exception in looking up space point ptr... 0x387d5230, 0x387d8290
Caught exception in looking up space point ptr... 0x42bb2fa0, 0x404f1420
Caught exception in looking up space point ptr... 0x404f1420, 0x42bb2fa0
Caught exception in looking up space point ptr... 0x387cc610, 0x387c0300
Caught exception in looking up space point ptr... 0x387c0300, 0x8dc7d230
Caught exception in looking up space point ptr... 0x6689e2d0, 0x6689e3d0
Caught exception in looking up space point ptr... 0x6689e3d0, 0x6689e2d0
Caught exception in looking up space point ptr... 0x3c38ace0, 0x1a01b530
Caught exception in looking up space point ptr... 0x1a01b530, 0x3c3871e0
Caught exception in looking up space point ptr... 0x526174a0, 0x52617710
Caught exception in looking up space point ptr... 0x52617710, 0x526174a0
Caught exception in looking up space point ptr... 0x18284ad0, 0x15786670
Caught exception in looking up space point ptr... 0x15786670, 0x18284ad0
Caught exception in looking up space point ptr... 0x1860fad0, 0x77ac2ce0
Caught exception in looking up space point ptr... 0x77ac2ce0, 0x162e60c0
Caught exception in looking up space point ptr... 0x64989b00, 0x3d505d80
Caught exception in looking up space point ptr... 0x3d505d80, 0x91953c50
Caught exception in looking up space point ptr... 0x854d4010, 0x854d1730
Caught exception in looking up space point ptr... 0x854d1730, 0x854d4010
Caught exception in looking up space point ptr... 0x921917f0, 0x92191550
Caught exception in looking up space point ptr... 0x92191550, 0x921917f0
Caught exception in looking up space point ptr... 0x19f60ab0, 0x71b9b1b0
Caught exception in looking up space point ptr... 0x71b9b1b0, 0x19f60ab0
Caught exception in looking up space point ptr... 0x52618150, 0x52617210
Caught exception in looking up space point ptr... 0x52617210, 0x52618150
Caught exception in looking up space point ptr... 0x6612d4c0, 0x1ce4da70
Caught exception in looking up space point ptr... 0x1ce4da70, 0x6612d4c0
Caught exception in looking up space point ptr... 0x6612d4c0, 0x536480e0
Caught exception in looking up space point ptr... 0x536480e0, 0x6612d4c0
Caught exception in looking up space point ptr... 0x4ca7e390, 0x6ed85e50
Caught exception in looking up space point ptr... 0x6ed85e50, 0x37d6ee90
Caught exception in looking up space point ptr... 0x52925510, 0x529235b0
Caught exception in looking up space point ptr... 0x52923c40, 0x52925510
Caught exception in looking up space point ptr... 0x50b61210, 0x4812bd40
Caught exception in looking up space point ptr... 0x4812bd40, 0x50b61210
Caught exception in looking up space point ptr... 0x50b61210, 0x752d6410
Caught exception in looking up space point ptr... 0x752d6410, 0x50b61210
Caught exception in looking up space point ptr... 0x66231350, 0x5048b6e0
Caught exception in looking up space point ptr... 0x5048b6e0, 0x520283b0
Caught exception in looking up space point ptr... 0x1f85a430, 0x65e68240
Caught exception in looking up space point ptr... 0x65e68240, 0x1f85a430
Caught exception in looking up space point ptr... 0x528e1c10, 0x8b146b80
Caught exception in looking up space point ptr... 0x8b146b80, 0x528e1c10
Caught exception in looking up space point ptr... 0x3d3395b0, 0x3d3398a0
Caught exception in looking up space point ptr... 0x3d3398a0, 0x3d3395b0
Caught exception in looking up space point ptr... 0x415844d0, 0x41584340
Caught exception in looking up space point ptr... 0x41584340, 0x415844d0
Caught exception in looking up space point ptr... 0x66923f10, 0x66924060
Caught exception in looking up space point ptr... 0x66924060, 0x11d16290
++++>>>> total num hits: 86117, num free: 82655
04-Feb-2026 00:44:54 UTC Closed output file "np02vd_raw_run042433_0417_df-s02-d1_dw_0_20260203T212036_reco_stage0_20260204T004454_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 128.844 150.547 180.825 148.264 13.9438 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.2485e-05 0.000107245 0.000305592 9.1078e-05 4.8435e-05 19
produce:tpcrawdecoder:PDVDTPCReader 15.4294 16.3548 20.2042 15.879 1.3195 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.679843 0.695267 0.717721 0.687234 0.013414 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0227556 0.0241759 0.0383155 0.0231491 0.00353514 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0226988 0.0230611 0.0234706 0.0230791 0.000173778 19
produce:beamevent:BeamEvent 0.000101143 0.00020066 0.00138137 0.000135304 0.000279365 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.92101 3.28659 4.10053 3.23884 0.242792 19
produce:ophit:OpHitFinder 0.0325289 0.0394608 0.0477682 0.0397489 0.00405399 19
produce:wclsdatavd:WireCellToolkit 84.131 103.612 120.383 101.671 10.1058 19
produce:gaushit:GausHitFinder 0.803549 1.32689 1.99205 1.38806 0.362917 19
produce:nhitsfilter:NumberOfHitsFilter 0.000191129 0.000334764 0.000767038 0.000354776 0.00012248 19
produce:reco3d:SpacePointSolver 10.7141 17.4774 31.791 16.9334 4.20862 19
produce:hitpdune:DisambigFromSpacePoints 0.119726 0.193808 0.33812 0.167738 0.0607434 19
produce:cluster3d:Cluster3D 1.13843 2.61324 5.86244 2.37802 1.14285 19
[art]:TriggerResults:TriggerResultInserter 2.7702e-05 3.81514e-05 0.000113762 3.1227e-05 1.89943e-05 19
end_path:out1:RootOutput 4.236e-06 8.512e-06 3.286e-05 8.072e-06 6.05679e-06 19
end_path:out1:RootOutput(write) 3.87992 4.85182 6.40932 4.30394 0.830665 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5616.46 MB
Peak resident set size usage (VmHWM): 3408.89 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0417_df-s02-d1_dw_0_20260203T212036_reco_stage0_20260204T004454_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0417_df-s02-d1_dw_0_20260203T212036_reco_stage0_20260204T004454_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0417_df-s02-d1_dw_0_20260203T212036_reco_stage0_20260204T004454_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162976.0,
"core.end_time": 1770165895.0,
"core.events": [
47545,
47551,
47557,
47563,
47569,
47575,
47581,
47587,
47593,
47599,
47605,
47611,
47617,
47623,
47629,
47635,
47641,
47647,
47653
],
"core.event_count": 19,
"core.first_event_number": 47545,
"core.last_event_number": 47653,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0417_df-s02-d1_dw_0_20260203T212036.hdf5"
}
]
} 