Jobsub ID 297922.14@dunegpschedd02.fnal.gov
| Jobsub ID | 297922.14@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:24 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce01 |
| Last heartbeat | 2026-02-04 00:43:46 |
| From worker node | Hostname | dune001-1527524.0-lcg2725.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:57:26 |
| Input files | vd-protodune:np02vd_raw_run042421_0133_df-s04-d0_dw_0_20260203T144256.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 44m (2671s) |
| CPU time | 37m (2237s = 83%) |
| Max RSS bytes | 2548461568 (2430 MiB) |
| Outputting started | 2026-02-04 00:41:59 |
| Output files | |
| Finished | 2026-02-04 00:43:46 |
| Saved logs | justin-logs:297922.14-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x6b85c940, 0x6b85c7a0
Caught exception in looking up space point ptr... 0x6a073880, 0x6a06fc50
Caught exception in looking up space point ptr... 0x6a06fc50, 0x6a0621a0
Caught exception in looking up space point ptr... 0x3bdad6f0, 0x3bdad980
Caught exception in looking up space point ptr... 0x3bdad980, 0x3bdab980
Caught exception in looking up space point ptr... 0x6fda4380, 0x388b6470
Caught exception in looking up space point ptr... 0x388ae970, 0x6fda4380
Caught exception in looking up space point ptr... 0x4c16e4f0, 0x4c16c3f0
Caught exception in looking up space point ptr... 0x4c16be40, 0x4c16e4f0
Caught exception in looking up space point ptr... 0x3bcb4180, 0x5e18d3d0
Caught exception in looking up space point ptr... 0x5e18d3d0, 0x3bcb4180
Caught exception in looking up space point ptr... 0x4c213aa0, 0x4c213560
Caught exception in looking up space point ptr... 0x4c213560, 0x4c213aa0
Caught exception in looking up space point ptr... 0x4c213aa0, 0x4c213950
Caught exception in looking up space point ptr... 0x4c213950, 0x4c213aa0
Caught exception in looking up space point ptr... 0x6b28aaf0, 0x654f1fc0
Caught exception in looking up space point ptr... 0x654f1fc0, 0x7cde0e80
Caught exception in looking up space point ptr... 0x6b139970, 0x6b139720
Caught exception in looking up space point ptr... 0x6b133b40, 0x6b139970
Caught exception in looking up space point ptr... 0x560e5c70, 0x393ddbe0
Caught exception in looking up space point ptr... 0x393ddbe0, 0x560e5c70
Caught exception in looking up space point ptr... 0x568e2bb0, 0x568e3d80
Caught exception in looking up space point ptr... 0x568dfbf0, 0x568e2bb0
Caught exception in looking up space point ptr... 0x4c0685f0, 0x4c068460
Caught exception in looking up space point ptr... 0x3c015c90, 0x4c0685f0
Caught exception in looking up space point ptr... 0x4c0bb880, 0x4c0b5920
Caught exception in looking up space point ptr... 0x4c0b5920, 0x4c0bb880
Caught exception in looking up space point ptr... 0x4c0bb880, 0x4c0b69a0
Caught exception in looking up space point ptr... 0x4c0b69a0, 0x4c0bb880
Caught exception in looking up space point ptr... 0x37da2fd0, 0x37da2a80
Caught exception in looking up space point ptr... 0x37da2a80, 0x37da2fd0
Caught exception in looking up space point ptr... 0x559c47d0, 0x49c72ef0
Caught exception in looking up space point ptr... 0x49c72ef0, 0x6e1be170
Caught exception in looking up space point ptr... 0x8a811160, 0x85b26380
Caught exception in looking up space point ptr... 0x85b26380, 0x85b26830
Caught exception in looking up space point ptr... 0x6fe523b0, 0x6fe52540
Caught exception in looking up space point ptr... 0x6fe52540, 0x6fe523b0
Caught exception in looking up space point ptr... 0x3392b4b0, 0x55cb4e60
Caught exception in looking up space point ptr... 0x55cb4e60, 0x3392b190
Caught exception in looking up space point ptr... 0x495608a0, 0x51d9f510
Caught exception in looking up space point ptr... 0x51d9f510, 0x495608a0
Caught exception in looking up space point ptr... 0x6174e0d0, 0x6ba483e0
Caught exception in looking up space point ptr... 0x6ba483e0, 0x6174e0d0
Caught exception in looking up space point ptr... 0x6ff32d00, 0x6ff32e90
Caught exception in looking up space point ptr... 0x6ff32e90, 0x6ff33020
Caught exception in looking up space point ptr... 0x6b1391e0, 0x6b138cf0
Caught exception in looking up space point ptr... 0x6b139430, 0x6b1391e0
Caught exception in looking up space point ptr... 0x559ca170, 0x559d1c70
Caught exception in looking up space point ptr... 0x559d1c70, 0x559d3860
Caught exception in looking up space point ptr... 0x559d3b80, 0x559ca640
Caught exception in looking up space point ptr... 0x559ca640, 0x559ca170
Caught exception in looking up space point ptr... 0x5f2e2460, 0x626c2b70
Caught exception in looking up space point ptr... 0x626c2b70, 0x5f2e22d0
Caught exception in looking up space point ptr... 0x4c130d30, 0x4c12dcb0
Caught exception in looking up space point ptr... 0x4c12a670, 0x4c130d30
Caught exception in looking up space point ptr... 0x6b13b6d0, 0x6b132130
Caught exception in looking up space point ptr... 0x6b132130, 0x6b13b6d0
Caught exception in looking up space point ptr... 0x66d62d20, 0x66d62a70
Caught exception in looking up space point ptr... 0x66d62a70, 0x66d62bf0
Caught exception in looking up space point ptr... 0x6681d370, 0x37c0c540
Caught exception in looking up space point ptr... 0x37c0c540, 0x37c0c9c0
Caught exception in looking up space point ptr... 0x8ab30100, 0x8ab2ff20
Caught exception in looking up space point ptr... 0x8ab2ff20, 0x8ab30100
Caught exception in looking up space point ptr... 0x785ee340, 0x7dc1c3e0
Caught exception in looking up space point ptr... 0x7dc1c3e0, 0x785ee340
++++>>>> total num hits: 87612, num free: 84961
04-Feb-2026 00:41:50 UTC Closed output file "np02vd_raw_run042421_0133_df-s04-d0_dw_0_20260203T144256_reco_stage0_20260204T004150_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 80.2267 95.9369 113.168 95.5162 8.4696 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.5209e-05 0.000111071 0.000278261 9.6236e-05 3.92422e-05 27
produce:tpcrawdecoder:PDVDTPCReader 13.9136 15.7317 24.0478 14.9012 2.20628 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.68321 0.722667 0.793647 0.714461 0.0333249 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0230471 0.0250401 0.0369312 0.0232683 0.00405501 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.113872 0.115659 0.137567 0.114717 0.00436736 27
produce:beamevent:BeamEvent 0.000104077 0.000262048 0.00129659 0.000193393 0.000248817 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.22432 3.65137 5.04444 3.63323 0.326039 27
produce:ophit:OpHitFinder 0.0312528 0.0386488 0.0450999 0.0388059 0.00320632 27
produce:wclsdatavd:WireCellToolkit 48.3234 61.5361 72.2751 61.3631 6.42308 27
produce:gaushit:GausHitFinder 0.433206 0.890718 1.6868 0.802884 0.307262 27
produce:nhitsfilter:NumberOfHitsFilter 0.000129696 0.000218234 0.000580758 0.000210888 8.4313e-05 27
produce:reco3d:SpacePointSolver 3.31022 7.63149 13.3045 7.41059 2.09893 27
produce:hitpdune:DisambigFromSpacePoints 0.0393941 0.0907302 0.169104 0.0847579 0.0268336 27
produce:cluster3d:Cluster3D 0.669303 1.83565 3.83013 1.54121 0.822074 27
[art]:TriggerResults:TriggerResultInserter 2.7962e-05 3.7986e-05 0.000108454 3.4993e-05 1.50252e-05 27
end_path:out1:RootOutput 5.869e-06 1.01939e-05 3.1417e-05 1.0155e-05 4.72737e-06 27
end_path:out1:RootOutput(write) 2.78255 3.63656 4.45009 3.66015 0.537323 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4886.14 MB
Peak resident set size usage (VmHWM): 2548.46 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0133_df-s04-d0_dw_0_20260203T144256_reco_stage0_20260204T004150_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0133_df-s04-d0_dw_0_20260203T144256_reco_stage0_20260204T004150_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0133_df-s04-d0_dw_0_20260203T144256_reco_stage0_20260204T004150_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163055.0,
"core.end_time": 1770165712.0,
"core.events": [
21610,
21616,
21622,
21628,
21634,
21640,
21646,
21652,
21658,
21664,
21670,
21676,
21682,
21688,
21694,
21700,
21706,
21712,
21718,
21724,
21730,
21736,
21742,
21748,
21754,
21760,
21766
],
"core.event_count": 27,
"core.first_event_number": 21610,
"core.last_event_number": 21766,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0133_df-s04-d0_dw_0_20260203T144256.hdf5"
}
]
} 