Jobsub ID 297923.140@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.140@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce05 |
| Last heartbeat | 2026-02-04 00:59:27 |
| From worker node | Hostname | dune001-1845699.0-lcg2712.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:06:38 |
| Input files | vd-protodune:np02vd_raw_run042433_0049_df-s03-d1_dw_0_20260203T190044.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 50m (3049s) |
| CPU time | 45m (2717s = 89%) |
| Max RSS bytes | 3386322944 (3229 MiB) |
| Outputting started | 2026-02-04 00:57:28 |
| Output files | |
| Finished | 2026-02-04 00:59:27 |
| Saved logs | justin-logs:297923.140-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
p space point ptr... 0x6fad51a0, 0x6fad45d0
Caught exception in looking up space point ptr... 0x6fad45d0, 0x6fad46f0
Caught exception in looking up space point ptr... 0x98596540, 0x98594920
Caught exception in looking up space point ptr... 0x98594920, 0x98596540
Caught exception in looking up space point ptr... 0x70e16840, 0x70e16520
Caught exception in looking up space point ptr... 0x70e16520, 0x70e16340
Caught exception in looking up space point ptr... 0x4412b370, 0x44123150
Caught exception in looking up space point ptr... 0x44123150, 0x4412f990
Caught exception in looking up space point ptr... 0xb8eac600, 0xb8eaccc0
Caught exception in looking up space point ptr... 0xb8eaca10, 0xb8eac600
Caught exception in looking up space point ptr... 0x47ec9ab0, 0x92de3500
Caught exception in looking up space point ptr... 0x92de3500, 0x92de3370
Caught exception in looking up space point ptr... 0xb14a3c80, 0xb14a3e10
Caught exception in looking up space point ptr... 0xb14a3e10, 0xb14a3c80
Caught exception in looking up space point ptr... 0x9cf242d0, 0xa4365e30
Caught exception in looking up space point ptr... 0xa4365e30, 0x9cf242d0
Caught exception in looking up space point ptr... 0x9cf242d0, 0x727db9b0
Caught exception in looking up space point ptr... 0x727db9b0, 0x9cf242d0
Caught exception in looking up space point ptr... 0x73675eb0, 0x7366a5c0
Caught exception in looking up space point ptr... 0x7366a5c0, 0x73675eb0
Caught exception in looking up space point ptr... 0x845429b0, 0xb99a51c0
Caught exception in looking up space point ptr... 0xb99a51c0, 0x4809a3c0
Caught exception in looking up space point ptr... 0x4f0398e0, 0x43cc12f0
Caught exception in looking up space point ptr... 0x43cc12f0, 0x4681a520
Caught exception in looking up space point ptr... 0xa3f11110, 0xb97d83b0
Caught exception in looking up space point ptr... 0xb97d83b0, 0xb97d8540
Caught exception in looking up space point ptr... 0x914fbd90, 0xaf42b060
Caught exception in looking up space point ptr... 0xaf42b060, 0x914fbd90
Caught exception in looking up space point ptr... 0xa4420b70, 0x468e4e60
Caught exception in looking up space point ptr... 0x468e4e60, 0xa4420b70
Caught exception in looking up space point ptr... 0x7d0697e0, 0x7d069af0
Caught exception in looking up space point ptr... 0x7d069af0, 0x7d0697e0
Caught exception in looking up space point ptr... 0x700d7390, 0x700e5ba0
Caught exception in looking up space point ptr... 0x700e5ba0, 0x700d7390
Caught exception in looking up space point ptr... 0x4b9e9050, 0x4b9e92b0
Caught exception in looking up space point ptr... 0x4b9e92b0, 0x4b9e8f20
Caught exception in looking up space point ptr... 0xb8ea06f0, 0xb8ea6190
Caught exception in looking up space point ptr... 0xb8ea6190, 0xb8ea1360
Caught exception in looking up space point ptr... 0xb8f060d0, 0xb8f01cb0
Caught exception in looking up space point ptr... 0xb8f01cb0, 0xb8f03d60
Caught exception in looking up space point ptr... 0xb8f03d60, 0xb8f04760
Caught exception in looking up space point ptr... 0x6e59e2a0, 0x6e59e430
Caught exception in looking up space point ptr... 0x6e59e430, 0x6e59e2a0
Caught exception in looking up space point ptr... 0x6e59e2a0, 0x4ba857b0
Caught exception in looking up space point ptr... 0x4ba857b0, 0x6e59e2a0
Caught exception in looking up space point ptr... 0x7d2fbce0, 0x7d2fd9a0
Caught exception in looking up space point ptr... 0x7d2fd9a0, 0x7d2fbce0
Caught exception in looking up space point ptr... 0x68f56500, 0x68f56370
Caught exception in looking up space point ptr... 0x68f56370, 0x68f56500
Caught exception in looking up space point ptr... 0x68f56500, 0x68f561e0
Caught exception in looking up space point ptr... 0x68f561e0, 0x68f56500
Caught exception in looking up space point ptr... 0xb1239b60, 0xb1239ac0
Caught exception in looking up space point ptr... 0xb1239ac0, 0xb1239b60
Caught exception in looking up space point ptr... 0xb123a080, 0xb1239ec0
Caught exception in looking up space point ptr... 0xb1239ec0, 0xb1239fa0
Caught exception in looking up space point ptr... 0xbcf094e0, 0xbcf09240
Caught exception in looking up space point ptr... 0xbcf09240, 0xbcf094e0
Caught exception in looking up space point ptr... 0x9cf3aff0, 0x9cf3b340
Caught exception in looking up space point ptr... 0x9cf3b340, 0x9cf36ee0
Caught exception in looking up space point ptr... 0xa35887f0, 0xa3588980
Caught exception in looking up space point ptr... 0xa3588980, 0xa3588ca0
Caught exception in looking up space point ptr... 0x47ed8370, 0x47ed8760
Caught exception in looking up space point ptr... 0x47ed8760, 0x47ed8370
Caught exception in looking up space point ptr... 0x47ed8370, 0x47ec6160
Caught exception in looking up space point ptr... 0x47ec6160, 0x47ed8370
Caught exception in looking up space point ptr... 0x4ac3b130, 0x4ac3af50
Caught exception in looking up space point ptr... 0x4ac3af50, 0x4ac3b130
++++>>>> total num hits: 123809, num free: 119271
04-Feb-2026 00:57:19 UTC Closed output file "np02vd_raw_run042433_0049_df-s03-d1_dw_0_20260203T190044_reco_stage0_20260204T005719_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 135.164 156.192 184.371 152.922 14.2834 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.3732e-05 0.000792207 0.0122095 0.000128645 0.00269197 19
produce:tpcrawdecoder:PDVDTPCReader 15.5236 18.0076 21.5092 18.113 1.7913 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.683975 0.724643 0.770311 0.721667 0.0280597 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229824 0.0277645 0.0358074 0.0271555 0.00461403 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0229882 0.0233001 0.0237524 0.0232737 0.000214973 19
produce:beamevent:BeamEvent 0.000107062 0.000253194 0.00122115 0.000196618 0.000235674 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.91474 3.52124 3.86458 3.57823 0.215491 19
produce:ophit:OpHitFinder 0.0324671 0.0412201 0.0528536 0.0416265 0.00472532 19
produce:wclsdatavd:WireCellToolkit 85.678 105.135 123.369 101.474 10.2077 19
produce:gaushit:GausHitFinder 0.819174 1.2912 2.10257 1.25481 0.377358 19
produce:nhitsfilter:NumberOfHitsFilter 0.000175876 0.000315003 0.000485054 0.000289188 9.22935e-05 19
produce:reco3d:SpacePointSolver 8.95527 18.7482 31.6369 17.9912 6.49409 19
produce:hitpdune:DisambigFromSpacePoints 0.0924121 0.224024 0.400749 0.229728 0.0829279 19
produce:cluster3d:Cluster3D 1.43462 3.0486 5.1724 2.53397 1.15148 19
[art]:TriggerResults:TriggerResultInserter 2.3586e-05 4.02973e-05 0.000101284 3.7147e-05 1.72029e-05 19
end_path:out1:RootOutput 7.852e-06 1.4355e-05 4.5379e-05 1.1608e-05 8.31648e-06 19
end_path:out1:RootOutput(write) 3.89839 5.33825 6.2955 5.89115 0.93961 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5702.34 MB
Peak resident set size usage (VmHWM): 3386.32 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0049_df-s03-d1_dw_0_20260203T190044_reco_stage0_20260204T005719_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0049_df-s03-d1_dw_0_20260203T190044_reco_stage0_20260204T005719_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0049_df-s03-d1_dw_0_20260203T190044_reco_stage0_20260204T005719_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163608.0,
"core.end_time": 1770166641.0,
"core.events": [
5595,
5601,
5607,
5613,
5619,
5625,
5631,
5637,
5643,
5649,
5655,
5661,
5667,
5673,
5679,
5685,
5691,
5697,
5703
],
"core.event_count": 19,
"core.first_event_number": 5595,
"core.last_event_number": 5703,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0049_df-s03-d1_dw_0_20260203T190044.hdf5"
}
]
} 