Jobsub ID 297922.19@dunegpschedd02.fnal.gov
| Jobsub ID | 297922.19@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:24 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce01 |
| Last heartbeat | 2026-02-04 01:00:13 |
| From worker node | Hostname | dune001-1527527.0-lcg2725.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:57:22 |
| Input files | vd-protodune:np02vd_raw_run042421_0087_df-s02-d0_dw_0_20260203T141805.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (3660s) |
| CPU time | 54m (3267s = 89%) |
| Max RSS bytes | 2676596736 (2552 MiB) |
| Outputting started | 2026-02-04 00:58:24 |
| Output files | |
| Finished | 2026-02-04 01:00:13 |
| Saved logs | justin-logs:297922.19-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x3b01a660, 0x67247f50
Caught exception in looking up space point ptr... 0x686e3ad0, 0x686e4020
Caught exception in looking up space point ptr... 0x686e4020, 0x686fb9d0
Caught exception in looking up space point ptr... 0x686e4520, 0x686e4700
Caught exception in looking up space point ptr... 0x686e4700, 0x3c14c2d0
Caught exception in looking up space point ptr... 0x3c14c2d0, 0x6cb41b90
Caught exception in looking up space point ptr... 0x6cb41b90, 0x223e6fa0
Caught exception in looking up space point ptr... 0x6cd67630, 0x1dee1690
Caught exception in looking up space point ptr... 0x1dee1690, 0x419666b0
Caught exception in looking up space point ptr... 0x1e7d7d60, 0x1e7d71f0
Caught exception in looking up space point ptr... 0x428101c0, 0x1e7d7d60
Caught exception in looking up space point ptr... 0x3d92be10, 0x6047a620
Caught exception in looking up space point ptr... 0x6047a620, 0x604a11c0
Caught exception in looking up space point ptr... 0x21e1c8b0, 0x77c64e80
Caught exception in looking up space point ptr... 0x77c64e80, 0x1e992a40
Caught exception in looking up space point ptr... 0x3c143a80, 0x48a27580
Caught exception in looking up space point ptr... 0x209aae10, 0x3c143a80
Caught exception in looking up space point ptr... 0x3fdc3fd0, 0x37f69750
Caught exception in looking up space point ptr... 0x3fdc4160, 0x3fdc3fd0
Caught exception in looking up space point ptr... 0x59bef630, 0x586a0840
Caught exception in looking up space point ptr... 0x586a0840, 0x2a0fe720
Caught exception in looking up space point ptr... 0x687853c0, 0x68772e00
Caught exception in looking up space point ptr... 0x68785550, 0x687853c0
Caught exception in looking up space point ptr... 0x427f0d90, 0x427f0f20
Caught exception in looking up space point ptr... 0x427de960, 0x427f0d90
Caught exception in looking up space point ptr... 0x418bf0b0, 0x418ce600
Caught exception in looking up space point ptr... 0x418ce600, 0x418ce790
Caught exception in looking up space point ptr... 0x4eb86150, 0x4b7d66f0
Caught exception in looking up space point ptr... 0x4b7d66f0, 0x297ba6c0
Caught exception in looking up space point ptr... 0x246fe070, 0x246fdd50
Caught exception in looking up space point ptr... 0x246fdd50, 0x246fd990
Caught exception in looking up space point ptr... 0x29ac8490, 0x4ebdab90
Caught exception in looking up space point ptr... 0x4ebdab90, 0x63c30ff0
Caught exception in looking up space point ptr... 0x3d83cc40, 0x44919570
Caught exception in looking up space point ptr... 0x44919570, 0x22a62580
Caught exception in looking up space point ptr... 0x57184fd0, 0x57196e10
Caught exception in looking up space point ptr... 0x3902ac00, 0x57184fd0
Caught exception in looking up space point ptr... 0x57190240, 0x5717e400
Caught exception in looking up space point ptr... 0x5717e400, 0x390241c0
Caught exception in looking up space point ptr... 0x48ad04f0, 0x42ed04f0
Caught exception in looking up space point ptr... 0x48ae17f0, 0x48ad04f0
Caught exception in looking up space point ptr... 0x3d9754e0, 0x3d9847f0
Caught exception in looking up space point ptr... 0x3d9847f0, 0x422dede0
Caught exception in looking up space point ptr... 0x3c594c00, 0x48d704f0
Caught exception in looking up space point ptr... 0x48d704f0, 0x48d70680
Caught exception in looking up space point ptr... 0x6766ac90, 0x490969e0
Caught exception in looking up space point ptr... 0x6767d250, 0x6766ac90
Caught exception in looking up space point ptr... 0x40b00360, 0x40b001d0
Caught exception in looking up space point ptr... 0x40b001d0, 0x37570e30
Caught exception in looking up space point ptr... 0x28b9a480, 0x28b99e90
Caught exception in looking up space point ptr... 0x28b99e90, 0x41965a40
Caught exception in looking up space point ptr... 0x2080b190, 0x58696880
Caught exception in looking up space point ptr... 0x58696880, 0x64e58360
Caught exception in looking up space point ptr... 0x29815bd0, 0x3a7bd470
Caught exception in looking up space point ptr... 0x3a7bd470, 0x29815bd0
Caught exception in looking up space point ptr... 0x59e06940, 0x5672b9f0
Caught exception in looking up space point ptr... 0x5672b9f0, 0x59e06940
Caught exception in looking up space point ptr... 0x54782e70, 0x46913800
Caught exception in looking up space point ptr... 0x46913800, 0x54782e70
Caught exception in looking up space point ptr... 0x67d56ea0, 0x22673bf0
Caught exception in looking up space point ptr... 0x28d22680, 0x67d56ea0
Caught exception in looking up space point ptr... 0x6cda77d0, 0x4eb96680
Caught exception in looking up space point ptr... 0x4eb96680, 0x4eb967d0
Caught exception in looking up space point ptr... 0x55996580, 0x3f69fa50
Caught exception in looking up space point ptr... 0x3f69fa50, 0x55996580
++++>>>> total num hits: 314197, num free: 308370
04-Feb-2026 00:58:14 UTC Closed output file "np02vd_raw_run042421_0087_df-s02-d0_dw_0_20260203T141805_reco_stage0_20260204T005814_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 84.8321 132.49 154.942 138.985 20.6094 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.8103e-05 0.000159935 0.00125239 9.1779e-05 0.00022584 27
produce:tpcrawdecoder:PDVDTPCReader 13.093 13.6228 17.4016 13.4305 0.797752 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.682371 0.7081 0.749274 0.710667 0.0153523 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229606 0.0238351 0.0396913 0.0232051 0.00311312 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.113751 0.121339 0.138138 0.114807 0.0103453 27
produce:beamevent:BeamEvent 0.000123948 0.000211298 0.00138575 0.000174073 0.000232684 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.09127 3.61065 4.05688 3.64136 0.189802 27
produce:ophit:OpHitFinder 0.0347475 0.0400222 0.0459556 0.0398242 0.00291771 27
produce:wclsdatavd:WireCellToolkit 55.1878 70.1428 80.7967 70.8452 6.19928 27
produce:gaushit:GausHitFinder 0.668165 1.28449 1.80658 1.26078 0.310271 27
produce:nhitsfilter:NumberOfHitsFilter 0.000162927 0.000307995 0.000715622 0.000286964 0.000127621 27
produce:reco3d:SpacePointSolver 3.77874 7.50155 16.6392 6.87983 2.89615 27
produce:hitpdune:DisambigFromSpacePoints 0.0616713 0.188192 0.373907 0.194312 0.0799614 27
produce:cluster3d:Cluster3D 0.970973 30.8285 48.9605 39.4555 17.6246 27
[art]:TriggerResults:TriggerResultInserter 2.7932e-05 4.59208e-05 0.000159572 3.7206e-05 2.91932e-05 27
end_path:out1:RootOutput 6.179e-06 2.06994e-05 0.000289188 1.0446e-05 5.28132e-05 27
end_path:out1:RootOutput(write) 2.9141 4.37882 5.76841 4.1628 0.786636 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4948.42 MB
Peak resident set size usage (VmHWM): 2676.6 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0087_df-s02-d0_dw_0_20260203T141805_reco_stage0_20260204T005814_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0087_df-s02-d0_dw_0_20260203T141805_reco_stage0_20260204T005814_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0087_df-s02-d0_dw_0_20260203T141805_reco_stage0_20260204T005814_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163052.0,
"core.end_time": 1770166696.0,
"core.events": [
14154,
14160,
14166,
14172,
14178,
14184,
14190,
14196,
14202,
14208,
14214,
14220,
14226,
14232,
14238,
14244,
14250,
14256,
14262,
14268,
14274,
14280,
14286,
14292,
14298,
14304,
14310
],
"core.event_count": 27,
"core.first_event_number": 14154,
"core.last_event_number": 14310,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0087_df-s02-d0_dw_0_20260203T141805.hdf5"
}
]
} 