Jobsub ID 298032.1@dunegpschedd02.fnal.gov
| Jobsub ID | 298032.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-04 02:06:32 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce02 |
| Last heartbeat | 2026-02-04 03:38:40 |
| From worker node | Hostname | wn2205240.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7513 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 02:06:54 |
| Input files | vd-protodune:np02vd_raw_run042433_0073_df-s02-d1_dw_0_20260203T190952.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5318s) |
| CPU time | 1h (4740s = 89%) |
| Max RSS bytes | 8897925120 (8485 MiB) |
| Outputting started | 2026-02-04 03:35:36 |
| Output files | |
| Finished | 2026-02-04 03:38:40 |
| Saved logs | justin-logs:298032.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
space point ptr... 0x4e9c9ba0, 0x4e9c9df0
Caught exception in looking up space point ptr... 0x4e9c9df0, 0x4e9c9950
Caught exception in looking up space point ptr... 0xd85e5d50, 0x73677a40
Caught exception in looking up space point ptr... 0x73677a40, 0xd85e5d50
Caught exception in looking up space point ptr... 0xde183d30, 0xde1678a0
Caught exception in looking up space point ptr... 0xde1678a0, 0xde1776d0
Caught exception in looking up space point ptr... 0xc3b57f50, 0xc3b509f0
Caught exception in looking up space point ptr... 0xc3b509f0, 0xc3b57f50
Caught exception in looking up space point ptr... 0x4a6e6500, 0x1162e710
Caught exception in looking up space point ptr... 0x316acdb0, 0x4a6e6500
Caught exception in looking up space point ptr... 0xc5dd8c40, 0xd8ee9be0
Caught exception in looking up space point ptr... 0xd8ee9be0, 0xc5dd8c40
Caught exception in looking up space point ptr... 0x1697c200, 0x167da110
Caught exception in looking up space point ptr... 0x167da110, 0x6cc20ca0
Caught exception in looking up space point ptr... 0x8b4a0e20, 0x2c25ed20
Caught exception in looking up space point ptr... 0x2c25ed20, 0x8b4a0e20
Caught exception in looking up space point ptr... 0x8b4a0e20, 0x8b4d3420
Caught exception in looking up space point ptr... 0x8b4d3420, 0x8b4a0e20
Caught exception in looking up space point ptr... 0x66e04070, 0x615eaa60
Caught exception in looking up space point ptr... 0x615eaa60, 0x5ab854b0
Caught exception in looking up space point ptr... 0x5ab854b0, 0x61dc1a50
Caught exception in looking up space point ptr... 0x61dc1a50, 0x55091f90
Caught exception in looking up space point ptr... 0x55091f90, 0x66e04070
Caught exception in looking up space point ptr... 0x5356f0a0, 0x5f794450
Caught exception in looking up space point ptr... 0x8dd26dd0, 0x5356f0a0
Caught exception in looking up space point ptr... 0x3d51c360, 0x2c24a660
Caught exception in looking up space point ptr... 0x2c24a660, 0x91f6ae0
Caught exception in looking up space point ptr... 0xd89d18c0, 0xd89d1730
Caught exception in looking up space point ptr... 0xd89d1730, 0xd89d18c0
Caught exception in looking up space point ptr... 0x5391d8e0, 0x138743d80
Caught exception in looking up space point ptr... 0x138743d80, 0x39ca3980
Caught exception in looking up space point ptr... 0x555aa6e0, 0x555aa550
Caught exception in looking up space point ptr... 0x555aa550, 0x555aa6e0
Caught exception in looking up space point ptr... 0x97ff8520, 0x18e77b80
Caught exception in looking up space point ptr... 0x18e77b80, 0x97ff8520
Caught exception in looking up space point ptr... 0x97ff8520, 0x97ff86b0
Caught exception in looking up space point ptr... 0x97ff86b0, 0x97ff8520
Caught exception in looking up space point ptr... 0x7b053610, 0xd85f9990
Caught exception in looking up space point ptr... 0xd85f9990, 0xd85ba400
Caught exception in looking up space point ptr... 0x7ed8d7c0, 0x6b204f90
Caught exception in looking up space point ptr... 0x6b204f90, 0x90fd970
Caught exception in looking up space point ptr... 0x97e93d80, 0x97e93bf0
Caught exception in looking up space point ptr... 0x97e93bf0, 0x97e93d80
Caught exception in looking up space point ptr... 0x97e93d80, 0xd96d3020
Caught exception in looking up space point ptr... 0xd96d3020, 0x97e93d80
Caught exception in looking up space point ptr... 0x97e93d80, 0xd96d2dc0
Caught exception in looking up space point ptr... 0xd96d2dc0, 0x97e93d80
Caught exception in looking up space point ptr... 0x97ff8070, 0x97ff7ee0
Caught exception in looking up space point ptr... 0x97ff7ee0, 0x97ff8070
Caught exception in looking up space point ptr... 0x97ff8070, 0x18d9c400
Caught exception in looking up space point ptr... 0x18d9c400, 0x97ff8070
Caught exception in looking up space point ptr... 0x1168dee0, 0x1168dc50
Caught exception in looking up space point ptr... 0x1168dc50, 0x1168e170
Caught exception in looking up space point ptr... 0x97fbb960, 0x97fbbc80
Caught exception in looking up space point ptr... 0x97fbbc80, 0x97fbbe10
Caught exception in looking up space point ptr... 0x59ceeff0, 0x4f6912b0
Caught exception in looking up space point ptr... 0x4f6912b0, 0x59ceeff0
Caught exception in looking up space point ptr... 0x385f6c90, 0x385f63e0
Caught exception in looking up space point ptr... 0x385f63e0, 0x385f6c90
Caught exception in looking up space point ptr... 0x5388a5c0, 0x51d99380
Caught exception in looking up space point ptr... 0x51d99380, 0x5388a5c0
Caught exception in looking up space point ptr... 0x5388a5c0, 0x3b9aa390
Caught exception in looking up space point ptr... 0x3b9aa390, 0x5388a5c0
Caught exception in looking up space point ptr... 0x2e4c7fe0, 0x7a680bd0
Caught exception in looking up space point ptr... 0x6956f2c0, 0x2e4c7fe0
Caught exception in looking up space point ptr... 0x353a3330, 0x353a3650
Caught exception in looking up space point ptr... 0x353a3650, 0x353a3330
++++>>>> total num hits: 2215095, num free: 2143677
04-Feb-2026 03:35:23 GMT Closed output file "np02vd_raw_run042433_0073_df-s02-d1_dw_0_20260203T190952_reco_stage0_20260204T033523_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 184.934 274.564 1049.2 203.859 215.475 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.2154e-05 0.000265617 0.00212803 0.000139242 0.000443006 19
produce:tpcrawdecoder:PDVDTPCReader 23.7974 27.2806 35.3657 26.7294 2.41061 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.638522 0.689674 0.807081 0.675462 0.0444995 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0218308 0.0232411 0.038217 0.0224239 0.00355354 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0218294 0.0226698 0.0260552 0.0223579 0.00103781 19
produce:beamevent:BeamEvent 9.9086e-05 0.000217378 0.000914321 0.000178977 0.000172642 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.34142 4.34653 5.15273 4.42745 0.459361 19
produce:ophit:OpHitFinder 0.0329788 0.0439763 0.0520196 0.0446692 0.00544264 19
produce:wclsdatavd:WireCellToolkit 124.957 140.581 165.554 139.295 9.8032 19
produce:gaushit:GausHitFinder 1.03437 2.53596 14.4345 1.49402 3.11651 19
produce:nhitsfilter:NumberOfHitsFilter 0.000307759 0.000582549 0.00287278 0.000434818 0.000564585 19
produce:reco3d:SpacePointSolver 11.676 28.8964 125.521 19.2425 28.9147 19
produce:hitpdune:DisambigFromSpacePoints 0.136012 1.07785 10.0642 0.257123 2.50227 19
produce:cluster3d:Cluster3D 1.82353 60.4437 698.173 3.76366 172.385 19
[art]:TriggerResults:TriggerResultInserter 3.2461e-05 4.76723e-05 9.2234e-05 4.3652e-05 1.4465e-05 19
end_path:out1:RootOutput 6.152e-06 1.04286e-05 2.4587e-05 9.307e-06 4.6589e-06 19
end_path:out1:RootOutput(write) 5.34407 8.55996 29.718 6.99376 5.79829 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 10864.7 MB
Peak resident set size usage (VmHWM): 8897.93 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0073_df-s02-d1_dw_0_20260203T190952_reco_stage0_20260204T033523_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0073_df-s02-d1_dw_0_20260203T190952_reco_stage0_20260204T033523_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0073_df-s02-d1_dw_0_20260203T190952_reco_stage0_20260204T033523_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770170826.0,
"core.end_time": 1770176126.0,
"core.events": [
8329,
8335,
8341,
8347,
8353,
8359,
8365,
8371,
8377,
8383,
8389,
8395,
8401,
8407,
8413,
8419,
8425,
8431,
8437
],
"core.event_count": 19,
"core.first_event_number": 8329,
"core.last_event_number": 8437,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0073_df-s02-d1_dw_0_20260203T190952.hdf5"
}
]
} 