Jobsub ID 297919.93@dunegpschedd02.fnal.gov
| Jobsub ID | 297919.93@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:54:25 |
| Site | UK_Imperial |
| Entry | DUNE_T2_UK_London_IC_ceprod01 |
| Last heartbeat | 2026-02-04 01:41:58 |
| From worker node | Hostname | bf1770092109.novalocal |
| cpuinfo | AMD EPYC-Genoa Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:31:19 |
| Input files | vd-protodune:np02vd_raw_run042421_0058_df-s02-d0_dw_0_20260203T140226.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7525s) |
| CPU time | 1h (4183s = 55%) |
| Max RSS bytes | 7793000448 (7431 MiB) |
| Outputting started | 2026-02-04 01:36:49 |
| Output files | |
| Finished | 2026-02-04 01:41:58 |
| Saved logs | justin-logs:297919.93-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
t exception in looking up space point ptr... 0x4e616c30, 0x4e616aa0
Caught exception in looking up space point ptr... 0x4e616aa0, 0x4e616c30
Caught exception in looking up space point ptr... 0x4e616c30, 0x4e616910
Caught exception in looking up space point ptr... 0x4e616910, 0x4e616c30
Caught exception in looking up space point ptr... 0x4e616c30, 0x4e617130
Caught exception in looking up space point ptr... 0x4e617130, 0x4e616c30
Caught exception in looking up space point ptr... 0x273be8b0, 0x26a5b2a0
Caught exception in looking up space point ptr... 0x26a5b2a0, 0x273be8b0
Caught exception in looking up space point ptr... 0x5b6e7c50, 0x5c978d00
Caught exception in looking up space point ptr... 0x5c978d00, 0x5b6e7c50
Caught exception in looking up space point ptr... 0xd83f680, 0xd83f1c0
Caught exception in looking up space point ptr... 0xd83f1c0, 0xd83f2f0
Caught exception in looking up space point ptr... 0xd83f2f0, 0xd83fda0
Caught exception in looking up space point ptr... 0xd83fda0, 0xd83f680
Caught exception in looking up space point ptr... 0xd81c8a0, 0xd81ca30
Caught exception in looking up space point ptr... 0xd81ca30, 0xd81cbc0
Caught exception in looking up space point ptr... 0x555e3e90, 0x555e4340
Caught exception in looking up space point ptr... 0x555e4340, 0x555e4660
Caught exception in looking up space point ptr... 0x5b712fe0, 0x4cb761f0
Caught exception in looking up space point ptr... 0x4cb761f0, 0x4cb76380
Caught exception in looking up space point ptr... 0xadc45590, 0xd49548b0
Caught exception in looking up space point ptr... 0xd49548b0, 0x42e42090
Caught exception in looking up space point ptr... 0x4f69ec20, 0x4136d840
Caught exception in looking up space point ptr... 0x4136d840, 0x4f69ec20
Caught exception in looking up space point ptr... 0x3932aa10, 0x263192d0
Caught exception in looking up space point ptr... 0x263192d0, 0x3932aa10
Caught exception in looking up space point ptr... 0x4e618bc0, 0x4e618d50
Caught exception in looking up space point ptr... 0x4e618d50, 0x4e618bc0
Caught exception in looking up space point ptr... 0x4e618bc0, 0x4e618a30
Caught exception in looking up space point ptr... 0x4e618a30, 0x4e618bc0
Caught exception in looking up space point ptr... 0x4e618bc0, 0x4e6188a0
Caught exception in looking up space point ptr... 0x4e6188a0, 0x4e618bc0
Caught exception in looking up space point ptr... 0x4e618bc0, 0x4e619070
Caught exception in looking up space point ptr... 0x4e619070, 0x4e618bc0
Caught exception in looking up space point ptr... 0x5eb95d00, 0x388c4ad0
Caught exception in looking up space point ptr... 0x388c4ad0, 0x2ee483a0
Caught exception in looking up space point ptr... 0x4cb71e10, 0x48dc2df0
Caught exception in looking up space point ptr... 0x48dc2df0, 0x4cb71e10
Caught exception in looking up space point ptr... 0xd816e00, 0xd816c20
Caught exception in looking up space point ptr... 0xd816c20, 0xd816e00
Caught exception in looking up space point ptr... 0x26a2bc60, 0x26a2bad0
Caught exception in looking up space point ptr... 0x26a2bad0, 0x4e25b9a0
Caught exception in looking up space point ptr... 0xd7f6250, 0xd7f6160
Caught exception in looking up space point ptr... 0xd7f6160, 0xd7f6020
Caught exception in looking up space point ptr... 0x324aa6b0, 0x324aa520
Caught exception in looking up space point ptr... 0x324aa520, 0x324aa6b0
Caught exception in looking up space point ptr... 0x15a885c0, 0x1503a3e0
Caught exception in looking up space point ptr... 0x1503a3e0, 0x15a885c0
Caught exception in looking up space point ptr... 0xc937020, 0xc934680
Caught exception in looking up space point ptr... 0xc934680, 0xc937020
Caught exception in looking up space point ptr... 0xc937020, 0x4738b9d0
Caught exception in looking up space point ptr... 0x4738b9d0, 0xc937020
Caught exception in looking up space point ptr... 0x5f8cc3c0, 0x5f8cc270
Caught exception in looking up space point ptr... 0x5f8cc270, 0x5f8cc3c0
Caught exception in looking up space point ptr... 0x11da15a0, 0x9b92510
Caught exception in looking up space point ptr... 0x9b92510, 0x11da15a0
Caught exception in looking up space point ptr... 0xd8540b0, 0xd7e9260
Caught exception in looking up space point ptr... 0xd7e9260, 0xd8540b0
Caught exception in looking up space point ptr... 0xd8540b0, 0xd849810
Caught exception in looking up space point ptr... 0xd849810, 0xd8540b0
Caught exception in looking up space point ptr... 0x27b73210, 0x27b72ef0
Caught exception in looking up space point ptr... 0x27b72ef0, 0x27b73210
Caught exception in looking up space point ptr... 0xc89b300, 0xc8adfa0
Caught exception in looking up space point ptr... 0xc8adfa0, 0xc89d7c0
Caught exception in looking up space point ptr... 0xd8159b0, 0xd815cd0
Caught exception in looking up space point ptr... 0xd815cd0, 0xd8157d0
++++>>>> total num hits: 619106, num free: 589597
04-Feb-2026 01:36:30 GMT Closed output file "np02vd_raw_run042421_0058_df-s02-d0_dw_0_20260203T140226_reco_stage0_20260204T013630_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 177.304 274.789 788.867 226.859 130.643 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.4812e-05 0.000131006 0.00040581 9.6525e-05 8.43746e-05 27
produce:tpcrawdecoder:PDVDTPCReader 84.826 116.872 165.289 111.451 20.4293 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.600979 0.796923 1.17601 0.797407 0.142691 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0180232 0.035731 0.288976 0.021973 0.0511054 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0867174 0.103122 0.134595 0.102528 0.0117456 27
produce:beamevent:BeamEvent 0.000101643 0.000292521 0.00239004 0.000208373 0.000421716 27
produce:pdvddaphne:DAPHNEReaderPDVD 11.4029 15.43 20.9829 15.209 2.41116 27
produce:ophit:OpHitFinder 0.0349897 0.0472262 0.0597428 0.0480449 0.00742926 27
produce:wclsdatavd:WireCellToolkit 61.8875 66.4473 77.9446 64.2144 4.82811 27
produce:gaushit:GausHitFinder 0.580855 2.15177 13.0185 0.921505 3.20574 27
produce:nhitsfilter:NumberOfHitsFilter 0.000151367 0.000464521 0.00429267 0.000258177 0.000781589 27
produce:reco3d:SpacePointSolver 5.69738 18.3655 79.2773 11.978 17.3022 27
produce:hitpdune:DisambigFromSpacePoints 0.0541481 0.605995 3.35928 0.0951225 1.03273 27
produce:cluster3d:Cluster3D 0.778198 47.8088 486.121 1.78758 109.874 27
[art]:TriggerResults:TriggerResultInserter 1.934e-05 4.21522e-05 0.000215694 2.8363e-05 4.28567e-05 27
end_path:out1:RootOutput 3.465e-06 5.90285e-06 1.7937e-05 5.298e-06 2.82416e-06 27
end_path:out1:RootOutput(write) 3.71499 6.06323 18.6182 4.35719 3.71583 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 10030.8 MB
Peak resident set size usage (VmHWM): 7793 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0058_df-s02-d0_dw_0_20260203T140226_reco_stage0_20260204T013630_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0058_df-s02-d0_dw_0_20260203T140226_reco_stage0_20260204T013630_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0058_df-s02-d0_dw_0_20260203T140226_reco_stage0_20260204T013630_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161494.0,
"core.end_time": 1770168992.0,
"core.events": [
9456,
9462,
9468,
9474,
9480,
9486,
9492,
9498,
9504,
9510,
9516,
9522,
9528,
9534,
9540,
9546,
9552,
9558,
9564,
9570,
9576,
9582,
9588,
9594,
9600,
9606,
9612
],
"core.event_count": 27,
"core.first_event_number": 9456,
"core.last_event_number": 9612,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0058_df-s02-d0_dw_0_20260203T140226.hdf5"
}
]
} 