Jobsub ID 298111.1@dunegpschedd02.fnal.gov
| Jobsub ID | 298111.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-04 04:14:38 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce02 |
| Last heartbeat | 2026-02-04 07:22:56 |
| From worker node | Hostname | wn2208251.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7513 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 04:15:13 |
| Input files | vd-protodune:np02vd_raw_run042422_0116_df-s04-d1_dw_0_20260203T161728.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11072s) |
| CPU time | 1h (4566s = 41%) |
| Max RSS bytes | 12655587328 (12069 MiB) |
| Outputting started | 2026-02-04 07:19:49 |
| Output files | |
| Finished | 2026-02-04 07:22:56 |
| Saved logs | justin-logs:298111.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
nt ptr... 0x944fbe30, 0xcbd03230
Caught exception in looking up space point ptr... 0x2b680560, 0x944fbe30
Caught exception in looking up space point ptr... 0x1bf093c0, 0x1bf09520
Caught exception in looking up space point ptr... 0x1bf09520, 0x1bf093c0
Caught exception in looking up space point ptr... 0x14ff3a40, 0x14ff3b40
Caught exception in looking up space point ptr... 0x14ff3b40, 0x8b88ed90
Caught exception in looking up space point ptr... 0x12b65f980, 0x1a651d50
Caught exception in looking up space point ptr... 0x2b664e90, 0x12b65f980
Caught exception in looking up space point ptr... 0x8b8831b0, 0x8b8832b0
Caught exception in looking up space point ptr... 0x8b8832b0, 0x8b87e060
Caught exception in looking up space point ptr... 0x526331e0, 0x52633050
Caught exception in looking up space point ptr... 0x52633050, 0x52617f40
Caught exception in looking up space point ptr... 0x383c5090, 0x2a4256a0
Caught exception in looking up space point ptr... 0x2a4256a0, 0x383c5090
Caught exception in looking up space point ptr... 0x121bba1a0, 0xcaf7ddf0
Caught exception in looking up space point ptr... 0xcaf7ddf0, 0xcaf7dba0
Caught exception in looking up space point ptr... 0x120ed0340, 0x120ed0540
Caught exception in looking up space point ptr... 0x120ed0540, 0x120ed0340
Caught exception in looking up space point ptr... 0x9fc6c00, 0x9fc6370
Caught exception in looking up space point ptr... 0x9fc6370, 0x1256535b0
Caught exception in looking up space point ptr... 0x1256535b0, 0x125653880
Caught exception in looking up space point ptr... 0x125653880, 0x9fc6c00
Caught exception in looking up space point ptr... 0x4f2f8220, 0x4f2f80d0
Caught exception in looking up space point ptr... 0x4f2f80d0, 0x4f2f95f0
Caught exception in looking up space point ptr... 0xe1b3650, 0x1277ca6e0
Caught exception in looking up space point ptr... 0x1277ca6e0, 0x2b681cd0
Caught exception in looking up space point ptr... 0x365ca230, 0x365caac0
Caught exception in looking up space point ptr... 0x365caac0, 0xb95cf40
Caught exception in looking up space point ptr... 0xb95cf40, 0xb95cdc0
Caught exception in looking up space point ptr... 0x365cac10, 0x365ca230
Caught exception in looking up space point ptr... 0x10e4bc70, 0x10e51060
Caught exception in looking up space point ptr... 0x10e51060, 0x10e51360
Caught exception in looking up space point ptr... 0x16ab4c600, 0x16ab4bcc0
Caught exception in looking up space point ptr... 0x16ab4bcc0, 0x16ab4c600
Caught exception in looking up space point ptr... 0x13c8341b0, 0x13c83a5c0
Caught exception in looking up space point ptr... 0x13c83a5c0, 0x13c836260
Caught exception in looking up space point ptr... 0x10e56c60, 0x10e56ad0
Caught exception in looking up space point ptr... 0x10e56ad0, 0x10e56df0
Caught exception in looking up space point ptr... 0x11683d80, 0x11684010
Caught exception in looking up space point ptr... 0x386c1c80, 0x11683d80
Caught exception in looking up space point ptr... 0x10e531b0, 0x10e537a0
Caught exception in looking up space point ptr... 0x10e537a0, 0x10e50490
Caught exception in looking up space point ptr... 0x5ac1e760, 0x5ac17800
Caught exception in looking up space point ptr... 0x5ac17800, 0x5ac1e760
Caught exception in looking up space point ptr... 0x5ac1e760, 0x5ac1f430
Caught exception in looking up space point ptr... 0x5ac1f430, 0x5ac1e760
Caught exception in looking up space point ptr... 0x8b6e0f40, 0x8b6e1d70
Caught exception in looking up space point ptr... 0x8b6e1d70, 0x8b6e32c0
Caught exception in looking up space point ptr... 0xef3532b0, 0xef3551a0
Caught exception in looking up space point ptr... 0xef3551a0, 0xef352cc0
Caught exception in looking up space point ptr... 0xef352cc0, 0xef3550a0
Caught exception in looking up space point ptr... 0x4f2f3230, 0x4f2f3330
Caught exception in looking up space point ptr... 0x4f2f3330, 0x4f2f3230
Caught exception in looking up space point ptr... 0xef35c5f0, 0xef354000
Caught exception in looking up space point ptr... 0xef354000, 0xef35c5f0
Caught exception in looking up space point ptr... 0xef35c5f0, 0xef356240
Caught exception in looking up space point ptr... 0xef356240, 0xef35c5f0
Caught exception in looking up space point ptr... 0x110b28bd0, 0x9bded40
Caught exception in looking up space point ptr... 0x9bded40, 0x125dc4070
Caught exception in looking up space point ptr... 0x18985e420, 0x18985e550
Caught exception in looking up space point ptr... 0x18985e550, 0x18985f3e0
Caught exception in looking up space point ptr... 0x2aa7af90, 0x8b81c300
Caught exception in looking up space point ptr... 0x8b81c300, 0x2aa88300
Caught exception in looking up space point ptr... 0x18985b130, 0x189859150
Caught exception in looking up space point ptr... 0x189859150, 0x18985b130
++++>>>> total num hits: 76874, num free: 73828
04-Feb-2026 07:19:37 GMT Closed output file "np02vd_raw_run042422_0116_df-s04-d1_dw_0_20260203T161728_reco_stage0_20260204T071937_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 266.92 391.085 1363.51 338.601 223.169 28
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.9181e-05 0.000129684 0.000350949 0.000119895 5.94891e-05 28
produce:tpcrawdecoder:PDVDTPCReader 124.895 209.505 249.587 216.048 32.8695 28
produce:triggerrawdecoder:PDVDTriggerReader4 0.842887 1.14616 1.76659 1.04851 0.23462 28
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0220136 0.0364329 0.0878309 0.0287209 0.0196657 28
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.107352 0.113802 0.147958 0.11008 0.00949368 28
produce:beamevent:BeamEvent 8.3447e-05 0.000229979 0.00167836 0.000177318 0.000284767 28
produce:pdvddaphne:DAPHNEReaderPDVD 16.8307 25.8952 34.5057 26.3253 4.29525 28
produce:ophit:OpHitFinder 0.0266515 0.0421776 0.0553947 0.0428868 0.0068051 28
produce:wclsdatavd:WireCellToolkit 57.5358 71.7666 106.695 71.0729 11.8522 28
produce:gaushit:GausHitFinder 0.511675 2.15457 13.3691 1.09351 3.12724 28
produce:nhitsfilter:NumberOfHitsFilter 0.00017558 0.000507824 0.00287868 0.000310053 0.000596763 28
[art]:TriggerResults:TriggerResultInserter 1.4768e-05 4.69855e-05 0.000205446 4.00755e-05 3.77991e-05 28
end_path:out1:RootOutput 8.206e-06 1.22445e-05 3.5436e-05 1.0685e-05 5.59769e-06 28
end_path:out1:RootOutput(write) 3.04982 5.83735 28.1834 4.08229 5.59185 28
produce:reco3d:SpacePointSolver 5.23196 19.8534 158.003 8.92742 35.8695 26
produce:hitpdune:DisambigFromSpacePoints 0.0407648 0.665412 8.31036 0.0954836 1.97665 26
produce:cluster3d:Cluster3D 0.673352 59.7437 907.637 2.00291 204.002 26
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 14644.8 MB
Peak resident set size usage (VmHWM): 12655.6 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0116_df-s04-d1_dw_0_20260203T161728_reco_stage0_20260204T071937_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0116_df-s04-d1_dw_0_20260203T161728_reco_stage0_20260204T071937_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0116_df-s04-d1_dw_0_20260203T161728_reco_stage0_20260204T071937_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770178528.0,
"core.end_time": 1770189579.0,
"core.events": [
18809,
18815,
18821,
18827,
18833,
18839,
18845,
18851,
18857,
18863,
18869,
18875,
18881,
18887,
18893,
18899,
18905,
18911,
18917,
18923,
18929,
18935,
18941,
18947,
18953,
18959,
18965,
18971
],
"core.event_count": 28,
"core.first_event_number": 18809,
"core.last_event_number": 18971,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0116_df-s04-d1_dw_0_20260203T161728.hdf5"
}
]
} 