Jobsub ID 303646.56@dunegpschedd01.fnal.gov
| Jobsub ID | 303646.56@dunegpschedd01.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:44:24 |
| Site | UK_Imperial |
| Entry | DUNE_T2_UK_London_IC_ceprod01 |
| Last heartbeat | 2026-02-04 00:56:13 |
| From worker node | Hostname | wl06.grid.hep.ph.ic.ac.uk |
| cpuinfo | AMD EPYC 7742 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:45:58 |
| Input files | vd-protodune:np02vd_raw_run042422_0097_df-s03-d0_dw_0_20260203T160712.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7587s) |
| CPU time | 1h (6659s = 87%) |
| Max RSS bytes | 4581675008 (4369 MiB) |
| Outputting started | 2026-02-04 00:52:36 |
| Output files | |
| Finished | 2026-02-04 00:56:13 |
| Saved logs | justin-logs:303646.56-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
a7fd00
Caught exception in looking up space point ptr... 0x51ea35f0, 0x51e90ea0
Caught exception in looking up space point ptr... 0x2fcfbde0, 0x2fd09ee0
Caught exception in looking up space point ptr... 0x2fcee320, 0x2fcfbde0
Caught exception in looking up space point ptr... 0x496064b0, 0x4a536720
Caught exception in looking up space point ptr... 0x4a244e90, 0x496064b0
Caught exception in looking up space point ptr... 0x5ae51450, 0x1129fb60
Caught exception in looking up space point ptr... 0x1129fb60, 0x5ae51450
Caught exception in looking up space point ptr... 0x465e49e0, 0x372b1880
Caught exception in looking up space point ptr... 0x465f2f90, 0x465e49e0
Caught exception in looking up space point ptr... 0x82c92ea0, 0x3661add0
Caught exception in looking up space point ptr... 0x3661add0, 0x6157ab20
Caught exception in looking up space point ptr... 0x614cfd80, 0x42711f90
Caught exception in looking up space point ptr... 0x42711f90, 0x3465dcc0
Caught exception in looking up space point ptr... 0x522ec3a0, 0x522fd1f0
Caught exception in looking up space point ptr... 0xfd8f350, 0x522ec3a0
Caught exception in looking up space point ptr... 0x46a05500, 0x469f5330
Caught exception in looking up space point ptr... 0x46a15540, 0x46a05500
Caught exception in looking up space point ptr... 0x61ce6900, 0x34a38810
Caught exception in looking up space point ptr... 0x61ce6a90, 0x61ce6900
Caught exception in looking up space point ptr... 0x30888fc0, 0x30888ee0
Caught exception in looking up space point ptr... 0x30888ee0, 0x308771b0
Caught exception in looking up space point ptr... 0x601c2570, 0x426999a0
Caught exception in looking up space point ptr... 0x4633dd90, 0x601c2570
Caught exception in looking up space point ptr... 0x10136d90, 0x5d7d2c00
Caught exception in looking up space point ptr... 0x10136e70, 0x10136d90
Caught exception in looking up space point ptr... 0x2abe16e0, 0x2abd1510
Caught exception in looking up space point ptr... 0x57781750, 0x2abe16e0
Caught exception in looking up space point ptr... 0x425b9a80, 0x514204e0
Caught exception in looking up space point ptr... 0x514204e0, 0x5140eba0
Caught exception in looking up space point ptr... 0x633dae80, 0x97c0220
Caught exception in looking up space point ptr... 0x97c0220, 0x97ae750
Caught exception in looking up space point ptr... 0x49892f60, 0x32ca7e30
Caught exception in looking up space point ptr... 0x5b313b90, 0x49892f60
Caught exception in looking up space point ptr... 0x65f13d0, 0x65dfdb0
Caught exception in looking up space point ptr... 0x65dfdb0, 0x326e37b0
Caught exception in looking up space point ptr... 0x2ea0dd90, 0x345b5e30
Caught exception in looking up space point ptr... 0x345b5e30, 0x2ea0dd90
Caught exception in looking up space point ptr... 0x610d6120, 0x8420ef0
Caught exception in looking up space point ptr... 0x8420ef0, 0x610d6120
Caught exception in looking up space point ptr... 0x8a44200, 0x833ff10
Caught exception in looking up space point ptr... 0x833ff10, 0x8a44200
Caught exception in looking up space point ptr... 0x4a1b5bb0, 0x6182eb20
Caught exception in looking up space point ptr... 0x6182eb20, 0x14263ce0
Caught exception in looking up space point ptr... 0x49730ea0, 0x5af95380
Caught exception in looking up space point ptr... 0x5af95380, 0x51dc8df0
Caught exception in looking up space point ptr... 0x51dc8df0, 0x5d03a1e0
Caught exception in looking up space point ptr... 0x5d03a1e0, 0x282a4ba0
Caught exception in looking up space point ptr... 0x4ea1b160, 0x1471f380
Caught exception in looking up space point ptr... 0x1471f380, 0x4ea1b160
Caught exception in looking up space point ptr... 0x33f86620, 0x50999370
Caught exception in looking up space point ptr... 0x33f86730, 0x33f86620
Caught exception in looking up space point ptr... 0x5099ab60, 0x158d10a0
Caught exception in looking up space point ptr... 0x158d10a0, 0x5099ab60
Caught exception in looking up space point ptr... 0x5099ab60, 0x38106b80
Caught exception in looking up space point ptr... 0x38106b80, 0x5099ab60
Caught exception in looking up space point ptr... 0x31ade5f0, 0x35953120
Caught exception in looking up space point ptr... 0x35953120, 0x31ade5f0
Caught exception in looking up space point ptr... 0x49943d10, 0x51726130
Caught exception in looking up space point ptr... 0x51726130, 0x49943d10
Caught exception in looking up space point ptr... 0x50d0d6c0, 0x57bb7400
Caught exception in looking up space point ptr... 0x57bb7400, 0x61159c40
Caught exception in looking up space point ptr... 0x2eebd220, 0x145779f0
Caught exception in looking up space point ptr... 0x145779f0, 0x728f0650
Caught exception in looking up space point ptr... 0x54f87540, 0x9eac2f0
Caught exception in looking up space point ptr... 0x9eac2f0, 0x54f87540
++++>>>> total num hits: 301903, num free: 295829
04-Feb-2026 00:52:14 GMT Closed output file "np02vd_raw_run042422_0097_df-s03-d0_dw_0_20260203T160712_reco_stage0_20260204T005214_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 173.541 273.347 589.577 255.112 110.203 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.7843e-05 0.000144704 0.000281528 0.000120854 5.16073e-05 27
produce:tpcrawdecoder:PDVDTPCReader 11.3667 12.5142 13.9644 12.4686 0.587405 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.478372 0.503738 0.523615 0.506021 0.0106085 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0163557 0.0168367 0.0195629 0.0167908 0.00056457 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.080868 0.0871657 0.0996019 0.0826357 0.00772622 27
produce:beamevent:BeamEvent 8.7162e-05 0.000219629 0.00123213 0.000168795 0.000205008 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.61264 5.6514 19.395 5.33699 2.74021 27
produce:ophit:OpHitFinder 0.0413435 0.0581679 0.0734992 0.0597224 0.00761776 27
produce:wclsdatavd:WireCellToolkit 92.2966 127.29 138.692 131.565 12.7847 27
produce:gaushit:GausHitFinder 1.01587 2.83745 7.18629 2.52672 1.26375 27
produce:nhitsfilter:NumberOfHitsFilter 0.0003093 0.000591941 0.00101056 0.000570118 0.000171085 27
produce:reco3d:SpacePointSolver 8.1612 14.535 29.0188 12.8919 5.93206 27
produce:hitpdune:DisambigFromSpacePoints 0.155156 0.494824 1.76072 0.387834 0.352459 27
produce:cluster3d:Cluster3D 2.70988 98.488 384.98 78.8623 97.7935 27
[art]:TriggerResults:TriggerResultInserter 2.6251e-05 6.50724e-05 0.000248868 4.8221e-05 4.99522e-05 27
end_path:out1:RootOutput 5.37e-06 1.10674e-05 3.4511e-05 1.039e-05 5.47148e-06 27
end_path:out1:RootOutput(write) 7.56377 10.8195 20.5885 10.2952 3.12571 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6589.58 MB
Peak resident set size usage (VmHWM): 4581.68 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0097_df-s03-d0_dw_0_20260203T160712_reco_stage0_20260204T005214_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0097_df-s03-d0_dw_0_20260203T160712_reco_stage0_20260204T005214_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0097_df-s03-d0_dw_0_20260203T160712_reco_stage0_20260204T005214_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770158777.0,
"core.end_time": 1770166337.0,
"core.events": [
15728,
15734,
15740,
15746,
15752,
15758,
15764,
15770,
15776,
15782,
15788,
15794,
15800,
15806,
15812,
15818,
15824,
15830,
15836,
15842,
15848,
15854,
15860,
15866,
15872,
15878,
15884
],
"core.event_count": 27,
"core.first_event_number": 15728,
"core.last_event_number": 15884,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0097_df-s03-d0_dw_0_20260203T160712.hdf5"
}
]
} 