Jobsub ID 297921.159@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.159@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_QMUL |
| Entry | DUNE_UK_London_QMUL_arcce02 |
| Last heartbeat | 2026-02-04 03:27:29 |
| From worker node | Hostname | cn046.htc.esc.qmul |
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:56:34 |
| Input files | vd-protodune:np02vd_raw_run042433_0018_df-s04-d0_dw_0_20260203T184858.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12383s) |
| CPU time | 2h (9002s = 72%) |
| Max RSS bytes | 10914435072 (10408 MiB) |
| Outputting started | 2026-02-04 03:23:34 |
| Output files | |
| Finished | 2026-02-04 03:27:29 |
| Saved logs | justin-logs:297921.159-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
looking up space point ptr... 0x1664d3b0, 0x1664cca0
Caught exception in looking up space point ptr... 0x35a87c60, 0x30b7e170
Caught exception in looking up space point ptr... 0x30b7e170, 0x35a87c60
Caught exception in looking up space point ptr... 0xea7a640, 0xea7e980
Caught exception in looking up space point ptr... 0xea7e980, 0xea7eb00
Caught exception in looking up space point ptr... 0x36b04ae0, 0xdac285e0
Caught exception in looking up space point ptr... 0xdac285e0, 0x3c0f9d70
Caught exception in looking up space point ptr... 0x1672c9f0, 0x16738a80
Caught exception in looking up space point ptr... 0x16738a80, 0x16738950
Caught exception in looking up space point ptr... 0x16738950, 0x16738bb0
Caught exception in looking up space point ptr... 0x2c5a8ce0, 0x2c5a8860
Caught exception in looking up space point ptr... 0x2c5a8860, 0x2c5a8ce0
Caught exception in looking up space point ptr... 0xe5b33cf0, 0x43d71b30
Caught exception in looking up space point ptr... 0x48335ce0, 0xe5b33cf0
Caught exception in looking up space point ptr... 0x4388ec90, 0x58f89520
Caught exception in looking up space point ptr... 0x58f89520, 0x4cf8e290
Caught exception in looking up space point ptr... 0x4cf8e290, 0x2bedc960
Caught exception in looking up space point ptr... 0x167518c0, 0x16751790
Caught exception in looking up space point ptr... 0x16751790, 0x167518c0
Caught exception in looking up space point ptr... 0x2e61daa0, 0x16785c60
Caught exception in looking up space point ptr... 0x1678a5b0, 0x2e61daa0
Caught exception in looking up space point ptr... 0x4a99bdb0, 0x7c14fef0
Caught exception in looking up space point ptr... 0x7c14fef0, 0x4a99bdb0
Caught exception in looking up space point ptr... 0x3dbbcde0, 0x3dbbbde0
Caught exception in looking up space point ptr... 0x3dbb9da0, 0x3dbbcde0
Caught exception in looking up space point ptr... 0x2bf09900, 0x4e5b0770
Caught exception in looking up space point ptr... 0x4e5b0770, 0x2bf0a370
Caught exception in looking up space point ptr... 0x3dc68230, 0x3dc680e0
Caught exception in looking up space point ptr... 0x3dc680e0, 0x3dc68230
Caught exception in looking up space point ptr... 0x8529fcf0, 0x9393680
Caught exception in looking up space point ptr... 0x9393680, 0x9dbc45c0
Caught exception in looking up space point ptr... 0x2bec19b0, 0x2bec2a50
Caught exception in looking up space point ptr... 0x2bec2a50, 0x2bec19b0
Caught exception in looking up space point ptr... 0x1667c7b0, 0x1666f420
Caught exception in looking up space point ptr... 0x1666f420, 0x1667c620
Caught exception in looking up space point ptr... 0x4388cf80, 0x822ea910
Caught exception in looking up space point ptr... 0x822ea910, 0x2bed4740
Caught exception in looking up space point ptr... 0x35c5de90, 0x35c53440
Caught exception in looking up space point ptr... 0x35c53440, 0x35c532a0
Caught exception in looking up space point ptr... 0x3dd4c830, 0x3dd4b670
Caught exception in looking up space point ptr... 0x3dd4b670, 0x3dd4fc20
Caught exception in looking up space point ptr... 0x310ee590, 0x310ee440
Caught exception in looking up space point ptr... 0x310ee440, 0x310ee830
Caught exception in looking up space point ptr... 0x3f030430, 0x3f034150
Caught exception in looking up space point ptr... 0x3f034150, 0x3f034bf0
Caught exception in looking up space point ptr... 0x4e981dc0, 0x6b4fc0b0
Caught exception in looking up space point ptr... 0x6b4fc0b0, 0x4e981dc0
Caught exception in looking up space point ptr... 0x1b077ba0, 0x9265c40
Caught exception in looking up space point ptr... 0x9265c40, 0x926a1a0
Caught exception in looking up space point ptr... 0x69c793e0, 0x69c79550
Caught exception in looking up space point ptr... 0x69c79550, 0x69c793e0
Caught exception in looking up space point ptr... 0x3dbc8f60, 0x3dbc9b20
Caught exception in looking up space point ptr... 0x3dbc9b20, 0x3dbc0570
Caught exception in looking up space point ptr... 0x394737b0, 0x86ebe3a0
Caught exception in looking up space point ptr... 0x86ebe3a0, 0x394737b0
Caught exception in looking up space point ptr... 0x38419890, 0x38419760
Caught exception in looking up space point ptr... 0x38419760, 0x38419890
Caught exception in looking up space point ptr... 0x310ed650, 0x310f9710
Caught exception in looking up space point ptr... 0x310f9710, 0x310ed650
Caught exception in looking up space point ptr... 0x17622b90, 0x1761ee00
Caught exception in looking up space point ptr... 0x17628530, 0x17622b90
Caught exception in looking up space point ptr... 0x181c8970, 0x181c7fe0
Caught exception in looking up space point ptr... 0x181c7fe0, 0x15169bd0
Caught exception in looking up space point ptr... 0x16f7e1e0, 0x16f7dec0
Caught exception in looking up space point ptr... 0x16f7dec0, 0x16f7e1e0
Caught exception in looking up space point ptr... 0x2dd52270, 0x2dd50c30
Caught exception in looking up space point ptr... 0x2dd50c30, 0x2dd51db0
++++>>>> total num hits: 148860, num free: 142637
04-Feb-2026 03:22:49 GMT Closed output file "np02vd_raw_run042433_0018_df-s04-d0_dw_0_20260203T184858_reco_stage0_20260204T032249_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 342.376 646.698 1686.44 403.407 444.783 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.4278e-05 0.000136801 0.00032796 0.000119216 5.58605e-05 19
produce:tpcrawdecoder:PDVDTPCReader 112.593 169.089 238.866 169.02 31.8397 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.602769 1.04856 4.35424 0.840548 0.797229 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0166631 0.0338794 0.157191 0.0210023 0.0353735 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0165002 0.0188208 0.0325858 0.0169434 0.00477171 19
produce:beamevent:BeamEvent 0.000137421 0.000225578 0.00123668 0.000163228 0.000239641 19
produce:pdvddaphne:DAPHNEReaderPDVD 14.0326 18.5755 22.3458 18.5267 2.35796 19
produce:ophit:OpHitFinder 0.0361846 0.0547815 0.0721753 0.0610542 0.0129389 19
produce:wclsdatavd:WireCellToolkit 148.378 181.572 222.193 173.21 24.9898 19
produce:gaushit:GausHitFinder 1.50532 4.6942 16.5694 2.31591 4.60517 19
produce:nhitsfilter:NumberOfHitsFilter 0.000535644 0.00104781 0.00198926 0.000841776 0.000492948 19
produce:reco3d:SpacePointSolver 14.444 38.1452 100.292 24.5181 30.0555 19
produce:hitpdune:DisambigFromSpacePoints 0.210145 1.52274 6.42984 0.406456 2.11634 19
produce:cluster3d:Cluster3D 2.15741 221.966 1167.78 3.6483 394.487 19
[art]:TriggerResults:TriggerResultInserter 2.9775e-05 4.79661e-05 0.000121283 4.2381e-05 1.97234e-05 19
end_path:out1:RootOutput 5.857e-06 1.09649e-05 2.7403e-05 1.0215e-05 4.81156e-06 19
end_path:out1:RootOutput(write) 5.32091 9.89761 23.45 6.80344 5.91067 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 13393.6 MB
Peak resident set size usage (VmHWM): 10914.4 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0018_df-s04-d0_dw_0_20260203T184858_reco_stage0_20260204T032249_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0018_df-s04-d0_dw_0_20260203T184858_reco_stage0_20260204T032249_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0018_df-s04-d0_dw_0_20260203T184858_reco_stage0_20260204T032249_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163004.0,
"core.end_time": 1770175373.0,
"core.events": [
2062,
2068,
2074,
2080,
2086,
2092,
2098,
2104,
2110,
2116,
2122,
2128,
2134,
2140,
2146,
2152,
2158,
2164,
2170
],
"core.event_count": 19,
"core.first_event_number": 2062,
"core.last_event_number": 2170,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0018_df-s04-d0_dw_0_20260203T184858.hdf5"
}
]
} 