Jobsub ID 298120.1@dunegpschedd02.fnal.gov
| Jobsub ID | 298120.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-04 05:00:40 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce01 |
| Last heartbeat | 2026-02-04 08:22:17 |
| From worker node | Hostname | wn2209251.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7513 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 05:02:02 |
| Input files | vd-protodune:np02vd_raw_run042421_0145_df-s03-d1_dw_0_20260203T144927.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11784s) |
| CPU time | 1h (4930s = 41%) |
| Max RSS bytes | 6436261888 (6138 MiB) |
| Outputting started | 2026-02-04 08:18:30 |
| Output files | |
| Finished | 2026-02-04 08:22:05 |
| Saved logs | justin-logs:298120.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
9ac0740
Caught exception in looking up space point ptr... 0x5cd45860, 0x5cd45760
Caught exception in looking up space point ptr... 0x518e72f0, 0x5cd45860
Caught exception in looking up space point ptr... 0x4ccff9f0, 0x14311060
Caught exception in looking up space point ptr... 0x14311060, 0xed6c9d0
Caught exception in looking up space point ptr... 0x3493c4a0, 0x11d6e9d0
Caught exception in looking up space point ptr... 0x11d6e9d0, 0x3493b2a0
Caught exception in looking up space point ptr... 0x3a311ab0, 0x3e11fae0
Caught exception in looking up space point ptr... 0x3e11fae0, 0xa2a21140
Caught exception in looking up space point ptr... 0x33f08940, 0x33f087b0
Caught exception in looking up space point ptr... 0x33f087b0, 0x33f08940
Caught exception in looking up space point ptr... 0x14965090, 0x14964210
Caught exception in looking up space point ptr... 0x14964210, 0x14963870
Caught exception in looking up space point ptr... 0x1313b650, 0x3fb5f000
Caught exception in looking up space point ptr... 0x3fb5f000, 0x1313b650
Caught exception in looking up space point ptr... 0x461d61b0, 0x404a4190
Caught exception in looking up space point ptr... 0x404a4190, 0x461d67f0
Caught exception in looking up space point ptr... 0x147fcdc0, 0x59810be0
Caught exception in looking up space point ptr... 0x59810be0, 0x147fcdc0
Caught exception in looking up space point ptr... 0x71d2fd0, 0x71d2f30
Caught exception in looking up space point ptr... 0x71d2f30, 0x71d2fd0
Caught exception in looking up space point ptr... 0x40dbeaf0, 0x4fb88090
Caught exception in looking up space point ptr... 0x4fb88090, 0x4fb878c0
Caught exception in looking up space point ptr... 0x36007a60, 0x2b85fe40
Caught exception in looking up space point ptr... 0x2b85fe40, 0x36007a60
Caught exception in looking up space point ptr... 0x5a84d9e0, 0x99cf7e0
Caught exception in looking up space point ptr... 0x99cf7e0, 0x5a84d9e0
Caught exception in looking up space point ptr... 0x5a84d9e0, 0x99cf650
Caught exception in looking up space point ptr... 0x99cf650, 0x5a84d9e0
Caught exception in looking up space point ptr... 0xeaa91d0, 0x35ff25c0
Caught exception in looking up space point ptr... 0x35ff25c0, 0x35ff2750
Caught exception in looking up space point ptr... 0x29282d00, 0x55b1ed40
Caught exception in looking up space point ptr... 0x55b1ed40, 0x4c1f3f30
Caught exception in looking up space point ptr... 0x39ffadf0, 0x39ffac60
Caught exception in looking up space point ptr... 0x39ffac60, 0x39ffadf0
Caught exception in looking up space point ptr... 0x2cd0edb0, 0x2cd0eee0
Caught exception in looking up space point ptr... 0x2cd0eee0, 0x2cd0ec80
Caught exception in looking up space point ptr... 0x29c70280, 0x451a8810
Caught exception in looking up space point ptr... 0x451a8810, 0x451a8970
Caught exception in looking up space point ptr... 0x37dfec40, 0x37e01b50
Caught exception in looking up space point ptr... 0x37e01b50, 0x37dfec40
Caught exception in looking up space point ptr... 0x37dfec40, 0x13126020
Caught exception in looking up space point ptr... 0x13126020, 0x37dfec40
Caught exception in looking up space point ptr... 0x297108e0, 0x297107b0
Caught exception in looking up space point ptr... 0x297107b0, 0x29710550
Caught exception in looking up space point ptr... 0x4ac86630, 0x4ac86780
Caught exception in looking up space point ptr... 0x4ac86780, 0x4ac864e0
Caught exception in looking up space point ptr... 0x87edc30, 0x87edd30
Caught exception in looking up space point ptr... 0x87edd30, 0x87edc30
Caught exception in looking up space point ptr... 0x16e7ee60, 0x87d39b0
Caught exception in looking up space point ptr... 0x87d39b0, 0x16e7ee60
Caught exception in looking up space point ptr... 0x18a32bf0, 0x18a36d30
Caught exception in looking up space point ptr... 0x18a36d30, 0x18a32bf0
Caught exception in looking up space point ptr... 0x3591d7d0, 0x3591d4b0
Caught exception in looking up space point ptr... 0x3591d4b0, 0x3591d360
Caught exception in looking up space point ptr... 0x5fe701a0, 0x5fe66a30
Caught exception in looking up space point ptr... 0x5fe66a30, 0x5fe701a0
Caught exception in looking up space point ptr... 0x2cced5f0, 0x2ccedbb0
Caught exception in looking up space point ptr... 0x2ccedbb0, 0x2cced3d0
Caught exception in looking up space point ptr... 0x2cced3d0, 0x2cced810
Caught exception in looking up space point ptr... 0x29287b70, 0x292877d0
Caught exception in looking up space point ptr... 0x292877d0, 0x29286780
Caught exception in looking up space point ptr... 0x559026c0, 0x3b1772f0
Caught exception in looking up space point ptr... 0x3b1772f0, 0x559026c0
Caught exception in looking up space point ptr... 0x4f896a30, 0x4f896b60
Caught exception in looking up space point ptr... 0x4f896b60, 0x4f896a30
++++>>>> total num hits: 130918, num free: 123258
04-Feb-2026 08:18:16 GMT Closed output file "np02vd_raw_run042421_0145_df-s03-d1_dw_0_20260203T144927_reco_stage0_20260204T081816_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 274.67 432.226 842.322 384.472 149.511 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.0441e-05 0.00015124 0.000311676 0.000119235 7.11621e-05 27
produce:tpcrawdecoder:PDVDTPCReader 136.79 229.134 266.018 230.036 30.5717 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.742566 1.17849 2.00561 1.0898 0.282074 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0218421 0.0326162 0.0758709 0.0260726 0.0157154 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.107916 0.117069 0.18096 0.110583 0.0164234 27
produce:beamevent:BeamEvent 0.000152938 0.000256086 0.00118665 0.000208463 0.000189832 27
produce:pdvddaphne:DAPHNEReaderPDVD 18.242 27.1152 33.6801 27.6152 3.587 27
produce:ophit:OpHitFinder 0.0389875 0.0463322 0.0578984 0.0458722 0.00556771 27
produce:wclsdatavd:WireCellToolkit 64.9436 81.2244 95.2741 81.1376 7.76904 27
produce:gaushit:GausHitFinder 0.890001 2.43678 10.2366 1.56857 2.23401 27
produce:nhitsfilter:NumberOfHitsFilter 0.000240783 0.000420855 0.000817398 0.000351321 0.000157545 27
produce:reco3d:SpacePointSolver 9.24911 17.9252 58.1075 15.1308 10.377 27
produce:hitpdune:DisambigFromSpacePoints 0.0727143 0.366006 1.8737 0.168261 0.45816 27
produce:cluster3d:Cluster3D 1.97034 65.6813 408.039 3.64945 122.829 27
[art]:TriggerResults:TriggerResultInserter 3.3282e-05 5.32781e-05 0.00011208 4.1879e-05 2.12338e-05 27
end_path:out1:RootOutput 3.787e-06 1.03377e-05 4.6628e-05 8.026e-06 9.35361e-06 27
end_path:out1:RootOutput(write) 3.53284 6.91944 16.9455 5.31467 3.76813 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 8557.82 MB
Peak resident set size usage (VmHWM): 6436.26 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0145_df-s03-d1_dw_0_20260203T144927_reco_stage0_20260204T081816_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0145_df-s03-d1_dw_0_20260203T144927_reco_stage0_20260204T081816_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0145_df-s03-d1_dw_0_20260203T144927_reco_stage0_20260204T081816_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770181334.0,
"core.end_time": 1770193098.0,
"core.events": [
23565,
23571,
23577,
23583,
23589,
23595,
23601,
23607,
23613,
23619,
23625,
23631,
23637,
23643,
23649,
23655,
23661,
23667,
23673,
23679,
23685,
23691,
23697,
23703,
23709,
23715,
23721
],
"core.event_count": 27,
"core.first_event_number": 23565,
"core.last_event_number": 23721,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0145_df-s03-d1_dw_0_20260203T144927.hdf5"
}
]
} 