Jobsub ID 303728.8@dunegpschedd01.fnal.gov
| Jobsub ID | 303728.8@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-04 01:20:30 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce01 |
| Last heartbeat | 2026-02-04 04:33:00 |
| From worker node | Hostname | wn2208251.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7513 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 01:21:16 |
| Input files | vd-protodune:np02vd_raw_run042421_0142_df-s02-d1_dw_0_20260203T144745.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11290s) |
| CPU time | 1h (5599s = 49%) |
| Max RSS bytes | 9875005440 (9417 MiB) |
| Outputting started | 2026-02-04 04:29:31 |
| Output files | |
| Finished | 2026-02-04 04:33:00 |
| Saved logs | justin-logs:303728.8-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Live HTCondor job logs |
Jobscript log (last 10,000 characters)
b7a10
Caught exception in looking up space point ptr... 0x2a0b7a10, 0xbe52160
Caught exception in looking up space point ptr... 0xbe52160, 0x319b65c0
Caught exception in looking up space point ptr... 0x319b65c0, 0x2cfb30f0
Caught exception in looking up space point ptr... 0x2cfb30f0, 0x6c9ce5c0
Caught exception in looking up space point ptr... 0x6c9ce5c0, 0xaeb6ecc0
Caught exception in looking up space point ptr... 0x8d66a3b0, 0x2428fd40
Caught exception in looking up space point ptr... 0x2428fd40, 0x452ba660
Caught exception in looking up space point ptr... 0x452ba660, 0x452ba7e0
Caught exception in looking up space point ptr... 0x452ba7e0, 0x452ba910
Caught exception in looking up space point ptr... 0x452ba910, 0x154bbd60
Caught exception in looking up space point ptr... 0x61d2d890, 0x2c66c410
Caught exception in looking up space point ptr... 0x2c66c410, 0x4be2f770
Caught exception in looking up space point ptr... 0x4be2f770, 0x1436eed0
Caught exception in looking up space point ptr... 0x29e1a430, 0x2cfb1030
Caught exception in looking up space point ptr... 0x4027c960, 0x29e1a430
Caught exception in looking up space point ptr... 0x30ec7460, 0xfee8a4c0
Caught exception in looking up space point ptr... 0xfee8a4c0, 0x30ec7460
Caught exception in looking up space point ptr... 0x319d6920, 0xf0b9faa0
Caught exception in looking up space point ptr... 0xf0b9faa0, 0xf0b9f080
Caught exception in looking up space point ptr... 0x5c75bac0, 0xc1c8dda0
Caught exception in looking up space point ptr... 0xc1c8dda0, 0x6ac8c0a0
Caught exception in looking up space point ptr... 0x452d5ed0, 0x3da90c20
Caught exception in looking up space point ptr... 0x3da90c20, 0x452d7350
Caught exception in looking up space point ptr... 0xbd38ee0, 0x404b8520
Caught exception in looking up space point ptr... 0x404b8520, 0xbd38ee0
Caught exception in looking up space point ptr... 0x232e3370, 0x6aba6700
Caught exception in looking up space point ptr... 0x6aba6700, 0x3468e530
Caught exception in looking up space point ptr... 0x6ac8b140, 0x4d10f060
Caught exception in looking up space point ptr... 0x4d10f060, 0x620afb10
Caught exception in looking up space point ptr... 0x405797e0, 0x29fa2c40
Caught exception in looking up space point ptr... 0x29fa2c40, 0x404df810
Caught exception in looking up space point ptr... 0x7475250, 0x7474e60
Caught exception in looking up space point ptr... 0x7474e60, 0x7475250
Caught exception in looking up space point ptr... 0x7a4c550, 0x7a4c3c0
Caught exception in looking up space point ptr... 0x7a4c3c0, 0x7a4c550
Caught exception in looking up space point ptr... 0x38780950, 0x6494d850
Caught exception in looking up space point ptr... 0x6494d850, 0x6494d620
Caught exception in looking up space point ptr... 0x362d3e90, 0x362d37f0
Caught exception in looking up space point ptr... 0x362d37f0, 0xc1aa98b0
Caught exception in looking up space point ptr... 0x4d33ecb0, 0x4d33eb50
Caught exception in looking up space point ptr... 0x4d33eb50, 0x4d33ecb0
Caught exception in looking up space point ptr... 0x414a0ad0, 0x414a16a0
Caught exception in looking up space point ptr... 0x30dde4d0, 0x414a13c0
Caught exception in looking up space point ptr... 0x414a13c0, 0x414a0da0
Caught exception in looking up space point ptr... 0x414a0da0, 0x414a0ad0
Caught exception in looking up space point ptr... 0x248a96a0, 0xca041ea0
Caught exception in looking up space point ptr... 0xca041ea0, 0x248a96a0
Caught exception in looking up space point ptr... 0x322a72f0, 0x13db39d0
Caught exception in looking up space point ptr... 0x13db39d0, 0x322a72f0
Caught exception in looking up space point ptr... 0x5b033bc0, 0x5b0338a0
Caught exception in looking up space point ptr... 0x5b0338a0, 0x5b033bc0
Caught exception in looking up space point ptr... 0x2311a250, 0x23119d20
Caught exception in looking up space point ptr... 0x23119d20, 0x2311a250
Caught exception in looking up space point ptr... 0x2af28580, 0x2af28080
Caught exception in looking up space point ptr... 0x2af28080, 0x2af28580
Caught exception in looking up space point ptr... 0x6aee1680, 0x13f82050
Caught exception in looking up space point ptr... 0x13f82050, 0x13f82960
Caught exception in looking up space point ptr... 0x6b07cd10, 0x2a0a0fb0
Caught exception in looking up space point ptr... 0x2a0a0fb0, 0x321faf10
Caught exception in looking up space point ptr... 0x321faf10, 0x2a0a0fb0
Caught exception in looking up space point ptr... 0x2a0a0fb0, 0x31312090
Caught exception in looking up space point ptr... 0xc75f8a50, 0x2a0a0fb0
Caught exception in looking up space point ptr... 0x2a0a0fb0, 0x6b07cd10
Caught exception in looking up space point ptr... 0x8d66a230, 0x8d66a100
Caught exception in looking up space point ptr... 0x8d66a100, 0x8d66a230
++++>>>> total num hits: 38141, num free: 36844
04-Feb-2026 04:29:19 GMT Closed output file "np02vd_raw_run042421_0142_df-s02-d1_dw_0_20260203T144745_reco_stage0_20260204T042919_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 227.303 414.016 1049.65 332.776 225.394 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.475e-05 0.000141983 0.000315443 0.000118422 6.13199e-05 27
produce:tpcrawdecoder:PDVDTPCReader 111.95 188.009 232.31 186.827 27.9856 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.788787 1.20457 3.70308 1.11728 0.526235 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0216943 0.0279692 0.0429228 0.0280722 0.00459276 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.107835 0.116011 0.142192 0.111096 0.0098116 27
produce:beamevent:BeamEvent 0.000111179 0.00022843 0.0011358 0.0001543 0.000256721 27
produce:pdvddaphne:DAPHNEReaderPDVD 14.1143 22.6486 28.106 23.2399 3.41575 27
produce:ophit:OpHitFinder 0.0291373 0.0424094 0.0501371 0.0428305 0.00458073 27
produce:wclsdatavd:WireCellToolkit 71.1649 81.7422 95.3043 82.5268 5.67729 27
produce:gaushit:GausHitFinder 0.564264 3.49356 18.3753 1.28747 4.99155 27
produce:nhitsfilter:NumberOfHitsFilter 0.000199846 0.000424836 0.00120407 0.000328377 0.000220846 27
produce:reco3d:SpacePointSolver 7.27546 22.8455 102.315 12.5204 24.3964 27
produce:hitpdune:DisambigFromSpacePoints 0.0489618 0.615777 3.59365 0.142074 1.03982 27
produce:cluster3d:Cluster3D 1.01236 85.5813 596.021 2.61596 180.965 27
[art]:TriggerResults:TriggerResultInserter 2.6359e-05 4.73379e-05 0.000119164 3.5937e-05 2.45141e-05 27
end_path:out1:RootOutput 4.017e-06 8.90156e-06 3.2682e-05 7.634e-06 5.66548e-06 27
end_path:out1:RootOutput(write) 3.5716 7.64413 28.1236 5.06183 6.36981 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 11824.8 MB
Peak resident set size usage (VmHWM): 9875.01 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0142_df-s02-d1_dw_0_20260203T144745_reco_stage0_20260204T042919_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0142_df-s02-d1_dw_0_20260203T144745_reco_stage0_20260204T042919_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0142_df-s02-d1_dw_0_20260203T144745_reco_stage0_20260204T042919_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770168089.0,
"core.end_time": 1770179361.0,
"core.events": [
23065,
23071,
23077,
23083,
23089,
23095,
23101,
23107,
23113,
23119,
23125,
23131,
23137,
23143,
23149,
23155,
23161,
23167,
23173,
23179,
23185,
23191,
23197,
23203,
23209,
23215,
23221
],
"core.event_count": 27,
"core.first_event_number": 23065,
"core.last_event_number": 23221,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0142_df-s02-d1_dw_0_20260203T144745.hdf5"
}
]
} 