Jobsub ID 303652.18@dunegpschedd01.fnal.gov
| Jobsub ID | 303652.18@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:50:26 |
| Site | UK_Imperial |
| Entry | DUNE_T2_UK_London_IC_ceprod02 |
| Last heartbeat | 2026-02-04 00:13:11 |
| From worker node | Hostname | bf1770081312.novalocal |
| cpuinfo | AMD EPYC-Genoa Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:26:57 |
| Input files | vd-protodune:np02vd_raw_run042433_0461_df-s02-d1_dw_0_20260203T213719.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 42m (2527s) |
| CPU time | 37m (2272s = 89%) |
| Max RSS bytes | 3435356160 (3276 MiB) |
| Outputting started | 2026-02-04 00:09:05 |
| Output files | |
| Finished | 2026-02-04 00:13:11 |
| Saved logs | justin-logs:303652.18-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
... 0x107203e0, 0x1071ff20
Caught exception in looking up space point ptr... 0x405180b0, 0x798e1730
Caught exception in looking up space point ptr... 0x798e1730, 0x16b860a0
Caught exception in looking up space point ptr... 0x685b4870, 0x685b3ab0
Caught exception in looking up space point ptr... 0x685b3ab0, 0x685b3490
Caught exception in looking up space point ptr... 0x388a7b20, 0x388a77b0
Caught exception in looking up space point ptr... 0x388a77b0, 0x388a7b20
Caught exception in looking up space point ptr... 0x6e790170, 0x6e7905a0
Caught exception in looking up space point ptr... 0x6e7905a0, 0x6e790170
Caught exception in looking up space point ptr... 0x6ad36e20, 0x6ad327e0
Caught exception in looking up space point ptr... 0x6ad357f0, 0x6ad36e20
Caught exception in looking up space point ptr... 0x11451120, 0x58a70780
Caught exception in looking up space point ptr... 0x58a70780, 0x11451120
Caught exception in looking up space point ptr... 0x6e731330, 0x6e6de080
Caught exception in looking up space point ptr... 0x6e6de080, 0x6e731330
Caught exception in looking up space point ptr... 0xc544640, 0xc570350
Caught exception in looking up space point ptr... 0xc570350, 0xc544640
Caught exception in looking up space point ptr... 0x84762fa0, 0x10d00e60
Caught exception in looking up space point ptr... 0x10d00e60, 0x10d00ff0
Caught exception in looking up space point ptr... 0x488a9360, 0x488a8ee0
Caught exception in looking up space point ptr... 0x488a8ee0, 0x488a9360
Caught exception in looking up space point ptr... 0x15350e30, 0x610c7800
Caught exception in looking up space point ptr... 0x610c7800, 0x15350e30
Caught exception in looking up space point ptr... 0x6e7775c0, 0x6e775ba0
Caught exception in looking up space point ptr... 0x6e775ba0, 0x6e775a10
Caught exception in looking up space point ptr... 0x125ecd40, 0x125ecf20
Caught exception in looking up space point ptr... 0x125ecf20, 0x125ecd40
Caught exception in looking up space point ptr... 0x60786ad0, 0x607867d0
Caught exception in looking up space point ptr... 0x607867d0, 0x60786ad0
Caught exception in looking up space point ptr... 0x10d14340, 0x2873f5f0
Caught exception in looking up space point ptr... 0x2873f5f0, 0x10d14340
Caught exception in looking up space point ptr... 0x4c2e1430, 0x4c2dcac0
Caught exception in looking up space point ptr... 0x4c2dcac0, 0x4c2e1430
Caught exception in looking up space point ptr... 0x6e75f7e0, 0x5c8a1c60
Caught exception in looking up space point ptr... 0x5c8a1c60, 0x6e75f7e0
Caught exception in looking up space point ptr... 0x6ad40a10, 0x53052230
Caught exception in looking up space point ptr... 0x53052230, 0x6ad40a10
Caught exception in looking up space point ptr... 0x6ad40a10, 0x53054d30
Caught exception in looking up space point ptr... 0x53054d30, 0x6ad40a10
Caught exception in looking up space point ptr... 0x6ba2a8b0, 0x6ba2a9f0
Caught exception in looking up space point ptr... 0x6ba2a9f0, 0x6ba2a8b0
Caught exception in looking up space point ptr... 0x6ba2a8b0, 0x61f1e390
Caught exception in looking up space point ptr... 0x61f1e390, 0x6ba2a8b0
Caught exception in looking up space point ptr... 0x2956f870, 0x2956f580
Caught exception in looking up space point ptr... 0x2956f580, 0x2956f870
Caught exception in looking up space point ptr... 0x4930aea0, 0x4930b230
Caught exception in looking up space point ptr... 0x4930b230, 0x4930b100
Caught exception in looking up space point ptr... 0x4930b100, 0x4930b360
Caught exception in looking up space point ptr... 0x6d6423e0, 0x6d642510
Caught exception in looking up space point ptr... 0x6d642510, 0x6d6423e0
Caught exception in looking up space point ptr... 0x29ad2180, 0x3ee8fb30
Caught exception in looking up space point ptr... 0x3ee8fb30, 0x29ad2180
Caught exception in looking up space point ptr... 0x62670fc0, 0x62673e40
Caught exception in looking up space point ptr... 0x62673e40, 0x62670fc0
Caught exception in looking up space point ptr... 0x62670fc0, 0x62671260
Caught exception in looking up space point ptr... 0x62671260, 0x62670fc0
Caught exception in looking up space point ptr... 0x10de1690, 0x10ddbab0
Caught exception in looking up space point ptr... 0x10dae4e0, 0x10de1690
Caught exception in looking up space point ptr... 0x3a0f24c0, 0x3a0f1d60
Caught exception in looking up space point ptr... 0x3a0f1d60, 0x3a0f24c0
Caught exception in looking up space point ptr... 0x685b33e0, 0x5e054b40
Caught exception in looking up space point ptr... 0x5e054b40, 0x685b33e0
Caught exception in looking up space point ptr... 0x48843470, 0x4883d610
Caught exception in looking up space point ptr... 0x4883d610, 0x48842be0
Caught exception in looking up space point ptr... 0x48842be0, 0x48843060
Caught exception in looking up space point ptr... 0x843899d0, 0x84382850
Caught exception in looking up space point ptr... 0x84382850, 0x8438a320
++++>>>> total num hits: 110456, num free: 106326
04-Feb-2026 00:08:56 GMT Closed output file "np02vd_raw_run042433_0461_df-s02-d1_dw_0_20260203T213719_reco_stage0_20260204T000856_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 123.086 129.698 139.74 129.706 4.63864 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.9859e-05 0.000179338 0.000873305 8.5899e-05 0.00019996 19
produce:tpcrawdecoder:PDVDTPCReader 16.1512 18.6255 22.0216 18.7882 1.34867 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.522484 0.565759 0.63143 0.559021 0.0303236 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0175313 0.0189641 0.0205416 0.0194596 0.0010732 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0173303 0.0189184 0.0206545 0.0194452 0.00104963 19
produce:beamevent:BeamEvent 7.4499e-05 0.000190166 0.00115526 0.000103329 0.000244283 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.37752 2.73912 2.98757 2.78207 0.181195 19
produce:ophit:OpHitFinder 0.0248641 0.0318219 0.037765 0.0321414 0.0036458 19
produce:wclsdatavd:WireCellToolkit 78.615 82.8481 87.6418 82.3177 2.37815 19
produce:gaushit:GausHitFinder 0.815145 1.02638 1.30886 1.01393 0.140926 19
produce:nhitsfilter:NumberOfHitsFilter 0.000177258 0.000240189 0.000354968 0.000215838 5.18135e-05 19
produce:reco3d:SpacePointSolver 12.0809 17.0001 23.3587 17.0014 3.12309 19
produce:hitpdune:DisambigFromSpacePoints 0.118983 0.160517 0.207362 0.158917 0.02755 19
produce:cluster3d:Cluster3D 1.64298 2.42501 3.72322 2.26734 0.549258 19
[art]:TriggerResults:TriggerResultInserter 2.034e-05 2.67072e-05 0.000111039 2.134e-05 1.99367e-05 19
end_path:out1:RootOutput 3.08e-06 4.59368e-06 1.768e-05 3.86e-06 3.13597e-06 19
end_path:out1:RootOutput(write) 3.95473 4.18947 4.43681 4.15328 0.140075 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5340.28 MB
Peak resident set size usage (VmHWM): 3435.36 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0461_df-s02-d1_dw_0_20260203T213719_reco_stage0_20260204T000856_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0461_df-s02-d1_dw_0_20260203T213719_reco_stage0_20260204T000856_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0461_df-s02-d1_dw_0_20260203T213719_reco_stage0_20260204T000856_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161227.0,
"core.end_time": 1770163737.0,
"core.events": [
52561,
52567,
52573,
52579,
52585,
52591,
52597,
52603,
52609,
52615,
52621,
52627,
52633,
52639,
52645,
52651,
52657,
52663,
52669
],
"core.event_count": 19,
"core.first_event_number": 52561,
"core.last_event_number": 52669,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0461_df-s02-d1_dw_0_20260203T213719.hdf5"
}
]
} 