Jobsub ID 297922.17@dunegpschedd02.fnal.gov
| Jobsub ID | 297922.17@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:24 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce05 |
| Last heartbeat | 2026-02-04 00:56:42 |
| From worker node | Hostname | dune001-1845818.0-lcg2474.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:57:38 |
| Input files | vd-protodune:np02vd_raw_run042421_0062_df-s04-d1_dw_0_20260203T140434.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 56m (3412s) |
| CPU time | 49m (2972s = 87%) |
| Max RSS bytes | 2605117440 (2484 MiB) |
| Outputting started | 2026-02-04 00:54:31 |
| Output files | |
| Finished | 2026-02-04 00:56:42 |
| Saved logs | justin-logs:297922.17-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x7ea1d600, 0x2fd795d0
Caught exception in looking up space point ptr... 0x2fd795d0, 0x2fd79530
Caught exception in looking up space point ptr... 0x2fd79530, 0x2fd79090
Caught exception in looking up space point ptr... 0x2fd79090, 0x7ea1d600
Caught exception in looking up space point ptr... 0x4834ad60, 0x4834aec0
Caught exception in looking up space point ptr... 0x4834aec0, 0x66f92240
Caught exception in looking up space point ptr... 0x66f92240, 0x66f92420
Caught exception in looking up space point ptr... 0x2a979080, 0x6053e570
Caught exception in looking up space point ptr... 0x6053e570, 0x69e4bbd0
Caught exception in looking up space point ptr... 0x2dd92e20, 0x2dd90620
Caught exception in looking up space point ptr... 0x2dd90620, 0x2dd92b00
Caught exception in looking up space point ptr... 0x44b03530, 0x44b033e0
Caught exception in looking up space point ptr... 0x44b033e0, 0x44b032e0
Caught exception in looking up space point ptr... 0x6fd3ffd0, 0x315350c0
Caught exception in looking up space point ptr... 0x315350c0, 0x588d3f30
Caught exception in looking up space point ptr... 0x79adf270, 0x79adf550
Caught exception in looking up space point ptr... 0x79adf550, 0x79adedf0
Caught exception in looking up space point ptr... 0x79adf690, 0x472f7960
Caught exception in looking up space point ptr... 0x472f7960, 0x670d63c0
Caught exception in looking up space point ptr... 0x6d4963f0, 0x6d496d70
Caught exception in looking up space point ptr... 0x6d496d70, 0x6d4963f0
Caught exception in looking up space point ptr... 0x6d4963f0, 0x6d496250
Caught exception in looking up space point ptr... 0x6d496250, 0x6d4963f0
Caught exception in looking up space point ptr... 0x5b714580, 0x5b711480
Caught exception in looking up space point ptr... 0x5b711480, 0x5b714580
Caught exception in looking up space point ptr... 0x31dd2110, 0x31dd1420
Caught exception in looking up space point ptr... 0x31dd1420, 0x31dd2110
Caught exception in looking up space point ptr... 0x60123b40, 0x60123ff0
Caught exception in looking up space point ptr... 0x60123ff0, 0x60123b40
Caught exception in looking up space point ptr... 0x7ea12b60, 0x7ea12840
Caught exception in looking up space point ptr... 0x7ea12840, 0x7ea126b0
Caught exception in looking up space point ptr... 0x2b174860, 0x670b6f90
Caught exception in looking up space point ptr... 0x670b6f90, 0x2b174860
Caught exception in looking up space point ptr... 0x60118a00, 0x60118b90
Caught exception in looking up space point ptr... 0x60118b90, 0x60118a00
Caught exception in looking up space point ptr... 0x4df84550, 0x7e9fa140
Caught exception in looking up space point ptr... 0x7e9fa140, 0x4eab5ed0
Caught exception in looking up space point ptr... 0x6df506a0, 0x5b1d8720
Caught exception in looking up space point ptr... 0x5b1d8720, 0x6df506a0
Caught exception in looking up space point ptr... 0x4b61b930, 0x4b61bbd0
Caught exception in looking up space point ptr... 0x4b61bbd0, 0x4b61ba80
Caught exception in looking up space point ptr... 0x5e91d6c0, 0x44a29cd0
Caught exception in looking up space point ptr... 0x44a29cd0, 0x5e91d6c0
Caught exception in looking up space point ptr... 0x7e9e76f0, 0x7e9e98b0
Caught exception in looking up space point ptr... 0x7e9e98b0, 0x7e9e76f0
Caught exception in looking up space point ptr... 0x2f3affc0, 0x2f3b00c0
Caught exception in looking up space point ptr... 0x2f3b00c0, 0x2f3affc0
Caught exception in looking up space point ptr... 0x55d96020, 0x55d93140
Caught exception in looking up space point ptr... 0x55d93140, 0x55d911e0
Caught exception in looking up space point ptr... 0x4890c1b0, 0x4890be30
Caught exception in looking up space point ptr... 0x4890be30, 0x4890c1b0
Caught exception in looking up space point ptr... 0x66a24d10, 0x4e7e5950
Caught exception in looking up space point ptr... 0x4e7e5950, 0x66a24d10
Caught exception in looking up space point ptr... 0x4ad97c70, 0x669fcfa0
Caught exception in looking up space point ptr... 0x669fcfa0, 0x4ad97c70
Caught exception in looking up space point ptr... 0x4ad97c70, 0x746cdf60
Caught exception in looking up space point ptr... 0x746cdf60, 0x4ad97c70
Caught exception in looking up space point ptr... 0x6d499fe0, 0x6d499710
Caught exception in looking up space point ptr... 0x6d499710, 0x6d497400
Caught exception in looking up space point ptr... 0x4e3576a0, 0x60121a20
Caught exception in looking up space point ptr... 0x60121a20, 0x4e3573c0
Caught exception in looking up space point ptr... 0x5b728440, 0x5b728180
Caught exception in looking up space point ptr... 0x5b728180, 0x5b728440
Caught exception in looking up space point ptr... 0x7ea14370, 0x7ea13d70
Caught exception in looking up space point ptr... 0x7ea13d70, 0x7ea14370
++++>>>> total num hits: 55228, num free: 52527
04-Feb-2026 00:54:20 UTC Closed output file "np02vd_raw_run042421_0062_df-s04-d1_dw_0_20260203T140434_reco_stage0_20260204T005420_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 100.46 122.027 141.125 123.734 9.32466 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.3687e-05 0.000130454 0.000338147 0.000112482 5.18411e-05 27
produce:tpcrawdecoder:PDVDTPCReader 14.6627 16.3222 19.4391 15.96 1.28885 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.66992 0.703638 0.721872 0.706915 0.0132463 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0228311 0.0234985 0.0269643 0.0233082 0.000815389 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.112868 0.119929 0.138631 0.115109 0.00947278 27
produce:beamevent:BeamEvent 0.000112713 0.000345748 0.00429347 0.000186712 0.000776493 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.6749 3.9687 4.31898 3.9646 0.167234 27
produce:ophit:OpHitFinder 0.0329837 0.0441304 0.0642756 0.0446362 0.00557071 27
produce:wclsdatavd:WireCellToolkit 65.207 81.6009 91.4934 83.3903 6.25231 27
produce:gaushit:GausHitFinder 0.640649 1.20499 2.05668 1.16292 0.333842 27
produce:nhitsfilter:NumberOfHitsFilter 0.000208282 0.00037824 0.000880238 0.000343387 0.000140198 27
produce:reco3d:SpacePointSolver 5.6873 10.8692 18.5127 10.4537 3.42007 27
produce:hitpdune:DisambigFromSpacePoints 0.0641819 0.124962 0.252052 0.119579 0.0395774 27
produce:cluster3d:Cluster3D 0.858438 2.33004 5.03295 1.92824 1.1062 27
[art]:TriggerResults:TriggerResultInserter 2.4306e-05 4.61591e-05 0.000159551 3.3563e-05 3.5704e-05 27
end_path:out1:RootOutput 5.481e-06 3.31388e-05 0.000592507 1.1051e-05 0.000109871 27
end_path:out1:RootOutput(write) 3.27017 4.67977 5.53939 4.83016 0.5482 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4667.67 MB
Peak resident set size usage (VmHWM): 2605.12 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0062_df-s04-d1_dw_0_20260203T140434_reco_stage0_20260204T005420_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0062_df-s04-d1_dw_0_20260203T140434_reco_stage0_20260204T005420_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0062_df-s04-d1_dw_0_20260203T140434_reco_stage0_20260204T005420_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163072.0,
"core.end_time": 1770166462.0,
"core.events": [
10109,
10115,
10121,
10127,
10133,
10139,
10145,
10151,
10157,
10163,
10169,
10175,
10181,
10187,
10193,
10199,
10205,
10211,
10217,
10223,
10229,
10235,
10241,
10247,
10253,
10259,
10265
],
"core.event_count": 27,
"core.first_event_number": 10109,
"core.last_event_number": 10265,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0062_df-s04-d1_dw_0_20260203T140434.hdf5"
}
]
} 