Jobsub ID 297921.48@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.48@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2026-02-04 01:34:50 |
| From worker node | Hostname | dune001-1520261.0-lcg2506.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:48:57 |
| Input files | vd-protodune:np02vd_raw_run042433_0003_df-s03-d0_dw_0_20260203T184314.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6206s) |
| CPU time | 1h (5703s = 91%) |
| Max RSS bytes | 3565203456 (3400 MiB) |
| Outputting started | 2026-02-04 01:32:25 |
| Output files | |
| Finished | 2026-02-04 01:34:50 |
| Saved logs | justin-logs:297921.48-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x3b079590, 0x3b532480
Caught exception in looking up space point ptr... 0x59e32e40, 0x59e32a20
Caught exception in looking up space point ptr... 0x59e32a20, 0x59e37f70
Caught exception in looking up space point ptr... 0x7c6c88a0, 0x5970a9c0
Caught exception in looking up space point ptr... 0x5970a9c0, 0x596c8760
Caught exception in looking up space point ptr... 0x39a09370, 0x55b0e2a0
Caught exception in looking up space point ptr... 0x55b0e2a0, 0x39a09370
Caught exception in looking up space point ptr... 0x33cd9140, 0x33cd8e20
Caught exception in looking up space point ptr... 0x33cd8e20, 0x33cd8c90
Caught exception in looking up space point ptr... 0x8bd92eb0, 0x4dad2160
Caught exception in looking up space point ptr... 0x4dad2160, 0x77f98ff0
Caught exception in looking up space point ptr... 0x2f3c4ed0, 0x2f3c50b0
Caught exception in looking up space point ptr... 0x2f3c50b0, 0x2f3cb490
Caught exception in looking up space point ptr... 0x33d06be0, 0x6b16eda0
Caught exception in looking up space point ptr... 0x6b16eda0, 0x33d06be0
Caught exception in looking up space point ptr... 0x906c3ad0, 0x906c3a30
Caught exception in looking up space point ptr... 0x69c520f0, 0x906c3ad0
Caught exception in looking up space point ptr... 0x681dec10, 0x681a76f0
Caught exception in looking up space point ptr... 0x681a76f0, 0x681ccae0
Caught exception in looking up space point ptr... 0x3304fe10, 0x64704e10
Caught exception in looking up space point ptr... 0x64704730, 0x64704c30
Caught exception in looking up space point ptr... 0x64704c30, 0x681a49f0
Caught exception in looking up space point ptr... 0x681a49f0, 0x3304fe10
Caught exception in looking up space point ptr... 0x828cc6e0, 0x828cc870
Caught exception in looking up space point ptr... 0x828cc870, 0x828ccb90
Caught exception in looking up space point ptr... 0x9eb5c3e0, 0x5df0e900
Caught exception in looking up space point ptr... 0x5df0e900, 0x9eb5c3e0
Caught exception in looking up space point ptr... 0x6d8d7d00, 0x70e6da60
Caught exception in looking up space point ptr... 0x70e6da60, 0x69ef1b10
Caught exception in looking up space point ptr... 0x3b6cae30, 0x3b182070
Caught exception in looking up space point ptr... 0x3b182070, 0x3b6cafc0
Caught exception in looking up space point ptr... 0x6741cda0, 0x60c8d790
Caught exception in looking up space point ptr... 0x60c8d790, 0x6741cda0
Caught exception in looking up space point ptr... 0x84b751a0, 0x623dd060
Caught exception in looking up space point ptr... 0x623dd060, 0x84b751a0
Caught exception in looking up space point ptr... 0x37460ff0, 0x37460b80
Caught exception in looking up space point ptr... 0x37460b80, 0x37460ff0
Caught exception in looking up space point ptr... 0x59b7ee60, 0xb0aa64b0
Caught exception in looking up space point ptr... 0xb0aa64b0, 0x59b7ee60
Caught exception in looking up space point ptr... 0x5bf209e0, 0x7c048e60
Caught exception in looking up space point ptr... 0x5e665620, 0x5bf209e0
Caught exception in looking up space point ptr... 0x2f4fc640, 0x2f5076e0
Caught exception in looking up space point ptr... 0x2f5076e0, 0x2f4fc640
Caught exception in looking up space point ptr... 0x36f63670, 0x36f5fe80
Caught exception in looking up space point ptr... 0x36f5fe80, 0x36f63670
Caught exception in looking up space point ptr... 0x36f4ee30, 0x2f4e23e0
Caught exception in looking up space point ptr... 0x2f4e23e0, 0x36f4ee30
Caught exception in looking up space point ptr... 0x7b8d9a50, 0x7b8d9be0
Caught exception in looking up space point ptr... 0x7b8d9be0, 0x7b8d9a50
Caught exception in looking up space point ptr... 0x69854090, 0x320aa4d0
Caught exception in looking up space point ptr... 0x320aa4d0, 0x69854090
Caught exception in looking up space point ptr... 0x515fb950, 0x515e73c0
Caught exception in looking up space point ptr... 0x515e73c0, 0x515fb950
Caught exception in looking up space point ptr... 0x515fb950, 0x515fb7c0
Caught exception in looking up space point ptr... 0x515fb7c0, 0x515fb950
Caught exception in looking up space point ptr... 0x596d08f0, 0x596cef80
Caught exception in looking up space point ptr... 0x596cef80, 0x596d1690
Caught exception in looking up space point ptr... 0x335503d0, 0x7730b7e0
Caught exception in looking up space point ptr... 0x7730b7e0, 0x335503d0
Caught exception in looking up space point ptr... 0x5f1f6720, 0x5f1f5040
Caught exception in looking up space point ptr... 0x5f1f5040, 0x35bfae70
Caught exception in looking up space point ptr... 0x36f1ebe0, 0x3b19c4f0
Caught exception in looking up space point ptr... 0x3b19c4f0, 0x3747ad60
Caught exception in looking up space point ptr... 0x28efe4f0, 0x831d5290
Caught exception in looking up space point ptr... 0x831d5290, 0x9c34b2c0
Caught exception in looking up space point ptr... 0x2f3d5fc0, 0x2f3d5e70
Caught exception in looking up space point ptr... 0x2f3d5e70, 0x2f3d1450
++++>>>> total num hits: 115012, num free: 110558
04-Feb-2026 01:32:10 UTC Closed output file "np02vd_raw_run042433_0003_df-s03-d0_dw_0_20260203T184314_reco_stage0_20260204T013210_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 235.788 319.452 386.548 340.448 45.4147 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000117892 0.000201148 0.000395479 0.000175484 8.6251e-05 19
produce:tpcrawdecoder:PDVDTPCReader 19.6237 26.6536 40.3079 26.7219 4.08383 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.701256 0.81021 1.33188 0.783145 0.131469 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0233161 0.0300908 0.0677417 0.0240483 0.0113403 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0231061 0.0238146 0.0264831 0.0235759 0.000818676 19
produce:beamevent:BeamEvent 0.000139234 0.000300031 0.00148003 0.000213195 0.000287434 19
produce:pdvddaphne:DAPHNEReaderPDVD 4.43268 4.94607 5.39159 4.93643 0.230058 19
produce:ophit:OpHitFinder 0.0341861 0.0496314 0.0661613 0.0513928 0.00777908 19
produce:wclsdatavd:WireCellToolkit 168.331 179.973 192.286 179.582 6.19145 19
produce:gaushit:GausHitFinder 1.86532 3.25852 4.44541 3.48791 0.766255 19
produce:nhitsfilter:NumberOfHitsFilter 0.00043734 0.000696238 0.00114008 0.000667427 0.000169969 19
produce:reco3d:SpacePointSolver 21.0015 32.959 48.7667 31.0269 6.97876 19
produce:hitpdune:DisambigFromSpacePoints 0.264326 0.462301 0.662977 0.451506 0.0992069 19
produce:cluster3d:Cluster3D 3.71635 60.4153 100.602 86.421 42.5376 19
[art]:TriggerResults:TriggerResultInserter 3.3311e-05 7.23176e-05 0.000206325 5.6682e-05 4.22742e-05 19
end_path:out1:RootOutput 6.75e-06 3.33066e-05 0.00039164 1.056e-05 8.4784e-05 19
end_path:out1:RootOutput(write) 7.8906 9.80282 11.487 9.61172 1.12215 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5715.35 MB
Peak resident set size usage (VmHWM): 3565.2 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0003_df-s03-d0_dw_0_20260203T184314_reco_stage0_20260204T013210_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0003_df-s03-d0_dw_0_20260203T184314_reco_stage0_20260204T013210_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0003_df-s03-d0_dw_0_20260203T184314_reco_stage0_20260204T013210_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162554.0,
"core.end_time": 1770168733.0,
"core.events": [
350,
356,
362,
368,
374,
380,
386,
392,
398,
404,
410,
416,
422,
428,
434,
440,
446,
452,
458
],
"core.event_count": 19,
"core.first_event_number": 350,
"core.last_event_number": 458,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0003_df-s03-d0_dw_0_20260203T184314.hdf5"
}
]
} 