Jobsub ID 297921.54@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.54@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2026-02-04 01:06:23 |
| From worker node | Hostname | dune001-1520260.0-lcg2541.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:49:10 |
| Input files | vd-protodune:np02vd_raw_run042433_0215_df-s03-d0_dw_0_20260203T200349.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4488s) |
| CPU time | 1h (4157s = 92%) |
| Max RSS bytes | 3404029952 (3246 MiB) |
| Outputting started | 2026-02-04 01:03:59 |
| Output files | |
| Finished | 2026-02-04 01:06:23 |
| Saved logs | justin-logs:297921.54-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x10462d50, 0x10462a20
Caught exception in looking up space point ptr... 0x38df3290, 0x38df3470
Caught exception in looking up space point ptr... 0x38df2470, 0x38df3290
Caught exception in looking up space point ptr... 0x5d510570, 0x5d513e20
Caught exception in looking up space point ptr... 0x5d513e20, 0x5d510570
Caught exception in looking up space point ptr... 0x66c9cea0, 0x66c9b660
Caught exception in looking up space point ptr... 0x66c9b660, 0x6306cd20
Caught exception in looking up space point ptr... 0x389c7e30, 0x389c70b0
Caught exception in looking up space point ptr... 0x389c70b0, 0x389c7e30
Caught exception in looking up space point ptr... 0x68f53190, 0x68f53520
Caught exception in looking up space point ptr... 0x68f53520, 0x68f53190
Caught exception in looking up space point ptr... 0x50d40110, 0x359123e0
Caught exception in looking up space point ptr... 0x359123e0, 0x50d40110
Caught exception in looking up space point ptr... 0x39a1f0e0, 0x39a1ef50
Caught exception in looking up space point ptr... 0x39a1ef50, 0x39a1f0e0
Caught exception in looking up space point ptr... 0x16643d10, 0x1663fbe0
Caught exception in looking up space point ptr... 0x1663fbe0, 0x16643d10
Caught exception in looking up space point ptr... 0x30c7c4d0, 0x494adbf0
Caught exception in looking up space point ptr... 0x494adbf0, 0x30c7c4d0
Caught exception in looking up space point ptr... 0x30c7c4d0, 0x3b18b010
Caught exception in looking up space point ptr... 0x3b18b010, 0x30c7c4d0
Caught exception in looking up space point ptr... 0x137276c0, 0x1597da30
Caught exception in looking up space point ptr... 0x1597da30, 0x137276c0
Caught exception in looking up space point ptr... 0x137276c0, 0x1597d600
Caught exception in looking up space point ptr... 0x1597d600, 0x137276c0
Caught exception in looking up space point ptr... 0x137276c0, 0x15985db0
Caught exception in looking up space point ptr... 0x15985db0, 0x137276c0
Caught exception in looking up space point ptr... 0x7aa68040, 0x7aa67b80
Caught exception in looking up space point ptr... 0x7aa67b80, 0x7aa67de0
Caught exception in looking up space point ptr... 0x5b5f7de0, 0x7ba19d90
Caught exception in looking up space point ptr... 0x7ba19d90, 0x5b5f7de0
Caught exception in looking up space point ptr... 0x6306b120, 0x630671e0
Caught exception in looking up space point ptr... 0x630671e0, 0x6306ba60
Caught exception in looking up space point ptr... 0x613e3720, 0x19d28000
Caught exception in looking up space point ptr... 0x19d28000, 0x613e3720
Caught exception in looking up space point ptr... 0x10683db0, 0x10683c60
Caught exception in looking up space point ptr... 0x10683c60, 0x10683db0
Caught exception in looking up space point ptr... 0x1199bd90, 0x1199c040
Caught exception in looking up space point ptr... 0x1199c040, 0x1199bd90
Caught exception in looking up space point ptr... 0x3dba6470, 0x3dba61d0
Caught exception in looking up space point ptr... 0x3dba61d0, 0x3dba4e20
Caught exception in looking up space point ptr... 0x54a36b80, 0x54a37050
Caught exception in looking up space point ptr... 0x54a37050, 0x54a36b80
Caught exception in looking up space point ptr... 0x34958760, 0x5235b9d0
Caught exception in looking up space point ptr... 0x5235b9d0, 0x34958760
Caught exception in looking up space point ptr... 0x31eba920, 0x31eba790
Caught exception in looking up space point ptr... 0x31eba790, 0x31eba920
Caught exception in looking up space point ptr... 0x169cb860, 0x162fde00
Caught exception in looking up space point ptr... 0x162fde00, 0x169cb860
Caught exception in looking up space point ptr... 0x38d99b50, 0x3812bab0
Caught exception in looking up space point ptr... 0x3812bab0, 0x5b646ba0
Caught exception in looking up space point ptr... 0x63065640, 0x63084d10
Caught exception in looking up space point ptr... 0x63084d10, 0x63084b80
Caught exception in looking up space point ptr... 0x83025390, 0x52725ed0
Caught exception in looking up space point ptr... 0x52725ed0, 0x83025390
Caught exception in looking up space point ptr... 0x5b60c6e0, 0x5b606430
Caught exception in looking up space point ptr... 0x5b606430, 0x5b60c6e0
Caught exception in looking up space point ptr... 0x5b60c6e0, 0x5b600e30
Caught exception in looking up space point ptr... 0x5b600e30, 0x5b60c6e0
Caught exception in looking up space point ptr... 0x5b60c6e0, 0x5b5fdf20
Caught exception in looking up space point ptr... 0x5b5fdf20, 0x5b60c6e0
Caught exception in looking up space point ptr... 0x5b5ffff0, 0x5b5fe2b0
Caught exception in looking up space point ptr... 0x5b5fe2b0, 0x5b5ffff0
Caught exception in looking up space point ptr... 0x5b5ff0d0, 0x5b600bb0
Caught exception in looking up space point ptr... 0x5b600bb0, 0x5b5fd7e0
Caught exception in looking up space point ptr... 0x38333a80, 0x383332f0
Caught exception in looking up space point ptr... 0x383332f0, 0x383322f0
++++>>>> total num hits: 73601, num free: 70908
04-Feb-2026 01:03:46 UTC Closed output file "np02vd_raw_run042433_0215_df-s03-d0_dw_0_20260203T200349_reco_stage0_20260204T010346_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 202.181 229.408 272.527 221.977 22.1683 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000108652 0.000168364 0.000304953 0.000144951 6.2151e-05 19
produce:tpcrawdecoder:PDVDTPCReader 18.6378 19.6684 24.1211 19.3398 1.11022 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.685808 0.718543 0.794183 0.715418 0.0274943 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0232681 0.0239473 0.0277865 0.0234419 0.00130789 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0232305 0.0234847 0.0240658 0.0234133 0.000240997 19
produce:beamevent:BeamEvent 0.000165941 0.000327699 0.00139723 0.000231731 0.000272474 19
produce:pdvddaphne:DAPHNEReaderPDVD 4.08394 4.43353 4.90051 4.45207 0.216336 19
produce:ophit:OpHitFinder 0.0395691 0.0559816 0.0732428 0.0557725 0.00929548 19
produce:wclsdatavd:WireCellToolkit 139.439 162.061 189.891 161.717 14.314 19
produce:gaushit:GausHitFinder 1.33021 2.15426 3.14561 2.1005 0.528367 19
produce:nhitsfilter:NumberOfHitsFilter 0.000410597 0.000648904 0.000907783 0.000659836 0.000148896 19
produce:reco3d:SpacePointSolver 16.5986 28.5904 49.0675 27.1698 9.38093 19
produce:hitpdune:DisambigFromSpacePoints 0.206197 0.312836 0.524129 0.28721 0.0881713 19
produce:cluster3d:Cluster3D 2.24774 3.75715 7.16836 3.27432 1.38392 19
[art]:TriggerResults:TriggerResultInserter 3.251e-05 5.19859e-05 0.000109541 4.6051e-05 2.20851e-05 19
end_path:out1:RootOutput 9.31e-06 1.58585e-05 6.033e-05 1.128e-05 1.15594e-05 19
end_path:out1:RootOutput(write) 5.97416 7.51672 9.45238 7.49594 1.25976 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5589.94 MB
Peak resident set size usage (VmHWM): 3404.03 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0215_df-s03-d0_dw_0_20260203T200349_reco_stage0_20260204T010346_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0215_df-s03-d0_dw_0_20260203T200349_reco_stage0_20260204T010346_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0215_df-s03-d0_dw_0_20260203T200349_reco_stage0_20260204T010346_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162565.0,
"core.end_time": 1770167029.0,
"core.events": [
24518,
24524,
24530,
24536,
24542,
24548,
24554,
24560,
24566,
24572,
24578,
24584,
24590,
24596,
24602,
24608,
24614,
24620,
24626
],
"core.event_count": 19,
"core.first_event_number": 24518,
"core.last_event_number": 24626,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0215_df-s03-d0_dw_0_20260203T200349.hdf5"
}
]
} 