Jobsub ID 297921.50@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.50@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce03 |
| Last heartbeat | 2026-02-04 01:00:12 |
| From worker node | Hostname | dune001-1535376.0-lcg2712.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:49:31 |
| Input files | vd-protodune:np02vd_raw_run042433_0244_df-s04-d0_dw_0_20260203T201451.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4121s) |
| CPU time | 59m (3562s = 86%) |
| Max RSS bytes | 3620470784 (3452 MiB) |
| Outputting started | 2026-02-04 00:58:14 |
| Output files | |
| Finished | 2026-02-04 01:00:12 |
| Saved logs | justin-logs:297921.50-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x3e939320, 0x3e939190
Caught exception in looking up space point ptr... 0x69eb3150, 0x69eb4510
Caught exception in looking up space point ptr... 0x69a6a7d0, 0x69eb3150
Caught exception in looking up space point ptr... 0x9a31ea80, 0x9a31e830
Caught exception in looking up space point ptr... 0x9a31e830, 0x8a4201c0
Caught exception in looking up space point ptr... 0x46020c30, 0x460209e0
Caught exception in looking up space point ptr... 0x460209e0, 0x46c93280
Caught exception in looking up space point ptr... 0xa4318490, 0x46b4f5e0
Caught exception in looking up space point ptr... 0x46b4f5e0, 0x450924b0
Caught exception in looking up space point ptr... 0x6cfb02c0, 0x8d34a0b0
Caught exception in looking up space point ptr... 0x8aa16e00, 0x6cfb02c0
Caught exception in looking up space point ptr... 0x498c4df0, 0x417cb4a0
Caught exception in looking up space point ptr... 0x417cb4a0, 0x417bdfe0
Caught exception in looking up space point ptr... 0xb65dcb20, 0xb65dc990
Caught exception in looking up space point ptr... 0xb65dc990, 0x8b1c3df0
Caught exception in looking up space point ptr... 0x42fd1560, 0x6cfdf0a0
Caught exception in looking up space point ptr... 0x6cfdf0a0, 0x444f1360
Caught exception in looking up space point ptr... 0x4add81f0, 0x4adc6270
Caught exception in looking up space point ptr... 0x4ade9e50, 0x4add81f0
Caught exception in looking up space point ptr... 0x69e98ad0, 0x69e9b6e0
Caught exception in looking up space point ptr... 0x69e98880, 0x69e98ad0
Caught exception in looking up space point ptr... 0x7cf37c70, 0x7cf37950
Caught exception in looking up space point ptr... 0x7cf37950, 0x4520f710
Caught exception in looking up space point ptr... 0x8f22c5e0, 0x8f207f10
Caught exception in looking up space point ptr... 0x8f207f10, 0x8f1f5f90
Caught exception in looking up space point ptr... 0x47bdb9e0, 0x47be4200
Caught exception in looking up space point ptr... 0x47be4200, 0x47be3f30
Caught exception in looking up space point ptr... 0x46e7fba0, 0xa29f8110
Caught exception in looking up space point ptr... 0xa29f8110, 0x46e86ae0
Caught exception in looking up space point ptr... 0x7f1bd060, 0x8cf259f0
Caught exception in looking up space point ptr... 0x8cf259f0, 0x6a53cdd0
Caught exception in looking up space point ptr... 0x973e7d40, 0xb5449180
Caught exception in looking up space point ptr... 0xb5449180, 0x973e7d40
Caught exception in looking up space point ptr... 0xb2c76850, 0x496c22a0
Caught exception in looking up space point ptr... 0x9aaa0480, 0xb2c76850
Caught exception in looking up space point ptr... 0x72bd16f0, 0x45ec4800
Caught exception in looking up space point ptr... 0x45ec4800, 0x45ec4de0
Caught exception in looking up space point ptr... 0xbc023990, 0x74f18c60
Caught exception in looking up space point ptr... 0x74f18c60, 0x74f08c20
Caught exception in looking up space point ptr... 0x95552160, 0x95563dc0
Caught exception in looking up space point ptr... 0x95540690, 0x95552160
Caught exception in looking up space point ptr... 0x6b777fa0, 0x69d58da0
Caught exception in looking up space point ptr... 0x44e6a430, 0x6b777fa0
Caught exception in looking up space point ptr... 0x69b95ef0, 0x69b83610
Caught exception in looking up space point ptr... 0x69ba84b0, 0x69b95ef0
Caught exception in looking up space point ptr... 0xb541e300, 0x6a73e5d0
Caught exception in looking up space point ptr... 0x6a73e5d0, 0x853138b0
Caught exception in looking up space point ptr... 0x477d75b0, 0x67ff6150
Caught exception in looking up space point ptr... 0x477e8720, 0x477d75b0
Caught exception in looking up space point ptr... 0x7f554ba0, 0x7f5672f0
Caught exception in looking up space point ptr... 0x7f542c20, 0x7f554ba0
Caught exception in looking up space point ptr... 0x753e39e0, 0x3e5cf370
Caught exception in looking up space point ptr... 0x753d20a0, 0x753e39e0
Caught exception in looking up space point ptr... 0x76133950, 0x6a791220
Caught exception in looking up space point ptr... 0x6a791220, 0x42139300
Caught exception in looking up space point ptr... 0xaf772330, 0x7537c430
Caught exception in looking up space point ptr... 0x7537c430, 0xaf772330
Caught exception in looking up space point ptr... 0x3c095800, 0x73fb1530
Caught exception in looking up space point ptr... 0x73fb1530, 0x3c095800
Caught exception in looking up space point ptr... 0xb2d0e170, 0x669c53f0
Caught exception in looking up space point ptr... 0x669c53f0, 0xb2d0e170
Caught exception in looking up space point ptr... 0x6672a400, 0x6698d430
Caught exception in looking up space point ptr... 0x66a75aa0, 0x6672a400
Caught exception in looking up space point ptr... 0x91448900, 0xb5711280
Caught exception in looking up space point ptr... 0xb5711280, 0x91448900
Caught exception in looking up space point ptr... 0x6be0d7d0, 0xb5452130
Caught exception in looking up space point ptr... 0xb5452130, 0x6be0d7d0
++++>>>> total num hits: 555031, num free: 546618
04-Feb-2026 00:58:06 UTC Closed output file "np02vd_raw_run042433_0244_df-s04-d0_dw_0_20260203T201451_reco_stage0_20260204T005806_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 151.057 213 250.939 217.353 27.2716 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000103797 0.000166357 0.00073347 0.000114553 0.000142238 19
produce:tpcrawdecoder:PDVDTPCReader 16.0828 28.2514 62.5483 22.1704 12.3784 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.667312 0.910913 4.38557 0.70746 0.820344 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.022911 0.0241687 0.0330317 0.0232478 0.00266074 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0229521 0.0232873 0.0246516 0.0232139 0.000343934 19
produce:beamevent:BeamEvent 0.000137338 0.000247077 0.00131048 0.000198661 0.000252051 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.41713 4.33692 9.18706 3.8988 1.35029 19
produce:ophit:OpHitFinder 0.0343262 0.0401265 0.0453658 0.04064 0.0028924 19
produce:wclsdatavd:WireCellToolkit 93.0975 108.13 124.775 105.401 9.38573 19
produce:gaushit:GausHitFinder 0.884831 2.21288 3.1526 2.27076 0.662477 19
produce:nhitsfilter:NumberOfHitsFilter 0.000251371 0.000438049 0.000786049 0.000466465 0.000135061 19
produce:reco3d:SpacePointSolver 14.2211 22.1276 29.6422 21.5438 4.72375 19
produce:hitpdune:DisambigFromSpacePoints 0.150304 0.323085 0.522938 0.30294 0.112531 19
produce:cluster3d:Cluster3D 2.04586 40.2746 66.8869 49.8879 22.812 19
[art]:TriggerResults:TriggerResultInserter 2.7903e-05 4.62395e-05 0.000154755 3.6215e-05 3.01593e-05 19
end_path:out1:RootOutput 4.106e-06 2.66771e-05 0.000335268 8.533e-06 7.29062e-05 19
end_path:out1:RootOutput(write) 4.03771 6.29608 8.00436 6.28848 1.11373 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5775.31 MB
Peak resident set size usage (VmHWM): 3620.47 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0244_df-s04-d0_dw_0_20260203T201451_reco_stage0_20260204T005806_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0244_df-s04-d0_dw_0_20260203T201451_reco_stage0_20260204T005806_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0244_df-s04-d0_dw_0_20260203T201451_reco_stage0_20260204T005806_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162583.0,
"core.end_time": 1770166688.0,
"core.events": [
27826,
27832,
27838,
27844,
27850,
27856,
27862,
27868,
27874,
27880,
27886,
27892,
27898,
27904,
27910,
27916,
27922,
27928,
27934
],
"core.event_count": 19,
"core.first_event_number": 27826,
"core.last_event_number": 27934,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0244_df-s04-d0_dw_0_20260203T201451.hdf5"
}
]
} 