Jobsub ID 297923.128@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.128@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2026-02-04 00:57:36 |
| From worker node | Hostname | dune001-1520610.0-lcg2713.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:04:43 |
| Input files | vd-protodune:np02vd_raw_run042433_0580_df-s04-d0_dw_0_20260203T222234.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 50m (3059s) |
| CPU time | 45m (2704s = 88%) |
| Max RSS bytes | 3325444096 (3171 MiB) |
| Outputting started | 2026-02-04 00:55:43 |
| Output files | |
| Finished | 2026-02-04 00:57:36 |
| Saved logs | justin-logs:297923.128-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0xa6ee6e00, 0xa6ee6cb0
Caught exception in looking up space point ptr... 0x98c85730, 0x7b8881f0
Caught exception in looking up space point ptr... 0x7b8881f0, 0x501ad2b0
Caught exception in looking up space point ptr... 0x501ad2b0, 0x4baa9ee0
Caught exception in looking up space point ptr... 0x83083b30, 0x83083a30
Caught exception in looking up space point ptr... 0x83083a30, 0x830825c0
Caught exception in looking up space point ptr... 0x9c2002c0, 0x7d712ad0
Caught exception in looking up space point ptr... 0x7d712ad0, 0x9c2002c0
Caught exception in looking up space point ptr... 0x7d703190, 0x7d703000
Caught exception in looking up space point ptr... 0x7d703000, 0x7d703190
Caught exception in looking up space point ptr... 0xad444cc0, 0x6d1aaf50
Caught exception in looking up space point ptr... 0x53ec9b60, 0xad444cc0
Caught exception in looking up space point ptr... 0x9ec36d80, 0x9ec36bf0
Caught exception in looking up space point ptr... 0x9ec36bf0, 0x9ec36d80
Caught exception in looking up space point ptr... 0x9ec36d80, 0x9ec41420
Caught exception in looking up space point ptr... 0x9ec41420, 0x9ec36d80
Caught exception in looking up space point ptr... 0x9c657fc0, 0x9b8b3760
Caught exception in looking up space point ptr... 0x9b8b3760, 0x9c657fc0
Caught exception in looking up space point ptr... 0x93d56660, 0x93d56560
Caught exception in looking up space point ptr... 0x93d56560, 0x93d56660
Caught exception in looking up space point ptr... 0x865f1a00, 0x876ea370
Caught exception in looking up space point ptr... 0x876ea370, 0x865f1a00
Caught exception in looking up space point ptr... 0x439624d0, 0x439627f0
Caught exception in looking up space point ptr... 0x439627f0, 0x439624d0
Caught exception in looking up space point ptr... 0x50df5fb0, 0xa1e59aa0
Caught exception in looking up space point ptr... 0xa1e59aa0, 0x50df5fb0
Caught exception in looking up space point ptr... 0x91dfcd30, 0x553c5b80
Caught exception in looking up space point ptr... 0x553c5b80, 0x52c38740
Caught exception in looking up space point ptr... 0xbebb0bb0, 0xbebb2760
Caught exception in looking up space point ptr... 0xbebb2760, 0xbebb0bb0
Caught exception in looking up space point ptr... 0x8ef41810, 0x8ef326b0
Caught exception in looking up space point ptr... 0x8ef326b0, 0x8ef3ef20
Caught exception in looking up space point ptr... 0xb3679150, 0xb3678fc0
Caught exception in looking up space point ptr... 0xb3678fc0, 0xb3679150
Caught exception in looking up space point ptr... 0xa8044300, 0xa8044490
Caught exception in looking up space point ptr... 0xa8044490, 0xa80447b0
Caught exception in looking up space point ptr... 0x7b1a0640, 0x7b1a04b0
Caught exception in looking up space point ptr... 0x7b1a04b0, 0x9b8b1c40
Caught exception in looking up space point ptr... 0x43121ab0, 0x431213c0
Caught exception in looking up space point ptr... 0x431213c0, 0x43121610
Caught exception in looking up space point ptr... 0x717fe080, 0x51589800
Caught exception in looking up space point ptr... 0x51589800, 0x717fe080
Caught exception in looking up space point ptr... 0xa9b52440, 0xa4947a40
Caught exception in looking up space point ptr... 0xa4947a40, 0x4dd0f710
Caught exception in looking up space point ptr... 0x4dd0f710, 0x9c4a58f0
Caught exception in looking up space point ptr... 0xb38b9d90, 0xb38b9f70
Caught exception in looking up space point ptr... 0xb38b9f70, 0xb38ba2e0
Caught exception in looking up space point ptr... 0x8e970820, 0x8e9709b0
Caught exception in looking up space point ptr... 0x8e9709b0, 0x8e970690
Caught exception in looking up space point ptr... 0x4f251060, 0x4f250a10
Caught exception in looking up space point ptr... 0x4f250a10, 0x4f251060
Caught exception in looking up space point ptr... 0x4f251060, 0x4f250b10
Caught exception in looking up space point ptr... 0x4f250b10, 0x4f251060
Caught exception in looking up space point ptr... 0x4f251060, 0x4f250ed0
Caught exception in looking up space point ptr... 0x4f250ed0, 0x4f251060
Caught exception in looking up space point ptr... 0x6e286610, 0x6e28c4a0
Caught exception in looking up space point ptr... 0xa9994ee0, 0x6e286610
Caught exception in looking up space point ptr... 0x50e54ed0, 0xbee8d510
Caught exception in looking up space point ptr... 0xbee8d510, 0x50e54ed0
Caught exception in looking up space point ptr... 0x50e54ed0, 0x6e2e4490
Caught exception in looking up space point ptr... 0x6e2e4490, 0x50e54ed0
Caught exception in looking up space point ptr... 0x738f1860, 0x738e14d0
Caught exception in looking up space point ptr... 0x738e14d0, 0x738f1860
Caught exception in looking up space point ptr... 0x9c7d8030, 0x913a0d90
Caught exception in looking up space point ptr... 0x913a0d90, 0xa72224b0
Caught exception in looking up space point ptr... 0xb3678b50, 0xb3678800
Caught exception in looking up space point ptr... 0xb3678800, 0xb3678b50
++++>>>> total num hits: 111294, num free: 106286
04-Feb-2026 00:55:34 UTC Closed output file "np02vd_raw_run042433_0580_df-s04-d0_dw_0_20260203T222234_reco_stage0_20260204T005534_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 139.193 156.806 174.024 156.387 7.00967 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.6175e-05 0.000107215 0.000246771 9.5754e-05 3.56103e-05 19
produce:tpcrawdecoder:PDVDTPCReader 15.359 18.9034 21.887 19.2027 1.67517 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.682745 0.698937 0.736003 0.692104 0.0147971 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0230191 0.0231872 0.0236533 0.0231664 0.000141375 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0229221 0.0231945 0.0240379 0.0231501 0.000233685 19
produce:beamevent:BeamEvent 9.4512e-05 0.000223893 0.00137101 0.000159861 0.0002724 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.26082 3.52482 3.78922 3.5497 0.139332 19
produce:ophit:OpHitFinder 0.0335596 0.0411339 0.0502456 0.0412829 0.00421952 19
produce:wclsdatavd:WireCellToolkit 100.575 110.428 122.572 109.454 5.23932 19
produce:gaushit:GausHitFinder 0.600622 1.23674 1.76413 1.23897 0.28727 19
produce:nhitsfilter:NumberOfHitsFilter 0.000178048 0.000310666 0.000776447 0.000292961 0.000143892 19
produce:reco3d:SpacePointSolver 8.44414 13.8388 17.9185 13.444 2.78624 19
produce:hitpdune:DisambigFromSpacePoints 0.109482 0.184696 0.261195 0.196976 0.0455469 19
produce:cluster3d:Cluster3D 1.43903 2.58627 3.97008 2.60428 0.656426 19
[art]:TriggerResults:TriggerResultInserter 2.5188e-05 3.98315e-05 0.000108654 3.6134e-05 1.7461e-05 19
end_path:out1:RootOutput 3.906e-06 8.89011e-06 2.9424e-05 5.548e-06 6.43658e-06 19
end_path:out1:RootOutput(write) 3.97165 5.26914 6.05552 5.45858 0.6747 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5717.7 MB
Peak resident set size usage (VmHWM): 3325.44 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0580_df-s04-d0_dw_0_20260203T222234_reco_stage0_20260204T005534_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0580_df-s04-d0_dw_0_20260203T222234_reco_stage0_20260204T005534_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0580_df-s04-d0_dw_0_20260203T222234_reco_stage0_20260204T005534_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163494.0,
"core.end_time": 1770166536.0,
"core.events": [
66130,
66136,
66142,
66148,
66154,
66160,
66166,
66172,
66178,
66184,
66190,
66196,
66202,
66208,
66214,
66220,
66226,
66232,
66238
],
"core.event_count": 19,
"core.first_event_number": 66130,
"core.last_event_number": 66238,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0580_df-s04-d0_dw_0_20260203T222234.hdf5"
}
]
} 