Jobsub ID 297923.0@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2026-02-04 00:50:34 |
| From worker node | Hostname | dune001-1520391.0-lcg2721.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:56:42 |
| Input files | vd-protodune:np02vd_raw_run042433_0011_df-s02-d1_dw_0_20260203T184616.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 52m (3133s) |
| CPU time | 46m (2794s = 89%) |
| Max RSS bytes | 3443621888 (3284 MiB) |
| Outputting started | 2026-02-04 00:48:57 |
| Output files | |
| Finished | 2026-02-04 00:50:34 |
| Saved logs | justin-logs:297923.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
up space point ptr... 0x158e64c0, 0x158e6830
Caught exception in looking up space point ptr... 0x34f5ecc0, 0x34f5d2f0
Caught exception in looking up space point ptr... 0x34f5d2f0, 0x34f5ecc0
Caught exception in looking up space point ptr... 0x146fed10, 0x3501da40
Caught exception in looking up space point ptr... 0x3501da40, 0x146ee690
Caught exception in looking up space point ptr... 0x14c66e60, 0x14c6f080
Caught exception in looking up space point ptr... 0x14c6f080, 0x14c6b9b0
Caught exception in looking up space point ptr... 0x867770d0, 0x86777820
Caught exception in looking up space point ptr... 0x86777820, 0x867770d0
Caught exception in looking up space point ptr... 0x394d7610, 0x394d4af0
Caught exception in looking up space point ptr... 0x394d4af0, 0x394d7610
Caught exception in looking up space point ptr... 0x6a72e780, 0x6a733ad0
Caught exception in looking up space point ptr... 0x6a733ad0, 0x6a72e780
Caught exception in looking up space point ptr... 0x3502b610, 0x3502b7a0
Caught exception in looking up space point ptr... 0x80dc7ee0, 0x3502b610
Caught exception in looking up space point ptr... 0x2f9e93b0, 0x850b89f0
Caught exception in looking up space point ptr... 0x2f9e9160, 0x2f9e93b0
Caught exception in looking up space point ptr... 0x14c84920, 0x14c84600
Caught exception in looking up space point ptr... 0x14c84600, 0x14c84920
Caught exception in looking up space point ptr... 0x70610f40, 0x705ecb30
Caught exception in looking up space point ptr... 0x705ecb30, 0x70610f40
Caught exception in looking up space point ptr... 0x12b5e400, 0x12b58110
Caught exception in looking up space point ptr... 0x12b58110, 0xa996ac0
Caught exception in looking up space point ptr... 0x849aa310, 0x849a9ff0
Caught exception in looking up space point ptr... 0x849a9ff0, 0x849aa180
Caught exception in looking up space point ptr... 0x5324a620, 0x5324a490
Caught exception in looking up space point ptr... 0x5324a490, 0x53249fe0
Caught exception in looking up space point ptr... 0x804ddd80, 0x804dde80
Caught exception in looking up space point ptr... 0x804dde80, 0x7fefcdd0
Caught exception in looking up space point ptr... 0x37878950, 0x37884590
Caught exception in looking up space point ptr... 0x37884590, 0x378767d0
Caught exception in looking up space point ptr... 0x850b7990, 0x850b7cb0
Caught exception in looking up space point ptr... 0x850b7cb0, 0x850b7990
Caught exception in looking up space point ptr... 0x49057df0, 0x49053e70
Caught exception in looking up space point ptr... 0x49053e70, 0x49057df0
Caught exception in looking up space point ptr... 0x84f8ee40, 0x84f8e260
Caught exception in looking up space point ptr... 0x84f8e260, 0x84f8ee40
Caught exception in looking up space point ptr... 0x84e46990, 0x84e46b40
Caught exception in looking up space point ptr... 0x84e46b40, 0x84e46cd0
Caught exception in looking up space point ptr... 0x2e84df30, 0x77345020
Caught exception in looking up space point ptr... 0x77345020, 0x2e856c40
Caught exception in looking up space point ptr... 0x175fd210, 0x48da6680
Caught exception in looking up space point ptr... 0x48da6680, 0x175fd210
Caught exception in looking up space point ptr... 0x505de230, 0x505dddf0
Caught exception in looking up space point ptr... 0x505dddf0, 0x505de230
Caught exception in looking up space point ptr... 0x853e5dc0, 0x4de80190
Caught exception in looking up space point ptr... 0x9fbe140, 0x853e5dc0
Caught exception in looking up space point ptr... 0x53a18e10, 0x53a18af0
Caught exception in looking up space point ptr... 0x53a18af0, 0x53a18960
Caught exception in looking up space point ptr... 0x505de4d0, 0x505de620
Caught exception in looking up space point ptr... 0x505de620, 0x505de770
Caught exception in looking up space point ptr... 0x177180b0, 0x17720630
Caught exception in looking up space point ptr... 0x17720630, 0x177180b0
Caught exception in looking up space point ptr... 0x67651700, 0x6764b3c0
Caught exception in looking up space point ptr... 0x6764b3c0, 0x67651700
Caught exception in looking up space point ptr... 0x34a5d260, 0x34a5a620
Caught exception in looking up space point ptr... 0x34a5a620, 0x34a5e680
Caught exception in looking up space point ptr... 0x39ca0bf0, 0x39c90700
Caught exception in looking up space point ptr... 0x39c90700, 0x39ca0bf0
Caught exception in looking up space point ptr... 0x14bfc190, 0x14bfb9c0
Caught exception in looking up space point ptr... 0x14bfb9c0, 0x14bfc190
Caught exception in looking up space point ptr... 0x14bfc190, 0x14bfc000
Caught exception in looking up space point ptr... 0x14bfc000, 0x14bfc190
Caught exception in looking up space point ptr... 0x12b47600, 0x12b47150
Caught exception in looking up space point ptr... 0x12b47150, 0x12b47600
Caught exception in looking up space point ptr... 0x505dc370, 0x505dc870
Caught exception in looking up space point ptr... 0x505dc870, 0x505dc6e0
++++>>>> total num hits: 174299, num free: 168294
04-Feb-2026 00:48:49 UTC Closed output file "np02vd_raw_run042433_0011_df-s02-d1_dw_0_20260203T184616_reco_stage0_20260204T004849_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 144.83 160.992 179.22 158.176 10.3824 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.1442e-05 0.000112934 0.000224539 9.4623e-05 4.07863e-05 19
produce:tpcrawdecoder:PDVDTPCReader 15.4116 18.0137 20.5682 19.4079 2.16842 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.676966 0.702018 0.734228 0.701359 0.0196961 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0227438 0.0257535 0.0345384 0.0233194 0.00408611 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0227474 0.0230893 0.0237021 0.0230644 0.000236752 19
produce:beamevent:BeamEvent 8.2805e-05 0.000193386 0.000949532 0.000160653 0.000181394 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.11995 3.47718 3.82331 3.49607 0.194055 19
produce:ophit:OpHitFinder 0.0323826 0.0416567 0.0708959 0.0406101 0.00816742 19
produce:wclsdatavd:WireCellToolkit 99.8883 111.11 120.625 112.002 5.40797 19
produce:gaushit:GausHitFinder 0.636914 1.39089 2.40807 1.25775 0.506993 19
produce:nhitsfilter:NumberOfHitsFilter 0.000172189 0.000292963 0.000428918 0.000315416 8.18486e-05 19
produce:reco3d:SpacePointSolver 8.8748 15.7027 25.3941 13.6553 4.49821 19
produce:hitpdune:DisambigFromSpacePoints 0.12281 0.225739 0.3471 0.219646 0.0687365 19
produce:cluster3d:Cluster3D 1.18811 4.70703 16.0071 3.59198 3.67851 19
[art]:TriggerResults:TriggerResultInserter 2.4917e-05 3.72372e-05 0.000111007 3.0366e-05 2.01765e-05 19
end_path:out1:RootOutput 3.666e-06 1.02718e-05 5.1938e-05 8.553e-06 1.00926e-05 19
end_path:out1:RootOutput(write) 3.94645 5.52486 6.60206 5.7701 0.706909 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5617.63 MB
Peak resident set size usage (VmHWM): 3443.62 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0011_df-s02-d1_dw_0_20260203T184616_reco_stage0_20260204T004849_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0011_df-s02-d1_dw_0_20260203T184616_reco_stage0_20260204T004849_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0011_df-s02-d1_dw_0_20260203T184616_reco_stage0_20260204T004849_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163012.0,
"core.end_time": 1770166131.0,
"core.events": [
1261,
1267,
1273,
1279,
1285,
1291,
1297,
1303,
1309,
1315,
1321,
1327,
1333,
1339,
1345,
1351,
1357,
1363,
1369
],
"core.event_count": 19,
"core.first_event_number": 1261,
"core.last_event_number": 1369,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0011_df-s02-d1_dw_0_20260203T184616.hdf5"
}
]
} 