Jobsub ID 297921.52@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.52@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce03 |
| Last heartbeat | 2026-02-04 01:33:02 |
| From worker node | Hostname | dune001-1535377.0-lcg2708.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:48:47 |
| Input files | vd-protodune:np02vd_raw_run042433_0092_df-s04-d0_dw_0_20260203T191706.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6119s) |
| CPU time | 1h (5772s = 94%) |
| Max RSS bytes | 10556338176 (10067 MiB) |
| Outputting started | 2026-02-04 01:30:50 |
| Output files | |
| Finished | 2026-02-04 01:33:02 |
| Saved logs | justin-logs:297921.52-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ption in looking up space point ptr... 0x8140a0a0, 0xf1172280
Caught exception in looking up space point ptr... 0x132cf6680, 0xf351c860
Caught exception in looking up space point ptr... 0xf351c860, 0x132cf6680
Caught exception in looking up space point ptr... 0xec49fce0, 0xec49fa40
Caught exception in looking up space point ptr... 0xec49fa40, 0xec49fce0
Caught exception in looking up space point ptr... 0x6be8dce0, 0x6be8db50
Caught exception in looking up space point ptr... 0x6be8db50, 0x6be8dce0
Caught exception in looking up space point ptr... 0x114f18ba0, 0x114f164d0
Caught exception in looking up space point ptr... 0x114f16d70, 0x114f149a0
Caught exception in looking up space point ptr... 0x114f149a0, 0x114f18ba0
Caught exception in looking up space point ptr... 0x14293d9f0, 0x14293d750
Caught exception in looking up space point ptr... 0x132d0c5b0, 0x14293d9f0
Caught exception in looking up space point ptr... 0x813e37e0, 0x813e3970
Caught exception in looking up space point ptr... 0x813e3970, 0x813e37e0
Caught exception in looking up space point ptr... 0x77f2fc70, 0x77f3bdc0
Caught exception in looking up space point ptr... 0x77f3bdc0, 0x77f2fc70
Caught exception in looking up space point ptr... 0x10e3502a0, 0x10e350110
Caught exception in looking up space point ptr... 0x10e350110, 0x10e34fc60
Caught exception in looking up space point ptr... 0x10e34fc60, 0x10e34ff80
Caught exception in looking up space point ptr... 0x10e34ff80, 0x10e3502a0
Caught exception in looking up space point ptr... 0x61d6dbd0, 0x61d832e0
Caught exception in looking up space point ptr... 0x61d832e0, 0x61d6dbd0
Caught exception in looking up space point ptr... 0x6eb2af70, 0x38563490
Caught exception in looking up space point ptr... 0x38563490, 0x6eb2af70
Caught exception in looking up space point ptr... 0x8dfe7f40, 0x8e004b20
Caught exception in looking up space point ptr... 0x8e004b20, 0x8dfe7f40
Caught exception in looking up space point ptr... 0xf3474f00, 0x63ce66b0
Caught exception in looking up space point ptr... 0x63ce66b0, 0xf3474f00
Caught exception in looking up space point ptr... 0xf3474f00, 0x63ce6460
Caught exception in looking up space point ptr... 0x63ce6460, 0xf3474f00
Caught exception in looking up space point ptr... 0x7dcbf170, 0x7dca9910
Caught exception in looking up space point ptr... 0x7dca9910, 0x7dca9a60
Caught exception in looking up space point ptr... 0x6ef19540, 0x6ef19220
Caught exception in looking up space point ptr... 0x6ef19220, 0x6ef193b0
Caught exception in looking up space point ptr... 0x3993d700, 0x776bdff0
Caught exception in looking up space point ptr... 0x776bdff0, 0xf56dfcd0
Caught exception in looking up space point ptr... 0x7dcc6a10, 0x7dcc6880
Caught exception in looking up space point ptr... 0x7dcc6880, 0x7dcc6a10
Caught exception in looking up space point ptr... 0x7dcc7820, 0x7dcc7690
Caught exception in looking up space point ptr... 0x7dcc7690, 0x7dcc7820
Caught exception in looking up space point ptr... 0x44fae6a0, 0x44fae380
Caught exception in looking up space point ptr... 0x44fae380, 0x44fae6a0
Caught exception in looking up space point ptr... 0x8dfff1f0, 0x8dfff510
Caught exception in looking up space point ptr... 0x8dfff510, 0x8dffef60
Caught exception in looking up space point ptr... 0xe0e68780, 0x1564b22c0
Caught exception in looking up space point ptr... 0x1564b22c0, 0xe0e6df20
Caught exception in looking up space point ptr... 0xd8bba080, 0x76f37dd0
Caught exception in looking up space point ptr... 0x76f37dd0, 0x133d27260
Caught exception in looking up space point ptr... 0x40761b90, 0x40765a90
Caught exception in looking up space point ptr... 0x40765a90, 0x40761b90
Caught exception in looking up space point ptr... 0x10261c6f0, 0x10261c540
Caught exception in looking up space point ptr... 0x10261c540, 0xec490420
Caught exception in looking up space point ptr... 0x32fd4420, 0x32ff0ca0
Caught exception in looking up space point ptr... 0x32ff0ca0, 0x32ff08a0
Caught exception in looking up space point ptr... 0x71bacd80, 0x71ba6690
Caught exception in looking up space point ptr... 0x71ba6690, 0x71babf00
Caught exception in looking up space point ptr... 0xd5991070, 0xd5991200
Caught exception in looking up space point ptr... 0xd5991200, 0xd5991070
Caught exception in looking up space point ptr... 0x10e34e870, 0x10e34e3c0
Caught exception in looking up space point ptr... 0x10e34e3c0, 0x10e34e870
Caught exception in looking up space point ptr... 0x10e34e870, 0x10e34e6e0
Caught exception in looking up space point ptr... 0x10e34e6e0, 0x10e34e870
Caught exception in looking up space point ptr... 0xf6aaf9b0, 0xf6aa7280
Caught exception in looking up space point ptr... 0xf6aa7280, 0xf6aaf9b0
Caught exception in looking up space point ptr... 0x64578df0, 0x64579ad0
Caught exception in looking up space point ptr... 0x645671e0, 0x64578df0
++++>>>> total num hits: 143078, num free: 137374
04-Feb-2026 01:30:38 UTC Closed output file "np02vd_raw_run042433_0092_df-s04-d0_dw_0_20260203T191706_reco_stage0_20260204T013038_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 141.231 317.798 953.924 168.994 266.437 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.9875e-05 0.000125201 0.000230718 0.000101132 4.31853e-05 19
produce:tpcrawdecoder:PDVDTPCReader 15.8705 16.3446 16.7245 16.477 0.272367 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.685307 0.738097 0.803313 0.738326 0.0314163 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0230323 0.0269396 0.0522559 0.0232245 0.00760632 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0229574 0.023248 0.0243148 0.0231742 0.000294211 19
produce:beamevent:BeamEvent 0.000120311 0.000201522 0.000806283 0.000158409 0.000147763 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.91472 3.40238 3.73779 3.45446 0.220006 19
produce:ophit:OpHitFinder 0.0356934 0.0423899 0.0470306 0.0422793 0.00295153 19
produce:wclsdatavd:WireCellToolkit 101.609 111.776 126.075 109.643 7.34965 19
produce:gaushit:GausHitFinder 0.845024 3.75233 13.3145 1.82938 3.99978 19
produce:nhitsfilter:NumberOfHitsFilter 0.000209175 0.000434478 0.000788466 0.000390608 0.000176024 19
produce:reco3d:SpacePointSolver 10.1872 27.9133 72.916 18.7028 20.318 19
produce:hitpdune:DisambigFromSpacePoints 0.11741 0.643338 2.59529 0.269222 0.723556 19
produce:cluster3d:Cluster3D 1.52786 144.407 717.428 3.75098 236.057 19
[art]:TriggerResults:TriggerResultInserter 3.0936e-05 5.41067e-05 0.000102955 4.1973e-05 2.3486e-05 19
end_path:out1:RootOutput 3.936e-06 1.0938e-05 2.696e-05 9.204e-06 6.06722e-06 19
end_path:out1:RootOutput(write) 4.05016 8.6507 21.7285 6.13226 5.31859 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 12985.3 MB
Peak resident set size usage (VmHWM): 10556.3 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0092_df-s04-d0_dw_0_20260203T191706_reco_stage0_20260204T013038_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0092_df-s04-d0_dw_0_20260203T191706_reco_stage0_20260204T013038_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0092_df-s04-d0_dw_0_20260203T191706_reco_stage0_20260204T013038_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162539.0,
"core.end_time": 1770168640.0,
"core.events": [
10498,
10504,
10510,
10516,
10522,
10528,
10534,
10540,
10546,
10552,
10558,
10564,
10570,
10576,
10582,
10588,
10594,
10600,
10606
],
"core.event_count": 19,
"core.first_event_number": 10498,
"core.last_event_number": 10606,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0092_df-s04-d0_dw_0_20260203T191706.hdf5"
}
]
} 