Jobsub ID 297922.16@dunegpschedd02.fnal.gov
| Jobsub ID | 297922.16@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:24 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce05 |
| Last heartbeat | 2026-02-04 00:44:37 |
| From worker node | Hostname | dune001-1845819.0-lcg2704.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:57:33 |
| Input files | vd-protodune:np02vd_raw_run042421_0104_df-s03-d1_dw_0_20260203T142716.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 45m (2721s) |
| CPU time | 38m (2321s = 85%) |
| Max RSS bytes | 2581516288 (2461 MiB) |
| Outputting started | 2026-02-04 00:42:56 |
| Output files | |
| Finished | 2026-02-04 00:44:37 |
| Saved logs | justin-logs:297922.16-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x53d8cdd0, 0x3a5c5b40
Caught exception in looking up space point ptr... 0x1a030700, 0x17160a50
Caught exception in looking up space point ptr... 0x17160a50, 0x1a030700
Caught exception in looking up space point ptr... 0x1a030700, 0x1a02b8d0
Caught exception in looking up space point ptr... 0x1a02b8d0, 0x1a030700
Caught exception in looking up space point ptr... 0x1a00cbe0, 0x1a00d140
Caught exception in looking up space point ptr... 0x1a00d140, 0x1a008650
Caught exception in looking up space point ptr... 0x1a008650, 0x17167550
Caught exception in looking up space point ptr... 0x17167550, 0x1a00cbe0
Caught exception in looking up space point ptr... 0x1a02ce60, 0x1701efa0
Caught exception in looking up space point ptr... 0x1701efa0, 0x1a02ce60
Caught exception in looking up space point ptr... 0x1a02ce60, 0x1a02b660
Caught exception in looking up space point ptr... 0x1a02b660, 0x1a02ce60
Caught exception in looking up space point ptr... 0x1d0a5390, 0x1d0a6ff0
Caught exception in looking up space point ptr... 0x1d0a6ff0, 0x1701ab90
Caught exception in looking up space point ptr... 0x1d0bf1d0, 0x17162050
Caught exception in looking up space point ptr... 0x17162050, 0x1d0af5d0
Caught exception in looking up space point ptr... 0x17162150, 0x1d0aa130
Caught exception in looking up space point ptr... 0x1d0aa130, 0x1d0bf1d0
Caught exception in looking up space point ptr... 0x442e5730, 0x520633f0
Caught exception in looking up space point ptr... 0x520633f0, 0x68f1f020
Caught exception in looking up space point ptr... 0x3a5e60f0, 0x17027470
Caught exception in looking up space point ptr... 0x17027470, 0x3a5debf0
Caught exception in looking up space point ptr... 0x3a5d1730, 0x72db0ae0
Caught exception in looking up space point ptr... 0x72db0ae0, 0x3a5d4c90
Caught exception in looking up space point ptr... 0x684274f0, 0x68427680
Caught exception in looking up space point ptr... 0x68427680, 0x684274f0
Caught exception in looking up space point ptr... 0x684274f0, 0x68427360
Caught exception in looking up space point ptr... 0x68427360, 0x684274f0
Caught exception in looking up space point ptr... 0x684274f0, 0x684279a0
Caught exception in looking up space point ptr... 0x684279a0, 0x684274f0
Caught exception in looking up space point ptr... 0x15b669f0, 0x15b5ec60
Caught exception in looking up space point ptr... 0x15b5ec60, 0x15b669f0
Caught exception in looking up space point ptr... 0x58aef8a0, 0x58aef710
Caught exception in looking up space point ptr... 0x58aef710, 0x58aef8a0
Caught exception in looking up space point ptr... 0x17df2620, 0x17df2490
Caught exception in looking up space point ptr... 0x17df2490, 0x17df2620
Caught exception in looking up space point ptr... 0x4312f390, 0x4312f230
Caught exception in looking up space point ptr... 0x13ade070, 0x4312f390
Caught exception in looking up space point ptr... 0x2d91a7d0, 0x3b4ee1c0
Caught exception in looking up space point ptr... 0x3b4ee1c0, 0x2d91a7d0
Caught exception in looking up space point ptr... 0x6843e1e0, 0x6843e050
Caught exception in looking up space point ptr... 0x6843e050, 0x6843e1e0
Caught exception in looking up space point ptr... 0x6843e1e0, 0x6843e370
Caught exception in looking up space point ptr... 0x6843e370, 0x6843e1e0
Caught exception in looking up space point ptr... 0x6843e1e0, 0x6843e690
Caught exception in looking up space point ptr... 0x6843e690, 0x6843e1e0
Caught exception in looking up space point ptr... 0x5510f950, 0x5510f7c0
Caught exception in looking up space point ptr... 0x5510f7c0, 0x5510f950
Caught exception in looking up space point ptr... 0x5510f950, 0x5510fe00
Caught exception in looking up space point ptr... 0x5510fe00, 0x5510f950
Caught exception in looking up space point ptr... 0x4de6d7d0, 0x4de6d6a0
Caught exception in looking up space point ptr... 0x4de6d6a0, 0x4de6d7d0
Caught exception in looking up space point ptr... 0x55120cf0, 0x55120980
Caught exception in looking up space point ptr... 0x55120980, 0x55120e80
Caught exception in looking up space point ptr... 0x55121010, 0x55120b10
Caught exception in looking up space point ptr... 0x55120b10, 0x55121010
Caught exception in looking up space point ptr... 0x5ac182b0, 0x11afea00
Caught exception in looking up space point ptr... 0x11afea00, 0x11afed20
Caught exception in looking up space point ptr... 0x17fe36a0, 0x17fe3510
Caught exception in looking up space point ptr... 0x1d0bd220, 0x17fe36a0
Caught exception in looking up space point ptr... 0x17e2f430, 0x62467a10
Caught exception in looking up space point ptr... 0x62467a10, 0x17e2f430
Caught exception in looking up space point ptr... 0x5d4e4760, 0x5d4e43f0
Caught exception in looking up space point ptr... 0x5d4e43f0, 0x5d4e4760
++++>>>> total num hits: 83987, num free: 80419
04-Feb-2026 00:42:46 UTC Closed output file "np02vd_raw_run042421_0104_df-s03-d1_dw_0_20260203T142716_reco_stage0_20260204T004246_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 84.2236 97.6473 110.046 98.1853 6.95405 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.0247e-05 0.000112538 0.000281065 8.5009e-05 5.39924e-05 27
produce:tpcrawdecoder:PDVDTPCReader 13.6442 14.2374 15.8891 14.1081 0.517867 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.678854 0.702414 0.73803 0.704069 0.0156935 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0227805 0.0230977 0.0242719 0.0230325 0.000273981 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.113233 0.113967 0.115579 0.113797 0.000558671 27
produce:beamevent:BeamEvent 9.3942e-05 0.000183127 0.00135794 0.000127443 0.000232944 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.12194 3.44425 3.72298 3.47951 0.188803 27
produce:ophit:OpHitFinder 0.021661 0.0374729 0.0428816 0.0385471 0.00407257 27
produce:wclsdatavd:WireCellToolkit 52.5151 61.7577 67.9375 62.4289 4.49113 27
produce:gaushit:GausHitFinder 0.407702 1.0061 1.59662 1.05176 0.274685 27
produce:nhitsfilter:NumberOfHitsFilter 0.000144639 0.000267239 0.000662442 0.000264079 9.39213e-05 27
produce:reco3d:SpacePointSolver 4.75618 9.82278 14.9938 9.8742 2.5973 27
produce:hitpdune:DisambigFromSpacePoints 0.0421782 0.105667 0.16446 0.105439 0.0319812 27
produce:cluster3d:Cluster3D 0.578241 2.57794 9.35413 2.05656 1.99814 27
[art]:TriggerResults:TriggerResultInserter 2.0051e-05 3.55929e-05 8.8514e-05 3.4412e-05 1.31378e-05 27
end_path:out1:RootOutput 4.136e-06 8.37344e-06 2.5278e-05 8.173e-06 4.19118e-06 27
end_path:out1:RootOutput(write) 2.59163 3.78319 4.5864 4.00678 0.582961 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4861.29 MB
Peak resident set size usage (VmHWM): 2581.52 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0104_df-s03-d1_dw_0_20260203T142716_reco_stage0_20260204T004246_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0104_df-s03-d1_dw_0_20260203T142716_reco_stage0_20260204T004246_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0104_df-s03-d1_dw_0_20260203T142716_reco_stage0_20260204T004246_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163064.0,
"core.end_time": 1770165768.0,
"core.events": [
16917,
16923,
16929,
16935,
16941,
16947,
16953,
16959,
16965,
16971,
16977,
16983,
16989,
16995,
17001,
17007,
17013,
17019,
17025,
17031,
17037,
17043,
17049,
17055,
17061,
17067,
17073
],
"core.event_count": 27,
"core.first_event_number": 16917,
"core.last_event_number": 17073,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0104_df-s03-d1_dw_0_20260203T142716.hdf5"
}
]
} 