Jobsub ID 303678.4@dunegpschedd01.fnal.gov
| Jobsub ID | 303678.4@dunegpschedd01.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:48:27 |
| Site | UK_Oxford |
| Entry | DUNE_UK_SGrid_Oxford_arc01 |
| Last heartbeat | 2026-02-04 03:47:03 |
| From worker node | Hostname | t2wn070.physics.ox.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:18:10 |
| Input files | vd-protodune:np02vd_raw_run042422_0078_df-s03-d1_dw_0_20260203T155655.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12226s) |
| CPU time | 2h (7844s = 64%) |
| Max RSS bytes | 12973965312 (12372 MiB) |
| Outputting started | 2026-02-04 03:42:02 |
| Output files | |
| Finished | 2026-02-04 03:47:03 |
| Saved logs | justin-logs:303678.4-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
eption in looking up space point ptr... 0x459d9dd0, 0x459d7e20
Caught exception in looking up space point ptr... 0x459d7e20, 0x459d9dd0
Caught exception in looking up space point ptr... 0x574f9fb0, 0x574f9e20
Caught exception in looking up space point ptr... 0x574f9e20, 0x574f9fb0
Caught exception in looking up space point ptr... 0xf5fa740, 0x54620a80
Caught exception in looking up space point ptr... 0x54620a80, 0x564f9dd0
Caught exception in looking up space point ptr... 0x564f9dd0, 0x564f9b80
Caught exception in looking up space point ptr... 0x564f9b80, 0xf5fa740
Caught exception in looking up space point ptr... 0x46d219e0, 0x36dd7940
Caught exception in looking up space point ptr... 0x36dd7940, 0x36dd7a40
Caught exception in looking up space point ptr... 0x2638d600, 0x2638efc0
Caught exception in looking up space point ptr... 0x2638efc0, 0x2638f0d0
Caught exception in looking up space point ptr... 0x41dfdbe0, 0x41dfda50
Caught exception in looking up space point ptr... 0x41dfda50, 0x41dfd8e0
Caught exception in looking up space point ptr... 0x567a9490, 0x43dfa040
Caught exception in looking up space point ptr... 0x567a9170, 0x567a9300
Caught exception in looking up space point ptr... 0x567a9300, 0x567a9490
Caught exception in looking up space point ptr... 0x3a5d1030, 0x4209f1c0
Caught exception in looking up space point ptr... 0x4209f1c0, 0x5a3c25e0
Caught exception in looking up space point ptr... 0x4d257a40, 0x4d257590
Caught exception in looking up space point ptr... 0x4d257590, 0x4d257a40
Caught exception in looking up space point ptr... 0x4a48aa00, 0x4a48a6e0
Caught exception in looking up space point ptr... 0x4a48a6e0, 0x4a48aa00
Caught exception in looking up space point ptr... 0x4a48aa00, 0x4a48a870
Caught exception in looking up space point ptr... 0x4a48a870, 0x4a48aa00
Caught exception in looking up space point ptr... 0x159cb670, 0x159cc6f0
Caught exception in looking up space point ptr... 0x159cc6f0, 0x159cb670
Caught exception in looking up space point ptr... 0x4a4aa5e0, 0x4a4aa6e0
Caught exception in looking up space point ptr... 0x4a4aa6e0, 0x241f1540
Caught exception in looking up space point ptr... 0x11b9f970, 0x3e12a6f0
Caught exception in looking up space point ptr... 0x3e12a6f0, 0x11b9f970
Caught exception in looking up space point ptr... 0x2d9660e0, 0x4495f0c0
Caught exception in looking up space point ptr... 0x4495f0c0, 0x2d9660e0
Caught exception in looking up space point ptr... 0xb050160, 0x112e67e0
Caught exception in looking up space point ptr... 0x112e67e0, 0x112e6590
Caught exception in looking up space point ptr... 0x112e6590, 0x567a8ad0
Caught exception in looking up space point ptr... 0x567a8ad0, 0xef66210
Caught exception in looking up space point ptr... 0x4ebc52e0, 0x4ebc5100
Caught exception in looking up space point ptr... 0x4ebc5100, 0x4ebc52e0
Caught exception in looking up space point ptr... 0x5498bb20, 0x5498be40
Caught exception in looking up space point ptr... 0x5498be40, 0x5498bcb0
Caught exception in looking up space point ptr... 0x31b43520, 0x31b43a20
Caught exception in looking up space point ptr... 0x31b43a20, 0x31b43520
Caught exception in looking up space point ptr... 0xaec0c10, 0xaebff70
Caught exception in looking up space point ptr... 0xaebff70, 0xaec0c10
Caught exception in looking up space point ptr... 0x2f66a130, 0x4a846690
Caught exception in looking up space point ptr... 0x4a846690, 0x4e865840
Caught exception in looking up space point ptr... 0x8092b10, 0x4a03d510
Caught exception in looking up space point ptr... 0x4a03d510, 0x2705f370
Caught exception in looking up space point ptr... 0x56394e40, 0x56395020
Caught exception in looking up space point ptr... 0x56395020, 0x56394e40
Caught exception in looking up space point ptr... 0x143e51990, 0x57763670
Caught exception in looking up space point ptr... 0x57763670, 0x143e51990
Caught exception in looking up space point ptr... 0x4d25fb20, 0x4d25f800
Caught exception in looking up space point ptr... 0x4d25f800, 0x4d25fb20
Caught exception in looking up space point ptr... 0x567a8e70, 0x2def92f0
Caught exception in looking up space point ptr... 0x2def92f0, 0x567a8e70
Caught exception in looking up space point ptr... 0x643c19a0, 0x646ba4e0
Caught exception in looking up space point ptr... 0x646ba4e0, 0x643c19a0
Caught exception in looking up space point ptr... 0x2cc87010, 0x2cc86ee0
Caught exception in looking up space point ptr... 0x2cc86ee0, 0xb620a7b0
Caught exception in looking up space point ptr... 0x36fa5e70, 0x36fa5ce0
Caught exception in looking up space point ptr... 0x36fa5ce0, 0x36fa5e70
Caught exception in looking up space point ptr... 0xb620ab40, 0xb62092e0
Caught exception in looking up space point ptr... 0xb62092e0, 0xb620ab40
++++>>>> total num hits: 99301, num free: 96513
04-Feb-2026 03:41:35 GMT Closed output file "np02vd_raw_run042422_0078_df-s03-d1_dw_0_20260203T155655_reco_stage0_20260204T034135_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 188.935 432.367 1621.14 259.149 380.216 28
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.088e-05 0.000158549 0.000327874 0.00011495 6.5449e-05 28
produce:tpcrawdecoder:PDVDTPCReader 92.6194 137.434 198.685 136.301 28.7686 28
produce:triggerrawdecoder:PDVDTriggerReader4 0.620773 0.871637 1.20403 0.832203 0.164116 28
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0192887 0.029162 0.0689896 0.0250244 0.013954 28
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.096371 0.0992375 0.117035 0.0971019 0.00589425 28
produce:beamevent:BeamEvent 0.000108994 0.000218204 0.00153749 0.000165671 0.000256017 28
produce:pdvddaphne:DAPHNEReaderPDVD 11.2615 18.0234 25.9703 17.9123 3.84518 28
produce:ophit:OpHitFinder 0.0351203 0.0439859 0.0541562 0.0447246 0.00474942 28
produce:wclsdatavd:WireCellToolkit 59.8911 73.3487 90.83 73.0365 8.36138 28
produce:gaushit:GausHitFinder 0.801293 2.29087 10.4464 1.14405 2.47915 28
produce:nhitsfilter:NumberOfHitsFilter 0.000235432 0.000562605 0.00150386 0.000361784 0.000413959 28
produce:reco3d:SpacePointSolver 8.12671 36.8541 172.509 14.7967 46.9562 28
produce:hitpdune:DisambigFromSpacePoints 0.0701367 1.49191 7.83317 0.122585 2.67286 28
produce:cluster3d:Cluster3D 1.55149 154.103 1132.47 2.60425 310.236 28
[art]:TriggerResults:TriggerResultInserter 2.5027e-05 4.00493e-05 0.000138229 3.29715e-05 2.1111e-05 28
end_path:out1:RootOutput 5.902e-06 1.31332e-05 4.8782e-05 1.06495e-05 9.7751e-06 28
end_path:out1:RootOutput(write) 3.40261 7.7173 32.2286 3.95507 7.69831 28
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 15769.4 MB
Peak resident set size usage (VmHWM): 12974 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0078_df-s03-d1_dw_0_20260203T155655_reco_stage0_20260204T034135_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0078_df-s03-d1_dw_0_20260203T155655_reco_stage0_20260204T034135_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0078_df-s03-d1_dw_0_20260203T155655_reco_stage0_20260204T034135_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770164308.0,
"core.end_time": 1770176498.0,
"core.events": [
12645,
12651,
12657,
12663,
12669,
12675,
12681,
12687,
12693,
12699,
12705,
12711,
12717,
12723,
12729,
12735,
12741,
12747,
12753,
12759,
12765,
12771,
12777,
12783,
12789,
12795,
12801,
12807
],
"core.event_count": 28,
"core.first_event_number": 12645,
"core.last_event_number": 12807,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0078_df-s03-d1_dw_0_20260203T155655.hdf5"
}
]
} 