Jobsub ID 303742.0@dunegpschedd01.fnal.gov
| Jobsub ID | 303742.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-04 01:32:30 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce15-multicore |
| Last heartbeat | 2026-02-04 04:47:13 |
| From worker node | Hostname | hnode63.pic.es |
| cpuinfo | AMD EPYC 7402P 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting |
| Started | 2026-02-04 01:33:14 |
| Input files | vd-protodune:np02vd_raw_run042421_0128_df-s02-d0_dw_0_20260203T144014.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11636s) |
| CPU time | 1h (4466s = 38%) |
| Max RSS bytes | 8572563456 (8175 MiB) |
| Outputting started | 2026-02-04 04:47:13 |
| Output files | |
| Finished | |
| List job events Live HTCondor job logs |
Jobscript log (last 10,000 characters)
Caught exception in looking up space point ptr... 0x6988fb80, 0x6988fa40
Caught exception in looking up space point ptr... 0x9d379cd0, 0x5c089100
Caught exception in looking up space point ptr... 0x2385ba10, 0x9d379cd0
Caught exception in looking up space point ptr... 0x48a52c80, 0x344f6e70
Caught exception in looking up space point ptr... 0x344f6e70, 0x5a616b60
Caught exception in looking up space point ptr... 0xb45f7320, 0x59c178d0
Caught exception in looking up space point ptr... 0x2aec84a0, 0x34debf30
Caught exception in looking up space point ptr... 0x34debf30, 0x255bdaa0
Caught exception in looking up space point ptr... 0x255bdaa0, 0x53297320
Caught exception in looking up space point ptr... 0x53297320, 0xb45f7320
Caught exception in looking up space point ptr... 0x59c1edc0, 0x40958ec0
Caught exception in looking up space point ptr... 0x40958810, 0x59c1edc0
Caught exception in looking up space point ptr... 0x23138d20, 0xc13cc00
Caught exception in looking up space point ptr... 0xc13cc00, 0xc13ca70
Caught exception in looking up space point ptr... 0x288f0ff0, 0x29dabcf0
Caught exception in looking up space point ptr... 0x29dabcf0, 0xb235cf60
Caught exception in looking up space point ptr... 0x43b5bad0, 0x9daa1100
Caught exception in looking up space point ptr... 0x9daa1100, 0x43b5bad0
Caught exception in looking up space point ptr... 0x52cf2e90, 0x5a597f50
Caught exception in looking up space point ptr... 0x5a597f50, 0x3ec7ecf0
Caught exception in looking up space point ptr... 0x49de1060, 0x49de0f30
Caught exception in looking up space point ptr... 0x49de0f30, 0x49de1060
Caught exception in looking up space point ptr... 0x22b5fda0, 0x22b651f0
Caught exception in looking up space point ptr... 0x22b651f0, 0x22b65380
Caught exception in looking up space point ptr... 0x22b65380, 0x22b68240
Caught exception in looking up space point ptr... 0x5f080060, 0x5f07ff10
Caught exception in looking up space point ptr... 0x5f07ff10, 0x5f080060
Caught exception in looking up space point ptr... 0x51ece380, 0x8821c480
Caught exception in looking up space point ptr... 0x8821c480, 0x8821c2e0
Caught exception in looking up space point ptr... 0x11878fd30, 0x356f0c30
Caught exception in looking up space point ptr... 0x356f0c30, 0x45d25dc0
Caught exception in looking up space point ptr... 0x4410be40, 0x22380900
Caught exception in looking up space point ptr... 0x22380900, 0x22380b00
Caught exception in looking up space point ptr... 0x5c036ab0, 0x13a21ac0
Caught exception in looking up space point ptr... 0x13a21ac0, 0x5c036ab0
Caught exception in looking up space point ptr... 0x2ec14dd0, 0x10bd6a30
Caught exception in looking up space point ptr... 0x10bd6a30, 0x5a616ff0
Caught exception in looking up space point ptr... 0x5a0a0fb0, 0x1111ed50
Caught exception in looking up space point ptr... 0x1111ed50, 0x59d53810
Caught exception in looking up space point ptr... 0x644b5e90, 0x9d792480
Caught exception in looking up space point ptr... 0x9d792480, 0x52f8e790
Caught exception in looking up space point ptr... 0x13d2c680, 0x5bfdeb00
Caught exception in looking up space point ptr... 0x5bfdeb00, 0x2f1cc870
Caught exception in looking up space point ptr... 0x2eb4b530, 0x3a255a90
Caught exception in looking up space point ptr... 0x3a255a90, 0x3a255c20
Caught exception in looking up space point ptr... 0x381f3660, 0x74443d0
Caught exception in looking up space point ptr... 0x74443d0, 0x381f3660
Caught exception in looking up space point ptr... 0x49b20de0, 0x23aa7d30
Caught exception in looking up space point ptr... 0x23aa7d30, 0x23aa80a0
Caught exception in looking up space point ptr... 0x23aa80a0, 0x23aa7e20
Caught exception in looking up space point ptr... 0x23aa7e20, 0x49b211a0
Caught exception in looking up space point ptr... 0xa602add0, 0x2412a120
Caught exception in looking up space point ptr... 0x2412a120, 0x24128d40
Caught exception in looking up space point ptr... 0x51eb9800, 0x1187b0d20
Caught exception in looking up space point ptr... 0x1187b0d20, 0x51eb9800
Caught exception in looking up space point ptr... 0x5f048f90, 0xc143830
Caught exception in looking up space point ptr... 0xc143830, 0x5f048f90
Caught exception in looking up space point ptr... 0x2e294e50, 0x2f0d2850
Caught exception in looking up space point ptr... 0x2f0d2850, 0x2e294e50
Caught exception in looking up space point ptr... 0x5cd77620, 0x4cb85d00
Caught exception in looking up space point ptr... 0x4cb85d00, 0x5cd77620
Caught exception in looking up space point ptr... 0xe495a90, 0x5c24d7d0
Caught exception in looking up space point ptr... 0x5c24d7d0, 0xe495a90
Caught exception in looking up space point ptr... 0x3cab21f0, 0x3cab1e50
Caught exception in looking up space point ptr... 0x3cab1e50, 0x3cab1f50
++++>>>> total num hits: 55035, num free: 52930
04-Feb-2026 05:47:03 CET Closed output file "np02vd_raw_run042421_0128_df-s02-d0_dw_0_20260203T144014_reco_stage0_20260204T044703_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 255.731 427.282 962.335 370.653 183.683 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.1092e-05 9.40341e-05 0.000264617 9.2352e-05 3.69531e-05 27
produce:tpcrawdecoder:PDVDTPCReader 154.409 239.633 308.467 245.49 41.0347 27
produce:triggerrawdecoder:PDVDTriggerReader4 1.13757 1.56985 3.29086 1.4386 0.492388 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0339505 0.0668741 0.847137 0.0354982 0.153058 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.168674 0.19087 0.209014 0.20402 0.0170708 27
produce:beamevent:BeamEvent 6.7102e-05 0.000185095 0.00196301 0.000120633 0.000349823 27
produce:pdvddaphne:DAPHNEReaderPDVD 14.9436 27.7555 35.4236 28.4817 4.77027 27
produce:ophit:OpHitFinder 0.0310487 0.0392517 0.0526323 0.0384751 0.0050355 27
produce:wclsdatavd:WireCellToolkit 58.4292 66.1698 76.7028 64.5149 4.53093 27
produce:gaushit:GausHitFinder 0.573325 1.87642 9.23625 0.988634 2.07061 27
produce:nhitsfilter:NumberOfHitsFilter 0.000175615 0.00055635 0.00176819 0.000355421 0.00041333 27
produce:reco3d:SpacePointSolver 5.85476 17.5658 69.6808 10.8194 17.4462 27
produce:hitpdune:DisambigFromSpacePoints 0.0536306 0.527203 2.93182 0.109499 0.911227 27
produce:cluster3d:Cluster3D 0.855274 66.774 530.198 2.08124 143.762 27
[art]:TriggerResults:TriggerResultInserter 2.051e-05 2.96557e-05 7.8452e-05 2.6211e-05 1.22707e-05 27
end_path:out1:RootOutput 3.26e-06 5.65133e-06 3.7231e-05 4.06e-06 6.32266e-06 27
end_path:out1:RootOutput(write) 3.09591 5.06853 16.3631 3.46995 3.5211 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 10767.6 MB
Peak resident set size usage (VmHWM): 8572.56 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0128_df-s02-d0_dw_0_20260203T144014_reco_stage0_20260204T044703_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0128_df-s02-d0_dw_0_20260203T144014_reco_stage0_20260204T044703_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0128_df-s02-d0_dw_0_20260203T144014_reco_stage0_20260204T044703_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770168805.0,
"core.end_time": 1770180425.0,
"core.events": [
20802,
20808,
20814,
20820,
20826,
20832,
20838,
20844,
20850,
20856,
20862,
20868,
20874,
20880,
20886,
20892,
20898,
20904,
20910,
20916,
20922,
20928,
20934,
20940,
20946,
20952,
20958
],
"core.event_count": 27,
"core.first_event_number": 20802,
"core.last_event_number": 20958,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0128_df-s02-d0_dw_0_20260203T144014.hdf5"
}
]
} 