Jobsub ID 303653.89@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.89@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-02-04 00:19:04 |
| From worker node | Hostname | td108.pic.es |
| cpuinfo | AMD EPYC 9825 144-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:41:10 |
| Input files | vd-protodune:np02vd_raw_run042421_0110_df-s03-d1_dw_0_20260203T143032.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 36m (2181s) |
| CPU time | 28m (1724s = 79%) |
| Max RSS bytes | 2526367744 (2409 MiB) |
| Outputting started | 2026-02-04 00:17:32 |
| Output files | |
| Finished | 2026-02-04 00:19:04 |
| Saved logs | justin-logs:303653.89-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0
Caught exception in looking up space point ptr... 0x45270020, 0x4526fa20
Caught exception in looking up space point ptr... 0x296ce380, 0x2a5478d0
Caught exception in looking up space point ptr... 0x2a547bb0, 0x296ce380
Caught exception in looking up space point ptr... 0xd4bdad0, 0x1471e520
Caught exception in looking up space point ptr... 0x1471e520, 0xd4bdad0
Caught exception in looking up space point ptr... 0x46fae220, 0x46fadf90
Caught exception in looking up space point ptr... 0x46fadf90, 0x46fae220
Caught exception in looking up space point ptr... 0x9acfb50, 0x9acfc50
Caught exception in looking up space point ptr... 0x9acfc50, 0x3b4e5020
Caught exception in looking up space point ptr... 0x9afe1a0, 0x24d252d0
Caught exception in looking up space point ptr... 0x24d252d0, 0x3f4bd760
Caught exception in looking up space point ptr... 0x4faec990, 0x3deea840
Caught exception in looking up space point ptr... 0x3deea840, 0x4faec990
Caught exception in looking up space point ptr... 0x585ddbf0, 0x32fc1bf0
Caught exception in looking up space point ptr... 0x32fc1bf0, 0x585ddbf0
Caught exception in looking up space point ptr... 0x30540870, 0x3053f950
Caught exception in looking up space point ptr... 0x3053f950, 0x30540870
Caught exception in looking up space point ptr... 0x29c5dbc0, 0x3ec48910
Caught exception in looking up space point ptr... 0x29c5dac0, 0x29c5dbc0
Caught exception in looking up space point ptr... 0x3067ebe0, 0x288c05a0
Caught exception in looking up space point ptr... 0x288c05a0, 0x5c49d990
Caught exception in looking up space point ptr... 0x4f2ca8d0, 0x60a70600
Caught exception in looking up space point ptr... 0x60a70600, 0x46f06ae0
Caught exception in looking up space point ptr... 0x46f06ae0, 0x2affce30
Caught exception in looking up space point ptr... 0x2affce30, 0x8285280
Caught exception in looking up space point ptr... 0x4fae5490, 0x4fae4b70
Caught exception in looking up space point ptr... 0x4fae4b70, 0x4fae4ce0
Caught exception in looking up space point ptr... 0x4547c2f0, 0x44d096d0
Caught exception in looking up space point ptr... 0x44d096d0, 0x4547c2f0
Caught exception in looking up space point ptr... 0x4547c2f0, 0x4547bf60
Caught exception in looking up space point ptr... 0x4547bf60, 0x4547c2f0
Caught exception in looking up space point ptr... 0x35de1940, 0x356a6190
Caught exception in looking up space point ptr... 0x356a6190, 0x35de17e0
Caught exception in looking up space point ptr... 0x5384bd20, 0x53847330
Caught exception in looking up space point ptr... 0x53847330, 0x5384bd20
Caught exception in looking up space point ptr... 0x14350010, 0x4d3d6f60
Caught exception in looking up space point ptr... 0x653ad80, 0x14350010
Caught exception in looking up space point ptr... 0x60a724a0, 0x60a72310
Caught exception in looking up space point ptr... 0x60a72310, 0x60a724a0
Caught exception in looking up space point ptr... 0x13420980, 0x4b5b8880
Caught exception in looking up space point ptr... 0x4b5b8880, 0x13420980
Caught exception in looking up space point ptr... 0x306e5e20, 0x214403b0
Caught exception in looking up space point ptr... 0x214403b0, 0x306e5e20
Caught exception in looking up space point ptr... 0x3ec7f070, 0x3bcbdae0
Caught exception in looking up space point ptr... 0x3bcbdae0, 0x27adebb0
Caught exception in looking up space point ptr... 0x3f5d37a0, 0x1360ba40
Caught exception in looking up space point ptr... 0x1360ba40, 0x352c4e20
Caught exception in looking up space point ptr... 0x352c4e20, 0x20bc7960
Caught exception in looking up space point ptr... 0x20bc7960, 0x3f5d37a0
Caught exception in looking up space point ptr... 0x25f0afa0, 0x25f0aaf0
Caught exception in looking up space point ptr... 0x25f0aaf0, 0x25f0afa0
Caught exception in looking up space point ptr... 0x10402750, 0x103fa6a0
Caught exception in looking up space point ptr... 0x103fa6a0, 0x350e92e0
Caught exception in looking up space point ptr... 0x14756300, 0x20e03330
Caught exception in looking up space point ptr... 0x20e03330, 0x14756300
Caught exception in looking up space point ptr... 0x20ba6590, 0x49c2a3d0
Caught exception in looking up space point ptr... 0x49c2a3d0, 0x49c29de0
Caught exception in looking up space point ptr... 0x24c1c310, 0x451d49b0
Caught exception in looking up space point ptr... 0x451d49b0, 0x451d48b0
Caught exception in looking up space point ptr... 0x101223f0, 0x3dedc730
Caught exception in looking up space point ptr... 0x3dedc730, 0x101223f0
Caught exception in looking up space point ptr... 0x356a50f0, 0x2b18cba0
Caught exception in looking up space point ptr... 0x2b18cba0, 0x356a50f0
Caught exception in looking up space point ptr... 0x269b6e30, 0x32fafed0
Caught exception in looking up space point ptr... 0x32fafed0, 0x307917e0
++++>>>> total num hits: 60738, num free: 58138
04-Feb-2026 01:17:19 CET Closed output file "np02vd_raw_run042421_0110_df-s03-d1_dw_0_20260203T143032_reco_stage0_20260204T001719_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 74.044 77.7758 91.3187 76.9117 3.47691 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.411e-05 0.00011218 0.000272091 0.00010509 4.04857e-05 27
produce:tpcrawdecoder:PDVDTPCReader 15.1104 15.5146 15.8155 15.5466 0.195553 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.883741 0.908052 0.927845 0.91386 0.0145223 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0294154 0.0299797 0.0336222 0.0298375 0.000739768 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.146419 0.148787 0.177693 0.147824 0.00570561 27
produce:beamevent:BeamEvent 0.000124371 0.000212896 0.00135034 0.00017123 0.000224402 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.16302 2.3769 2.58004 2.35491 0.104653 27
produce:ophit:OpHitFinder 0.0228611 0.0328108 0.0388645 0.0333341 0.00374282 27
produce:wclsdatavd:WireCellToolkit 44.4065 45.909 47.6868 46.1171 0.781656 27
produce:gaushit:GausHitFinder 0.489622 0.670454 0.978565 0.645514 0.131032 27
produce:nhitsfilter:NumberOfHitsFilter 0.000174571 0.000230211 0.000728403 0.000207741 0.000100906 27
produce:reco3d:SpacePointSolver 4.82977 7.60139 10.8809 7.10879 1.66473 27
produce:hitpdune:DisambigFromSpacePoints 0.0452091 0.0695179 0.161503 0.0629033 0.0235018 27
produce:cluster3d:Cluster3D 0.62382 1.60255 10.2443 1.14245 1.75267 27
[art]:TriggerResults:TriggerResultInserter 3.188e-05 5.34523e-05 0.000148051 5.044e-05 2.2461e-05 27
end_path:out1:RootOutput 7.401e-06 1.24334e-05 3.719e-05 1.118e-05 6.04518e-06 27
end_path:out1:RootOutput(write) 2.67622 2.88284 3.32096 2.85038 0.132539 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4589.92 MB
Peak resident set size usage (VmHWM): 2526.37 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0110_df-s03-d1_dw_0_20260203T143032_reco_stage0_20260204T001719_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0110_df-s03-d1_dw_0_20260203T143032_reco_stage0_20260204T001719_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0110_df-s03-d1_dw_0_20260203T143032_reco_stage0_20260204T001719_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162077.0,
"core.end_time": 1770164240.0,
"core.events": [
17889,
17895,
17901,
17907,
17913,
17919,
17925,
17931,
17937,
17943,
17949,
17955,
17961,
17967,
17973,
17979,
17985,
17991,
17997,
18003,
18009,
18015,
18021,
18027,
18033,
18039,
18045
],
"core.event_count": 27,
"core.first_event_number": 17889,
"core.last_event_number": 18045,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0110_df-s03-d1_dw_0_20260203T143032.hdf5"
}
]
} 