Jobsub ID 303290.0@dunegpschedd01.fnal.gov
| Jobsub ID | 303290.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12663 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 07:48:36 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-02-03 09:10:28 |
| From worker node | Hostname | hnode66.pic.es |
| cpuinfo | AMD EPYC 7402P 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 07:49:35 |
| Input files | vd-protodune:np02vd_raw_run039273_0000_df-s05-d2_dw_0_20250831T094635.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 59m (3557s) |
| CPU time | 50m (3023s = 84%) |
| Max RSS bytes | 3908677632 (3727 MiB) |
| Outputting started | 2026-02-03 08:48:54 |
| Output files | |
| Finished | 2026-02-03 09:10:28 |
| Saved logs | justin-logs:303290.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
tr... 0x13f04a00, 0x13f04870
Caught exception in looking up space point ptr... 0x5997ee90, 0x13f04a00
Caught exception in looking up space point ptr... 0x495a8980, 0x745ff920
Caught exception in looking up space point ptr... 0x745ff920, 0x5e08a620
Caught exception in looking up space point ptr... 0x620fca50, 0x620fcf00
Caught exception in looking up space point ptr... 0x620fc410, 0x620fca50
Caught exception in looking up space point ptr... 0x18e0e8f0, 0xe57a1a0
Caught exception in looking up space point ptr... 0x18e0ea80, 0x18e0e8f0
Caught exception in looking up space point ptr... 0x3a9aad50, 0x3b760a60
Caught exception in looking up space point ptr... 0x3b761b90, 0x3a9aad50
Caught exception in looking up space point ptr... 0x664f8d40, 0x664e53d0
Caught exception in looking up space point ptr... 0x664e53d0, 0x664e54d0
Caught exception in looking up space point ptr... 0x58729140, 0x3b8625e0
Caught exception in looking up space point ptr... 0x5b60d0a0, 0x58729140
Caught exception in looking up space point ptr... 0x14f6e270, 0x452af750
Caught exception in looking up space point ptr... 0x452af750, 0x14f6e270
Caught exception in looking up space point ptr... 0x664b6010, 0x49720e90
Caught exception in looking up space point ptr... 0x49720e90, 0x745fb7c0
Caught exception in looking up space point ptr... 0x6613a110, 0x6613a070
Caught exception in looking up space point ptr... 0x59448f60, 0x6613a110
Caught exception in looking up space point ptr... 0x10b76040, 0x6abee590
Caught exception in looking up space point ptr... 0x6abee590, 0x875f3b80
Caught exception in looking up space point ptr... 0x10b755f0, 0x3e4df8d0
Caught exception in looking up space point ptr... 0x3e4df8d0, 0x195b1ac0
Caught exception in looking up space point ptr... 0x69a5c3d0, 0x1dba0cc0
Caught exception in looking up space point ptr... 0x1dba0cc0, 0x69a5c3d0
Caught exception in looking up space point ptr... 0x8d6f520, 0x8d6f650
Caught exception in looking up space point ptr... 0x8d692e0, 0x8d6f520
Caught exception in looking up space point ptr... 0x79931d20, 0x79935aa0
Caught exception in looking up space point ptr... 0x79935aa0, 0x79931d20
Caught exception in looking up space point ptr... 0x65f9d1b0, 0x65fa0650
Caught exception in looking up space point ptr... 0x65fa0650, 0x65fa08a0
Caught exception in looking up space point ptr... 0x5a409400, 0x5a3db290
Caught exception in looking up space point ptr... 0x5a3db290, 0x5a409400
Caught exception in looking up space point ptr... 0x755ab1a0, 0x755ab010
Caught exception in looking up space point ptr... 0x755ab010, 0x755aaca0
Caught exception in looking up space point ptr... 0x3b893ab0, 0x5c3dde40
Caught exception in looking up space point ptr... 0x5c3dde40, 0x3b893ab0
Caught exception in looking up space point ptr... 0x613d4660, 0x36916dd0
Caught exception in looking up space point ptr... 0x36916dd0, 0x613d4660
Caught exception in looking up space point ptr... 0x59232d70, 0x59230d30
Caught exception in looking up space point ptr... 0x59230d30, 0x59249030
Caught exception in looking up space point ptr... 0x628fc060, 0x6c1bfcf0
Caught exception in looking up space point ptr... 0x6c1bfcf0, 0x628f4c70
Caught exception in looking up space point ptr... 0x4b522c50, 0x41794490
Caught exception in looking up space point ptr... 0x41794490, 0x4d4ec760
Caught exception in looking up space point ptr... 0x628f2330, 0x62917d60
Caught exception in looking up space point ptr... 0x628f3ac0, 0x628f2330
Caught exception in looking up space point ptr... 0x4cd4d700, 0x1e94ca80
Caught exception in looking up space point ptr... 0x1e94ca80, 0x40c8bae0
Caught exception in looking up space point ptr... 0x5c556500, 0x7596db50
Caught exception in looking up space point ptr... 0x7596db50, 0x5c556500
Caught exception in looking up space point ptr... 0x1ef03120, 0x60527ed0
Caught exception in looking up space point ptr... 0x60527ed0, 0x6298c040
Caught exception in looking up space point ptr... 0x8d22660, 0x8d22400
Caught exception in looking up space point ptr... 0x8d22400, 0x8d22660
Caught exception in looking up space point ptr... 0x8d22660, 0x8d22530
Caught exception in looking up space point ptr... 0x8d22530, 0x8d22660
Caught exception in looking up space point ptr... 0x4b0f73d0, 0x4b0f6610
Caught exception in looking up space point ptr... 0x4b0f6610, 0x4b0f73d0
Caught exception in looking up space point ptr... 0x4b0f73d0, 0x4b0f6ca0
Caught exception in looking up space point ptr... 0x4b0f6ca0, 0x4b0f73d0
Caught exception in looking up space point ptr... 0x8d70360, 0x8d70490
Caught exception in looking up space point ptr... 0x8d70490, 0x8d70360
Caught exception in looking up space point ptr... 0x8c83b690, 0x7c086c70
Caught exception in looking up space point ptr... 0x7c086c70, 0x8c83b690
Caught exception in looking up space point ptr... 0x74c4bed0, 0x74c4bd80
Caught exception in looking up space point ptr... 0x74c4bd80, 0x74c4bed0
++++>>>> total num hits: 160340, num free: 155418
03-Feb-2026 09:48:32 CET Closed output file "np02vd_raw_run039273_0000_df-s05-d2_dw_0_20250831T094635_reco_stage0_20260203T084832_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 171.545 191.542 229.361 185.957 17.5023 18
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.2053e-05 0.000107597 0.00027147 9.81785e-05 4.14512e-05 18
produce:tpcrawdecoder:PDVDTPCReader 22.0259 27.6782 60.9072 22.8545 10.667 18
produce:triggerrawdecoder:PDVDTriggerReader4 0.0723015 0.0753049 0.086121 0.0726334 0.00485336 18
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0362754 0.0408471 0.0497941 0.0368367 0.00516233 18
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.180248 0.19574 0.424011 0.18116 0.0554366 18
produce:beamevent:BeamEvent 0.000313021 1.40296 24.8468 0.000715491 5.68622 18
produce:pdvddaphne:DAPHNEReaderPDVD 5.852 6.92025 12.2627 6.40032 1.55365 18
produce:ophit:OpHitFinder 0.0350594 0.0485766 0.0621659 0.0484656 0.00755937 18
produce:wclsdatavd:WireCellToolkit 116.107 123.147 138.825 123.735 5.63349 18
produce:gaushit:GausHitFinder 0.662925 1.3128 2.09457 1.29498 0.31062 18
produce:nhitsfilter:NumberOfHitsFilter 0.000281541 0.000499325 0.00191131 0.000390259 0.000365276 18
produce:reco3d:SpacePointSolver 7.22575 16.0391 22.3059 17.1147 4.36383 18
produce:hitpdune:DisambigFromSpacePoints 0.0981542 0.299681 0.474424 0.28721 0.101767 18
produce:cluster3d:Cluster3D 1.42722 8.54252 16.4549 7.94143 3.6827 18
[art]:TriggerResults:TriggerResultInserter 2.0161e-05 3.15523e-05 7.9963e-05 2.5601e-05 1.45223e-05 18
end_path:out1:RootOutput 3.47e-06 6.184e-06 2.441e-05 4.35e-06 5.62383e-06 18
end_path:out1:RootOutput(write) 4.85119 5.79774 7.85899 5.66762 0.618986 18
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5854.54 MB
Peak resident set size usage (VmHWM): 3908.68 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039273_0000_df-s05-d2_dw_0_20250831T094635_reco_stage0_20260203T084832_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run039273_0000_df-s05-d2_dw_0_20250831T094635_reco_stage0_20260203T084832_offline.root
Ran successfully
{
"name": "np02vd_raw_run039273_0000_df-s05-d2_dw_0_20250831T094635_reco_stage0_20260203T084832_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_beam.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770104987.0,
"core.end_time": 1770108514.0,
"core.events": [
16,
36,
56,
76,
96,
116,
136,
156,
176,
196,
216,
236,
256,
276,
296,
316,
336,
356
],
"core.event_count": 18,
"core.first_event_number": 16,
"core.last_event_number": 356,
"core.data_stream": "physics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39273
],
"core.runs_subruns": [
3927300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039273_0000_df-s05-d2_dw_0_20250831T094635.hdf5"
}
]
} 