Jobsub ID 297923.90@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.90@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce513 |
| Last heartbeat | 2026-02-04 00:59:33 |
| From worker node | Hostname | b9p12p8471.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:00:22 |
| Input files | vd-protodune:np02vd_raw_run042433_0044_df-s02-d1_dw_0_20260203T185849.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 56m (3389s) |
| CPU time | 54m (3249s = 95%) |
| Max RSS bytes | 3612905472 (3445 MiB) |
| Outputting started | 2026-02-04 00:56:53 |
| Output files | |
| Finished | 2026-02-04 00:59:33 |
| Saved logs | justin-logs:297923.90-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
looking up space point ptr... 0x1a4e1c90, 0x50f59f40
Caught exception in looking up space point ptr... 0x581282d0, 0x16ea82d0
Caught exception in looking up space point ptr... 0x16ea82d0, 0x16ece280
Caught exception in looking up space point ptr... 0x58127740, 0x5c65e4c0
Caught exception in looking up space point ptr... 0x5c65e4c0, 0x6510d6d0
Caught exception in looking up space point ptr... 0x44208ac0, 0x3e55da50
Caught exception in looking up space point ptr... 0x3e55da50, 0x61bc9630
Caught exception in looking up space point ptr... 0x58116b50, 0x58116900
Caught exception in looking up space point ptr... 0x58116900, 0x58116da0
Caught exception in looking up space point ptr... 0x3a78cbe0, 0x5bb047f0
Caught exception in looking up space point ptr... 0x5bb047f0, 0x5bb04980
Caught exception in looking up space point ptr... 0x624c66b0, 0x2c482eb0
Caught exception in looking up space point ptr... 0x2c482eb0, 0x624c66b0
Caught exception in looking up space point ptr... 0x79e83970, 0x2cbcb9f0
Caught exception in looking up space point ptr... 0x2cbcb9f0, 0x5ac5f00
Caught exception in looking up space point ptr... 0x14b2fbd0, 0xaedfe40
Caught exception in looking up space point ptr... 0xaedfe40, 0x43199d10
Caught exception in looking up space point ptr... 0x4aadc8b0, 0x3d56e0d0
Caught exception in looking up space point ptr... 0x6b72e460, 0x4aadc8b0
Caught exception in looking up space point ptr... 0x38b84820, 0x38b73200
Caught exception in looking up space point ptr... 0x38b92470, 0x38b84820
Caught exception in looking up space point ptr... 0x45c5fc80, 0x3a2564c0
Caught exception in looking up space point ptr... 0x3a2564c0, 0x3a267c70
Caught exception in looking up space point ptr... 0x191657a0, 0x37734ba0
Caught exception in looking up space point ptr... 0x19165930, 0x191657a0
Caught exception in looking up space point ptr... 0x5c4dcc10, 0x5c4dca80
Caught exception in looking up space point ptr... 0x5c4dca80, 0x5c4b2a30
Caught exception in looking up space point ptr... 0x74325640, 0x8ade090
Caught exception in looking up space point ptr... 0x8d958b0, 0x74325640
Caught exception in looking up space point ptr... 0x58136a10, 0x58116660
Caught exception in looking up space point ptr... 0x58116660, 0x58115f70
Caught exception in looking up space point ptr... 0x2e657e40, 0x2e647310
Caught exception in looking up space point ptr... 0x2e647310, 0x2e635390
Caught exception in looking up space point ptr... 0x85a09710, 0x85a19f20
Caught exception in looking up space point ptr... 0x85a19f20, 0x85a2c350
Caught exception in looking up space point ptr... 0x6f3e9070, 0x6f3d7730
Caught exception in looking up space point ptr... 0x6f3d7730, 0x6f3c9f90
Caught exception in looking up space point ptr... 0x121eabb0, 0x121d9720
Caught exception in looking up space point ptr... 0x15669570, 0x121eabb0
Caught exception in looking up space point ptr... 0x536bb730, 0x536bb8c0
Caught exception in looking up space point ptr... 0x536bb8c0, 0x536bb730
Caught exception in looking up space point ptr... 0x4ad39760, 0x4ad39b50
Caught exception in looking up space point ptr... 0x4ad39b50, 0x4ad39570
Caught exception in looking up space point ptr... 0x4ad39570, 0xaf4c990
Caught exception in looking up space point ptr... 0xaf4c990, 0x59c23ca0
Caught exception in looking up space point ptr... 0x2a0e7b60, 0x3920f070
Caught exception in looking up space point ptr... 0x60c99ff0, 0x2a0e7b60
Caught exception in looking up space point ptr... 0x374cdb40, 0x535d7ac0
Caught exception in looking up space point ptr... 0x535d7ac0, 0x53553400
Caught exception in looking up space point ptr... 0x43cd2400, 0x1805fd70
Caught exception in looking up space point ptr... 0x1805fd70, 0x43cd2400
Caught exception in looking up space point ptr... 0x4aa1fb70, 0x5225c490
Caught exception in looking up space point ptr... 0x5225c490, 0x4aa1fb70
Caught exception in looking up space point ptr... 0x4aa1fb70, 0x32b13240
Caught exception in looking up space point ptr... 0x32b13240, 0x4aa1fb70
Caught exception in looking up space point ptr... 0x4ad42e70, 0x4ad432b0
Caught exception in looking up space point ptr... 0x4ad434d0, 0x4ad42e70
Caught exception in looking up space point ptr... 0x3a697710, 0x3a6975a0
Caught exception in looking up space point ptr... 0x3a6975a0, 0x3a697710
Caught exception in looking up space point ptr... 0x2d81e650, 0x37c3bf60
Caught exception in looking up space point ptr... 0x37c3bf60, 0x2d81e3d0
Caught exception in looking up space point ptr... 0xafcb770, 0x4c5f61b0
Caught exception in looking up space point ptr... 0x4c5f61b0, 0xafcb770
Caught exception in looking up space point ptr... 0x61e18ee0, 0x55369490
Caught exception in looking up space point ptr... 0x55369490, 0x61e18ee0
Caught exception in looking up space point ptr... 0x12d35dc0, 0x12d35c30
Caught exception in looking up space point ptr... 0x12d35c30, 0x12d35dc0
++++>>>> total num hits: 537338, num free: 527470
04-Feb-2026 01:56:43 CET Closed output file "np02vd_raw_run042433_0044_df-s02-d1_dw_0_20260203T185849_reco_stage0_20260204T005643_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 124.276 174.85 196.086 183.64 23.3146 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.8431e-05 9.57175e-05 0.000303154 7.8731e-05 5.6515e-05 19
produce:tpcrawdecoder:PDVDTPCReader 6.6153 7.99318 17.5064 7.36236 2.38137 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.00899025 0.0279738 0.115887 0.0133766 0.0267126 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000377224 0.00164095 0.0225484 0.000468386 0.00492839 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000363325 0.000469054 0.000681259 0.000453536 6.67874e-05 19
produce:beamevent:BeamEvent 5.398e-05 0.0001269 0.00087777 7.9151e-05 0.000178592 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.16064 2.6156 3.24046 2.67331 0.321583 19
produce:ophit:OpHitFinder 0.0297102 0.0366698 0.0443684 0.0360516 0.0039039 19
produce:wclsdatavd:WireCellToolkit 94.8313 103.541 109.889 103.362 4.04995 19
produce:gaushit:GausHitFinder 0.848411 1.83851 2.61831 1.89642 0.464817 19
produce:nhitsfilter:NumberOfHitsFilter 0.000225042 0.000312922 0.000454066 0.000304194 6.28151e-05 19
produce:reco3d:SpacePointSolver 8.09764 14.5258 26.7493 13.9529 5.21715 19
produce:hitpdune:DisambigFromSpacePoints 0.0641603 0.266063 0.555501 0.229227 0.12372 19
produce:cluster3d:Cluster3D 0.770948 38.203 53.209 46.7277 18.9779 19
[art]:TriggerResults:TriggerResultInserter 2.008e-05 3.02314e-05 9.4731e-05 2.521e-05 1.63126e-05 19
end_path:out1:RootOutput 2.97e-06 1.67376e-05 0.000164182 6.98e-06 3.54809e-05 19
end_path:out1:RootOutput(write) 4.44182 5.77532 6.94805 5.69437 0.66836 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5607.26 MB
Peak resident set size usage (VmHWM): 3612.91 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0044_df-s02-d1_dw_0_20260203T185849_reco_stage0_20260204T005643_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0044_df-s02-d1_dw_0_20260203T185849_reco_stage0_20260204T005643_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0044_df-s02-d1_dw_0_20260203T185849_reco_stage0_20260204T005643_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163236.0,
"core.end_time": 1770166604.0,
"core.events": [
5023,
5029,
5035,
5041,
5047,
5053,
5059,
5065,
5071,
5077,
5083,
5089,
5095,
5101,
5107,
5113,
5119,
5125,
5131
],
"core.event_count": 19,
"core.first_event_number": 5023,
"core.last_event_number": 5131,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0044_df-s02-d1_dw_0_20260203T185849.hdf5"
}
]
} 