Jobsub ID 297919.8@dunegpschedd02.fnal.gov
| Jobsub ID | 297919.8@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:54:25 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce503 |
| Last heartbeat | 2026-02-04 00:09:13 |
| From worker node | Hostname | b9p02p6824.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:28:55 |
| Input files | vd-protodune:np02vd_raw_run042421_0164_df-s02-d1_dw_0_20260203T145941.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 37m (2278s) |
| CPU time | 36m (2186s = 95%) |
| Max RSS bytes | 2668298240 (2544 MiB) |
| Outputting started | 2026-02-04 00:06:55 |
| Output files | |
| Finished | 2026-02-04 00:09:13 |
| Saved logs | justin-logs:297919.8-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
121250
Caught exception in looking up space point ptr... 0x4c1b36f0, 0x4c1b3560
Caught exception in looking up space point ptr... 0x4c1b3560, 0x4c1b32c0
Caught exception in looking up space point ptr... 0x4c1bf180, 0x4c1b36f0
Caught exception in looking up space point ptr... 0x3604ab00, 0x3604a2d0
Caught exception in looking up space point ptr... 0x3604a2d0, 0x36045620
Caught exception in looking up space point ptr... 0xf4263f0, 0xf42e070
Caught exception in looking up space point ptr... 0xf42e070, 0x4d1640f0
Caught exception in looking up space point ptr... 0x27177220, 0x27177510
Caught exception in looking up space point ptr... 0x27180780, 0x27177220
Caught exception in looking up space point ptr... 0x12fb1480, 0x12fb1720
Caught exception in looking up space point ptr... 0x12fb1720, 0x12fb1480
Caught exception in looking up space point ptr... 0x2ae1c630, 0x2ae1c2c0
Caught exception in looking up space point ptr... 0x2ae1c2c0, 0x2ae1c630
Caught exception in looking up space point ptr... 0x49a94330, 0x49a94740
Caught exception in looking up space point ptr... 0x49a94740, 0x49a94ad0
Caught exception in looking up space point ptr... 0x51e83dd0, 0x2ecb59d0
Caught exception in looking up space point ptr... 0x2ecb59d0, 0x36162660
Caught exception in looking up space point ptr... 0x2ae19e50, 0x2ae1f010
Caught exception in looking up space point ptr... 0x32606480, 0x2ae19e50
Caught exception in looking up space point ptr... 0x4c8ded10, 0x4c8deea0
Caught exception in looking up space point ptr... 0x4c8deea0, 0x4c8ded10
Caught exception in looking up space point ptr... 0x4cd66180, 0x23463740
Caught exception in looking up space point ptr... 0x23463740, 0x4cd51710
Caught exception in looking up space point ptr... 0x144ae660, 0x144ab790
Caught exception in looking up space point ptr... 0x144ab790, 0x144ae660
Caught exception in looking up space point ptr... 0x325f9140, 0x325f8670
Caught exception in looking up space point ptr... 0x325f8670, 0x325f9140
Caught exception in looking up space point ptr... 0x27180d90, 0x2341d200
Caught exception in looking up space point ptr... 0x2341d200, 0x2716b2b0
Caught exception in looking up space point ptr... 0x549bd2e0, 0x549bd580
Caught exception in looking up space point ptr... 0x549bd580, 0x549bf180
Caught exception in looking up space point ptr... 0x22b698f0, 0x22b53ea0
Caught exception in looking up space point ptr... 0x22b53ea0, 0x8376d10
Caught exception in looking up space point ptr... 0xd518620, 0xd50a710
Caught exception in looking up space point ptr... 0xd50a710, 0xd50a4c0
Caught exception in looking up space point ptr... 0x270e85c0, 0x270e81b0
Caught exception in looking up space point ptr... 0x270e81b0, 0x270e85c0
Caught exception in looking up space point ptr... 0x3bb24c90, 0x3bb24970
Caught exception in looking up space point ptr... 0x3bb24970, 0x3bb24b00
Caught exception in looking up space point ptr... 0x5dd7c8d0, 0x5dd7fc90
Caught exception in looking up space point ptr... 0x5dd7fc90, 0x5dd7c8d0
Caught exception in looking up space point ptr... 0x23421bb0, 0x23425520
Caught exception in looking up space point ptr... 0x23425520, 0x23421bb0
Caught exception in looking up space point ptr... 0x51e83f90, 0x51e85b60
Caught exception in looking up space point ptr... 0x51e85b60, 0x51e83f90
Caught exception in looking up space point ptr... 0x4d160490, 0x4d1607b0
Caught exception in looking up space point ptr... 0x4d1607b0, 0x4d160490
Caught exception in looking up space point ptr... 0x2dc064a0, 0x2dc06f60
Caught exception in looking up space point ptr... 0x2dc06f60, 0x2dc064a0
Caught exception in looking up space point ptr... 0x9ba67c0, 0x9ba65e0
Caught exception in looking up space point ptr... 0x9ba65e0, 0x9ba67c0
Caught exception in looking up space point ptr... 0x4a5b1960, 0x4a5b1600
Caught exception in looking up space point ptr... 0x4a5b1600, 0x4a5b2c00
Caught exception in looking up space point ptr... 0x27179090, 0x27179220
Caught exception in looking up space point ptr... 0x27179220, 0x27179090
Caught exception in looking up space point ptr... 0x61ccd2c0, 0x61ccd450
Caught exception in looking up space point ptr... 0x61ccd450, 0x5b7390e0
Caught exception in looking up space point ptr... 0x5b7390e0, 0x5b738ee0
Caught exception in looking up space point ptr... 0x5b738ee0, 0x61ccd2c0
Caught exception in looking up space point ptr... 0x645c44c0, 0x49a2c140
Caught exception in looking up space point ptr... 0x49a2c140, 0x3dd4d240
Caught exception in looking up space point ptr... 0x3604ad90, 0x3603d060
Caught exception in looking up space point ptr... 0x3603d060, 0x3604aec0
Caught exception in looking up space point ptr... 0x3604aec0, 0x3604a580
Caught exception in looking up space point ptr... 0x3604a580, 0x3604ad90
++++>>>> total num hits: 70524, num free: 67934
04-Feb-2026 01:06:48 CET Closed output file "np02vd_raw_run042421_0164_df-s02-d1_dw_0_20260203T145941_reco_stage0_20260204T000648_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 76.7105 82.2175 95.2124 80.6317 5.00492 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.04e-05 7.96661e-05 0.000168181 7.406e-05 3.0248e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.59156 4.23717 6.45695 3.98286 0.737058 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00939642 0.0167925 0.0435367 0.0129019 0.00860059 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000387483 0.000503004 0.00132045 0.000468133 0.000166824 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00146299 0.00199538 0.0064642 0.00177807 0.000924082 27
produce:beamevent:BeamEvent 4.9181e-05 0.000103864 0.000757455 7.262e-05 0.000129528 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.97663 2.56355 3.08272 2.58779 0.319038 27
produce:ophit:OpHitFinder 0.0246464 0.03386 0.0425998 0.0330242 0.00504719 27
produce:wclsdatavd:WireCellToolkit 52.3123 58.4129 66.1032 58.3542 3.06397 27
produce:gaushit:GausHitFinder 0.453781 0.936564 1.48588 0.887577 0.244492 27
produce:nhitsfilter:NumberOfHitsFilter 0.000122251 0.000249068 0.000602194 0.000230342 8.91079e-05 27
produce:reco3d:SpacePointSolver 4.55229 10.7459 21.5891 9.87541 3.46591 27
produce:hitpdune:DisambigFromSpacePoints 0.0399848 0.0981972 0.187448 0.0868171 0.0366661 27
produce:cluster3d:Cluster3D 0.573906 1.68871 2.57019 1.66389 0.576276 27
[art]:TriggerResults:TriggerResultInserter 1.726e-05 2.73561e-05 9.349e-05 2.567e-05 1.38576e-05 27
end_path:out1:RootOutput 3.61e-06 5.94374e-06 2.737e-05 4.61e-06 4.44507e-06 27
end_path:out1:RootOutput(write) 2.87775 3.46076 5.03471 3.1555 0.603208 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4595.23 MB
Peak resident set size usage (VmHWM): 2668.3 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0164_df-s02-d1_dw_0_20260203T145941_reco_stage0_20260204T000648_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0164_df-s02-d1_dw_0_20260203T145941_reco_stage0_20260204T000648_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0164_df-s02-d1_dw_0_20260203T145941_reco_stage0_20260204T000648_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161347.0,
"core.end_time": 1770163609.0,
"core.events": [
26641,
26647,
26653,
26659,
26665,
26671,
26677,
26683,
26689,
26695,
26701,
26707,
26713,
26719,
26725,
26731,
26737,
26743,
26749,
26755,
26761,
26767,
26773,
26779,
26785,
26791,
26797
],
"core.event_count": 27,
"core.first_event_number": 26641,
"core.last_event_number": 26797,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0164_df-s02-d1_dw_0_20260203T145941.hdf5"
}
]
} 