Jobsub ID 297923.8@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.8@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce505 |
| Last heartbeat | 2026-02-04 00:35:21 |
| From worker node | Hostname | b9p35p0031.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:57:35 |
| Input files | vd-protodune:np02vd_raw_run042433_0280_df-s03-d0_dw_0_20260203T202832.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 35m (2139s) |
| CPU time | 34m (2070s = 96%) |
| Max RSS bytes | 3402276864 (3244 MiB) |
| Outputting started | 2026-02-04 00:33:16 |
| Output files | |
| Finished | 2026-02-04 00:35:21 |
| Saved logs | justin-logs:297923.8-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ptr... 0x18e9b2f0, 0x6648fdf0
Caught exception in looking up space point ptr... 0x6648fdf0, 0x6648fc60
Caught exception in looking up space point ptr... 0x31b51030, 0x31b43b70
Caught exception in looking up space point ptr... 0x31b43b70, 0x31b51030
Caught exception in looking up space point ptr... 0x164f17d0, 0x164f1440
Caught exception in looking up space point ptr... 0x164f1440, 0x164f17d0
Caught exception in looking up space point ptr... 0xa1f8dd0, 0x666e6c70
Caught exception in looking up space point ptr... 0x666e6c70, 0x39958d10
Caught exception in looking up space point ptr... 0x34db1890, 0x2954cce0
Caught exception in looking up space point ptr... 0x2954cce0, 0x43cd9f90
Caught exception in looking up space point ptr... 0x43cd9f90, 0x36a4b5c0
Caught exception in looking up space point ptr... 0x370ddd20, 0x370d9fa0
Caught exception in looking up space point ptr... 0x370d9fa0, 0x370ddd20
Caught exception in looking up space point ptr... 0x816c4d80, 0x816c3db0
Caught exception in looking up space point ptr... 0x816c3db0, 0x816c3f40
Caught exception in looking up space point ptr... 0x2a27b360, 0x75373b80
Caught exception in looking up space point ptr... 0x7ad1b270, 0x2a27b360
Caught exception in looking up space point ptr... 0x7ce1bba0, 0x7ce1bec0
Caught exception in looking up space point ptr... 0x7ce1bec0, 0x7ce1c050
Caught exception in looking up space point ptr... 0x3dd92f50, 0x3dd95d10
Caught exception in looking up space point ptr... 0x3dd95d10, 0x3dd92f50
Caught exception in looking up space point ptr... 0x39997300, 0x3999af30
Caught exception in looking up space point ptr... 0x3999af30, 0x39996ce0
Caught exception in looking up space point ptr... 0x2b8df6f0, 0x2b8e1050
Caught exception in looking up space point ptr... 0x2b8e1050, 0x2b8df6f0
Caught exception in looking up space point ptr... 0x65c832c0, 0x65c83130
Caught exception in looking up space point ptr... 0x65c83130, 0x6700e1a0
Caught exception in looking up space point ptr... 0x615fb100, 0x615fade0
Caught exception in looking up space point ptr... 0x615fade0, 0x615fb100
Caught exception in looking up space point ptr... 0x370e23b0, 0x370e1ec0
Caught exception in looking up space point ptr... 0x370e1ec0, 0x370e2600
Caught exception in looking up space point ptr... 0x6220e040, 0x6220cf50
Caught exception in looking up space point ptr... 0x6220cf50, 0x6220e040
Caught exception in looking up space point ptr... 0x816ccaf0, 0x816ccc90
Caught exception in looking up space point ptr... 0x816ccc90, 0x816ccaf0
Caught exception in looking up space point ptr... 0x1a39fba0, 0xe443750
Caught exception in looking up space point ptr... 0xe443750, 0x1a39fba0
Caught exception in looking up space point ptr... 0x370e6ea0, 0x370e6d10
Caught exception in looking up space point ptr... 0x370e6d10, 0x370e6ea0
Caught exception in looking up space point ptr... 0x5608df70, 0x5609d510
Caught exception in looking up space point ptr... 0x5609d510, 0x5608df70
Caught exception in looking up space point ptr... 0x5ffcd120, 0x5ffcbce0
Caught exception in looking up space point ptr... 0x5ffcbce0, 0x5ffc7360
Caught exception in looking up space point ptr... 0x816aebb0, 0x816aefe0
Caught exception in looking up space point ptr... 0x816aefe0, 0x816aebb0
Caught exception in looking up space point ptr... 0x6221daa0, 0x62226870
Caught exception in looking up space point ptr... 0x62226870, 0x62217810
Caught exception in looking up space point ptr... 0x44504240, 0x445040b0
Caught exception in looking up space point ptr... 0x445040b0, 0x44504240
Caught exception in looking up space point ptr... 0x9c60f70, 0x9c86280
Caught exception in looking up space point ptr... 0x9c86280, 0x9c60f70
Caught exception in looking up space point ptr... 0x2a2a3110, 0x2a2a32a0
Caught exception in looking up space point ptr... 0x2a2a32a0, 0x2a2a3110
Caught exception in looking up space point ptr... 0x55d8f670, 0x55d8f8c0
Caught exception in looking up space point ptr... 0x55d8f420, 0x55d8f670
Caught exception in looking up space point ptr... 0x60a4c970, 0x60a4c570
Caught exception in looking up space point ptr... 0x60a4c570, 0x60a4c670
Caught exception in looking up space point ptr... 0x60d29340, 0x60d29000
Caught exception in looking up space point ptr... 0x60d29000, 0x60d29340
Caught exception in looking up space point ptr... 0x12dcd650, 0x37ab0d10
Caught exception in looking up space point ptr... 0x37ab0d10, 0x12dcd650
Caught exception in looking up space point ptr... 0x63f34220, 0x63f3ccb0
Caught exception in looking up space point ptr... 0x63f3ccb0, 0x63f43280
Caught exception in looking up space point ptr... 0x164cfdd0, 0x164cffa0
Caught exception in looking up space point ptr... 0x164cffa0, 0x164cfdd0
Caught exception in looking up space point ptr... 0x164cfdd0, 0x164d0300
Caught exception in looking up space point ptr... 0x164d0300, 0x164cfdd0
++++>>>> total num hits: 102092, num free: 98567
04-Feb-2026 01:33:09 CET Closed output file "np02vd_raw_run042433_0280_df-s03-d0_dw_0_20260203T202832_reco_stage0_20260204T003309_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 92.0901 109.656 129.122 108.702 10.7597 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.687e-05 8.41937e-05 0.00022671 7.667e-05 3.42271e-05 19
produce:tpcrawdecoder:PDVDTPCReader 5.30627 6.05962 6.54385 6.09954 0.267652 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.00862082 0.0195236 0.0436592 0.0122203 0.0111951 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.00038069 0.000545718 0.00088224 0.00050725 0.000113615 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00036622 0.000509997 0.000862741 0.0004551 0.000132522 19
produce:beamevent:BeamEvent 5.24e-05 0.000122192 0.00085125 7.848e-05 0.000172672 19
produce:pdvddaphne:DAPHNEReaderPDVD 1.60919 2.01163 2.32523 2.02852 0.177337 19
produce:ophit:OpHitFinder 0.0233882 0.032781 0.0410911 0.0326305 0.00489646 19
produce:wclsdatavd:WireCellToolkit 68.8982 78.8298 93.649 78.9099 6.21137 19
produce:gaushit:GausHitFinder 0.649393 1.08795 1.71447 0.980652 0.335774 19
produce:nhitsfilter:NumberOfHitsFilter 0.00014305 0.000249755 0.00042975 0.00023284 8.23035e-05 19
produce:reco3d:SpacePointSolver 7.69317 14.4096 22.7388 13.1255 4.24974 19
produce:hitpdune:DisambigFromSpacePoints 0.072615 0.146195 0.238371 0.127723 0.0422739 19
produce:cluster3d:Cluster3D 0.906557 2.20536 7.64482 1.97226 1.43567 19
[art]:TriggerResults:TriggerResultInserter 2.412e-05 3.48974e-05 8.153e-05 3.335e-05 1.1392e-05 19
end_path:out1:RootOutput 5.05e-06 6.64211e-06 1.882e-05 6.01e-06 2.93947e-06 19
end_path:out1:RootOutput(write) 3.94772 4.80804 5.63189 4.8166 0.503591 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5391.72 MB
Peak resident set size usage (VmHWM): 3402.28 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0280_df-s03-d0_dw_0_20260203T202832_reco_stage0_20260204T003309_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0280_df-s03-d0_dw_0_20260203T202832_reco_stage0_20260204T003309_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0280_df-s03-d0_dw_0_20260203T202832_reco_stage0_20260204T003309_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163063.0,
"core.end_time": 1770165190.0,
"core.events": [
31928,
31934,
31940,
31946,
31952,
31958,
31964,
31970,
31976,
31982,
31988,
31994,
32000,
32006,
32012,
32018,
32024,
32030,
32036
],
"core.event_count": 19,
"core.first_event_number": 31928,
"core.last_event_number": 32036,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0280_df-s03-d0_dw_0_20260203T202832.hdf5"
}
]
} 