Jobsub ID 297921.96@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.96@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce504 |
| Last heartbeat | 2026-02-04 01:22:47 |
| From worker node | Hostname | b9p06p4022.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:54:07 |
| Input files | vd-protodune:np02vd_raw_run042433_0616_df-s02-d1_dw_0_20260203T223613.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5089s) |
| CPU time | 1h (4925s = 96%) |
| Max RSS bytes | 3549683712 (3385 MiB) |
| Outputting started | 2026-02-04 01:19:02 |
| Output files | |
| Finished | 2026-02-04 01:22:47 |
| Saved logs | justin-logs:297921.96-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ace point ptr... 0x6ebacbd0, 0x6eba9970
Caught exception in looking up space point ptr... 0x4bee4500, 0x51eddb80
Caught exception in looking up space point ptr... 0x51eddb80, 0x51ed8420
Caught exception in looking up space point ptr... 0xe3e3920, 0x4a9cd800
Caught exception in looking up space point ptr... 0x4a9cd800, 0xe3e3b70
Caught exception in looking up space point ptr... 0x97fd4a0, 0x6ebfd4e0
Caught exception in looking up space point ptr... 0x6ebfd4e0, 0x97ff1c0
Caught exception in looking up space point ptr... 0xce544b0, 0xce6bd00
Caught exception in looking up space point ptr... 0xce6bd00, 0xce6baa0
Caught exception in looking up space point ptr... 0x7bb81f70, 0x4be94880
Caught exception in looking up space point ptr... 0x4be94880, 0x7bb83b10
Caught exception in looking up space point ptr... 0x759e0d0, 0x759de80
Caught exception in looking up space point ptr... 0x759de80, 0x75a9b20
Caught exception in looking up space point ptr... 0x87811600, 0x4eeb8580
Caught exception in looking up space point ptr... 0x4eeb8580, 0x8780af10
Caught exception in looking up space point ptr... 0x30d1cc20, 0x30d1ca50
Caught exception in looking up space point ptr... 0x879f7840, 0x30d1cc20
Caught exception in looking up space point ptr... 0x61e5be90, 0x87a10710
Caught exception in looking up space point ptr... 0x61e5bb70, 0x61e5be90
Caught exception in looking up space point ptr... 0x5195c850, 0x5a01fa50
Caught exception in looking up space point ptr... 0x5a01fa50, 0x5a01f9b0
Caught exception in looking up space point ptr... 0x7bd77fd0, 0x2de10da0
Caught exception in looking up space point ptr... 0x2de10da0, 0x30cd1210
Caught exception in looking up space point ptr... 0x1014aa50, 0x7bd77fd0
Caught exception in looking up space point ptr... 0x3b34c8f0, 0x6e955d10
Caught exception in looking up space point ptr... 0x6e955d10, 0x3b34c8f0
Caught exception in looking up space point ptr... 0x9b45470, 0x9b32d20
Caught exception in looking up space point ptr... 0x17523410, 0x9b45470
Caught exception in looking up space point ptr... 0x4d815a80, 0xe757fa0
Caught exception in looking up space point ptr... 0x35bb0840, 0x4d815a80
Caught exception in looking up space point ptr... 0x59d34d50, 0x59d1e150
Caught exception in looking up space point ptr... 0x59d34ee0, 0x59d34d50
Caught exception in looking up space point ptr... 0x566202b0, 0x5661fae0
Caught exception in looking up space point ptr... 0x5661fae0, 0x5661f180
Caught exception in looking up space point ptr... 0x4909e0d0, 0x6cf8ac60
Caught exception in looking up space point ptr... 0x6cf8ac60, 0x6cf8adf0
Caught exception in looking up space point ptr... 0x80a7ec90, 0x80a38a30
Caught exception in looking up space point ptr... 0x80a7efb0, 0x80a7ec90
Caught exception in looking up space point ptr... 0x7ec43010, 0x7ec42e80
Caught exception in looking up space point ptr... 0x7ec42e80, 0x7ec1a760
Caught exception in looking up space point ptr... 0x433b8200, 0x73927ec0
Caught exception in looking up space point ptr... 0x13993e40, 0x433b8200
Caught exception in looking up space point ptr... 0x191a9aa0, 0x4ef39f40
Caught exception in looking up space point ptr... 0x4ef39f40, 0x7391da60
Caught exception in looking up space point ptr... 0x616c5750, 0x7e4b2a90
Caught exception in looking up space point ptr... 0x616d5ab0, 0x616c5750
Caught exception in looking up space point ptr... 0x649f00e0, 0x7d2f3770
Caught exception in looking up space point ptr... 0x7d2f3770, 0x4ab9d120
Caught exception in looking up space point ptr... 0x36a610c0, 0x36a4f5f0
Caught exception in looking up space point ptr... 0x36a72a00, 0x36a610c0
Caught exception in looking up space point ptr... 0x4b8f1160, 0x632b7a40
Caught exception in looking up space point ptr... 0x632b7a40, 0x4b8f2330
Caught exception in looking up space point ptr... 0x39c77c60, 0x40629ae0
Caught exception in looking up space point ptr... 0x40629ae0, 0x49689190
Caught exception in looking up space point ptr... 0x491d73d0, 0x7b897e60
Caught exception in looking up space point ptr... 0x7b897e60, 0x43d912c0
Caught exception in looking up space point ptr... 0x357e9330, 0x2e924090
Caught exception in looking up space point ptr... 0x2e924090, 0x357e9330
Caught exception in looking up space point ptr... 0x41f70710, 0x40466960
Caught exception in looking up space point ptr... 0x40466960, 0x38690570
Caught exception in looking up space point ptr... 0x38690570, 0x616477e0
Caught exception in looking up space point ptr... 0x15585320, 0x41612f40
Caught exception in looking up space point ptr... 0x41612f40, 0x52815930
Caught exception in looking up space point ptr... 0x7441a7e0, 0x7441a6b0
Caught exception in looking up space point ptr... 0x7441a6b0, 0x7441a7e0
Caught exception in looking up space point ptr... 0x62b735b0, 0x493f6f00
Caught exception in looking up space point ptr... 0x493f6f00, 0x6ac2bf80
++++>>>> total num hits: 512394, num free: 503604
04-Feb-2026 02:18:41 CET Closed output file "np02vd_raw_run042433_0616_df-s02-d1_dw_0_20260203T223613_reco_stage0_20260204T011841_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 117.615 261.049 344.587 286.539 73.1447 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.6721e-05 0.000282447 0.00194673 0.000181933 0.000404663 19
produce:tpcrawdecoder:PDVDTPCReader 5.38399 8.19586 11.7901 8.39973 1.79153 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.0113577 0.0260318 0.0513851 0.0270265 0.0106643 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000382376 0.0011876 0.00268891 0.000940064 0.000688646 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000412146 0.00122044 0.0042087 0.000851403 0.000935032 19
produce:beamevent:BeamEvent 6.4131e-05 0.000420961 0.00402972 0.000177632 0.000862761 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.10035 3.46699 5.65203 3.51526 0.734429 19
produce:ophit:OpHitFinder 0.0230336 0.0457294 0.0797515 0.0440732 0.0123053 19
produce:wclsdatavd:WireCellToolkit 90.5397 153.46 192.107 173.902 35.7307 19
produce:gaushit:GausHitFinder 0.807432 2.92875 4.9157 3.23186 1.06596 19
produce:nhitsfilter:NumberOfHitsFilter 0.000265644 0.00164373 0.00408617 0.0015076 0.00118014 19
produce:reco3d:SpacePointSolver 13.344 20.0847 31.9689 19.918 5.00903 19
produce:hitpdune:DisambigFromSpacePoints 0.133539 0.415648 0.88313 0.417967 0.205657 19
produce:cluster3d:Cluster3D 1.14544 65.0004 108.235 77.6069 37.5404 19
[art]:TriggerResults:TriggerResultInserter 2.64e-05 6.54778e-05 0.000358556 3.8701e-05 7.46431e-05 19
end_path:out1:RootOutput 4.69e-06 1.05702e-05 3.9011e-05 7.95e-06 7.42687e-06 19
end_path:out1:RootOutput(write) 4.0367 7.35464 9.99903 7.86089 1.78827 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5551.3 MB
Peak resident set size usage (VmHWM): 3549.68 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0616_df-s02-d1_dw_0_20260203T223613_reco_stage0_20260204T011841_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0616_df-s02-d1_dw_0_20260203T223613_reco_stage0_20260204T011841_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0616_df-s02-d1_dw_0_20260203T223613_reco_stage0_20260204T011841_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162868.0,
"core.end_time": 1770167924.0,
"core.events": [
70231,
70237,
70243,
70249,
70255,
70261,
70267,
70273,
70279,
70285,
70291,
70297,
70303,
70309,
70315,
70321,
70327,
70333,
70339
],
"core.event_count": 19,
"core.first_event_number": 70231,
"core.last_event_number": 70339,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0616_df-s02-d1_dw_0_20260203T223613.hdf5"
}
]
} 