Jobsub ID 303653.9@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.9@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce509 |
| Last heartbeat | 2026-02-04 01:01:59 |
| From worker node | Hostname | b9p34p1022.cern.ch |
| cpuinfo | AMD EPYC 9655 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:36:38 |
| Input files | vd-protodune:np02vd_raw_run042421_0008_df-s02-d0_dw_0_20260203T133514.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4942s) |
| CPU time | 1h (4799s = 97%) |
| Max RSS bytes | 12604551168 (12020 MiB) |
| Outputting started | 2026-02-04 00:59:02 |
| Output files | |
| Finished | 2026-02-04 01:01:59 |
| Saved logs | justin-logs:303653.9-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0, 0x57e201e0
Caught exception in looking up space point ptr... 0x57e201e0, 0x594a1740
Caught exception in looking up space point ptr... 0x2cf0e0a0, 0x28f4c1f0
Caught exception in looking up space point ptr... 0x28f4c1f0, 0x10addf10
Caught exception in looking up space point ptr... 0x31d840b0, 0x31d83f20
Caught exception in looking up space point ptr... 0x31d83f20, 0x31d840b0
Caught exception in looking up space point ptr... 0xf602d70, 0x29e05ce0
Caught exception in looking up space point ptr... 0x29e05ce0, 0x57764610
Caught exception in looking up space point ptr... 0x543f06c0, 0x33f6e890
Caught exception in looking up space point ptr... 0x33f6e890, 0x543f06c0
Caught exception in looking up space point ptr... 0x5fa939f0, 0x398f7050
Caught exception in looking up space point ptr... 0x398f7050, 0x251f1210
Caught exception in looking up space point ptr... 0x5c0b4410, 0x49c62310
Caught exception in looking up space point ptr... 0x49c62310, 0x2a6c4240
Caught exception in looking up space point ptr... 0x3b59bac0, 0x2a650a30
Caught exception in looking up space point ptr... 0x2a650a30, 0x65653aa0
Caught exception in looking up space point ptr... 0x5437c0f0, 0x3487f8e0
Caught exception in looking up space point ptr... 0x3487f8e0, 0x124382240
Caught exception in looking up space point ptr... 0x124382240, 0x2016d5b0
Caught exception in looking up space point ptr... 0x2016d5b0, 0x3bea1f00
Caught exception in looking up space point ptr... 0x3bea1f00, 0x5437c0f0
Caught exception in looking up space point ptr... 0x42e30d00, 0x2ab11290
Caught exception in looking up space point ptr... 0x2ab11290, 0x5f82dce0
Caught exception in looking up space point ptr... 0x31a51f20, 0x12e1e500
Caught exception in looking up space point ptr... 0x1432d3d0, 0x31a51f20
Caught exception in looking up space point ptr... 0x21593110, 0x5d719330
Caught exception in looking up space point ptr... 0x5d719330, 0x21593110
Caught exception in looking up space point ptr... 0x2e82d6e0, 0x2e9196a0
Caught exception in looking up space point ptr... 0x2e9196a0, 0x209db270
Caught exception in looking up space point ptr... 0x209db270, 0x2a901b40
Caught exception in looking up space point ptr... 0x593d9100, 0x51b2edb0
Caught exception in looking up space point ptr... 0x51b2edb0, 0x593d9100
Caught exception in looking up space point ptr... 0x2ea046a0, 0x2b40cf90
Caught exception in looking up space point ptr... 0x2b40cf90, 0x3153a0a0
Caught exception in looking up space point ptr... 0x2b6372d0, 0x2a187f10
Caught exception in looking up space point ptr... 0x2a187f10, 0x2b6372d0
Caught exception in looking up space point ptr... 0x64ea6420, 0x2c4e4b00
Caught exception in looking up space point ptr... 0x2c4e4b00, 0x5c77d020
Caught exception in looking up space point ptr... 0x55f1fa90, 0x30ec9670
Caught exception in looking up space point ptr... 0x30ec9670, 0x55f1fa90
Caught exception in looking up space point ptr... 0xbba1f50, 0x38f6a2d0
Caught exception in looking up space point ptr... 0x38f6a2d0, 0xbba1f50
Caught exception in looking up space point ptr... 0x2787cac0, 0x30a99460
Caught exception in looking up space point ptr... 0x30a99460, 0x2787cac0
Caught exception in looking up space point ptr... 0x41d9f170, 0x2a3260c0
Caught exception in looking up space point ptr... 0x35e38f10, 0x41d9f170
Caught exception in looking up space point ptr... 0x471a7820, 0x2b5227e0
Caught exception in looking up space point ptr... 0x2b5227e0, 0x471a7820
Caught exception in looking up space point ptr... 0x21b186c0, 0x650aed20
Caught exception in looking up space point ptr... 0x650aed20, 0x650aeeb0
Caught exception in looking up space point ptr... 0x2b451ce0, 0x49d24810
Caught exception in looking up space point ptr... 0x49d24810, 0x2b451ce0
Caught exception in looking up space point ptr... 0xba844a0, 0x30dd0580
Caught exception in looking up space point ptr... 0x30dd0580, 0xba844a0
Caught exception in looking up space point ptr... 0x5fee6d20, 0x2a5560f0
Caught exception in looking up space point ptr... 0x2a5560f0, 0x3f7815d0
Caught exception in looking up space point ptr... 0x5d7bfdf0, 0x2fd2ba80
Caught exception in looking up space point ptr... 0x2fd2ba80, 0x5d7bfdf0
Caught exception in looking up space point ptr... 0x2a31d970, 0x395c82d0
Caught exception in looking up space point ptr... 0x395c82d0, 0x251281f0
Caught exception in looking up space point ptr... 0x2f09dd90, 0x117317d0
Caught exception in looking up space point ptr... 0x117317d0, 0x3c565870
Caught exception in looking up space point ptr... 0x51b242f0, 0x5fdecbf0
Caught exception in looking up space point ptr... 0x5fdecbf0, 0x51b242f0
Caught exception in looking up space point ptr... 0x2a1773f0, 0x33f6c460
Caught exception in looking up space point ptr... 0x33f6c460, 0x277f1b90
++++>>>> total num hits: 32770, num free: 31123
04-Feb-2026 01:58:54 CET Closed output file "np02vd_raw_run042421_0008_df-s02-d0_dw_0_20260203T133514_reco_stage0_20260204T005854_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 58.3438 174.507 948.692 72.0514 242.525 28
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.9519e-05 9.23224e-05 0.000237074 8.5918e-05 3.0436e-05 28
produce:tpcrawdecoder:PDVDTPCReader 3.90577 4.83024 6.91165 4.65293 0.645759 28
produce:triggerrawdecoder:PDVDTriggerReader4 0.00865168 0.0142518 0.0337246 0.011478 0.00640576 28
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000324776 0.000767576 0.00218605 0.000654084 0.000391634 28
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00111613 0.00196034 0.00417788 0.00173532 0.000725702 28
produce:beamevent:BeamEvent 8.5137e-05 0.000138372 0.000769452 0.000117991 0.000122687 28
produce:pdvddaphne:DAPHNEReaderPDVD 1.70423 2.12083 2.71329 2.11623 0.23571 28
produce:ophit:OpHitFinder 0.022781 0.0331625 0.0402732 0.0336166 0.00444712 28
produce:wclsdatavd:WireCellToolkit 41.7454 48.9695 58.4392 48.6278 3.5705 28
produce:gaushit:GausHitFinder 0.408235 1.47234 8.78912 0.816475 1.74235 28
produce:nhitsfilter:NumberOfHitsFilter 0.00014036 0.00027586 0.000671986 0.000200374 0.000155015 28
produce:reco3d:SpacePointSolver 4.63498 20.03 91.2236 9.6146 24.6917 28
produce:hitpdune:DisambigFromSpacePoints 0.0401768 0.695852 4.75124 0.0841493 1.37303 28
produce:cluster3d:Cluster3D 0.56873 91.221 771.911 1.6049 209.541 28
[art]:TriggerResults:TriggerResultInserter 2.7031e-05 3.92512e-05 8.8773e-05 3.46465e-05 1.45913e-05 28
end_path:out1:RootOutput 5.948e-06 9.15943e-06 2.3064e-05 7.847e-06 3.74218e-06 28
end_path:out1:RootOutput(write) 2.7525 5.07424 16.4147 3.38928 3.9272 28
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 15132.8 MB
Peak resident set size usage (VmHWM): 12604.6 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0008_df-s02-d0_dw_0_20260203T133514_reco_stage0_20260204T005854_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0008_df-s02-d0_dw_0_20260203T133514_reco_stage0_20260204T005854_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0008_df-s02-d0_dw_0_20260203T133514_reco_stage0_20260204T005854_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161806.0,
"core.end_time": 1770166735.0,
"core.events": [
1308,
1314,
1320,
1326,
1332,
1338,
1344,
1350,
1356,
1362,
1368,
1374,
1380,
1386,
1392,
1398,
1404,
1410,
1416,
1422,
1428,
1434,
1440,
1446,
1452,
1458,
1464,
1470
],
"core.event_count": 28,
"core.first_event_number": 1308,
"core.last_event_number": 1470,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0008_df-s02-d0_dw_0_20260203T133514.hdf5"
}
]
} 