Jobsub ID 297923.133@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.133@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce507 |
| Last heartbeat | 2026-02-04 00:51:29 |
| From worker node | Hostname | b9p35p0020.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:04:23 |
| Input files | vd-protodune:np02vd_raw_run042433_0078_df-s04-d0_dw_0_20260203T191146.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 44m (2678s) |
| CPU time | 43m (2604s = 97%) |
| Max RSS bytes | 5435023360 (5183 MiB) |
| Outputting started | 2026-02-04 00:49:03 |
| Output files | |
| Finished | 2026-02-04 00:51:29 |
| Saved logs | justin-logs:297923.133-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
king up space point ptr... 0x5a216ee0, 0x5a217440
Caught exception in looking up space point ptr... 0x5a217440, 0x3e6a6170
Caught exception in looking up space point ptr... 0x3e6a6170, 0x3e6a63c0
Caught exception in looking up space point ptr... 0x39c6abc0, 0x39c6ad10
Caught exception in looking up space point ptr... 0x39c6ad10, 0x11d300b0
Caught exception in looking up space point ptr... 0x10f29e40, 0x10f29760
Caught exception in looking up space point ptr... 0x10f29760, 0x10f296c0
Caught exception in looking up space point ptr... 0x362efce0, 0x362ecf90
Caught exception in looking up space point ptr... 0x362ecf90, 0x362efce0
Caught exception in looking up space point ptr... 0x6bc53ee0, 0x40056010
Caught exception in looking up space point ptr... 0x4f4af3d0, 0x6bc53ee0
Caught exception in looking up space point ptr... 0x12397220, 0x3b2d05c0
Caught exception in looking up space point ptr... 0x3b2d05c0, 0x40e93020
Caught exception in looking up space point ptr... 0x39f54ec0, 0x39f54dc0
Caught exception in looking up space point ptr... 0x39f54dc0, 0x73357f50
Caught exception in looking up space point ptr... 0x11e34eb0, 0x11e33b80
Caught exception in looking up space point ptr... 0x11e33b80, 0x11e34eb0
Caught exception in looking up space point ptr... 0x7d3492e0, 0x7d349170
Caught exception in looking up space point ptr... 0x7d349170, 0x7d3492e0
Caught exception in looking up space point ptr... 0x3eb78c30, 0x15ce7720
Caught exception in looking up space point ptr... 0x15ce7720, 0x3eb78c30
Caught exception in looking up space point ptr... 0x5243d790, 0x40c2eb30
Caught exception in looking up space point ptr... 0x40c2eb30, 0x5243d790
Caught exception in looking up space point ptr... 0x5243d790, 0x40c2e820
Caught exception in looking up space point ptr... 0x40c2e820, 0x5243d790
Caught exception in looking up space point ptr... 0x42ff3bf0, 0x594ad030
Caught exception in looking up space point ptr... 0x594ad030, 0x42ff3bf0
Caught exception in looking up space point ptr... 0x847f3d10, 0x36338b70
Caught exception in looking up space point ptr... 0x36338b70, 0x847f3d10
Caught exception in looking up space point ptr... 0x3e0fef60, 0x5859afd0
Caught exception in looking up space point ptr... 0x5859afd0, 0x3cae4420
Caught exception in looking up space point ptr... 0x5b363f70, 0x6ca1bc40
Caught exception in looking up space point ptr... 0x6ca1bc40, 0x5b363f70
Caught exception in looking up space point ptr... 0x30731640, 0x30730770
Caught exception in looking up space point ptr... 0x30730770, 0x30731640
Caught exception in looking up space point ptr... 0x10f0a510, 0x10f0a3c0
Caught exception in looking up space point ptr... 0x10f0a3c0, 0x10f0a6a0
Caught exception in looking up space point ptr... 0x195e3410, 0x195dec60
Caught exception in looking up space point ptr... 0x195dec60, 0x195d9620
Caught exception in looking up space point ptr... 0x732bb9d0, 0x7143ed20
Caught exception in looking up space point ptr... 0x7143ed20, 0x732bb9d0
Caught exception in looking up space point ptr... 0xffe73a0, 0xffe8750
Caught exception in looking up space point ptr... 0xffe8750, 0xffe8300
Caught exception in looking up space point ptr... 0x431d67e0, 0x5a264590
Caught exception in looking up space point ptr... 0x5a264590, 0x6e23b2c0
Caught exception in looking up space point ptr... 0x6b428240, 0x6b428140
Caught exception in looking up space point ptr... 0x6b428140, 0x6b40aa00
Caught exception in looking up space point ptr... 0x3dfd2420, 0x3dfd25b0
Caught exception in looking up space point ptr... 0x3dfd25b0, 0x3dfbab40
Caught exception in looking up space point ptr... 0x6607c6a0, 0x43003090
Caught exception in looking up space point ptr... 0x43003090, 0x6607c6a0
Caught exception in looking up space point ptr... 0x6b45b2d0, 0x6b45afb0
Caught exception in looking up space point ptr... 0x6b45afb0, 0x6b45b140
Caught exception in looking up space point ptr... 0x2de84a70, 0x818aca00
Caught exception in looking up space point ptr... 0x818aca00, 0x2de84a70
Caught exception in looking up space point ptr... 0x6bb940e0, 0x6bb94180
Caught exception in looking up space point ptr... 0x6bb94180, 0x6bb94240
Caught exception in looking up space point ptr... 0x5a2666d0, 0x3e8d05b0
Caught exception in looking up space point ptr... 0x3e8d05b0, 0x5a2666d0
Caught exception in looking up space point ptr... 0x5b40a220, 0x39ed8fd0
Caught exception in looking up space point ptr... 0x39ed8fd0, 0x5b40a220
Caught exception in looking up space point ptr... 0x5b40a220, 0x8160c880
Caught exception in looking up space point ptr... 0x8160c880, 0x5b40a220
Caught exception in looking up space point ptr... 0x29e3ff60, 0x29e3fab0
Caught exception in looking up space point ptr... 0x29e3fab0, 0x29e3f920
Caught exception in looking up space point ptr... 0x29e3f920, 0x29e3fdd0
Caught exception in looking up space point ptr... 0x29e3fdd0, 0x29e400f0
++++>>>> total num hits: 99472, num free: 95744
04-Feb-2026 01:48:57 CET Closed output file "np02vd_raw_run042433_0078_df-s04-d0_dw_0_20260203T191146_reco_stage0_20260204T004857_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 87.966 138.562 301.466 133.775 56.3442 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.4641e-05 6.92958e-05 0.000204891 5.9231e-05 3.27186e-05 19
produce:tpcrawdecoder:PDVDTPCReader 4.77218 5.45049 6.1946 5.33286 0.42329 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.00757599 0.00993387 0.0245216 0.00863271 0.0038091 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000282462 0.000411399 0.000586434 0.000402163 8.3485e-05 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000240732 0.00036103 0.000602234 0.000342152 8.90456e-05 19
produce:beamevent:BeamEvent 5.3641e-05 9.94707e-05 0.000746835 6.152e-05 0.000152691 19
produce:pdvddaphne:DAPHNEReaderPDVD 1.40891 1.66455 2.00381 1.66216 0.153755 19
produce:ophit:OpHitFinder 0.0214979 0.028815 0.0351398 0.0284361 0.00364376 19
produce:wclsdatavd:WireCellToolkit 62.7073 68.6772 74.601 68.706 3.05544 19
produce:gaushit:GausHitFinder 0.605594 1.37469 2.57731 1.30626 0.480779 19
produce:nhitsfilter:NumberOfHitsFilter 0.000167771 0.000232161 0.000462264 0.000212282 6.7673e-05 19
produce:reco3d:SpacePointSolver 7.06189 13.4584 24.239 11.4455 4.55656 19
produce:hitpdune:DisambigFromSpacePoints 0.065197 0.218409 0.625243 0.156032 0.159646 19
produce:cluster3d:Cluster3D 0.771967 42.501 193.028 40.35 52.1475 19
[art]:TriggerResults:TriggerResultInserter 2.032e-05 3.21559e-05 8.9011e-05 3.04e-05 1.39395e-05 19
end_path:out1:RootOutput 4.12e-06 6.06063e-06 1.8461e-05 5.58e-06 2.98125e-06 19
end_path:out1:RootOutput(write) 3.68594 5.14688 7.96558 4.8822 0.983874 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 7633.95 MB
Peak resident set size usage (VmHWM): 5435.02 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0078_df-s04-d0_dw_0_20260203T191146_reco_stage0_20260204T004857_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0078_df-s04-d0_dw_0_20260203T191146_reco_stage0_20260204T004857_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0078_df-s04-d0_dw_0_20260203T191146_reco_stage0_20260204T004857_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163470.0,
"core.end_time": 1770166138.0,
"core.events": [
8902,
8908,
8914,
8920,
8926,
8932,
8938,
8944,
8950,
8956,
8962,
8968,
8974,
8980,
8986,
8992,
8998,
9004,
9010
],
"core.event_count": 19,
"core.first_event_number": 8902,
"core.last_event_number": 9010,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0078_df-s04-d0_dw_0_20260203T191146.hdf5"
}
]
} 