Jobsub ID 303653.116@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.116@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce504 |
| Last heartbeat | 2026-02-04 01:38:48 |
| From worker node | Hostname | b9p30p1409.cern.ch |
| cpuinfo | AMD EPYC 7302 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:44:15 |
| Input files | vd-protodune:np02vd_raw_run042421_0010_df-s04-d0_dw_0_20260203T133621.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6650s) |
| CPU time | 1h (6430s = 96%) |
| Max RSS bytes | 11742257152 (11198 MiB) |
| Outputting started | 2026-02-04 01:35:10 |
| Output files | |
| Finished | 2026-02-04 01:38:48 |
| Saved logs | justin-logs:303653.116-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
space point ptr... 0x3cd52010, 0x88c9180
Caught exception in looking up space point ptr... 0x15b629e50, 0x1250a63e0
Caught exception in looking up space point ptr... 0x1250a63e0, 0x15b629e50
Caught exception in looking up space point ptr... 0x15b629e50, 0x3cd73670
Caught exception in looking up space point ptr... 0x3cd73670, 0x15b629e50
Caught exception in looking up space point ptr... 0x29f750b0, 0x29f74d90
Caught exception in looking up space point ptr... 0x29f74d90, 0x29f74a70
Caught exception in looking up space point ptr... 0x168a11240, 0xc8da2d70
Caught exception in looking up space point ptr... 0xd32aeb40, 0x168a11240
Caught exception in looking up space point ptr... 0xe8fc86a0, 0x648bb80
Caught exception in looking up space point ptr... 0x648bb80, 0xe8fc86a0
Caught exception in looking up space point ptr... 0x3cedb660, 0x11ec85380
Caught exception in looking up space point ptr... 0x11ec85380, 0x3cedb660
Caught exception in looking up space point ptr... 0x30000c00, 0xf13e2530
Caught exception in looking up space point ptr... 0xf13e2530, 0x30000c00
Caught exception in looking up space point ptr... 0x1045f6f70, 0x14b9589f0
Caught exception in looking up space point ptr... 0x14b9589f0, 0xe8fc7130
Caught exception in looking up space point ptr... 0xbf8d4360, 0xbf8d44f0
Caught exception in looking up space point ptr... 0xbf8d44f0, 0xbf8d4360
Caught exception in looking up space point ptr... 0x144d2cce0, 0x144d2c670
Caught exception in looking up space point ptr... 0xc5b0af50, 0x144d2cce0
Caught exception in looking up space point ptr... 0x2b303e20, 0x29f1e2c0
Caught exception in looking up space point ptr... 0x29f1e2c0, 0x2b303e20
Caught exception in looking up space point ptr... 0x13b0d26b0, 0xf17d9380
Caught exception in looking up space point ptr... 0xf17d9380, 0x13b0d26b0
Caught exception in looking up space point ptr... 0x13b0d26b0, 0x13b0d2210
Caught exception in looking up space point ptr... 0x13b0d2210, 0x13b0d26b0
Caught exception in looking up space point ptr... 0x14cff21e0, 0x14cff20b0
Caught exception in looking up space point ptr... 0x14cff20b0, 0x14cff21e0
Caught exception in looking up space point ptr... 0x8b3abf50, 0x8b3abc30
Caught exception in looking up space point ptr... 0x8b3abc30, 0x8b3abf50
Caught exception in looking up space point ptr... 0x2a3a0280, 0x876b7b90
Caught exception in looking up space point ptr... 0x876b7b90, 0x876b7a40
Caught exception in looking up space point ptr... 0x876b52e0, 0x876b5430
Caught exception in looking up space point ptr... 0x876b5430, 0x876b52e0
Caught exception in looking up space point ptr... 0x3ce0e270, 0x1268bce30
Caught exception in looking up space point ptr... 0x1268bce30, 0x1268be490
Caught exception in looking up space point ptr... 0xf7e41540, 0x14945f6a0
Caught exception in looking up space point ptr... 0x14945f6a0, 0x14945fac0
Caught exception in looking up space point ptr... 0xc3234280, 0x140c00ad0
Caught exception in looking up space point ptr... 0x140c00ad0, 0xc3234280
Caught exception in looking up space point ptr... 0x1651deb20, 0x1651de830
Caught exception in looking up space point ptr... 0x1651de830, 0x1651de540
Caught exception in looking up space point ptr... 0x7f20e0a0, 0xc2cb91c0
Caught exception in looking up space point ptr... 0xc2cb91c0, 0xbf9c4d80
Caught exception in looking up space point ptr... 0x1651c9810, 0x1651c9520
Caught exception in looking up space point ptr... 0x1651c9520, 0x1651c9810
Caught exception in looking up space point ptr... 0x3d0c0680, 0x2a0caf00
Caught exception in looking up space point ptr... 0x2a0caf00, 0x2a0cb000
Caught exception in looking up space point ptr... 0x111da57f0, 0x80bc7e50
Caught exception in looking up space point ptr... 0x80bc7e50, 0x80bc94d0
Caught exception in looking up space point ptr... 0x7f20df70, 0x7f20e410
Caught exception in looking up space point ptr... 0x7f20e410, 0x7f20da50
Caught exception in looking up space point ptr... 0xe6a03580, 0x29f0c770
Caught exception in looking up space point ptr... 0x29f0c770, 0xe6a03580
Caught exception in looking up space point ptr... 0x303e5240, 0xe56f4ed0
Caught exception in looking up space point ptr... 0xe56f4ed0, 0x303e5240
Caught exception in looking up space point ptr... 0x2af9a390, 0x112ce8360
Caught exception in looking up space point ptr... 0x112ce8360, 0x2af9a390
Caught exception in looking up space point ptr... 0xd4e597d0, 0x15593b350
Caught exception in looking up space point ptr... 0x15593b350, 0xc45320b0
Caught exception in looking up space point ptr... 0x2a93a3a0, 0x2a939f60
Caught exception in looking up space point ptr... 0x2a939f60, 0x2a93a3a0
Caught exception in looking up space point ptr... 0x2a93a3a0, 0xe93b2630
Caught exception in looking up space point ptr... 0xe93b2630, 0x2a93a3a0
++++>>>> total num hits: 91367, num free: 88110
04-Feb-2026 02:34:58 CET Closed output file "np02vd_raw_run042421_0010_df-s04-d0_dw_0_20260203T133621_reco_stage0_20260204T013458_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 86.2873 234.45 1309.74 105.096 284.115 28
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.1671e-05 0.000107786 0.000267655 9.99365e-05 5.00296e-05 28
produce:tpcrawdecoder:PDVDTPCReader 4.04742 4.64505 5.28143 4.6301 0.297749 28
produce:triggerrawdecoder:PDVDTriggerReader4 0.0116174 0.021249 0.0518445 0.0152472 0.0107785 28
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000411387 0.000640208 0.00196104 0.000543079 0.000301591 28
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00149352 0.00195246 0.00324593 0.00193668 0.000322173 28
produce:beamevent:BeamEvent 6.5641e-05 0.000144497 0.00110362 0.000104387 0.000186769 28
produce:pdvddaphne:DAPHNEReaderPDVD 2.76773 4.47571 5.62633 4.48466 0.563596 28
produce:ophit:OpHitFinder 0.0221362 0.0336158 0.0487451 0.0323564 0.00570794 28
produce:wclsdatavd:WireCellToolkit 62.3803 71.375 85.0092 70.9761 7.23245 28
produce:gaushit:GausHitFinder 0.534259 3.13471 16.574 1.23833 3.87021 28
produce:nhitsfilter:NumberOfHitsFilter 0.000225454 0.000646373 0.00166759 0.000353226 0.000459791 28
produce:reco3d:SpacePointSolver 5.25453 30.0668 134.442 14.0645 33.5016 25
produce:hitpdune:DisambigFromSpacePoints 0.0563562 1.54467 7.68233 0.11843 2.21727 25
produce:cluster3d:Cluster3D 0.630087 129.41 1038.87 2.29357 250.941 25
[art]:TriggerResults:TriggerResultInserter 2.5201e-05 4.35344e-05 9.8491e-05 3.53055e-05 1.99315e-05 28
end_path:out1:RootOutput 4.09e-06 2.98562e-05 0.00059841 8.29e-06 0.000109495 28
end_path:out1:RootOutput(write) 3.35494 6.93869 26.1841 4.5479 5.39738 28
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 13683 MB
Peak resident set size usage (VmHWM): 11742.3 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0010_df-s04-d0_dw_0_20260203T133621_reco_stage0_20260204T013458_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0010_df-s04-d0_dw_0_20260203T133621_reco_stage0_20260204T013458_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0010_df-s04-d0_dw_0_20260203T133621_reco_stage0_20260204T013458_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162269.0,
"core.end_time": 1770168900.0,
"core.events": [
1636,
1642,
1648,
1654,
1660,
1666,
1672,
1678,
1684,
1690,
1696,
1702,
1708,
1714,
1720,
1726,
1732,
1738,
1744,
1750,
1756,
1762,
1768,
1774,
1780,
1786,
1792,
1798
],
"core.event_count": 28,
"core.first_event_number": 1636,
"core.last_event_number": 1798,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0010_df-s04-d0_dw_0_20260203T133621.hdf5"
}
]
} 