Jobsub ID 303653.7@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.7@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce510 |
| Last heartbeat | 2026-02-04 00:39:04 |
| From worker node | Hostname | b9p35p0023.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:36:28 |
| Input files | vd-protodune:np02vd_raw_run042421_0154_df-s03-d0_dw_0_20260203T145418.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 59m (3594s) |
| CPU time | 58m (3492s = 97%) |
| Max RSS bytes | 9598730240 (9154 MiB) |
| Outputting started | 2026-02-04 00:36:24 |
| Output files | |
| Finished | 2026-02-04 00:39:04 |
| Saved logs | justin-logs:303653.7-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
fa0
Caught exception in looking up space point ptr... 0xfc5796e0, 0x3bd31230
Caught exception in looking up space point ptr... 0x3bd31230, 0xfc5796e0
Caught exception in looking up space point ptr... 0x65dc6c30, 0xc8ccdd20
Caught exception in looking up space point ptr... 0x66973650, 0x650e4580
Caught exception in looking up space point ptr... 0x650e4580, 0xcaad92c0
Caught exception in looking up space point ptr... 0x603ae1a0, 0x65dc6c30
Caught exception in looking up space point ptr... 0x8755db0, 0x8743fb0
Caught exception in looking up space point ptr... 0x8743fb0, 0x87442f0
Caught exception in looking up space point ptr... 0xd3174970, 0xd31742e0
Caught exception in looking up space point ptr... 0xd31742e0, 0xd3174470
Caught exception in looking up space point ptr... 0x61ec3ab0, 0x61ec3d10
Caught exception in looking up space point ptr... 0x61ec3d10, 0x641d5ce0
Caught exception in looking up space point ptr... 0xa6d2d230, 0xa6d2cf10
Caught exception in looking up space point ptr... 0x9cc6c7e0, 0xa6d2d230
Caught exception in looking up space point ptr... 0x87493a0, 0x87482c0
Caught exception in looking up space point ptr... 0x8749690, 0x87493a0
Caught exception in looking up space point ptr... 0x655ccfe0, 0x95ed6780
Caught exception in looking up space point ptr... 0x655cce50, 0x655ccfe0
Caught exception in looking up space point ptr... 0xd55280f0, 0xd5527e50
Caught exception in looking up space point ptr... 0xcbd9a460, 0xd55280f0
Caught exception in looking up space point ptr... 0xaf7ff100, 0x618e4f90
Caught exception in looking up space point ptr... 0x618e4f90, 0xd4be9cc0
Caught exception in looking up space point ptr... 0x66a6e9b0, 0x66a651e0
Caught exception in looking up space point ptr... 0x66a60290, 0x66a62140
Caught exception in looking up space point ptr... 0x66a62140, 0x66a6e9b0
Caught exception in looking up space point ptr... 0xe60c71c0, 0x6311b0c0
Caught exception in looking up space point ptr... 0x6311b0c0, 0x6311b310
Caught exception in looking up space point ptr... 0x65f08480, 0x65f081e0
Caught exception in looking up space point ptr... 0x65f081e0, 0x65f08480
Caught exception in looking up space point ptr... 0xa6c56e30, 0xa6c56c50
Caught exception in looking up space point ptr... 0xa6c56c50, 0xa6c56e30
Caught exception in looking up space point ptr... 0x9ed61710, 0x9ed63c60
Caught exception in looking up space point ptr... 0x9ed63c60, 0x9ed62e80
Caught exception in looking up space point ptr... 0xaa7132c0, 0xaa7134a0
Caught exception in looking up space point ptr... 0xaa7134a0, 0xaa7132c0
Caught exception in looking up space point ptr... 0xaa7132c0, 0x8807df0
Caught exception in looking up space point ptr... 0x8807df0, 0xaa7132c0
Caught exception in looking up space point ptr... 0xd3d98830, 0x95d32190
Caught exception in looking up space point ptr... 0x95d32190, 0x5f8d0800
Caught exception in looking up space point ptr... 0x5f8d0800, 0xa89e04a0
Caught exception in looking up space point ptr... 0xa89e04a0, 0xd3d98830
Caught exception in looking up space point ptr... 0xd3d829e0, 0xd3d82800
Caught exception in looking up space point ptr... 0xd3d82800, 0xd3d826b0
Caught exception in looking up space point ptr... 0x93b75970, 0x93b75820
Caught exception in looking up space point ptr... 0x93b75820, 0x93b75970
Caught exception in looking up space point ptr... 0xd4cc0910, 0xd4cc07e0
Caught exception in looking up space point ptr... 0xd4cc1360, 0xd4cc0910
Caught exception in looking up space point ptr... 0x657c76c0, 0x657c7810
Caught exception in looking up space point ptr... 0x657c7810, 0x657c7960
Caught exception in looking up space point ptr... 0x657c7960, 0x657c7810
Caught exception in looking up space point ptr... 0x657c7810, 0x657c7c40
Caught exception in looking up space point ptr... 0x65f15740, 0x65f15420
Caught exception in looking up space point ptr... 0x65f15420, 0x65f15740
Caught exception in looking up space point ptr... 0x66f86fb0, 0x2a04db70
Caught exception in looking up space point ptr... 0x2a04db70, 0x2a0c7e60
Caught exception in looking up space point ptr... 0xb7801550, 0xcda595d0
Caught exception in looking up space point ptr... 0xcda595d0, 0xb7801550
Caught exception in looking up space point ptr... 0x1039557a0, 0x3be3c6e0
Caught exception in looking up space point ptr... 0x3be3c6e0, 0x1039557a0
Caught exception in looking up space point ptr... 0x9ed686b0, 0xd3d7cd00
Caught exception in looking up space point ptr... 0xd3d7cd00, 0x9ed686b0
Caught exception in looking up space point ptr... 0x9ed686b0, 0x8743d60
Caught exception in looking up space point ptr... 0x8743d60, 0x9ed686b0
Caught exception in looking up space point ptr... 0xca03cea0, 0xa8952160
Caught exception in looking up space point ptr... 0xa8952160, 0xca03cea0
++++>>>> total num hits: 53026, num free: 50874
04-Feb-2026 01:36:17 CET Closed output file "np02vd_raw_run042421_0154_df-s03-d0_dw_0_20260203T145418_reco_stage0_20260204T003617_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 56.7267 131.193 601.316 63.7729 166.282 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.641e-05 7.66901e-05 0.00022656 7.383e-05 3.06004e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.50576 4.13308 7.48098 3.98766 0.725708 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00765574 0.0181343 0.141198 0.00970561 0.0257767 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000352031 0.000484238 0.00135695 0.000422962 0.000191101 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00111965 0.0013884 0.00199075 0.00136494 0.000196253 27
produce:beamevent:BeamEvent 6.475e-05 0.0001091 0.000731363 8.3231e-05 0.000122776 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.10103 2.41119 2.70649 2.43182 0.148236 27
produce:ophit:OpHitFinder 0.0247207 0.0318508 0.0379088 0.0332326 0.0033338 27
produce:wclsdatavd:WireCellToolkit 41.6272 45.7876 52.0222 45.9929 2.71501 27
produce:gaushit:GausHitFinder 0.30986 1.37308 10.8499 0.641786 2.20004 27
produce:nhitsfilter:NumberOfHitsFilter 0.00010037 0.000177077 0.000514742 0.00013581 0.000107765 27
produce:reco3d:SpacePointSolver 2.75745 12.4764 56.8827 5.59753 16.5415 27
produce:hitpdune:DisambigFromSpacePoints 0.0215984 0.399437 3.4009 0.0637178 0.868483 27
produce:cluster3d:Cluster3D 0.432711 59.7873 462.707 1.24801 141.866 27
[art]:TriggerResults:TriggerResultInserter 2.046e-05 3.29926e-05 9.97e-05 2.973e-05 1.4204e-05 27
end_path:out1:RootOutput 4.67e-06 6.37963e-06 2.405e-05 5.55e-06 3.61273e-06 27
end_path:out1:RootOutput(write) 2.82139 4.73849 14.0565 3.31446 3.39699 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 11916.3 MB
Peak resident set size usage (VmHWM): 9598.73 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0154_df-s03-d0_dw_0_20260203T145418_reco_stage0_20260204T003617_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0154_df-s03-d0_dw_0_20260203T145418_reco_stage0_20260204T003617_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0154_df-s03-d0_dw_0_20260203T145418_reco_stage0_20260204T003617_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161797.0,
"core.end_time": 1770165378.0,
"core.events": [
25028,
25034,
25040,
25046,
25052,
25058,
25064,
25070,
25076,
25082,
25088,
25094,
25100,
25106,
25112,
25118,
25124,
25130,
25136,
25142,
25148,
25154,
25160,
25166,
25172,
25178,
25184
],
"core.event_count": 27,
"core.first_event_number": 25028,
"core.last_event_number": 25184,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0154_df-s03-d0_dw_0_20260203T145418.hdf5"
}
]
} 