Jobsub ID 303651.128@dunegpschedd01.fnal.gov
| Jobsub ID | 303651.128@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:50:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce515 |
| Last heartbeat | 2026-02-04 00:09:02 |
| From worker node | Hostname | b9p12p0201.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:22:08 |
| Input files | vd-protodune:np02vd_raw_run042421_0079_df-s03-d1_dw_0_20260203T141345.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 44m (2658s) |
| CPU time | 42m (2541s = 95%) |
| Max RSS bytes | 6112149504 (5829 MiB) |
| Outputting started | 2026-02-04 00:06:28 |
| Output files | |
| Finished | 2026-02-04 00:09:02 |
| Saved logs | justin-logs:303651.128-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
x15099350
Caught exception in looking up space point ptr... 0x15099350, 0x15099470
Caught exception in looking up space point ptr... 0x5e41bfa0, 0x5e41be10
Caught exception in looking up space point ptr... 0x5e41be10, 0x54796290
Caught exception in looking up space point ptr... 0x4c2c32d0, 0x4c2c33d0
Caught exception in looking up space point ptr... 0x28276cb0, 0x4c2c32d0
Caught exception in looking up space point ptr... 0x50e86430, 0x50e85760
Caught exception in looking up space point ptr... 0x50e85760, 0x50e86600
Caught exception in looking up space point ptr... 0x2eca5390, 0x2eca4f70
Caught exception in looking up space point ptr... 0x2eca4f70, 0x2eca5390
Caught exception in looking up space point ptr... 0x30260890, 0x3025b0b0
Caught exception in looking up space point ptr... 0x3025b0b0, 0x30260790
Caught exception in looking up space point ptr... 0x15091a10, 0x3e6f7e90
Caught exception in looking up space point ptr... 0x150959c0, 0x15091a10
Caught exception in looking up space point ptr... 0x3fac5b00, 0x5baa5500
Caught exception in looking up space point ptr... 0x5baa5500, 0x3fac5b00
Caught exception in looking up space point ptr... 0x412826e0, 0x41282480
Caught exception in looking up space point ptr... 0x41282480, 0x412823e0
Caught exception in looking up space point ptr... 0x2ef2d550, 0x30337d40
Caught exception in looking up space point ptr... 0x30337d40, 0x2ef3f920
Caught exception in looking up space point ptr... 0x2f4f58e0, 0x2f4fcb70
Caught exception in looking up space point ptr... 0x2f4fcb70, 0x2f50a760
Caught exception in looking up space point ptr... 0x2c74af90, 0x2c728530
Caught exception in looking up space point ptr... 0x2c728530, 0x2c7283e0
Caught exception in looking up space point ptr... 0x30278980, 0x30278740
Caught exception in looking up space point ptr... 0x30278740, 0x30278980
Caught exception in looking up space point ptr... 0x39d2b810, 0x39d2bef0
Caught exception in looking up space point ptr... 0x54446e80, 0x39d2b810
Caught exception in looking up space point ptr... 0x43308d60, 0x510bafc0
Caught exception in looking up space point ptr... 0x510bafc0, 0x43308d60
Caught exception in looking up space point ptr... 0x444b2a90, 0x444b22e0
Caught exception in looking up space point ptr... 0x444b22e0, 0x444b2b30
Caught exception in looking up space point ptr... 0x444b2b30, 0x444b2000
Caught exception in looking up space point ptr... 0x2ec9ccf0, 0x2ec9c980
Caught exception in looking up space point ptr... 0x2ec9c980, 0x2ec9c830
Caught exception in looking up space point ptr... 0x3ca39990, 0x3ca40800
Caught exception in looking up space point ptr... 0x3ca40800, 0x3ca39990
Caught exception in looking up space point ptr... 0x3c6d8150, 0x3c6d7440
Caught exception in looking up space point ptr... 0x3c6d7440, 0x3c6d7310
Caught exception in looking up space point ptr... 0x46b37f20, 0xdca7790
Caught exception in looking up space point ptr... 0xdca7790, 0x46b3b070
Caught exception in looking up space point ptr... 0x46b3b070, 0xdcb31c0
Caught exception in looking up space point ptr... 0x20f27530, 0x2730dbe0
Caught exception in looking up space point ptr... 0x2730dbe0, 0x20f27530
Caught exception in looking up space point ptr... 0x3f1913c0, 0x3f190a40
Caught exception in looking up space point ptr... 0x3f190a40, 0x3f1913c0
Caught exception in looking up space point ptr... 0xdf3e660, 0xdf3c170
Caught exception in looking up space point ptr... 0xdf3c170, 0x3027f9c0
Caught exception in looking up space point ptr... 0x9c71800, 0x9c71700
Caught exception in looking up space point ptr... 0x9c71700, 0x9c6f820
Caught exception in looking up space point ptr... 0x5baa8b70, 0x5baa8e90
Caught exception in looking up space point ptr... 0x5baa8e90, 0x5baa91b0
Caught exception in looking up space point ptr... 0xdd91290, 0xdd915b0
Caught exception in looking up space point ptr... 0xdd915b0, 0xdd91290
Caught exception in looking up space point ptr... 0x7896c860, 0x7896a720
Caught exception in looking up space point ptr... 0x7896a720, 0x7896a040
Caught exception in looking up space point ptr... 0x50e896a0, 0x50e89510
Caught exception in looking up space point ptr... 0x50e89510, 0x50e896a0
Caught exception in looking up space point ptr... 0x5441a390, 0x5441b4e0
Caught exception in looking up space point ptr... 0x5441b4e0, 0x5441a390
Caught exception in looking up space point ptr... 0x5441a390, 0x3f21dd00
Caught exception in looking up space point ptr... 0x3f21dd00, 0x5441a390
Caught exception in looking up space point ptr... 0xddd8790, 0xddd8400
Caught exception in looking up space point ptr... 0xddda720, 0xddd8790
Caught exception in looking up space point ptr... 0x4b44d740, 0x50d96000
Caught exception in looking up space point ptr... 0x50d96000, 0x27ef2a10
++++>>>> total num hits: 148997, num free: 143103
04-Feb-2026 01:06:20 CET Closed output file "np02vd_raw_run042421_0079_df-s03-d1_dw_0_20260203T141345_reco_stage0_20260204T000620_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 59.9871 96.5944 326.27 77.4965 58.1792 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.294e-05 7.35529e-05 0.000186961 6.618e-05 3.24441e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.35156 3.95937 4.91101 3.88192 0.394237 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00925435 0.0163881 0.0388911 0.0127379 0.0078526 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000349841 0.000486327 0.00115709 0.000453161 0.000147158 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00146251 0.00176583 0.00243499 0.00174336 0.000228834 27
produce:beamevent:BeamEvent 4.602e-05 0.000104433 0.000633852 8.0581e-05 0.000111387 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.94027 2.23953 2.59743 2.21578 0.185896 27
produce:ophit:OpHitFinder 0.0210759 0.0316516 0.0459528 0.0326786 0.00533009 27
produce:wclsdatavd:WireCellToolkit 45.8367 52.2492 63.0942 51.2613 4.63889 27
produce:gaushit:GausHitFinder 0.392827 1.70736 10.8034 0.877323 2.37859 27
produce:nhitsfilter:NumberOfHitsFilter 0.00012876 0.000257112 0.000513842 0.000225901 0.000101167 27
produce:reco3d:SpacePointSolver 3.50381 11.1049 27.4712 10.4841 5.31517 27
produce:hitpdune:DisambigFromSpacePoints 0.0375467 0.259639 1.34012 0.0835929 0.393915 27
produce:cluster3d:Cluster3D 0.573973 21.2241 218.915 1.4662 49.0497 27
[art]:TriggerResults:TriggerResultInserter 1.409e-05 3.53001e-05 0.000178791 2.77e-05 3.12893e-05 27
end_path:out1:RootOutput 3.35e-06 6.09407e-06 3.076e-05 4.25e-06 5.16342e-06 27
end_path:out1:RootOutput(write) 2.56008 3.7806 9.0866 3.13793 1.55009 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 8156.34 MB
Peak resident set size usage (VmHWM): 6112.15 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0079_df-s03-d1_dw_0_20260203T141345_reco_stage0_20260204T000620_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0079_df-s03-d1_dw_0_20260203T141345_reco_stage0_20260204T000620_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0079_df-s03-d1_dw_0_20260203T141345_reco_stage0_20260204T000620_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160938.0,
"core.end_time": 1770163582.0,
"core.events": [
12861,
12867,
12873,
12879,
12885,
12891,
12897,
12903,
12909,
12915,
12921,
12927,
12933,
12939,
12945,
12951,
12957,
12963,
12969,
12975,
12981,
12987,
12993,
12999,
13005,
13011,
13017
],
"core.event_count": 27,
"core.first_event_number": 12861,
"core.last_event_number": 13017,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0079_df-s03-d1_dw_0_20260203T141345.hdf5"
}
]
} 