Jobsub ID 303651.190@dunegpschedd01.fnal.gov
| Jobsub ID | 303651.190@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:50:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce512 |
| Last heartbeat | 2026-02-04 00:07:15 |
| From worker node | Hostname | b9p10p5730.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:24:02 |
| Input files | vd-protodune:np02vd_raw_run042421_0081_df-s03-d0_dw_0_20260203T141451.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 40m (2438s) |
| CPU time | 38m (2332s = 95%) |
| Max RSS bytes | 3439955968 (3280 MiB) |
| Outputting started | 2026-02-04 00:04:41 |
| Output files | |
| Finished | 2026-02-04 00:07:15 |
| Saved logs | justin-logs:303651.190-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
x37868850
Caught exception in looking up space point ptr... 0x37868850, 0x37867eb0
Caught exception in looking up space point ptr... 0x37867eb0, 0x37868850
Caught exception in looking up space point ptr... 0x937c280, 0x937c570
Caught exception in looking up space point ptr... 0x937c570, 0x937d1c0
Caught exception in looking up space point ptr... 0x377eeff0, 0x377f21d0
Caught exception in looking up space point ptr... 0x377f21d0, 0x377ecc20
Caught exception in looking up space point ptr... 0x35674750, 0x4a7b3bd0
Caught exception in looking up space point ptr... 0x4a7b3bd0, 0x35674750
Caught exception in looking up space point ptr... 0x25da31c0, 0x2b117820
Caught exception in looking up space point ptr... 0x2b117820, 0x25d95d60
Caught exception in looking up space point ptr... 0x6866170, 0x6866300
Caught exception in looking up space point ptr... 0x6866300, 0x6866490
Caught exception in looking up space point ptr... 0x47b9ddb0, 0x15dc4c30
Caught exception in looking up space point ptr... 0x15dc4c30, 0x5e1ced50
Caught exception in looking up space point ptr... 0x5e32b940, 0x373b6f10
Caught exception in looking up space point ptr... 0x373b6f10, 0x65be1ee0
Caught exception in looking up space point ptr... 0xf56b3a0, 0xb702010
Caught exception in looking up space point ptr... 0x2ab94a90, 0xf56b3a0
Caught exception in looking up space point ptr... 0x43999a70, 0x3f403050
Caught exception in looking up space point ptr... 0x3f403050, 0x43999a70
Caught exception in looking up space point ptr... 0x5c8ce600, 0x11b85290
Caught exception in looking up space point ptr... 0x316562a0, 0x5c8ce600
Caught exception in looking up space point ptr... 0x63ab6af0, 0x63ab7060
Caught exception in looking up space point ptr... 0x63ab7060, 0x63ab6d80
Caught exception in looking up space point ptr... 0x2ca46810, 0x2ca465c0
Caught exception in looking up space point ptr... 0x2ca465c0, 0x2ca46810
Caught exception in looking up space point ptr... 0x30a79220, 0x31901090
Caught exception in looking up space point ptr... 0x31901090, 0x319011e0
Caught exception in looking up space point ptr... 0x5b48f3e0, 0x5b48f170
Caught exception in looking up space point ptr... 0x5b48f560, 0x5b48f3e0
Caught exception in looking up space point ptr... 0x582c1d80, 0x582c1f10
Caught exception in looking up space point ptr... 0x582c1f10, 0x582c20a0
Caught exception in looking up space point ptr... 0x459da5b0, 0x4e1c9800
Caught exception in looking up space point ptr... 0x4e1c9800, 0x459da5b0
Caught exception in looking up space point ptr... 0x33a45390, 0x657dbb90
Caught exception in looking up space point ptr... 0x657dbb90, 0x3dcde3b0
Caught exception in looking up space point ptr... 0x3dcde3b0, 0x4a22ada0
Caught exception in looking up space point ptr... 0x3f5cc840, 0x3f5ccaf0
Caught exception in looking up space point ptr... 0x3f5da510, 0x3f5cc840
Caught exception in looking up space point ptr... 0x520909f0, 0x52094eb0
Caught exception in looking up space point ptr... 0x520902d0, 0x520909f0
Caught exception in looking up space point ptr... 0x3ac4e1e0, 0x62944fe0
Caught exception in looking up space point ptr... 0x62944fe0, 0x3ac4e610
Caught exception in looking up space point ptr... 0x4eceb1c0, 0x157c87e0
Caught exception in looking up space point ptr... 0x157c87e0, 0x65b8dcd0
Caught exception in looking up space point ptr... 0x2d9a3ff0, 0x35674670
Caught exception in looking up space point ptr... 0x35674670, 0x2b117bf0
Caught exception in looking up space point ptr... 0x629618b0, 0x62961590
Caught exception in looking up space point ptr... 0x62961590, 0x629618b0
Caught exception in looking up space point ptr... 0xec4d840, 0xec4db60
Caught exception in looking up space point ptr... 0xec4db60, 0xec4dcf0
Caught exception in looking up space point ptr... 0x52b60af0, 0x652ce680
Caught exception in looking up space point ptr... 0x652ce680, 0x44a543c0
Caught exception in looking up space point ptr... 0x44a543c0, 0x3d77d7b0
Caught exception in looking up space point ptr... 0x30a5fa20, 0x30a60b20
Caught exception in looking up space point ptr... 0x30a60b20, 0x30a5fa20
Caught exception in looking up space point ptr... 0x3dc7deb0, 0x284cd360
Caught exception in looking up space point ptr... 0x284cd360, 0x3f4d4f30
Caught exception in looking up space point ptr... 0x316bfc40, 0x5e2b3c80
Caught exception in looking up space point ptr... 0x5e2b3c80, 0xb143080
Caught exception in looking up space point ptr... 0x2abe81b0, 0x28920a00
Caught exception in looking up space point ptr... 0x28920a00, 0x373bb900
Caught exception in looking up space point ptr... 0x373bb900, 0x44966ba0
Caught exception in looking up space point ptr... 0x140a8c60, 0x339ea980
Caught exception in looking up space point ptr... 0x339ea980, 0x5e319040
++++>>>> total num hits: 71538, num free: 69172
04-Feb-2026 01:04:32 CET Closed output file "np02vd_raw_run042421_0081_df-s03-d0_dw_0_20260203T141451_reco_stage0_20260204T000432_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 61.6826 88.4619 151.292 81.8827 21.8233 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.729e-05 8.38995e-05 0.000189032 7.456e-05 3.01386e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.69816 4.8337 13.9814 4.51945 1.82684 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00997493 0.0209026 0.0471604 0.0173376 0.00982419 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000402295 0.000587979 0.000909031 0.000556177 0.000130217 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00157317 0.00223622 0.00337165 0.00215739 0.000462069 27
produce:beamevent:BeamEvent 5.5831e-05 0.000139654 0.000963742 0.000105382 0.000165561 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.91117 2.5228 3.30702 2.39736 0.370753 27
produce:ophit:OpHitFinder 0.0224193 0.0334839 0.0424347 0.0342234 0.00474613 27
produce:wclsdatavd:WireCellToolkit 47.2095 53.9644 66.0326 52.908 4.99912 27
produce:gaushit:GausHitFinder 0.513271 1.01069 2.37946 0.87836 0.421858 27
produce:nhitsfilter:NumberOfHitsFilter 0.000127362 0.000283115 0.000385035 0.000259133 6.62274e-05 27
produce:reco3d:SpacePointSolver 4.34793 13.1915 20.149 13.3328 4.03649 27
produce:hitpdune:DisambigFromSpacePoints 0.0477605 0.14091 0.413161 0.107318 0.0888847 27
produce:cluster3d:Cluster3D 0.824614 9.19073 65.6792 2.04603 17.9698 27
[art]:TriggerResults:TriggerResultInserter 2.09e-05 3.03669e-05 9.1401e-05 2.6791e-05 1.29299e-05 27
end_path:out1:RootOutput 5.1e-06 8.45559e-06 2.848e-05 7.58e-06 4.22486e-06 27
end_path:out1:RootOutput(write) 2.76545 3.52718 5.31704 3.19674 0.702653 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5549.76 MB
Peak resident set size usage (VmHWM): 3439.96 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0081_df-s03-d0_dw_0_20260203T141451_reco_stage0_20260204T000432_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0081_df-s03-d0_dw_0_20260203T141451_reco_stage0_20260204T000432_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0081_df-s03-d0_dw_0_20260203T141451_reco_stage0_20260204T000432_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161051.0,
"core.end_time": 1770163474.0,
"core.events": [
13190,
13196,
13202,
13208,
13214,
13220,
13226,
13232,
13238,
13244,
13250,
13256,
13262,
13268,
13274,
13280,
13286,
13292,
13298,
13304,
13310,
13316,
13322,
13328,
13334,
13340,
13346
],
"core.event_count": 27,
"core.first_event_number": 13190,
"core.last_event_number": 13346,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0081_df-s03-d0_dw_0_20260203T141451.hdf5"
}
]
} 