Jobsub ID 303647.190@dunegpschedd01.fnal.gov
| Jobsub ID | 303647.190@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:46:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce514 |
| Last heartbeat | 2026-02-04 00:10:58 |
| From worker node | Hostname | b9p08p6650.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:47:08 |
| Input files | vd-protodune:np02vd_raw_run042421_0007_df-s03-d1_dw_0_20260203T133442.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4822s) |
| CPU time | 1h (4669s = 96%) |
| Max RSS bytes | 10014298112 (9550 MiB) |
| Outputting started | 2026-02-04 00:07:32 |
| Output files | |
| Finished | 2026-02-04 00:10:58 |
| Saved logs | justin-logs:303647.190-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
x93cc1a50
Caught exception in looking up space point ptr... 0x10642c620, 0x1064a2b20
Caught exception in looking up space point ptr... 0x1064a2b20, 0x10642c620
Caught exception in looking up space point ptr... 0x10642c620, 0x6cf6f760
Caught exception in looking up space point ptr... 0x6cf6f760, 0x10642c620
Caught exception in looking up space point ptr... 0x2b455070, 0x9a085cb0
Caught exception in looking up space point ptr... 0x9a085cb0, 0x4abccff0
Caught exception in looking up space point ptr... 0x4abccff0, 0x8f3f1300
Caught exception in looking up space point ptr... 0x8f3f1300, 0x2b455070
Caught exception in looking up space point ptr... 0x4f5d1eb0, 0xce1bb00
Caught exception in looking up space point ptr... 0xce1bb00, 0x4f5d1eb0
Caught exception in looking up space point ptr... 0x4f5d1eb0, 0x9a092b80
Caught exception in looking up space point ptr... 0x9a092b80, 0x4f5d1eb0
Caught exception in looking up space point ptr... 0x3fd055a0, 0x3faf1a30
Caught exception in looking up space point ptr... 0x3faf1a30, 0x3fd055a0
Caught exception in looking up space point ptr... 0x3fd055a0, 0x53ec33b0
Caught exception in looking up space point ptr... 0x53ec33b0, 0x3fd055a0
Caught exception in looking up space point ptr... 0x3fd055a0, 0x413af600
Caught exception in looking up space point ptr... 0x413af600, 0x3fd055a0
Caught exception in looking up space point ptr... 0xcfb9730, 0x414a3850
Caught exception in looking up space point ptr... 0x96fe3070, 0xcfb9730
Caught exception in looking up space point ptr... 0x84e4cdb0, 0x5809eb60
Caught exception in looking up space point ptr... 0x5809eb60, 0x95c14e10
Caught exception in looking up space point ptr... 0x95c14e10, 0x67a014f0
Caught exception in looking up space point ptr... 0x67a014f0, 0x84e4cdb0
Caught exception in looking up space point ptr... 0x6e60d790, 0x413e9e10
Caught exception in looking up space point ptr... 0x413e9e10, 0x6e60d790
Caught exception in looking up space point ptr... 0x1060afff0, 0x224f6d10
Caught exception in looking up space point ptr... 0x5ca1fa10, 0x1060afff0
Caught exception in looking up space point ptr... 0x32447870, 0x8f6e9a0
Caught exception in looking up space point ptr... 0x8f6e9a0, 0x32447870
Caught exception in looking up space point ptr... 0x6146a0c0, 0x3f5151b0
Caught exception in looking up space point ptr... 0x3f5151b0, 0x6146a0c0
Caught exception in looking up space point ptr... 0x6146a0c0, 0xdbef550
Caught exception in looking up space point ptr... 0xdbef550, 0x6146a0c0
Caught exception in looking up space point ptr... 0x5ac7efa0, 0x53162c70
Caught exception in looking up space point ptr... 0x53162c70, 0x5ac7efa0
Caught exception in looking up space point ptr... 0x1064ed1f0, 0x1063f4ee0
Caught exception in looking up space point ptr... 0x1063f4ee0, 0x1064ed1f0
Caught exception in looking up space point ptr... 0x1064ed1f0, 0x6d01bb70
Caught exception in looking up space point ptr... 0x6d01bb70, 0x1064ed1f0
Caught exception in looking up space point ptr... 0x3fbfb690, 0x65c1eb70
Caught exception in looking up space point ptr... 0x384ff5a0, 0x3fbfb690
Caught exception in looking up space point ptr... 0x53acc200, 0x53ab9f20
Caught exception in looking up space point ptr... 0x53ab9f20, 0x49e5f790
Caught exception in looking up space point ptr... 0x60caa0f0, 0x60caa280
Caught exception in looking up space point ptr... 0x60caa280, 0x53acc200
Caught exception in looking up space point ptr... 0x1062a9950, 0x1061f89c0
Caught exception in looking up space point ptr... 0x1061f89c0, 0x1062ab180
Caught exception in looking up space point ptr... 0xcde0aa0, 0x51b685b0
Caught exception in looking up space point ptr... 0x51b685b0, 0x14ba3370
Caught exception in looking up space point ptr... 0x14ba3370, 0x21e6f5a0
Caught exception in looking up space point ptr... 0x435e0bf0, 0x368a82d0
Caught exception in looking up space point ptr... 0x435e14e0, 0x435e0bf0
Caught exception in looking up space point ptr... 0x2e8cd200, 0x38e6f8a0
Caught exception in looking up space point ptr... 0x38e6f8a0, 0x2e8cd200
Caught exception in looking up space point ptr... 0x6cf7ab00, 0x6cfb03d0
Caught exception in looking up space point ptr... 0x6cfb03d0, 0x6cf7ab00
Caught exception in looking up space point ptr... 0x35487910, 0x237d0310
Caught exception in looking up space point ptr... 0x237d0310, 0x67eca870
Caught exception in looking up space point ptr... 0x21a9f420, 0x21a9f2f0
Caught exception in looking up space point ptr... 0x21a9f2f0, 0x21a9f420
Caught exception in looking up space point ptr... 0x21a9f420, 0x690ae7b0
Caught exception in looking up space point ptr... 0x690ae7b0, 0x21a9f420
Caught exception in looking up space point ptr... 0x21a9f420, 0x690ae8f0
Caught exception in looking up space point ptr... 0x690ae8f0, 0x21a9f420
++++>>>> total num hits: 2912298, num free: 2819126
04-Feb-2026 01:07:21 CET Closed output file "np02vd_raw_run042421_0007_df-s03-d1_dw_0_20260203T133442_reco_stage0_20260204T000721_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 79.1173 175.902 895.22 97.3049 203.253 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.7181e-05 0.000103088 0.000281654 9.6951e-05 4.50382e-05 27
produce:tpcrawdecoder:PDVDTPCReader 4.47216 4.74009 5.25547 4.68711 0.185231 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.0107566 0.0830745 1.84935 0.0138769 0.346424 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000434095 0.000668117 0.00191153 0.000579547 0.000306046 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00161196 0.00217937 0.00442591 0.0019584 0.00065923 27
produce:beamevent:BeamEvent 7.1281e-05 0.000158571 0.00145268 0.000112721 0.000255047 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.2441 3.00097 3.64496 2.98717 0.299482 27
produce:ophit:OpHitFinder 0.029699 0.0394949 0.051974 0.0395957 0.00437247 27
produce:wclsdatavd:WireCellToolkit 57.7552 69.4843 83.8596 69.3227 5.92027 27
produce:gaushit:GausHitFinder 0.647501 2.13608 10.5679 1.17238 2.52223 27
produce:nhitsfilter:NumberOfHitsFilter 0.000183003 0.000397982 0.00110626 0.000282833 0.000274192 27
produce:reco3d:SpacePointSolver 5.29157 18.9421 84.7859 10.8662 20.0124 27
produce:hitpdune:DisambigFromSpacePoints 0.0549191 0.714514 4.09662 0.116409 1.28917 27
produce:cluster3d:Cluster3D 1.01367 70.627 695.029 1.95296 174.015 27
[art]:TriggerResults:TriggerResultInserter 2.206e-05 3.87271e-05 0.000120271 3.267e-05 1.93927e-05 27
end_path:out1:RootOutput 4.33e-06 8.75756e-06 3.4111e-05 8.941e-06 5.47493e-06 27
end_path:out1:RootOutput(write) 2.97033 6.10468 18.4436 4.52796 4.37741 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 12061.8 MB
Peak resident set size usage (VmHWM): 10014.3 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0007_df-s03-d1_dw_0_20260203T133442_reco_stage0_20260204T000721_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0007_df-s03-d1_dw_0_20260203T133442_reco_stage0_20260204T000721_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0007_df-s03-d1_dw_0_20260203T133442_reco_stage0_20260204T000721_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770158841.0,
"core.end_time": 1770163643.0,
"core.events": [
1143,
1149,
1155,
1161,
1167,
1173,
1179,
1185,
1191,
1197,
1203,
1209,
1215,
1221,
1227,
1233,
1239,
1245,
1251,
1257,
1263,
1269,
1275,
1281,
1287,
1293,
1299
],
"core.event_count": 27,
"core.first_event_number": 1143,
"core.last_event_number": 1299,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0007_df-s03-d1_dw_0_20260203T133442.hdf5"
}
]
} 