Jobsub ID 303653.19@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.19@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce509 |
| Last heartbeat | 2026-02-04 00:24:26 |
| From worker node | Hostname | b9p10p7838.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:36:50 |
| Input files | vd-protodune:np02vd_raw_run042421_0037_df-s02-d0_dw_0_20260203T135101.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 45m (2712s) |
| CPU time | 43m (2626s = 96%) |
| Max RSS bytes | 2584227840 (2464 MiB) |
| Outputting started | 2026-02-04 00:22:03 |
| Output files | |
| Finished | 2026-02-04 00:24:26 |
| Saved logs | justin-logs:303653.19-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
int ptr... 0x527f0560, 0x367db330
Caught exception in looking up space point ptr... 0xf81a3c0, 0x2cf05b40
Caught exception in looking up space point ptr... 0x2cf05b40, 0x2cf059d0
Caught exception in looking up space point ptr... 0x2cf059d0, 0x2a0ebce0
Caught exception in looking up space point ptr... 0x2a0ebce0, 0x4b0c93b0
Caught exception in looking up space point ptr... 0x2c98e560, 0x3d2e4d70
Caught exception in looking up space point ptr... 0x3d2e4d70, 0x3bc92150
Caught exception in looking up space point ptr... 0x3bc92150, 0x601a5600
Caught exception in looking up space point ptr... 0x601a5600, 0x4c35cb80
Caught exception in looking up space point ptr... 0x4c35cb80, 0x11120f70
Caught exception in looking up space point ptr... 0x21fd6f00, 0x16f37450
Caught exception in looking up space point ptr... 0x16f37450, 0x16f375d0
Caught exception in looking up space point ptr... 0x375c58d0, 0x5f1c1e60
Caught exception in looking up space point ptr... 0x5f1c1e60, 0xc0a6d20
Caught exception in looking up space point ptr... 0x60312c30, 0x593ac130
Caught exception in looking up space point ptr... 0x593ac130, 0x5efe1f30
Caught exception in looking up space point ptr... 0x4c3ade20, 0x4c3adc20
Caught exception in looking up space point ptr... 0x4c3adc20, 0x4c3ac2c0
Caught exception in looking up space point ptr... 0x4c3ac2c0, 0x4c3afad0
Caught exception in looking up space point ptr... 0x4c3afad0, 0x4c3ade20
Caught exception in looking up space point ptr... 0x33b04300, 0xa50fef0
Caught exception in looking up space point ptr... 0xa50fef0, 0x33b04300
Caught exception in looking up space point ptr... 0x3a107b90, 0x11660520
Caught exception in looking up space point ptr... 0x11660520, 0xe32f140
Caught exception in looking up space point ptr... 0x4cf9e7c0, 0xf52d9f0
Caught exception in looking up space point ptr... 0xf52d9f0, 0x4cf9e7c0
Caught exception in looking up space point ptr... 0x3baff970, 0x5d568f40
Caught exception in looking up space point ptr... 0x5d568f40, 0x5d568b20
Caught exception in looking up space point ptr... 0x48097a00, 0x284224c0
Caught exception in looking up space point ptr... 0x4ceed350, 0x48097a00
Caught exception in looking up space point ptr... 0x23ffe830, 0x23ffe700
Caught exception in looking up space point ptr... 0x23ffe700, 0x23ffe5d0
Caught exception in looking up space point ptr... 0x3a203b70, 0x220adad0
Caught exception in looking up space point ptr... 0x220adad0, 0x2e7af680
Caught exception in looking up space point ptr... 0x12e3a610, 0x12e3a8e0
Caught exception in looking up space point ptr... 0x12e3a8e0, 0x12e3a610
Caught exception in looking up space point ptr... 0x43813680, 0x43813580
Caught exception in looking up space point ptr... 0x43813580, 0x43813680
Caught exception in looking up space point ptr... 0x237f4090, 0x259c3780
Caught exception in looking up space point ptr... 0x259c3780, 0x237f4090
Caught exception in looking up space point ptr... 0x2f917ae0, 0x2f917950
Caught exception in looking up space point ptr... 0x21fc6040, 0x2f917ae0
Caught exception in looking up space point ptr... 0x568252d0, 0x2bddc9f0
Caught exception in looking up space point ptr... 0x2bddc9f0, 0x568252d0
Caught exception in looking up space point ptr... 0x4c3a5630, 0x4c39f6f0
Caught exception in looking up space point ptr... 0x4c39f6f0, 0x4c3a5630
Caught exception in looking up space point ptr... 0x22ea3f40, 0x22ea2270
Caught exception in looking up space point ptr... 0x22ea0e10, 0x22ea3f40
Caught exception in looking up space point ptr... 0x2c809f70, 0x31b76b90
Caught exception in looking up space point ptr... 0x31b76b90, 0x2c809f70
Caught exception in looking up space point ptr... 0x2c809f70, 0x31b76a90
Caught exception in looking up space point ptr... 0x31b76a90, 0x2c809f70
Caught exception in looking up space point ptr... 0x114ee370, 0x312f9cb0
Caught exception in looking up space point ptr... 0x114f2250, 0x114ee370
Caught exception in looking up space point ptr... 0x49bc8180, 0x32917870
Caught exception in looking up space point ptr... 0x2d5ee6e0, 0x49bc8180
Caught exception in looking up space point ptr... 0xa4e3480, 0xa4e33a0
Caught exception in looking up space point ptr... 0xa4e33a0, 0xa4e36c0
Caught exception in looking up space point ptr... 0x15973240, 0x3da2f380
Caught exception in looking up space point ptr... 0x3da2f380, 0x34a69190
Caught exception in looking up space point ptr... 0x154a5f50, 0x154a68a0
Caught exception in looking up space point ptr... 0x154a6540, 0x154a5f50
Caught exception in looking up space point ptr... 0x3ce9f610, 0x3ce9f740
Caught exception in looking up space point ptr... 0x3ce9f740, 0x3ce9f870
Caught exception in looking up space point ptr... 0x260a76e0, 0x591910f0
Caught exception in looking up space point ptr... 0x591910f0, 0x260a76e0
++++>>>> total num hits: 40665, num free: 38950
04-Feb-2026 01:21:55 CET Closed output file "np02vd_raw_run042421_0037_df-s02-d0_dw_0_20260203T135101_reco_stage0_20260204T002155_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 82.2749 97.6627 116.969 96.0417 9.00814 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.277e-05 9.17309e-05 0.000258292 7.7521e-05 4.84775e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.19858 3.56253 4.07229 3.56456 0.238649 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.0115901 0.0136844 0.0239506 0.0131229 0.00247029 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000465953 0.000602332 0.000978597 0.000530551 0.000143217 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00167261 0.00228377 0.00337131 0.00222185 0.000456273 27
produce:beamevent:BeamEvent 7.3391e-05 0.000151081 0.00101489 0.000119871 0.000171018 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.33799 3.09083 3.51739 3.13134 0.261415 27
produce:ophit:OpHitFinder 0.0301739 0.040803 0.0495963 0.0411184 0.00542896 27
produce:wclsdatavd:WireCellToolkit 61.1873 73.3241 87.5119 72.0863 5.84478 27
produce:gaushit:GausHitFinder 0.544667 1.09113 1.67418 1.01015 0.322928 27
produce:nhitsfilter:NumberOfHitsFilter 0.000159541 0.000262368 0.000426103 0.000271363 7.15948e-05 27
produce:reco3d:SpacePointSolver 5.51658 10.2608 17.5554 10.3288 2.81872 27
produce:hitpdune:DisambigFromSpacePoints 0.0546572 0.112072 0.251818 0.111538 0.0407917 27
produce:cluster3d:Cluster3D 1.03581 1.88817 4.93236 1.72406 0.762653 27
[art]:TriggerResults:TriggerResultInserter 2.158e-05 3.67001e-05 9.1011e-05 3.198e-05 1.41829e-05 27
end_path:out1:RootOutput 4.86e-06 9.97296e-06 2.864e-05 9.62e-06 4.03759e-06 27
end_path:out1:RootOutput(write) 3.19969 4.25034 5.71744 4.22971 0.620273 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4551.45 MB
Peak resident set size usage (VmHWM): 2584.23 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0037_df-s02-d0_dw_0_20260203T135101_reco_stage0_20260204T002155_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0037_df-s02-d0_dw_0_20260203T135101_reco_stage0_20260204T002155_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0037_df-s02-d0_dw_0_20260203T135101_reco_stage0_20260204T002155_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161825.0,
"core.end_time": 1770164516.0,
"core.events": [
6042,
6048,
6054,
6060,
6066,
6072,
6078,
6084,
6090,
6096,
6102,
6108,
6114,
6120,
6126,
6132,
6138,
6144,
6150,
6156,
6162,
6168,
6174,
6180,
6186,
6192,
6198
],
"core.event_count": 27,
"core.first_event_number": 6042,
"core.last_event_number": 6198,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0037_df-s02-d0_dw_0_20260203T135101.hdf5"
}
]
} 