Jobsub ID 303647.2@dunegpschedd01.fnal.gov
| Jobsub ID | 303647.2@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:46:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce514 |
| Last heartbeat | 2026-02-04 00:59:44 |
| From worker node | Hostname | b9p06p2461.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:47:32 |
| Input files | vd-protodune:np02vd_raw_run042421_0143_df-s02-d1_dw_0_20260203T144818.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7667s) |
| CPU time | 2h (7434s = 96%) |
| Max RSS bytes | 14541459456 (13867 MiB) |
| Outputting started | 2026-02-04 00:55:27 |
| Output files | |
| Finished | 2026-02-04 00:59:44 |
| Saved logs | justin-logs:303647.2-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
tion in looking up space point ptr... 0x118c4fa0, 0x60ecadd0
Caught exception in looking up space point ptr... 0x60ecadd0, 0x11538a470
Caught exception in looking up space point ptr... 0x2fe24050, 0x14c480e0
Caught exception in looking up space point ptr... 0x2afd6080, 0x2fe24050
Caught exception in looking up space point ptr... 0x24d8fcb0, 0x24d8fe40
Caught exception in looking up space point ptr... 0x8282300, 0x24d8fcb0
Caught exception in looking up space point ptr... 0x50fd3040, 0x294de7b0
Caught exception in looking up space point ptr... 0x2f3ba1d0, 0x50fd3040
Caught exception in looking up space point ptr... 0x4f4ef5d0, 0x4f4ef820
Caught exception in looking up space point ptr... 0x3cc0e500, 0x4f4ef5d0
Caught exception in looking up space point ptr... 0xf1014610, 0x25f7de60
Caught exception in looking up space point ptr... 0x272619c0, 0xf1014610
Caught exception in looking up space point ptr... 0x5a145a90, 0x28c4f600
Caught exception in looking up space point ptr... 0x28c4f600, 0x5a145a90
Caught exception in looking up space point ptr... 0x156ebf50, 0x156ec0e0
Caught exception in looking up space point ptr... 0x156ec0e0, 0x915c2c0
Caught exception in looking up space point ptr... 0x2cf3fed0, 0x8f930460
Caught exception in looking up space point ptr... 0x5bcd1c10, 0x2cf3fed0
Caught exception in looking up space point ptr... 0x39095ae0, 0x237c7880
Caught exception in looking up space point ptr... 0x237c7880, 0x2f40a770
Caught exception in looking up space point ptr... 0x2b470af0, 0x2b46f6c0
Caught exception in looking up space point ptr... 0x2b46ff80, 0x2b470af0
Caught exception in looking up space point ptr... 0x445fd910, 0x2669eb10
Caught exception in looking up space point ptr... 0x2669eb10, 0x445fd910
Caught exception in looking up space point ptr... 0x30377000, 0x2bf7fc70
Caught exception in looking up space point ptr... 0x2bf7fc70, 0x30377000
Caught exception in looking up space point ptr... 0x227d6aa0, 0x57772320
Caught exception in looking up space point ptr... 0x227d6910, 0x227d6aa0
Caught exception in looking up space point ptr... 0x4ef9a5e0, 0x3f411770
Caught exception in looking up space point ptr... 0x3f411770, 0x8d756e80
Caught exception in looking up space point ptr... 0x12d42c60, 0xa6382a20
Caught exception in looking up space point ptr... 0xa6382a20, 0x12d42dd0
Caught exception in looking up space point ptr... 0x12d42dd0, 0x4ea81080
Caught exception in looking up space point ptr... 0x4ea81080, 0x4ea80ee0
Caught exception in looking up space point ptr... 0x4ea80ee0, 0x2b926130
Caught exception in looking up space point ptr... 0x25d02d50, 0x114d8690
Caught exception in looking up space point ptr... 0x114d8690, 0x38182b70
Caught exception in looking up space point ptr... 0x3e7c6380, 0xce9e2860
Caught exception in looking up space point ptr... 0xce9e2860, 0x107eb7b0
Caught exception in looking up space point ptr... 0x2f63f7c0, 0x279dc830
Caught exception in looking up space point ptr... 0x279dd890, 0x2f63f7c0
Caught exception in looking up space point ptr... 0x45d92940, 0xf1098ac0
Caught exception in looking up space point ptr... 0xf1098780, 0x45d92940
Caught exception in looking up space point ptr... 0x28aea1e0, 0x4474fda0
Caught exception in looking up space point ptr... 0x4474fda0, 0x41f152a0
Caught exception in looking up space point ptr... 0xa339830, 0xa339540
Caught exception in looking up space point ptr... 0xa339540, 0xa339830
Caught exception in looking up space point ptr... 0x74a42f10, 0x12cca7d80
Caught exception in looking up space point ptr... 0x12cca7d80, 0x74a42f10
Caught exception in looking up space point ptr... 0xca6b0180, 0x274940f0
Caught exception in looking up space point ptr... 0x274940f0, 0xca6b0180
Caught exception in looking up space point ptr... 0x30375700, 0x74a443b0
Caught exception in looking up space point ptr... 0x74a443b0, 0x30375700
Caught exception in looking up space point ptr... 0x4f35cff0, 0x4f35d380
Caught exception in looking up space point ptr... 0x4f35d380, 0x4f35cff0
Caught exception in looking up space point ptr... 0xa4e2880, 0x34b60450
Caught exception in looking up space point ptr... 0x34b60450, 0xa4e2880
Caught exception in looking up space point ptr... 0xa4e2880, 0xa63bbdf0
Caught exception in looking up space point ptr... 0xa63bbdf0, 0xa4e2880
Caught exception in looking up space point ptr... 0x2386acd0, 0x2386ab40
Caught exception in looking up space point ptr... 0x2386ab40, 0x2386a9b0
Caught exception in looking up space point ptr... 0x153f73c0, 0x2ad82f50
Caught exception in looking up space point ptr... 0x2ad82f50, 0x153f7520
Caught exception in looking up space point ptr... 0x28b10030, 0x4cd3ef30
Caught exception in looking up space point ptr... 0x4cd3ef30, 0x28b10030
++++>>>> total num hits: 54009, num free: 51910
04-Feb-2026 01:55:09 CET Closed output file "np02vd_raw_run042421_0143_df-s02-d1_dw_0_20260203T144818_reco_stage0_20260204T005509_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 86.1256 271.245 1137.46 102.072 330.789 28
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.4791e-05 0.000121555 0.000472395 8.5501e-05 8.63688e-05 28
produce:tpcrawdecoder:PDVDTPCReader 3.52722 4.24039 5.31882 4.21244 0.333691 28
produce:triggerrawdecoder:PDVDTriggerReader4 0.0106657 0.0222881 0.0795806 0.0168892 0.0151369 28
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000404234 0.000827218 0.00345658 0.000564561 0.000743118 28
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00161549 0.00257138 0.00782392 0.00201818 0.00151655 28
produce:beamevent:BeamEvent 5.4811e-05 0.000130189 0.000928871 0.000106861 0.000155621 28
produce:pdvddaphne:DAPHNEReaderPDVD 2.15654 3.21135 3.97742 3.23032 0.468667 28
produce:ophit:OpHitFinder 0.0244269 0.0380604 0.0484984 0.0378011 0.0056939 28
produce:wclsdatavd:WireCellToolkit 58.2444 70.6929 83.0218 69.8539 6.32726 28
produce:gaushit:GausHitFinder 0.521546 2.53004 10.2329 1.20836 2.70586 28
produce:nhitsfilter:NumberOfHitsFilter 0.000189982 0.000472475 0.00134553 0.000329144 0.000312598 28
produce:reco3d:SpacePointSolver 5.13828 32.844 147.069 13.0571 42.9158 28
produce:hitpdune:DisambigFromSpacePoints 0.0487153 1.29453 7.96101 0.143489 2.38437 28
produce:cluster3d:Cluster3D 0.521909 148.419 897.705 2.2581 276.948 28
[art]:TriggerResults:TriggerResultInserter 1.792e-05 3.76455e-05 9.9332e-05 3.576e-05 1.4134e-05 28
end_path:out1:RootOutput 5.02e-06 2.3708e-05 0.000415204 8.635e-06 7.54944e-05 28
end_path:out1:RootOutput(write) 3.02595 7.90986 25.4881 4.4656 6.78231 28
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 16580.5 MB
Peak resident set size usage (VmHWM): 14541.5 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0143_df-s02-d1_dw_0_20260203T144818_reco_stage0_20260204T005509_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0143_df-s02-d1_dw_0_20260203T144818_reco_stage0_20260204T005509_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0143_df-s02-d1_dw_0_20260203T144818_reco_stage0_20260204T005509_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770158865.0,
"core.end_time": 1770166511.0,
"core.events": [
23227,
23233,
23239,
23245,
23251,
23257,
23263,
23269,
23275,
23281,
23287,
23293,
23299,
23305,
23311,
23317,
23323,
23329,
23335,
23341,
23347,
23353,
23359,
23365,
23371,
23377,
23383,
23389
],
"core.event_count": 28,
"core.first_event_number": 23227,
"core.last_event_number": 23389,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0143_df-s02-d1_dw_0_20260203T144818.hdf5"
}
]
} 