Jobsub ID 303653.66@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.66@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce515 |
| Last heartbeat | 2026-02-03 23:56:47 |
| From worker node | Hostname | b9p12p0201.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:41:35 |
| Input files | vd-protodune:np02vd_raw_run042421_0166_df-s04-d1_dw_0_20260203T150049.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 13m (821s) |
| CPU time | 12m (777s = 94%) |
| Max RSS bytes | 2627219456 (2505 MiB) |
| Outputting started | 2026-02-03 23:55:18 |
| Output files | |
| Finished | 2026-02-03 23:56:47 |
| Saved logs | justin-logs:303653.66-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
df50
Caught exception in looking up space point ptr... 0x46d0df50, 0x46d0daa0
Caught exception in looking up space point ptr... 0x39694160, 0x396c35a0
Caught exception in looking up space point ptr... 0x396c35a0, 0x396bffb0
Caught exception in looking up space point ptr... 0x5bd05df0, 0x5bd061b0
Caught exception in looking up space point ptr... 0x5bd061b0, 0x5bd05df0
Caught exception in looking up space point ptr... 0x11370000, 0x135a7300
Caught exception in looking up space point ptr... 0x239a3230, 0x11370000
Caught exception in looking up space point ptr... 0x314c0d90, 0x3150e750
Caught exception in looking up space point ptr... 0x3150e750, 0x55c94950
Caught exception in looking up space point ptr... 0x445421c0, 0x44547130
Caught exception in looking up space point ptr... 0x44541e10, 0x445421c0
Caught exception in looking up space point ptr... 0x4bd7a720, 0x127993f0
Caught exception in looking up space point ptr... 0x127993f0, 0x6203b420
Caught exception in looking up space point ptr... 0x4d7f88f0, 0x4d7f89f0
Caught exception in looking up space point ptr... 0x4d7f89f0, 0x4d7f88f0
Caught exception in looking up space point ptr... 0x49ee7a90, 0x4bfc7140
Caught exception in looking up space point ptr... 0x4bfc7140, 0x49ee7a90
Caught exception in looking up space point ptr... 0x2c5a9e90, 0x50f59ff0
Caught exception in looking up space point ptr... 0x50f59ff0, 0x4b8e7aa0
Caught exception in looking up space point ptr... 0x4b8e7aa0, 0x372e0240
Caught exception in looking up space point ptr... 0x4a04c720, 0x4b2049d0
Caught exception in looking up space point ptr... 0x4b2049d0, 0x4a04c720
Caught exception in looking up space point ptr... 0x48dcf690, 0x48dcf8f0
Caught exception in looking up space point ptr... 0x48dcf8f0, 0x48dcf690
Caught exception in looking up space point ptr... 0x1138f0c0, 0x1138f210
Caught exception in looking up space point ptr... 0x1138f530, 0x1138f0c0
Caught exception in looking up space point ptr... 0x5023f710, 0x5023f470
Caught exception in looking up space point ptr... 0x5023f470, 0x5023f710
Caught exception in looking up space point ptr... 0x548eb8f0, 0x548ebc60
Caught exception in looking up space point ptr... 0x548e69a0, 0x548eb8f0
Caught exception in looking up space point ptr... 0xe858e10, 0xe858af0
Caught exception in looking up space point ptr... 0xe858af0, 0xe858e10
Caught exception in looking up space point ptr... 0x55a82460, 0x3756cb50
Caught exception in looking up space point ptr... 0x3756cb50, 0x55a82460
Caught exception in looking up space point ptr... 0x390c7560, 0x390c28c0
Caught exception in looking up space point ptr... 0x390c28c0, 0x390c7560
Caught exception in looking up space point ptr... 0x7b016a0, 0x7b07bd0
Caught exception in looking up space point ptr... 0x7b07bd0, 0x7b016a0
Caught exception in looking up space point ptr... 0x2bdcdbf0, 0x2bdc9a10
Caught exception in looking up space point ptr... 0x2bdc9a10, 0x2bdcdbf0
Caught exception in looking up space point ptr... 0x4bf4bf20, 0x4bf4be20
Caught exception in looking up space point ptr... 0x4bf4be20, 0x4bf4bc50
Caught exception in looking up space point ptr... 0x390a2db0, 0x390a2b70
Caught exception in looking up space point ptr... 0x390a2b70, 0x390a2db0
Caught exception in looking up space point ptr... 0x113c5de0, 0x113c60c0
Caught exception in looking up space point ptr... 0x113c60c0, 0x113c6350
Caught exception in looking up space point ptr... 0x24d4d190, 0x24d4fb80
Caught exception in looking up space point ptr... 0x24d4fb80, 0x24d4fa50
Caught exception in looking up space point ptr... 0x4b086dd0, 0x4b086c40
Caught exception in looking up space point ptr... 0x4b086c40, 0x4b086dd0
Caught exception in looking up space point ptr... 0x4b086dd0, 0x4b086ab0
Caught exception in looking up space point ptr... 0x4b086ab0, 0x4b086dd0
Caught exception in looking up space point ptr... 0xe7ddca0, 0xe7de150
Caught exception in looking up space point ptr... 0xe7de150, 0xe7ddca0
Caught exception in looking up space point ptr... 0x46ce44e0, 0x46ce8080
Caught exception in looking up space point ptr... 0x46ce8080, 0x46ce44e0
Caught exception in looking up space point ptr... 0x46ce44e0, 0x46ce8210
Caught exception in looking up space point ptr... 0x46ce8210, 0x46ce44e0
Caught exception in looking up space point ptr... 0xd8e2e20, 0x57304200
Caught exception in looking up space point ptr... 0x57304200, 0xd8e2e20
Caught exception in looking up space point ptr... 0xd8e2e20, 0x3a9b6f60
Caught exception in looking up space point ptr... 0x3a9b6f60, 0xd8e2e20
Caught exception in looking up space point ptr... 0xe7df320, 0xe7df190
Caught exception in looking up space point ptr... 0xe7df190, 0xe7df4b0
Caught exception in looking up space point ptr... 0xe7dc710, 0xe7dc530
Caught exception in looking up space point ptr... 0xe7dc530, 0xe7dc8a0
Caught exception in looking up space point ptr... 0x3f303c60, 0x3f304510
Caught exception in looking up space point ptr... 0x3f304510, 0x3f303c60
++++>>>> total num hits: 126023, num free: 122693
04-Feb-2026 00:55:11 CET Closed output file "np02vd_raw_run042421_0166_df-s04-d1_dw_0_20260203T150049_reco_stage0_20260203T235511_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 64.1149 70.3779 77.0234 69.14 4.01548 11
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.191e-05 7.41485e-05 0.000223511 5.264e-05 5.09469e-05 11
produce:tpcrawdecoder:PDVDTPCReader 4.29327 4.63266 5.04779 4.54843 0.253752 11
produce:triggerrawdecoder:PDVDTriggerReader4 0.0118192 0.0142445 0.0173797 0.013797 0.00173158 11
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000406652 0.00476828 0.0252479 0.000501612 0.00900005 11
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00187451 0.00237984 0.00464115 0.00200283 0.000757708 11
produce:beamevent:BeamEvent 4.866e-05 0.000177708 0.00116791 7.835e-05 0.000313767 11
produce:pdvddaphne:DAPHNEReaderPDVD 1.8719 2.21336 2.52811 2.21852 0.214698 11
produce:ophit:OpHitFinder 0.0232837 0.0300793 0.0355043 0.0298131 0.00334839 11
produce:wclsdatavd:WireCellToolkit 45.8976 48.2303 50.1055 48.4109 1.12332 11
produce:gaushit:GausHitFinder 0.551648 0.70573 0.904387 0.688159 0.129541 11
produce:nhitsfilter:NumberOfHitsFilter 0.00016845 0.000235373 0.000424092 0.00022627 6.37222e-05 11
produce:reco3d:SpacePointSolver 7.07646 10.0551 15.1518 9.28635 2.56888 11
produce:hitpdune:DisambigFromSpacePoints 0.0529532 0.0839304 0.177299 0.0720879 0.0337797 11
produce:cluster3d:Cluster3D 0.727262 1.46373 2.30732 1.20959 0.555756 11
[art]:TriggerResults:TriggerResultInserter 1.522e-05 2.64937e-05 8.513e-05 2.203e-05 1.87317e-05 11
end_path:out1:RootOutput 3.09e-06 6.47182e-06 2.501e-05 4.42e-06 6.05378e-06 11
end_path:out1:RootOutput(write) 2.69649 2.92855 3.10898 2.98394 0.142165 11
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4567.25 MB
Peak resident set size usage (VmHWM): 2627.22 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0166_df-s04-d1_dw_0_20260203T150049_reco_stage0_20260203T235511_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0166_df-s04-d1_dw_0_20260203T150049_reco_stage0_20260203T235511_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0166_df-s04-d1_dw_0_20260203T150049_reco_stage0_20260203T235511_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162104.0,
"core.end_time": 1770162912.0,
"core.events": [
26975,
26981,
26987,
26993,
26999,
27005,
27011,
27017,
27023,
27029,
27035
],
"core.event_count": 11,
"core.first_event_number": 26975,
"core.last_event_number": 27035,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0166_df-s04-d1_dw_0_20260203T150049.hdf5"
}
]
} 