Jobsub ID 303652.14@dunegpschedd01.fnal.gov
| Jobsub ID | 303652.14@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:50:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce503 |
| Last heartbeat | 2026-02-04 00:09:53 |
| From worker node | Hostname | b9p05p0564.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:25:54 |
| Input files | vd-protodune:np02vd_raw_run042433_0314_df-s02-d1_dw_0_20260203T204128.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 41m (2495s) |
| CPU time | 40m (2407s = 96%) |
| Max RSS bytes | 3393708032 (3236 MiB) |
| Outputting started | 2026-02-04 00:07:30 |
| Output files | |
| Finished | 2026-02-04 00:09:53 |
| Saved logs | justin-logs:303652.14-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
space point ptr... 0x6a5fc5f0, 0x3e2e7810
Caught exception in looking up space point ptr... 0x2d244300, 0x3b9b2210
Caught exception in looking up space point ptr... 0x4b0ae860, 0x2d244300
Caught exception in looking up space point ptr... 0x3cf13720, 0x3cf13820
Caught exception in looking up space point ptr... 0x3cf13820, 0x3cf1b8f0
Caught exception in looking up space point ptr... 0x46fd0870, 0x3f3d8c70
Caught exception in looking up space point ptr... 0x3f3d8c70, 0x3724db20
Caught exception in looking up space point ptr... 0x1a0ce370, 0x1a0cfd20
Caught exception in looking up space point ptr... 0x1a0cfd20, 0x1a0ce370
Caught exception in looking up space point ptr... 0x1a10ade0, 0x35901910
Caught exception in looking up space point ptr... 0x184ec450, 0x1a10ade0
Caught exception in looking up space point ptr... 0xe1ca390, 0xe1ca170
Caught exception in looking up space point ptr... 0xe1ca170, 0xe1ca390
Caught exception in looking up space point ptr... 0xc8159a0, 0xc815d60
Caught exception in looking up space point ptr... 0xc815d60, 0xc7fe020
Caught exception in looking up space point ptr... 0x366c0fc0, 0x3b5fc9a0
Caught exception in looking up space point ptr... 0x3b5fc9a0, 0x366c0fc0
Caught exception in looking up space point ptr... 0x366c0fc0, 0x15ac88f0
Caught exception in looking up space point ptr... 0x15ac88f0, 0x366c0fc0
Caught exception in looking up space point ptr... 0x28fceb30, 0x28fcdd10
Caught exception in looking up space point ptr... 0x28fcdd10, 0x28fceb30
Caught exception in looking up space point ptr... 0x6fc6d090, 0x18884b60
Caught exception in looking up space point ptr... 0x18884b60, 0xdfe7750
Caught exception in looking up space point ptr... 0xe1faf50, 0xe1fada0
Caught exception in looking up space point ptr... 0xe1fada0, 0xe1fb080
Caught exception in looking up space point ptr... 0x10e0ccb0, 0x12174620
Caught exception in looking up space point ptr... 0x12174620, 0x10e0ccb0
Caught exception in looking up space point ptr... 0x493bb810, 0x3f92c150
Caught exception in looking up space point ptr... 0x3f92c150, 0xf2877c0
Caught exception in looking up space point ptr... 0x423e9600, 0x423e69b0
Caught exception in looking up space point ptr... 0x423e69b0, 0x423e8760
Caught exception in looking up space point ptr... 0x5fddb550, 0x5fddb1d0
Caught exception in looking up space point ptr... 0x5fddb1d0, 0x5fddb550
Caught exception in looking up space point ptr... 0x5fdc8820, 0x5fdc7420
Caught exception in looking up space point ptr... 0x5fdc7420, 0x5fdc8820
Caught exception in looking up space point ptr... 0x5fdc8820, 0x5fdc7200
Caught exception in looking up space point ptr... 0x5fdc7200, 0x5fdc8820
Caught exception in looking up space point ptr... 0x6c251a30, 0x6b0bf8d0
Caught exception in looking up space point ptr... 0x6b0bf8d0, 0x6c251a30
Caught exception in looking up space point ptr... 0x805cd8c0, 0x805cd620
Caught exception in looking up space point ptr... 0x805cd620, 0x805cd8c0
Caught exception in looking up space point ptr... 0x11365bb0, 0x11365b10
Caught exception in looking up space point ptr... 0x11365b10, 0x11365bb0
Caught exception in looking up space point ptr... 0x46d52c10, 0x5335db80
Caught exception in looking up space point ptr... 0x5335db80, 0x46d52c10
Caught exception in looking up space point ptr... 0x46d52c10, 0x5335da30
Caught exception in looking up space point ptr... 0x5335da30, 0x46d52c10
Caught exception in looking up space point ptr... 0x39a7aff0, 0x2a8c53b0
Caught exception in looking up space point ptr... 0x2a8c53b0, 0x39a7aff0
Caught exception in looking up space point ptr... 0x2e594c30, 0x5b75b120
Caught exception in looking up space point ptr... 0x5b75b120, 0x7499a4a0
Caught exception in looking up space point ptr... 0x42a15ea0, 0x42a157d0
Caught exception in looking up space point ptr... 0x42a157d0, 0x42a13220
Caught exception in looking up space point ptr... 0x5fdee900, 0x5fdee450
Caught exception in looking up space point ptr... 0x5fdee450, 0x5fdee900
Caught exception in looking up space point ptr... 0x74207ed0, 0x74207c70
Caught exception in looking up space point ptr... 0x69c37290, 0x74207ed0
Caught exception in looking up space point ptr... 0xdfdbc50, 0xdfdbac0
Caught exception in looking up space point ptr... 0xdfdbac0, 0xdfdbc50
Caught exception in looking up space point ptr... 0x62753770, 0x3c111300
Caught exception in looking up space point ptr... 0x3c111300, 0x3c111420
Caught exception in looking up space point ptr... 0x19d03480, 0x19d037a0
Caught exception in looking up space point ptr... 0x19d037a0, 0x19d03480
Caught exception in looking up space point ptr... 0x5fde93a0, 0x5fde9030
Caught exception in looking up space point ptr... 0x5fde9030, 0x5fde93a0
Caught exception in looking up space point ptr... 0x429b5530, 0x429b5780
Caught exception in looking up space point ptr... 0x429b5780, 0x429b58f0
++++>>>> total num hits: 82362, num free: 79210
04-Feb-2026 01:07:21 CET Closed output file "np02vd_raw_run042433_0314_df-s02-d1_dw_0_20260203T204128_reco_stage0_20260204T000721_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 112.811 128.522 147.642 126.262 7.79878 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.6501e-05 7.90211e-05 0.000156062 7.0581e-05 2.55282e-05 19
produce:tpcrawdecoder:PDVDTPCReader 5.49371 6.50628 8.0778 6.4564 0.674201 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.0101561 0.0212591 0.0661992 0.0130104 0.0149328 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000363505 0.000541395 0.00121105 0.000467315 0.00017985 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000361865 0.000450103 0.000662668 0.000428076 7.44471e-05 19
produce:beamevent:BeamEvent 5.22e-05 0.000125995 0.000974632 7.9951e-05 0.000200558 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.19062 2.62303 3.42593 2.48963 0.354851 19
produce:ophit:OpHitFinder 0.0252694 0.0333796 0.0412973 0.0326731 0.00458231 19
produce:wclsdatavd:WireCellToolkit 87.2004 96.5193 112.229 95.9747 5.60668 19
produce:gaushit:GausHitFinder 0.687531 1.08303 1.70255 1.04994 0.219858 19
produce:nhitsfilter:NumberOfHitsFilter 0.000207272 0.00031404 0.000473826 0.000294324 6.80173e-05 19
produce:reco3d:SpacePointSolver 8.77977 15.1204 21.5326 15.2865 3.16665 19
produce:hitpdune:DisambigFromSpacePoints 0.0931216 0.145344 0.21791 0.142637 0.0279015 19
produce:cluster3d:Cluster3D 0.979713 1.93941 3.05929 1.95918 0.462778 19
[art]:TriggerResults:TriggerResultInserter 2.308e-05 3.74342e-05 0.000168032 2.6821e-05 3.1752e-05 19
end_path:out1:RootOutput 3.7e-06 7.65268e-06 4.492e-05 5.46e-06 8.91139e-06 19
end_path:out1:RootOutput(write) 3.97306 4.50284 6.28994 4.30852 0.520341 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5388.55 MB
Peak resident set size usage (VmHWM): 3393.71 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0314_df-s02-d1_dw_0_20260203T204128_reco_stage0_20260204T000721_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0314_df-s02-d1_dw_0_20260203T204128_reco_stage0_20260204T000721_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0314_df-s02-d1_dw_0_20260203T204128_reco_stage0_20260204T000721_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161164.0,
"core.end_time": 1770163643.0,
"core.events": [
35803,
35809,
35815,
35821,
35827,
35833,
35839,
35845,
35851,
35857,
35863,
35869,
35875,
35881,
35887,
35893,
35899,
35905,
35911
],
"core.event_count": 19,
"core.first_event_number": 35803,
"core.last_event_number": 35911,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0314_df-s02-d1_dw_0_20260203T204128.hdf5"
}
]
} 