Jobsub ID 297923.5@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.5@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce505 |
| Last heartbeat | 2026-02-04 00:33:44 |
| From worker node | Hostname | b9p35p0031.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:57:02 |
| Input files | vd-protodune:np02vd_raw_run042433_0615_df-s04-d0_dw_0_20260203T223552.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 34m (2079s) |
| CPU time | 33m (2014s = 96%) |
| Max RSS bytes | 3403767808 (3246 MiB) |
| Outputting started | 2026-02-04 00:31:43 |
| Output files | |
| Finished | 2026-02-04 00:33:44 |
| Saved logs | justin-logs:297923.5-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
g up space point ptr... 0x2ca5da20, 0x2ca5dd40
Caught exception in looking up space point ptr... 0x13bf7120, 0x11338810
Caught exception in looking up space point ptr... 0x11338810, 0x13bf7120
Caught exception in looking up space point ptr... 0x13bf7120, 0x7f1cfe30
Caught exception in looking up space point ptr... 0x7f1cfe30, 0x13bf7120
Caught exception in looking up space point ptr... 0x7b185810, 0x2ca75170
Caught exception in looking up space point ptr... 0x2ca75170, 0x7b185710
Caught exception in looking up space point ptr... 0x348b97e0, 0x348b8fc0
Caught exception in looking up space point ptr... 0x348b8fc0, 0x348b97e0
Caught exception in looking up space point ptr... 0x60923ca0, 0x60923e20
Caught exception in looking up space point ptr... 0x60923e20, 0x60923ca0
Caught exception in looking up space point ptr... 0x8e93c90, 0x8e93b40
Caught exception in looking up space point ptr... 0x8e93b40, 0x8e93c90
Caught exception in looking up space point ptr... 0xff34c80, 0xff37bc0
Caught exception in looking up space point ptr... 0xff37bc0, 0xff34c80
Caught exception in looking up space point ptr... 0x3c072390, 0x3c06c800
Caught exception in looking up space point ptr... 0x3c06c800, 0x3c066130
Caught exception in looking up space point ptr... 0xd478d00, 0xd478b70
Caught exception in looking up space point ptr... 0xd478b70, 0xd478d00
Caught exception in looking up space point ptr... 0x9ee43a0, 0x9ef1e70
Caught exception in looking up space point ptr... 0x9ef1e70, 0x9ee43a0
Caught exception in looking up space point ptr... 0x14efd820, 0x14f119d0
Caught exception in looking up space point ptr... 0x14f119d0, 0x6fd17620
Caught exception in looking up space point ptr... 0xff04480, 0x5f4e1560
Caught exception in looking up space point ptr... 0x5f4e1560, 0xff05160
Caught exception in looking up space point ptr... 0x59d3f470, 0x1b2f2df0
Caught exception in looking up space point ptr... 0x1b2f2df0, 0x59d3f470
Caught exception in looking up space point ptr... 0x1a35b570, 0x1a34feb0
Caught exception in looking up space point ptr... 0x1a34feb0, 0x1a347b10
Caught exception in looking up space point ptr... 0x1a34fff0, 0x1a350120
Caught exception in looking up space point ptr... 0x1a350120, 0x1a35b570
Caught exception in looking up space point ptr... 0x13bcb010, 0x13bcae30
Caught exception in looking up space point ptr... 0x13bcae30, 0x13bcb010
Caught exception in looking up space point ptr... 0x6ec96cc0, 0xfa36e30
Caught exception in looking up space point ptr... 0xfa36e30, 0x66986010
Caught exception in looking up space point ptr... 0x16004ea0, 0x1a1a5c80
Caught exception in looking up space point ptr... 0x1a1a5c80, 0x380e1fd0
Caught exception in looking up space point ptr... 0x1a72a900, 0x1a72aa80
Caught exception in looking up space point ptr... 0x1a72aa80, 0x1a72a900
Caught exception in looking up space point ptr... 0x5200c400, 0x5200b470
Caught exception in looking up space point ptr... 0x5200b470, 0x5200c400
Caught exception in looking up space point ptr... 0x7f850d90, 0x7f853f50
Caught exception in looking up space point ptr... 0x7f853f50, 0x7f850d90
Caught exception in looking up space point ptr... 0x7b196350, 0x5fe38990
Caught exception in looking up space point ptr... 0x5fe38990, 0x7b196350
Caught exception in looking up space point ptr... 0x478b4760, 0x478bdba0
Caught exception in looking up space point ptr... 0x478bdba0, 0x478bcfb0
Caught exception in looking up space point ptr... 0x4c60e870, 0x4c60e550
Caught exception in looking up space point ptr... 0x4c60e550, 0x4c60e000
Caught exception in looking up space point ptr... 0x5fdf5e20, 0x5fe1d760
Caught exception in looking up space point ptr... 0x5fe1d760, 0x5fdf5e20
Caught exception in looking up space point ptr... 0x7b3383f0, 0x7b0fedf0
Caught exception in looking up space point ptr... 0x7b0fedf0, 0x7b3383f0
Caught exception in looking up space point ptr... 0x4d6f4b20, 0x6690abe0
Caught exception in looking up space point ptr... 0x6690abe0, 0x4d6f4b20
Caught exception in looking up space point ptr... 0x398c92e0, 0x407c3520
Caught exception in looking up space point ptr... 0x407c3520, 0x407c23d0
Caught exception in looking up space point ptr... 0x59d35c10, 0x59d356a0
Caught exception in looking up space point ptr... 0x59d356a0, 0x59d35c10
Caught exception in looking up space point ptr... 0x5eba34d0, 0x5eb9ccc0
Caught exception in looking up space point ptr... 0x5eb9ccc0, 0x5eba34d0
Caught exception in looking up space point ptr... 0xfc80d30, 0xfc80ba0
Caught exception in looking up space point ptr... 0xfc80ba0, 0xfc80d30
Caught exception in looking up space point ptr... 0x5eb7ed70, 0x5eb7ee90
Caught exception in looking up space point ptr... 0x5eb7ee90, 0x5eb7ed70
Caught exception in looking up space point ptr... 0x561acbe0, 0x561aca90
Caught exception in looking up space point ptr... 0x561aca90, 0x561acbe0
++++>>>> total num hits: 118137, num free: 112019
04-Feb-2026 01:31:37 CET Closed output file "np02vd_raw_run042433_0615_df-s04-d0_dw_0_20260203T223552_reco_stage0_20260204T003137_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 96.3034 106.602 117.864 107.261 6.3918 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.599e-05 8.03879e-05 0.00022229 7.341e-05 3.46328e-05 19
produce:tpcrawdecoder:PDVDTPCReader 5.46017 5.90601 6.26975 5.94551 0.193417 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.00756528 0.0208553 0.0577623 0.013567 0.0153155 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.00031982 0.000560049 0.00079922 0.00057355 0.000136203 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00027856 0.000521335 0.00083177 0.00051028 0.000160722 19
produce:beamevent:BeamEvent 5.668e-05 0.000130715 0.00084337 8.567e-05 0.000169248 19
produce:pdvddaphne:DAPHNEReaderPDVD 1.68597 2.03735 2.28176 2.06805 0.169872 19
produce:ophit:OpHitFinder 0.0255107 0.0344585 0.0409282 0.0348286 0.00384836 19
produce:wclsdatavd:WireCellToolkit 68.6279 80.0148 88.7412 79.438 5.00175 19
produce:gaushit:GausHitFinder 0.519412 0.928408 1.40484 0.843264 0.253851 19
produce:nhitsfilter:NumberOfHitsFilter 0.00014553 0.000208596 0.00036792 0.00019139 6.28546e-05 19
produce:reco3d:SpacePointSolver 6.6478 11.2229 17.4161 11.4866 2.58172 19
produce:hitpdune:DisambigFromSpacePoints 0.0550664 0.133923 0.214941 0.131861 0.0457867 19
produce:cluster3d:Cluster3D 0.831586 1.74284 2.92092 1.7496 0.549421 19
[art]:TriggerResults:TriggerResultInserter 2.334e-05 3.37232e-05 9.319e-05 3.095e-05 1.44766e-05 19
end_path:out1:RootOutput 4.51e-06 6.35316e-06 2.274e-05 5.42e-06 3.89254e-06 19
end_path:out1:RootOutput(write) 3.82149 4.51826 5.69353 4.31262 0.548945 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5419.19 MB
Peak resident set size usage (VmHWM): 3403.77 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0615_df-s04-d0_dw_0_20260203T223552_reco_stage0_20260204T003137_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0615_df-s04-d0_dw_0_20260203T223552_reco_stage0_20260204T003137_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0615_df-s04-d0_dw_0_20260203T223552_reco_stage0_20260204T003137_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163030.0,
"core.end_time": 1770165098.0,
"core.events": [
70120,
70126,
70132,
70138,
70144,
70150,
70156,
70162,
70168,
70174,
70180,
70186,
70192,
70198,
70204,
70210,
70216,
70222,
70228
],
"core.event_count": 19,
"core.first_event_number": 70120,
"core.last_event_number": 70228,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0615_df-s04-d0_dw_0_20260203T223552.hdf5"
}
]
} 