Jobsub ID 297923.141@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.141@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | IT_CNAF |
| Entry | CMSHTPC_T1_IT_CNAF_condor_ce02 |
| Last heartbeat | 2026-02-04 01:38:14 |
| From worker node | Hostname | wn-s04-06-11-04.cr.cnaf.infn.it |
| cpuinfo | AMD EPYC 7351 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:06:35 |
| Input files | vd-protodune:np02vd_raw_run042433_0422_df-s04-d0_dw_0_20260203T212232.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5357s) |
| CPU time | 1h (4652s = 86%) |
| Max RSS bytes | 3388342272 (3231 MiB) |
| Outputting started | 2026-02-04 01:35:54 |
| Output files | |
| Finished | 2026-02-04 01:38:14 |
| Saved logs | justin-logs:297923.141-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ng up space point ptr... 0x5e277e20, 0x5e27c2e0
Caught exception in looking up space point ptr... 0x33013a70, 0x81a8ade0
Caught exception in looking up space point ptr... 0x46813ce0, 0x33013a70
Caught exception in looking up space point ptr... 0x59084580, 0x590919e0
Caught exception in looking up space point ptr... 0x590919e0, 0x59084580
Caught exception in looking up space point ptr... 0x4aaf08e0, 0xfaa5c20
Caught exception in looking up space point ptr... 0x3790b8b0, 0x4aaf08e0
Caught exception in looking up space point ptr... 0x19b7e890, 0x19b8b5b0
Caught exception in looking up space point ptr... 0x19b8b5b0, 0x19b8c430
Caught exception in looking up space point ptr... 0xa50e6b0, 0xa50eb70
Caught exception in looking up space point ptr... 0xa50eb70, 0xa50e6b0
Caught exception in looking up space point ptr... 0x38fe8230, 0x109f7530
Caught exception in looking up space point ptr... 0x109f7530, 0x38fe8230
Caught exception in looking up space point ptr... 0x68032620, 0x68032770
Caught exception in looking up space point ptr... 0x58bab7a0, 0x68032620
Caught exception in looking up space point ptr... 0x9cd9a50, 0x9cd92a0
Caught exception in looking up space point ptr... 0x9cce5a0, 0x9ccf710
Caught exception in looking up space point ptr... 0x9ccf710, 0x9ccf8b0
Caught exception in looking up space point ptr... 0x9ccf8b0, 0x9cd9a50
Caught exception in looking up space point ptr... 0x43cce010, 0x43ccd6e0
Caught exception in looking up space point ptr... 0x43ccd6e0, 0x43ccdf20
Caught exception in looking up space point ptr... 0xfa90640, 0xfa99520
Caught exception in looking up space point ptr... 0xfa90820, 0xfa90640
Caught exception in looking up space point ptr... 0x582dedf0, 0x582dead0
Caught exception in looking up space point ptr... 0x582e6510, 0x582dedf0
Caught exception in looking up space point ptr... 0x59dab610, 0x59dbc1d0
Caught exception in looking up space point ptr... 0x3ab627a0, 0x59dab610
Caught exception in looking up space point ptr... 0x4abd8de0, 0x4abd8c50
Caught exception in looking up space point ptr... 0x4abd8c50, 0x4abd8de0
Caught exception in looking up space point ptr... 0x4abd8de0, 0x4abd9290
Caught exception in looking up space point ptr... 0x4abd9290, 0x4abd8de0
Caught exception in looking up space point ptr... 0x6073c4c0, 0x18572b50
Caught exception in looking up space point ptr... 0x59db9240, 0x6073c4c0
Caught exception in looking up space point ptr... 0x65f0c7b0, 0x65f0cad0
Caught exception in looking up space point ptr... 0x65f0cad0, 0x65f0c7b0
Caught exception in looking up space point ptr... 0x14240270, 0x1423cc70
Caught exception in looking up space point ptr... 0x1423cc70, 0x14240270
Caught exception in looking up space point ptr... 0x4abe1270, 0x4abe0f00
Caught exception in looking up space point ptr... 0x4abe1450, 0x4abe1270
Caught exception in looking up space point ptr... 0x3ab94730, 0x3ab94ce0
Caught exception in looking up space point ptr... 0x3ab94ce0, 0x3ab94730
Caught exception in looking up space point ptr... 0x19f48b80, 0x6c4e6430
Caught exception in looking up space point ptr... 0x6c4e6430, 0x19f48b80
Caught exception in looking up space point ptr... 0x29831420, 0x29830fd0
Caught exception in looking up space point ptr... 0x29830fd0, 0x29831420
Caught exception in looking up space point ptr... 0x57f9c1a0, 0x57f9c000
Caught exception in looking up space point ptr... 0x57f9c000, 0x57f9c1a0
Caught exception in looking up space point ptr... 0xead5d60, 0xeacad50
Caught exception in looking up space point ptr... 0xeacad50, 0xead6810
Caught exception in looking up space point ptr... 0x57f85690, 0x57f859b0
Caught exception in looking up space point ptr... 0x57f859b0, 0x57f83b20
Caught exception in looking up space point ptr... 0x73696e90, 0x73696b00
Caught exception in looking up space point ptr... 0x73696b00, 0x73696e90
Caught exception in looking up space point ptr... 0x12ba4cb0, 0x12b9a320
Caught exception in looking up space point ptr... 0x12b9a320, 0x12ba4cb0
Caught exception in looking up space point ptr... 0x12b94bf0, 0x12ba9960
Caught exception in looking up space point ptr... 0x12ba9960, 0x12b94bf0
Caught exception in looking up space point ptr... 0x6af5cb90, 0x37b95070
Caught exception in looking up space point ptr... 0x37b95070, 0x54e1c0f0
Caught exception in looking up space point ptr... 0x625a0b90, 0x9941c90
Caught exception in looking up space point ptr... 0x9941c90, 0x625a0b90
Caught exception in looking up space point ptr... 0x7b9f9030, 0x7b9f8e50
Caught exception in looking up space point ptr... 0x7b9f8e50, 0x7b9f9210
Caught exception in looking up space point ptr... 0x57fae000, 0x57fae4c0
Caught exception in looking up space point ptr... 0x57fae4c0, 0x57fae000
Caught exception in looking up space point ptr... 0xa5c7550, 0x59e3ea90
Caught exception in looking up space point ptr... 0x59e3ea90, 0x177eedf0
++++>>>> total num hits: 116650, num free: 113366
04-Feb-2026 02:35:42 CET Closed output file "np02vd_raw_run042433_0422_df-s04-d0_dw_0_20260203T212232_reco_stage0_20260204T013542_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 250.984 273.054 296.718 273.553 13.1859 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.456e-05 0.000166955 0.000346801 0.00014656 6.39444e-05 19
produce:tpcrawdecoder:PDVDTPCReader 22.1426 31.4291 51.8703 29.7211 7.30992 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.330696 0.382667 0.609002 0.355607 0.072894 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0105188 0.0156598 0.0433361 0.0111267 0.00789155 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0104614 0.0107867 0.0116224 0.0107003 0.000235621 19
produce:beamevent:BeamEvent 0.000167951 0.000307151 0.00154532 0.000222931 0.000300601 19
produce:pdvddaphne:DAPHNEReaderPDVD 4.63264 5.76874 8.06933 5.57126 0.913296 19
produce:ophit:OpHitFinder 0.0455229 0.0531066 0.0659922 0.0515152 0.00529572 19
produce:wclsdatavd:WireCellToolkit 170.363 181.962 214.621 177.923 11.479 19
produce:gaushit:GausHitFinder 2.06389 2.68044 3.39743 2.6144 0.403153 19
produce:nhitsfilter:NumberOfHitsFilter 0.000550732 0.000716646 0.00156473 0.000666602 0.000213673 19
produce:reco3d:SpacePointSolver 23.0976 35.3976 45.3344 34.9781 5.53206 19
produce:hitpdune:DisambigFromSpacePoints 0.286057 0.388549 0.492847 0.381577 0.0602758 19
produce:cluster3d:Cluster3D 4.09452 5.78031 7.71111 5.42507 1.09921 19
[art]:TriggerResults:TriggerResultInserter 4.547e-05 6.46847e-05 0.00019119 5.761e-05 3.12793e-05 19
end_path:out1:RootOutput 8.79e-06 1.52327e-05 4.316e-05 1.057e-05 9.97049e-06 19
end_path:out1:RootOutput(write) 6.55534 9.12463 9.83702 9.22048 0.674504 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5367.9 MB
Peak resident set size usage (VmHWM): 3388.34 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0422_df-s04-d0_dw_0_20260203T212232_reco_stage0_20260204T013542_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0422_df-s04-d0_dw_0_20260203T212232_reco_stage0_20260204T013542_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0422_df-s04-d0_dw_0_20260203T212232_reco_stage0_20260204T013542_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163615.0,
"core.end_time": 1770168945.0,
"core.events": [
48118,
48124,
48130,
48136,
48142,
48148,
48154,
48160,
48166,
48172,
48178,
48184,
48190,
48196,
48202,
48208,
48214,
48220,
48226
],
"core.event_count": 19,
"core.first_event_number": 48118,
"core.last_event_number": 48226,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0422_df-s04-d0_dw_0_20260203T212232.hdf5"
}
]
} 