Jobsub ID 303652.141@dunegpschedd01.fnal.gov
| Jobsub ID | 303652.141@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:50:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce509 |
| Last heartbeat | 2026-02-04 01:01:02 |
| From worker node | Hostname | b9p10p7838.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:31:12 |
| Input files | vd-protodune:np02vd_raw_run042433_0074_df-s03-d1_dw_0_20260203T191014.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5194s) |
| CPU time | 1h (5032s = 96%) |
| Max RSS bytes | 12471341056 (11893 MiB) |
| Outputting started | 2026-02-04 00:57:51 |
| Output files | |
| Finished | 2026-02-04 01:01:02 |
| Saved logs | justin-logs:303652.141-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ing up space point ptr... 0x15167c2d0, 0x15167c1a0
Caught exception in looking up space point ptr... 0x15167c1a0, 0x15167be10
Caught exception in looking up space point ptr... 0x403e2b20, 0x403e2c20
Caught exception in looking up space point ptr... 0x403e2c20, 0x403e2b20
Caught exception in looking up space point ptr... 0x195b130f0, 0x195b13280
Caught exception in looking up space point ptr... 0x403e2490, 0x195b130f0
Caught exception in looking up space point ptr... 0x182d8ea20, 0x10b53e380
Caught exception in looking up space point ptr... 0x10b53e380, 0x182d8ef00
Caught exception in looking up space point ptr... 0x38f1b2e0, 0xdd718ab0
Caught exception in looking up space point ptr... 0xdd718ab0, 0x38f3e080
Caught exception in looking up space point ptr... 0xeee67a00, 0xeee67d20
Caught exception in looking up space point ptr... 0xeee67d20, 0xeee67a00
Caught exception in looking up space point ptr... 0x11a7997f0, 0x11a799980
Caught exception in looking up space point ptr... 0x11a799980, 0x11a799b10
Caught exception in looking up space point ptr... 0x16e718220, 0x16e7180b0
Caught exception in looking up space point ptr... 0x16e7180b0, 0x16e718220
Caught exception in looking up space point ptr... 0x14f5240b0, 0x14f524200
Caught exception in looking up space point ptr... 0x14f524200, 0x14f524390
Caught exception in looking up space point ptr... 0x1a01a7db0, 0x1a01a8140
Caught exception in looking up space point ptr... 0x1a01a8140, 0x1a01a77c0
Caught exception in looking up space point ptr... 0x38de7970, 0xec44b3d0
Caught exception in looking up space point ptr... 0xec44b3d0, 0x38de7970
Caught exception in looking up space point ptr... 0x16e68b520, 0xf3af9550
Caught exception in looking up space point ptr... 0xf3af9550, 0xf3afc7f0
Caught exception in looking up space point ptr... 0x194571030, 0x168a28ff0
Caught exception in looking up space point ptr... 0x168a28ff0, 0x194571030
Caught exception in looking up space point ptr... 0x16e68a150, 0x16e68a2a0
Caught exception in looking up space point ptr... 0x16e68a2a0, 0x16e68a150
Caught exception in looking up space point ptr... 0x18547bb30, 0x124aa6180
Caught exception in looking up space point ptr... 0x124aa6180, 0x124aa5ff0
Caught exception in looking up space point ptr... 0xd23414f0, 0xd23416f0
Caught exception in looking up space point ptr... 0xd23416f0, 0xd23417f0
Caught exception in looking up space point ptr... 0x195513120, 0x3aacb5f0
Caught exception in looking up space point ptr... 0x3aacb5f0, 0x195513120
Caught exception in looking up space point ptr... 0x140102c60, 0x140103350
Caught exception in looking up space point ptr... 0x140103350, 0x4c3fe790
Caught exception in looking up space point ptr... 0x6063ebf0, 0x6063ed80
Caught exception in looking up space point ptr... 0x6063ed80, 0x6063f0a0
Caught exception in looking up space point ptr... 0x1475a07f0, 0x1475a4a90
Caught exception in looking up space point ptr... 0x1475a4a90, 0x1475a4db0
Caught exception in looking up space point ptr... 0xf1dc3e0, 0xf1db0f0
Caught exception in looking up space point ptr... 0xf1cbf10, 0xf1dc3e0
Caught exception in looking up space point ptr... 0x16788d4a0, 0xff1b8df0
Caught exception in looking up space point ptr... 0xff1b8df0, 0xff1bfb30
Caught exception in looking up space point ptr... 0x140892e50, 0xec40ac80
Caught exception in looking up space point ptr... 0xec40ac80, 0x140892e50
Caught exception in looking up space point ptr... 0x11a797ef0, 0x11a7983a0
Caught exception in looking up space point ptr... 0x11a7983a0, 0x11a797ef0
Caught exception in looking up space point ptr... 0x377a0390, 0x395a2330
Caught exception in looking up space point ptr... 0x395a2330, 0x377a0390
Caught exception in looking up space point ptr... 0xd0c884f0, 0xd0c88360
Caught exception in looking up space point ptr... 0xd0c88360, 0xd0c884f0
Caught exception in looking up space point ptr... 0x11a7991b0, 0x11a799660
Caught exception in looking up space point ptr... 0x11a799660, 0x11a7991b0
Caught exception in looking up space point ptr... 0x11a7991b0, 0x11a7931d0
Caught exception in looking up space point ptr... 0x11a7931d0, 0x11a7991b0
Caught exception in looking up space point ptr... 0x11a796220, 0x11a796610
Caught exception in looking up space point ptr... 0x11a796610, 0x11a796220
Caught exception in looking up space point ptr... 0xdd6e7980, 0xdd6e7cc0
Caught exception in looking up space point ptr... 0xdd6e7cc0, 0xdd6e8000
Caught exception in looking up space point ptr... 0x3ae75e80, 0x3ff3ca00
Caught exception in looking up space point ptr... 0x3ff3ca00, 0x3ae75e80
Caught exception in looking up space point ptr... 0x1885c2040, 0x1885c2f30
Caught exception in looking up space point ptr... 0x1885c2f30, 0x1885c2680
Caught exception in looking up space point ptr... 0xd20997f0, 0xd2099b40
Caught exception in looking up space point ptr... 0xd2099b40, 0xd20999f0
++++>>>> total num hits: 170219, num free: 163124
04-Feb-2026 01:57:36 CET Closed output file "np02vd_raw_run042433_0074_df-s03-d1_dw_0_20260203T191014_reco_stage0_20260204T005736_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 134.65 269.464 1467.15 158.286 316.413 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.1851e-05 9.93032e-05 0.00015774 9.0301e-05 2.9e-05 19
produce:tpcrawdecoder:PDVDTPCReader 6.45333 6.79185 7.21949 6.83841 0.213567 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.0107834 0.0271076 0.122391 0.0186703 0.0250856 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000416563 0.000630711 0.00154483 0.000560196 0.000248733 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000403183 0.000567434 0.00118943 0.0004945 0.000202057 19
produce:beamevent:BeamEvent 6.817e-05 0.000162839 0.00105096 0.000111202 0.000211044 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.00711 4.52856 6.06805 4.53652 0.617457 19
produce:ophit:OpHitFinder 0.0299446 0.0388109 0.0469253 0.0411413 0.00581421 19
produce:wclsdatavd:WireCellToolkit 104.022 120.829 139.483 119.44 8.57624 19
produce:gaushit:GausHitFinder 0.794363 3.03982 17.0293 1.24722 4.53925 19
produce:nhitsfilter:NumberOfHitsFilter 0.00026432 0.000559928 0.00202203 0.000341514 0.000500988 19
produce:reco3d:SpacePointSolver 10.885 33.2217 177.627 17.8633 42.3656 19
produce:hitpdune:DisambigFromSpacePoints 0.0928741 1.31952 10.0272 0.217358 2.70499 19
produce:cluster3d:Cluster3D 1.60174 91.549 1097.57 2.51959 258.745 19
[art]:TriggerResults:TriggerResultInserter 2.571e-05 3.68198e-05 0.000113292 2.9651e-05 1.97949e-05 19
end_path:out1:RootOutput 7.8e-06 1.8328e-05 0.000157741 9.29e-06 3.32972e-05 19
end_path:out1:RootOutput(write) 4.29564 8.07362 30.6987 5.89425 6.41453 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 14544.6 MB
Peak resident set size usage (VmHWM): 12471.3 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0074_df-s03-d1_dw_0_20260203T191014_reco_stage0_20260204T005736_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0074_df-s03-d1_dw_0_20260203T191014_reco_stage0_20260204T005736_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0074_df-s03-d1_dw_0_20260203T191014_reco_stage0_20260204T005736_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161485.0,
"core.end_time": 1770166659.0,
"core.events": [
8445,
8451,
8457,
8463,
8469,
8475,
8481,
8487,
8493,
8499,
8505,
8511,
8517,
8523,
8529,
8535,
8541,
8547,
8553
],
"core.event_count": 19,
"core.first_event_number": 8445,
"core.last_event_number": 8553,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0074_df-s03-d1_dw_0_20260203T191014.hdf5"
}
]
} 