Jobsub ID 297923.46@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.46@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce509 |
| Last heartbeat | 2026-02-04 00:54:40 |
| From worker node | Hostname | b9p04p3844.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:59:18 |
| Input files | vd-protodune:np02vd_raw_run042433_0100_df-s03-d0_dw_0_20260203T192008.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 52m (3156s) |
| CPU time | 50m (3041s = 96%) |
| Max RSS bytes | 3632263168 (3463 MiB) |
| Outputting started | 2026-02-04 00:51:57 |
| Output files | |
| Finished | 2026-02-04 00:54:40 |
| Saved logs | justin-logs:297923.46-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
point ptr... 0x14223bc0, 0x142246b0
Caught exception in looking up space point ptr... 0x14224390, 0x14223bc0
Caught exception in looking up space point ptr... 0x4cb9d490, 0x4b9c4eb0
Caught exception in looking up space point ptr... 0x45f3bf30, 0x4cb9d490
Caught exception in looking up space point ptr... 0x4dce4930, 0x17c6acf0
Caught exception in looking up space point ptr... 0x46cb8f20, 0x4dce4930
Caught exception in looking up space point ptr... 0x46d474c0, 0x3ad8ea60
Caught exception in looking up space point ptr... 0x3ad8ea60, 0x46d474c0
Caught exception in looking up space point ptr... 0x35bd7fd0, 0x42d80b50
Caught exception in looking up space point ptr... 0x42d80b50, 0x389f7420
Caught exception in looking up space point ptr... 0x4d814190, 0x4d813bf0
Caught exception in looking up space point ptr... 0x13fe0200, 0x4d814190
Caught exception in looking up space point ptr... 0x766c94e0, 0xce7db80
Caught exception in looking up space point ptr... 0xce7db80, 0x46cd5da0
Caught exception in looking up space point ptr... 0x39c10f60, 0x39bf1e80
Caught exception in looking up space point ptr... 0x39c1ebb0, 0x39c10f60
Caught exception in looking up space point ptr... 0x43711550, 0xcf20970
Caught exception in looking up space point ptr... 0xcf20970, 0x77ac700
Caught exception in looking up space point ptr... 0x6ea3ac60, 0x158f5060
Caught exception in looking up space point ptr... 0x158f5060, 0x60bfbc30
Caught exception in looking up space point ptr... 0xc453e90, 0x11ca33f0
Caught exception in looking up space point ptr... 0xc4541b0, 0x11b597b0
Caught exception in looking up space point ptr... 0x11b597b0, 0xc453e90
Caught exception in looking up space point ptr... 0x1764cc50, 0x1764ca00
Caught exception in looking up space point ptr... 0x1764ca00, 0x52d7fc80
Caught exception in looking up space point ptr... 0x61171ec0, 0x3303ddd0
Caught exception in looking up space point ptr... 0x429a4120, 0x61171ec0
Caught exception in looking up space point ptr... 0x45fde290, 0x118547f0
Caught exception in looking up space point ptr... 0x118547f0, 0x45fde4e0
Caught exception in looking up space point ptr... 0x42e3aa00, 0x2dacd3c0
Caught exception in looking up space point ptr... 0x430127b0, 0x42e3aa00
Caught exception in looking up space point ptr... 0x8ad8ec0, 0x4d833f60
Caught exception in looking up space point ptr... 0x4d833f60, 0x4cf2ba40
Caught exception in looking up space point ptr... 0x42b97650, 0x4c1c04d0
Caught exception in looking up space point ptr... 0x4c1c04d0, 0x42b97650
Caught exception in looking up space point ptr... 0x5e9ea290, 0x59915a50
Caught exception in looking up space point ptr... 0x59915a50, 0x59915be0
Caught exception in looking up space point ptr... 0x4561e1e0, 0x922d8460
Caught exception in looking up space point ptr... 0x16ccfd90, 0x4561e1e0
Caught exception in looking up space point ptr... 0x198bbcc0, 0x198bc800
Caught exception in looking up space point ptr... 0x198bb720, 0x198bbcc0
Caught exception in looking up space point ptr... 0x8104d180, 0x106f8d50
Caught exception in looking up space point ptr... 0x48a367d0, 0x8104d180
Caught exception in looking up space point ptr... 0x4bfcbd30, 0x4bfb9770
Caught exception in looking up space point ptr... 0x4bfb9770, 0x4bfa9730
Caught exception in looking up space point ptr... 0x608422c0, 0x60830020
Caught exception in looking up space point ptr... 0x608540b0, 0x608422c0
Caught exception in looking up space point ptr... 0x10130b50, 0x115bbb90
Caught exception in looking up space point ptr... 0x1183ef20, 0x10130b50
Caught exception in looking up space point ptr... 0xeda3310, 0x49f2f340
Caught exception in looking up space point ptr... 0xedb0f60, 0xeda3310
Caught exception in looking up space point ptr... 0x359fc980, 0x359fd2c0
Caught exception in looking up space point ptr... 0x359fd2c0, 0xc8b8070
Caught exception in looking up space point ptr... 0x108a18a0, 0x10893c50
Caught exception in looking up space point ptr... 0x10893c50, 0x108a1710
Caught exception in looking up space point ptr... 0x192945b0, 0x817fc9d0
Caught exception in looking up space point ptr... 0x817fc9d0, 0x192945b0
Caught exception in looking up space point ptr... 0x192945b0, 0x3e3a9340
Caught exception in looking up space point ptr... 0x3e3a9340, 0x192945b0
Caught exception in looking up space point ptr... 0x6efbbcd0, 0x5ac01a20
Caught exception in looking up space point ptr... 0x5ac01a20, 0x3ac23820
Caught exception in looking up space point ptr... 0x3ac23820, 0x5ac01a20
Caught exception in looking up space point ptr... 0x5ac01a20, 0x4c3cb9a0
Caught exception in looking up space point ptr... 0x4c3cb9a0, 0x5ac01a20
Caught exception in looking up space point ptr... 0x5ac01a20, 0x44d57010
Caught exception in looking up space point ptr... 0x61e8a040, 0x43967800
Caught exception in looking up space point ptr... 0x43967800, 0x61e8a040
++++>>>> total num hits: 532806, num free: 523950
04-Feb-2026 01:51:50 CET Closed output file "np02vd_raw_run042433_0100_df-s03-d0_dw_0_20260203T192008_reco_stage0_20260204T005150_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 130.825 163.029 194.657 165.502 18.1961 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.8301e-05 9.54942e-05 0.000224714 7.3631e-05 4.68212e-05 19
produce:tpcrawdecoder:PDVDTPCReader 5.53111 7.31496 16.3802 6.63689 2.28054 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.0115232 0.0227995 0.0577003 0.0147954 0.0133257 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000440957 0.000558344 0.000896313 0.000543418 0.000117226 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000374436 0.000517353 0.000821352 0.000467607 0.000115789 19
produce:beamevent:BeamEvent 7.9691e-05 0.00014451 0.000828103 0.000102551 0.000162645 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.23773 2.62359 3.16478 2.60378 0.257592 19
produce:ophit:OpHitFinder 0.0266869 0.0353105 0.0416071 0.0350559 0.0043336 19
produce:wclsdatavd:WireCellToolkit 86.5178 96.9401 107.516 96.6437 5.12151 19
produce:gaushit:GausHitFinder 0.788975 1.68023 2.50478 1.7918 0.416419 19
produce:nhitsfilter:NumberOfHitsFilter 0.000284845 0.000368723 0.000592039 0.000359286 6.81504e-05 19
produce:reco3d:SpacePointSolver 11.7278 20.6784 29.4697 20.2803 4.66394 19
produce:hitpdune:DisambigFromSpacePoints 0.125601 0.227357 0.380737 0.234393 0.0513112 19
produce:cluster3d:Cluster3D 1.4701 28.1068 49.6177 40.4368 18.8975 19
[art]:TriggerResults:TriggerResultInserter 2.232e-05 3.06468e-05 9.3461e-05 2.516e-05 1.57099e-05 19
end_path:out1:RootOutput 4.56e-06 8.09432e-06 2.9481e-05 7.351e-06 5.21324e-06 19
end_path:out1:RootOutput(write) 4.14977 5.36662 6.22001 5.48414 0.466652 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5617.03 MB
Peak resident set size usage (VmHWM): 3632.26 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0100_df-s03-d0_dw_0_20260203T192008_reco_stage0_20260204T005150_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0100_df-s03-d0_dw_0_20260203T192008_reco_stage0_20260204T005150_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0100_df-s03-d0_dw_0_20260203T192008_reco_stage0_20260204T005150_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163173.0,
"core.end_time": 1770166311.0,
"core.events": [
11408,
11414,
11420,
11426,
11432,
11438,
11444,
11450,
11456,
11462,
11468,
11474,
11480,
11486,
11492,
11498,
11504,
11510,
11516
],
"core.event_count": 19,
"core.first_event_number": 11408,
"core.last_event_number": 11516,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0100_df-s03-d0_dw_0_20260203T192008.hdf5"
}
]
} 