Jobsub ID 297922.25@dunegpschedd02.fnal.gov
| Jobsub ID | 297922.25@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce509 |
| Last heartbeat | 2026-02-04 01:26:01 |
| From worker node | Hostname | b9p34p1022.cern.ch |
| cpuinfo | AMD EPYC 9655 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:57:00 |
| Input files | vd-protodune:np02vd_raw_run042421_0143_df-s03-d0_dw_0_20260203T144821.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5146s) |
| CPU time | 1h (5028s = 97%) |
| Max RSS bytes | 10608476160 (10117 MiB) |
| Outputting started | 2026-02-04 01:22:49 |
| Output files | |
| Finished | 2026-02-04 01:26:01 |
| Saved logs | justin-logs:297922.25-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
oking up space point ptr... 0x11ff85b60, 0x524a6700
Caught exception in looking up space point ptr... 0x524a6700, 0x364f4910
Caught exception in looking up space point ptr... 0x4a406a20, 0x6e90a370
Caught exception in looking up space point ptr... 0x132b55230, 0x4a406a20
Caught exception in looking up space point ptr... 0xde744590, 0x523ea1a0
Caught exception in looking up space point ptr... 0x523ea1a0, 0xde744590
Caught exception in looking up space point ptr... 0x4a2b5200, 0x2caa9220
Caught exception in looking up space point ptr... 0x2caa9220, 0x4a2b5200
Caught exception in looking up space point ptr... 0xc5e60400, 0x248f0de0
Caught exception in looking up space point ptr... 0xdcd2e690, 0xc5e60400
Caught exception in looking up space point ptr... 0xc112d660, 0xc112d4d0
Caught exception in looking up space point ptr... 0xc112d4d0, 0xc112d660
Caught exception in looking up space point ptr... 0xec5a85e0, 0xec5a92b0
Caught exception in looking up space point ptr... 0xec5a92b0, 0x14ce6e20
Caught exception in looking up space point ptr... 0xe55f46e0, 0xe55f4870
Caught exception in looking up space point ptr... 0xe55f4870, 0x52664ee0
Caught exception in looking up space point ptr... 0x479cef00, 0x10db1430
Caught exception in looking up space point ptr... 0x10db1430, 0x479cef00
Caught exception in looking up space point ptr... 0x3f01aae0, 0x3f01a950
Caught exception in looking up space point ptr... 0x3f01a950, 0x3f01aae0
Caught exception in looking up space point ptr... 0x308188d0, 0x15bbc860
Caught exception in looking up space point ptr... 0x15bbc860, 0x5403acc0
Caught exception in looking up space point ptr... 0x5403acc0, 0x4c06ebc0
Caught exception in looking up space point ptr... 0x24b3a0d0, 0x24b3aad0
Caught exception in looking up space point ptr... 0x24b3aad0, 0x306e55b0
Caught exception in looking up space point ptr... 0x2afe9b70, 0x297f2e50
Caught exception in looking up space point ptr... 0x132dd8410, 0x2afe9b70
Caught exception in looking up space point ptr... 0x24bc3110, 0x12646b80
Caught exception in looking up space point ptr... 0x12646b80, 0x2afe9dd0
Caught exception in looking up space point ptr... 0x245f2650, 0x32aab8b0
Caught exception in looking up space point ptr... 0x32aab8b0, 0x245f2650
Caught exception in looking up space point ptr... 0x116f2dc30, 0x22356b20
Caught exception in looking up space point ptr... 0x22356b20, 0x116f2d2b0
Caught exception in looking up space point ptr... 0xc947a010, 0x3173b070
Caught exception in looking up space point ptr... 0x3173b070, 0xc9428160
Caught exception in looking up space point ptr... 0x13f78160, 0x364adb90
Caught exception in looking up space point ptr... 0x364adb90, 0xec4661e0
Caught exception in looking up space point ptr... 0xec4661e0, 0x282d0100
Caught exception in looking up space point ptr... 0xda2d48a0, 0xda2d4b50
Caught exception in looking up space point ptr... 0xda2d4b50, 0xda2d48a0
Caught exception in looking up space point ptr... 0x487e1ed0, 0x487e2870
Caught exception in looking up space point ptr... 0x487e2870, 0x487e1ed0
Caught exception in looking up space point ptr... 0x15dafc310, 0x13644410
Caught exception in looking up space point ptr... 0x13644410, 0x2d414a10
Caught exception in looking up space point ptr... 0xa9d93a0, 0xc7d51590
Caught exception in looking up space point ptr... 0xc7d51590, 0xc7d51e70
Caught exception in looking up space point ptr... 0x4a673850, 0x4a6736c0
Caught exception in looking up space point ptr... 0xd8f2ebb0, 0x4a673850
Caught exception in looking up space point ptr... 0x3135dcf0, 0xb03d240
Caught exception in looking up space point ptr... 0xb03d240, 0x3135dcf0
Caught exception in looking up space point ptr... 0xde5f4140, 0x30727410
Caught exception in looking up space point ptr... 0x30727410, 0xde5f4140
Caught exception in looking up space point ptr... 0x481e2e10, 0x249fb330
Caught exception in looking up space point ptr... 0x249fb330, 0x249fb430
Caught exception in looking up space point ptr... 0x3b9139d0, 0x5241d980
Caught exception in looking up space point ptr... 0x5241d980, 0x3b9139d0
Caught exception in looking up space point ptr... 0x224d6e70, 0x224d6d40
Caught exception in looking up space point ptr... 0x224d6d40, 0x224d68f0
Caught exception in looking up space point ptr... 0x224d68f0, 0x275ce010
Caught exception in looking up space point ptr... 0x2456a540, 0x32f4c850
Caught exception in looking up space point ptr... 0x32f4c850, 0x2456a3b0
Caught exception in looking up space point ptr... 0x3b99b9c0, 0x3f6963b0
Caught exception in looking up space point ptr... 0xec3c7e80, 0x3b99b9c0
Caught exception in looking up space point ptr... 0x154cd490, 0x5402c760
Caught exception in looking up space point ptr... 0x5402c760, 0x154cd490
++++>>>> total num hits: 46407, num free: 44715
04-Feb-2026 02:22:40 CET Closed output file "np02vd_raw_run042421_0143_df-s03-d0_dw_0_20260203T144821_reco_stage0_20260204T012240_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 60.5291 181.896 956.896 69.8064 232.194 28
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.5202e-05 9.58961e-05 0.000177195 8.6189e-05 3.00011e-05 28
produce:tpcrawdecoder:PDVDTPCReader 3.53208 3.91992 4.51148 3.86907 0.219572 28
produce:triggerrawdecoder:PDVDTriggerReader4 0.00844066 0.0176103 0.0599547 0.0124595 0.0113558 28
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000376003 0.000741083 0.00551008 0.000557054 0.000926253 28
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00126539 0.0017671 0.00435891 0.00157211 0.00068093 28
produce:beamevent:BeamEvent 7.4241e-05 0.000133138 0.000920667 0.000105263 0.000152466 28
produce:pdvddaphne:DAPHNEReaderPDVD 1.74567 2.13336 2.52438 2.16666 0.215679 28
produce:ophit:OpHitFinder 0.0257534 0.0336115 0.0424999 0.0327655 0.00479186 28
produce:wclsdatavd:WireCellToolkit 43.9756 50.3744 56.3279 50.3452 3.36774 28
produce:gaushit:GausHitFinder 0.31176 1.73694 7.98569 0.770883 1.98314 28
produce:nhitsfilter:NumberOfHitsFilter 0.000141432 0.000311074 0.000810453 0.000249729 0.000183235 28
produce:reco3d:SpacePointSolver 3.07861 21.1567 98.364 8.90741 28.4975 28
produce:hitpdune:DisambigFromSpacePoints 0.0292429 0.891461 5.96474 0.0913337 1.74441 28
produce:cluster3d:Cluster3D 0.379752 96.3688 769.024 1.77885 196.249 28
[art]:TriggerResults:TriggerResultInserter 2.719e-05 4.3556e-05 8.2293e-05 3.94145e-05 1.43046e-05 28
end_path:out1:RootOutput 5.128e-06 1.3971e-05 0.000187831 6.124e-06 3.36413e-05 28
end_path:out1:RootOutput(write) 2.57548 5.21161 16.4014 3.41725 3.84398 28
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 12990.4 MB
Peak resident set size usage (VmHWM): 10608.5 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0143_df-s03-d0_dw_0_20260203T144821_reco_stage0_20260204T012240_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0143_df-s03-d0_dw_0_20260203T144821_reco_stage0_20260204T012240_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0143_df-s03-d0_dw_0_20260203T144821_reco_stage0_20260204T012240_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163028.0,
"core.end_time": 1770168162.0,
"core.events": [
23240,
23246,
23252,
23258,
23264,
23270,
23276,
23282,
23288,
23294,
23300,
23306,
23312,
23318,
23324,
23330,
23336,
23342,
23348,
23354,
23360,
23366,
23372,
23378,
23384,
23390,
23396,
23402
],
"core.event_count": 28,
"core.first_event_number": 23240,
"core.last_event_number": 23402,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0143_df-s03-d0_dw_0_20260203T144821.hdf5"
}
]
} 