Jobsub ID 297921.91@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.91@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce505 |
| Last heartbeat | 2026-02-04 00:46:26 |
| From worker node | Hostname | b9p35p0031.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:53:47 |
| Input files | vd-protodune:np02vd_raw_run042433_0452_df-s02-d1_dw_0_20260203T213354.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 50m (3007s) |
| CPU time | 48m (2909s = 96%) |
| Max RSS bytes | 3617050624 (3449 MiB) |
| Outputting started | 2026-02-04 00:43:57 |
| Output files | |
| Finished | 2026-02-04 00:46:26 |
| Saved logs | justin-logs:297921.91-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x3e0c3d00, 0x45b2a210
Caught exception in looking up space point ptr... 0x3320d790, 0x5f005260
Caught exception in looking up space point ptr... 0x5f005260, 0x3320dcb0
Caught exception in looking up space point ptr... 0x3320dcb0, 0x3320da20
Caught exception in looking up space point ptr... 0x3320df40, 0x3320d790
Caught exception in looking up space point ptr... 0x609d5050, 0x31c317a0
Caught exception in looking up space point ptr... 0x31c317a0, 0x609d5050
Caught exception in looking up space point ptr... 0x37bd6ba0, 0x524d0490
Caught exception in looking up space point ptr... 0x524d0490, 0x37bd6ba0
Caught exception in looking up space point ptr... 0x728a58b0, 0x6554d300
Caught exception in looking up space point ptr... 0x6554d300, 0x728a58b0
Caught exception in looking up space point ptr... 0x3323a3e0, 0x3323a670
Caught exception in looking up space point ptr... 0x3323a670, 0x3323a150
Caught exception in looking up space point ptr... 0x33228d40, 0x33228fd0
Caught exception in looking up space point ptr... 0x33228fd0, 0x33228ab0
Caught exception in looking up space point ptr... 0x33245790, 0x33245a20
Caught exception in looking up space point ptr... 0x33245a20, 0x332454b0
Caught exception in looking up space point ptr... 0x33231ee0, 0x33232170
Caught exception in looking up space point ptr... 0x33232170, 0x33231c50
Caught exception in looking up space point ptr... 0x33212be0, 0x33212e70
Caught exception in looking up space point ptr... 0x33212e70, 0x33212950
Caught exception in looking up space point ptr... 0x3322d250, 0x3322d4e0
Caught exception in looking up space point ptr... 0x3322d4e0, 0x3322cfc0
Caught exception in looking up space point ptr... 0x37f986a0, 0x592d3490
Caught exception in looking up space point ptr... 0x592d3490, 0x37f986a0
Caught exception in looking up space point ptr... 0x3322a8e0, 0x3322ab70
Caught exception in looking up space point ptr... 0x3322ab70, 0x3322ae00
Caught exception in looking up space point ptr... 0x33239650, 0x332398e0
Caught exception in looking up space point ptr... 0x332398e0, 0x33239b70
Caught exception in looking up space point ptr... 0x3320be10, 0x3320c0a0
Caught exception in looking up space point ptr... 0x3320c0a0, 0x3320bb80
Caught exception in looking up space point ptr... 0x3e0d0550, 0x296e79a0
Caught exception in looking up space point ptr... 0x296e79a0, 0x114da7e0
Caught exception in looking up space point ptr... 0x33229b10, 0x33229da0
Caught exception in looking up space point ptr... 0x33229da0, 0x3322a030
Caught exception in looking up space point ptr... 0x332242e0, 0x33224570
Caught exception in looking up space point ptr... 0x33224570, 0x33224050
Caught exception in looking up space point ptr... 0x33234530, 0x332347c0
Caught exception in looking up space point ptr... 0x332347c0, 0x332342a0
Caught exception in looking up space point ptr... 0x332271a0, 0x33227430
Caught exception in looking up space point ptr... 0x33227430, 0x33226f10
Caught exception in looking up space point ptr... 0x3323fa50, 0x3323fce0
Caught exception in looking up space point ptr... 0x3323fce0, 0x3323f7c0
Caught exception in looking up space point ptr... 0x33227f70, 0x33228200
Caught exception in looking up space point ptr... 0x33228200, 0x33227ce0
Caught exception in looking up space point ptr... 0x3323c250, 0x3323c4e0
Caught exception in looking up space point ptr... 0x3323c4e0, 0x3323bfc0
Caught exception in looking up space point ptr... 0x332355a0, 0x33235830
Caught exception in looking up space point ptr... 0x33235830, 0x332352c0
Caught exception in looking up space point ptr... 0x51eea560, 0x3e0d6060
Caught exception in looking up space point ptr... 0x3e0d6060, 0xa4796b0
Caught exception in looking up space point ptr... 0x3323d840, 0x3323dd60
Caught exception in looking up space point ptr... 0x3323dad0, 0x3323d840
Caught exception in looking up space point ptr... 0x45aef420, 0x3e0ae2d0
Caught exception in looking up space point ptr... 0x3e0ca5a0, 0x45aef420
Caught exception in looking up space point ptr... 0x33231110, 0x332313a0
Caught exception in looking up space point ptr... 0x332313a0, 0x33230e30
Caught exception in looking up space point ptr... 0x33247540, 0x33247a60
Caught exception in looking up space point ptr... 0x332477d0, 0x33247540
Caught exception in looking up space point ptr... 0x33238840, 0x33238d60
Caught exception in looking up space point ptr... 0x33238ad0, 0x33238840
Caught exception in looking up space point ptr... 0x3323b270, 0x3323b790
Caught exception in looking up space point ptr... 0x3323b500, 0x3323b270
Caught exception in looking up space point ptr... 0x37bd6010, 0x37bd6420
Caught exception in looking up space point ptr... 0x37bd6420, 0x37bd62d0
Caught exception in looking up space point ptr... 0x5eb6ebe0, 0x1624d450
Caught exception in looking up space point ptr... 0x1624d450, 0x5eb6ebe0
++++>>>> total num hits: 507721, num free: 498130
04-Feb-2026 01:43:49 CET Closed output file "np02vd_raw_run042433_0452_df-s02-d1_dw_0_20260203T213354_reco_stage0_20260204T004349_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 104.667 155.247 177.942 160.669 21.2438 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.051e-05 8.22158e-05 0.00020937 7.476e-05 3.13119e-05 19
produce:tpcrawdecoder:PDVDTPCReader 6.01225 6.55251 7.02645 6.55318 0.275368 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.00859244 0.0153349 0.0661977 0.00997879 0.0129119 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.00037804 0.000576082 0.00120544 0.00052741 0.000184197 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00033559 0.0005113 0.00074364 0.00051913 0.000126565 19
produce:beamevent:BeamEvent 5.775e-05 0.000124221 0.00080449 8.076e-05 0.000161493 19
produce:pdvddaphne:DAPHNEReaderPDVD 1.77335 2.03655 2.26008 2.05151 0.158043 19
produce:ophit:OpHitFinder 0.0259581 0.0344062 0.041138 0.0345374 0.00404271 19
produce:wclsdatavd:WireCellToolkit 73.0092 82.0818 94.4047 82.3821 5.95559 19
produce:gaushit:GausHitFinder 1.12096 1.57095 1.86989 1.60695 0.224454 19
produce:nhitsfilter:NumberOfHitsFilter 0.00018845 0.000234198 0.00041721 0.00021742 4.93107e-05 19
produce:reco3d:SpacePointSolver 7.38454 11.9832 17.0226 11.5052 2.60507 19
produce:hitpdune:DisambigFromSpacePoints 0.131241 0.200928 0.400629 0.194453 0.059449 19
produce:cluster3d:Cluster3D 1.60307 44.4593 60.2506 51.0014 18.652 19
[art]:TriggerResults:TriggerResultInserter 2.57e-05 3.93884e-05 9.949e-05 3.789e-05 1.53492e-05 19
end_path:out1:RootOutput 4.72e-06 6.86368e-06 2.327e-05 5.99e-06 3.97006e-06 19
end_path:out1:RootOutput(write) 4.63666 6.27071 7.71479 5.95039 0.806046 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5591.4 MB
Peak resident set size usage (VmHWM): 3617.05 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0452_df-s02-d1_dw_0_20260203T213354_reco_stage0_20260204T004349_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0452_df-s02-d1_dw_0_20260203T213354_reco_stage0_20260204T004349_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0452_df-s02-d1_dw_0_20260203T213354_reco_stage0_20260204T004349_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162835.0,
"core.end_time": 1770165830.0,
"core.events": [
51535,
51541,
51547,
51553,
51559,
51565,
51571,
51577,
51583,
51589,
51595,
51601,
51607,
51613,
51619,
51625,
51631,
51637,
51643
],
"core.event_count": 19,
"core.first_event_number": 51535,
"core.last_event_number": 51643,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0452_df-s02-d1_dw_0_20260203T213354.hdf5"
}
]
} 