Jobsub ID 303647.123@dunegpschedd01.fnal.gov
| Jobsub ID | 303647.123@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:46:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce515 |
| Last heartbeat | 2026-02-03 23:49:17 |
| From worker node | Hostname | b9p35p0043.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:47:03 |
| Input files | vd-protodune:np02vd_raw_run042421_0128_df-s04-d0_dw_0_20260203T144014.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 59m (3567s) |
| CPU time | 57m (3451s = 96%) |
| Max RSS bytes | 8714256384 (8310 MiB) |
| Outputting started | 2026-02-03 23:46:32 |
| Output files | |
| Finished | 2026-02-03 23:49:17 |
| Saved logs | justin-logs:303647.123-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
75d0
Caught exception in looking up space point ptr... 0x55b975d0, 0x487fbb30
Caught exception in looking up space point ptr... 0x4c4ab0e0, 0x24fd8980
Caught exception in looking up space point ptr... 0x24fd8980, 0x1321df40
Caught exception in looking up space point ptr... 0x1321df40, 0x1321d500
Caught exception in looking up space point ptr... 0x1321d500, 0x9cd24ef0
Caught exception in looking up space point ptr... 0x9cd24ef0, 0x2d968fc0
Caught exception in looking up space point ptr... 0x2d968fc0, 0x40626750
Caught exception in looking up space point ptr... 0x40626750, 0x2d969480
Caught exception in looking up space point ptr... 0x2d969480, 0x40627660
Caught exception in looking up space point ptr... 0x40627660, 0x4c4ab0e0
Caught exception in looking up space point ptr... 0x38869580, 0x54dadd90
Caught exception in looking up space point ptr... 0x54dadd90, 0x2ffb4540
Caught exception in looking up space point ptr... 0x2ffb4540, 0x3f308df0
Caught exception in looking up space point ptr... 0x3f308df0, 0x35545280
Caught exception in looking up space point ptr... 0x35545280, 0x3b1297c0
Caught exception in looking up space point ptr... 0x3b2398f0, 0x3b089f80
Caught exception in looking up space point ptr... 0x2c94f2e0, 0x3b2398f0
Caught exception in looking up space point ptr... 0x9af09f00, 0x4c603480
Caught exception in looking up space point ptr... 0x4c603480, 0x2d703d90
Caught exception in looking up space point ptr... 0x9864320, 0xbc02df0
Caught exception in looking up space point ptr... 0xbc02df0, 0x9cfd7150
Caught exception in looking up space point ptr... 0x440537d0, 0xa1db4b80
Caught exception in looking up space point ptr... 0xa1db4b80, 0x2e169090
Caught exception in looking up space point ptr... 0x2e169090, 0xa1d9ef0
Caught exception in looking up space point ptr... 0x2e19d340, 0x64d4cee0
Caught exception in looking up space point ptr... 0x64d4cee0, 0x37a0a680
Caught exception in looking up space point ptr... 0x2e19d480, 0x2e19d3e0
Caught exception in looking up space point ptr... 0x2e19d3e0, 0x2e19d340
Caught exception in looking up space point ptr... 0xc2cbf4c0, 0x3ed1e7f0
Caught exception in looking up space point ptr... 0x3ed1e7f0, 0xc2cbf4c0
Caught exception in looking up space point ptr... 0x4f2875f0, 0xc061f8b0
Caught exception in looking up space point ptr... 0xc061f8b0, 0x499985a0
Caught exception in looking up space point ptr... 0xbc3e310, 0x48fce0d0
Caught exception in looking up space point ptr... 0x48fce0d0, 0x48fce3d0
Caught exception in looking up space point ptr... 0x4c5e1520, 0x4c5e1390
Caught exception in looking up space point ptr... 0x4c5e1390, 0x4a523e10
Caught exception in looking up space point ptr... 0x3c773bc0, 0x4c5e1520
Caught exception in looking up space point ptr... 0x89c5ad60, 0x8568340
Caught exception in looking up space point ptr... 0x8568340, 0x56239760
Caught exception in looking up space point ptr... 0x4c4a9d20, 0x9b120a20
Caught exception in looking up space point ptr... 0x9b120a20, 0x1f6247c0
Caught exception in looking up space point ptr... 0x4f2a2f50, 0x467abd00
Caught exception in looking up space point ptr... 0x9af0e840, 0x4f2a2f50
Caught exception in looking up space point ptr... 0x4c4fb200, 0x4c4fb070
Caught exception in looking up space point ptr... 0x4c4fb070, 0x4c4fb200
Caught exception in looking up space point ptr... 0x12045d40, 0x2f30e860
Caught exception in looking up space point ptr... 0x2f30e860, 0x43e63580
Caught exception in looking up space point ptr... 0x40bb2ef0, 0x40bb26d0
Caught exception in looking up space point ptr... 0x40bb26d0, 0x40bb2ef0
Caught exception in looking up space point ptr... 0x3eaeef50, 0x32289490
Caught exception in looking up space point ptr... 0x32289490, 0x32289380
Caught exception in looking up space point ptr... 0x12c30250, 0xd931160
Caught exception in looking up space point ptr... 0xd931160, 0x4c44c5a0
Caught exception in looking up space point ptr... 0x4c3c7ff0, 0x33bf2470
Caught exception in looking up space point ptr... 0x33bf2470, 0x9af0a7b0
Caught exception in looking up space point ptr... 0x37435950, 0x45ea9620
Caught exception in looking up space point ptr... 0x45ea9620, 0x37435950
Caught exception in looking up space point ptr... 0x388693e0, 0xce6c240
Caught exception in looking up space point ptr... 0xce6c240, 0x388693e0
Caught exception in looking up space point ptr... 0x4c5b1b70, 0x109fefc0
Caught exception in looking up space point ptr... 0x109fefc0, 0x2493dc10
Caught exception in looking up space point ptr... 0x9b12a2c0, 0x9b12a060
Caught exception in looking up space point ptr... 0x9b12a060, 0x9b12a190
Caught exception in looking up space point ptr... 0x3f789690, 0x622fc5f0
Caught exception in looking up space point ptr... 0x622fc5f0, 0x3f789690
++++>>>> total num hits: 41472, num free: 40344
04-Feb-2026 00:46:23 CET Closed output file "np02vd_raw_run042421_0128_df-s04-d0_dw_0_20260203T144014_reco_stage0_20260203T234623_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 59.756 130.025 600.874 71.1201 132.341 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.439e-05 7.5146e-05 0.00021088 6.908e-05 2.7935e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.68745 4.67664 9.95057 4.22575 1.34812 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00826771 0.01248 0.0322166 0.0101943 0.00607229 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0003257 0.000591643 0.0012451 0.0004974 0.000241527 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00107842 0.00155722 0.00330249 0.00142764 0.000449519 27
produce:beamevent:BeamEvent 5.885e-05 0.000117187 0.0008791 8.284e-05 0.000150781 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.78911 2.12962 2.50154 2.12916 0.177231 27
produce:ophit:OpHitFinder 0.0199406 0.0336599 0.0416706 0.0352236 0.00481765 27
produce:wclsdatavd:WireCellToolkit 43.5118 50.4526 62.2153 49.6454 4.42001 27
produce:gaushit:GausHitFinder 0.507751 1.60674 8.77284 0.808153 1.87159 27
produce:nhitsfilter:NumberOfHitsFilter 0.00011944 0.000236164 0.00084578 0.00017133 0.000152977 27
produce:reco3d:SpacePointSolver 4.72898 14.0251 57.4263 8.34765 13.353 27
produce:hitpdune:DisambigFromSpacePoints 0.0428192 0.445306 3.59012 0.0817518 0.817817 27
produce:cluster3d:Cluster3D 0.717828 51.4085 448.636 1.38785 111.321 27
[art]:TriggerResults:TriggerResultInserter 2.466e-05 3.52956e-05 7.163e-05 3.082e-05 1.07078e-05 27
end_path:out1:RootOutput 4.38e-06 6.47778e-06 1.769e-05 5.2e-06 3.2946e-06 27
end_path:out1:RootOutput(write) 2.59944 5.19394 15.0443 4.0451 3.0023 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 11052.6 MB
Peak resident set size usage (VmHWM): 8714.26 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0128_df-s04-d0_dw_0_20260203T144014_reco_stage0_20260203T234623_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0128_df-s04-d0_dw_0_20260203T144014_reco_stage0_20260203T234623_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0128_df-s04-d0_dw_0_20260203T144014_reco_stage0_20260203T234623_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770158831.0,
"core.end_time": 1770162384.0,
"core.events": [
20800,
20806,
20812,
20818,
20824,
20830,
20836,
20842,
20848,
20854,
20860,
20866,
20872,
20878,
20884,
20890,
20896,
20902,
20908,
20914,
20920,
20926,
20932,
20938,
20944,
20950,
20956
],
"core.event_count": 27,
"core.first_event_number": 20800,
"core.last_event_number": 20956,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0128_df-s04-d0_dw_0_20260203T144014.hdf5"
}
]
} 