Jobsub ID 297917.118@dunegpschedd02.fnal.gov
| Jobsub ID | 297917.118@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:25 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce505 |
| Last heartbeat | 2026-02-03 23:57:16 |
| From worker node | Hostname | b9p35p0031.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:23:17 |
| Input files | vd-protodune:np02vd_raw_run042421_0083_df-s02-d0_dw_0_20260203T141553.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 31m (1913s) |
| CPU time | 30m (1832s = 95%) |
| Max RSS bytes | 2676338688 (2552 MiB) |
| Outputting started | 2026-02-03 23:55:11 |
| Output files | |
| Finished | 2026-02-03 23:57:16 |
| Saved logs | justin-logs:297917.118-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
eac430, 0x3c5ac090
Caught exception in looking up space point ptr... 0x56750ed0, 0x4243a0f0
Caught exception in looking up space point ptr... 0x4243a0f0, 0x30024cd0
Caught exception in looking up space point ptr... 0x128baf80, 0x128badf0
Caught exception in looking up space point ptr... 0x128badf0, 0x3109b520
Caught exception in looking up space point ptr... 0x47864d90, 0x279a2ba0
Caught exception in looking up space point ptr... 0x279a2ba0, 0x47864d90
Caught exception in looking up space point ptr... 0x5ca51700, 0x5ca51890
Caught exception in looking up space point ptr... 0x5ca51890, 0x5ca51700
Caught exception in looking up space point ptr... 0x5ca51700, 0x3ae8e670
Caught exception in looking up space point ptr... 0x3ae8e670, 0x5ca51700
Caught exception in looking up space point ptr... 0x5ca51700, 0x146aebd0
Caught exception in looking up space point ptr... 0x146aebd0, 0x5ca51700
Caught exception in looking up space point ptr... 0x414b95f0, 0x5ce0dd40
Caught exception in looking up space point ptr... 0x424a91c0, 0x414b95f0
Caught exception in looking up space point ptr... 0x26874ea0, 0x26873c10
Caught exception in looking up space point ptr... 0x2686ffa0, 0x26874ea0
Caught exception in looking up space point ptr... 0x22918340, 0x22927d60
Caught exception in looking up space point ptr... 0x22927d60, 0x59d27930
Caught exception in looking up space point ptr... 0x23ac3130, 0x265c70f0
Caught exception in looking up space point ptr... 0x265c70f0, 0x5be1a4c0
Caught exception in looking up space point ptr... 0x33c89390, 0x33c89fe0
Caught exception in looking up space point ptr... 0x33c89fe0, 0x56c8cee0
Caught exception in looking up space point ptr... 0x3e796390, 0x3e795ef0
Caught exception in looking up space point ptr... 0x3e795ef0, 0x3e796140
Caught exception in looking up space point ptr... 0x40a8fed0, 0x40aa42e0
Caught exception in looking up space point ptr... 0x40aa42e0, 0x40a8fed0
Caught exception in looking up space point ptr... 0x40a8fed0, 0x40aa46e0
Caught exception in looking up space point ptr... 0x40aa46e0, 0x40a8fed0
Caught exception in looking up space point ptr... 0x27942230, 0x2794f540
Caught exception in looking up space point ptr... 0x2794f540, 0x27945de0
Caught exception in looking up space point ptr... 0x5b352c0, 0x5b35000
Caught exception in looking up space point ptr... 0x5b35000, 0x5b34eb0
Caught exception in looking up space point ptr... 0x5b355e0, 0x5b352c0
Caught exception in looking up space point ptr... 0x80824b0, 0x5a9da300
Caught exception in looking up space point ptr... 0x5a9da300, 0x5a9da170
Caught exception in looking up space point ptr... 0x29dbfe20, 0x29dbfcf0
Caught exception in looking up space point ptr... 0x33d6b2f0, 0x29dbfe20
Caught exception in looking up space point ptr... 0x33b65150, 0x33b525a0
Caught exception in looking up space point ptr... 0x33b525a0, 0x33b53cd0
Caught exception in looking up space point ptr... 0x2686dfd0, 0x2686c7a0
Caught exception in looking up space point ptr... 0x2686c7a0, 0x2686d4f0
Caught exception in looking up space point ptr... 0x3cbfa550, 0x6aba5080
Caught exception in looking up space point ptr... 0x6aba5080, 0x6aba4d40
Caught exception in looking up space point ptr... 0x3ee5a580, 0x14c8f830
Caught exception in looking up space point ptr... 0x14c8f830, 0x80d83b0
Caught exception in looking up space point ptr... 0x5b53d50, 0x5b53920
Caught exception in looking up space point ptr... 0x5b53920, 0x5b53d50
Caught exception in looking up space point ptr... 0xe5bc920, 0xe5bcb80
Caught exception in looking up space point ptr... 0xe5bcb80, 0xe5bb850
Caught exception in looking up space point ptr... 0x40a4dbd0, 0x4114f290
Caught exception in looking up space point ptr... 0x4104a130, 0x40a4dbd0
Caught exception in looking up space point ptr... 0x5a5146a0, 0x5387a660
Caught exception in looking up space point ptr... 0x5387a660, 0x9303790
Caught exception in looking up space point ptr... 0xa8d0460, 0xa8d0330
Caught exception in looking up space point ptr... 0xa8d0330, 0xa8d0460
Caught exception in looking up space point ptr... 0x33b52690, 0x64f14390
Caught exception in looking up space point ptr... 0x64f14390, 0x33de4a00
Caught exception in looking up space point ptr... 0x27a6d850, 0x14c80700
Caught exception in looking up space point ptr... 0x14c80700, 0x27a6d850
Caught exception in looking up space point ptr... 0x5ba8cf10, 0x266c4590
Caught exception in looking up space point ptr... 0x266c4590, 0x281c86f0
Caught exception in looking up space point ptr... 0x5b4da10, 0x5b4e5e0
Caught exception in looking up space point ptr... 0x5b4e5e0, 0x5b4e090
Caught exception in looking up space point ptr... 0x57c45ac0, 0x61d6db80
Caught exception in looking up space point ptr... 0x61d6db80, 0x57c45ac0
++++>>>> total num hits: 97480, num free: 95400
04-Feb-2026 00:55:06 CET Closed output file "np02vd_raw_run042421_0083_df-s02-d0_dw_0_20260203T141553_reco_stage0_20260203T235506_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 59.2657 69.027 79.5495 70.0378 6.23944 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.298e-05 7.38393e-05 0.000162191 7.276e-05 1.90059e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.51322 4.25414 11.1827 3.90427 1.45986 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00825479 0.0127899 0.0309231 0.0103549 0.00580924 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000316971 0.000474479 0.00063511 0.00047535 7.57659e-05 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00108568 0.00148238 0.00203776 0.00149457 0.000229942 27
produce:beamevent:BeamEvent 5.665e-05 0.000100965 0.0005541 8.291e-05 8.99413e-05 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.60768 2.00722 2.32453 2.04144 0.183922 27
produce:ophit:OpHitFinder 0.0266785 0.0330342 0.0426543 0.0323344 0.00437671 27
produce:wclsdatavd:WireCellToolkit 43.5177 47.7477 54.9041 47.1524 2.92858 27
produce:gaushit:GausHitFinder 0.412467 0.742998 1.0466 0.740866 0.179742 27
produce:nhitsfilter:NumberOfHitsFilter 0.00011601 0.000179759 0.00038393 0.00016534 5.81505e-05 27
produce:reco3d:SpacePointSolver 3.92422 9.0569 14.8249 8.9705 3.17681 27
produce:hitpdune:DisambigFromSpacePoints 0.0338418 0.0854603 0.177823 0.0687403 0.0417853 27
produce:cluster3d:Cluster3D 0.56944 1.52721 2.90262 1.44521 0.668105 27
[art]:TriggerResults:TriggerResultInserter 2.338e-05 3.3157e-05 9.889e-05 2.979e-05 1.38329e-05 27
end_path:out1:RootOutput 4.22e-06 5.97889e-06 2.227e-05 5.52e-06 3.22914e-06 27
end_path:out1:RootOutput(write) 2.70854 3.53321 4.69489 3.56132 0.453347 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4689.83 MB
Peak resident set size usage (VmHWM): 2676.34 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0083_df-s02-d0_dw_0_20260203T141553_reco_stage0_20260203T235506_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0083_df-s02-d0_dw_0_20260203T141553_reco_stage0_20260203T235506_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0083_df-s02-d0_dw_0_20260203T141553_reco_stage0_20260203T235506_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161003.0,
"core.end_time": 1770162907.0,
"core.events": [
13506,
13512,
13518,
13524,
13530,
13536,
13542,
13548,
13554,
13560,
13566,
13572,
13578,
13584,
13590,
13596,
13602,
13608,
13614,
13620,
13626,
13632,
13638,
13644,
13650,
13656,
13662
],
"core.event_count": 27,
"core.first_event_number": 13506,
"core.last_event_number": 13662,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0083_df-s02-d0_dw_0_20260203T141553.hdf5"
}
]
} 