Jobsub ID 297916.90@dunegpschedd02.fnal.gov
| Jobsub ID | 297916.90@dunegpschedd02.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:46:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce505 |
| Last heartbeat | 2026-02-03 23:22:44 |
| From worker node | Hostname | b9p35p0031.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:48:26 |
| Input files | vd-protodune:np02vd_raw_run042422_0099_df-s02-d0_dw_0_20260203T160817.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 32m (1934s) |
| CPU time | 30m (1859s = 96%) |
| Max RSS bytes | 2642161664 (2519 MiB) |
| Outputting started | 2026-02-03 23:20:41 |
| Output files | |
| Finished | 2026-02-03 23:22:44 |
| Saved logs | justin-logs:297916.90-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
10
Caught exception in looking up space point ptr... 0x3d90b760, 0x3d90baf0
Caught exception in looking up space point ptr... 0x3d90baf0, 0x3d90b760
Caught exception in looking up space point ptr... 0x4262d590, 0x42617d40
Caught exception in looking up space point ptr... 0x42617d40, 0x4262e570
Caught exception in looking up space point ptr... 0x3a7fef70, 0x3a800b00
Caught exception in looking up space point ptr... 0x3a7efee0, 0x3a801000
Caught exception in looking up space point ptr... 0x3a801000, 0x3a7fce00
Caught exception in looking up space point ptr... 0x3a7fce00, 0x3a7fef70
Caught exception in looking up space point ptr... 0x479698d0, 0x47969e90
Caught exception in looking up space point ptr... 0x479575e0, 0x479698d0
Caught exception in looking up space point ptr... 0x30cfd0f0, 0x30cf8280
Caught exception in looking up space point ptr... 0x30cf8280, 0x30cfcfc0
Caught exception in looking up space point ptr... 0x5e964070, 0x5e964b40
Caught exception in looking up space point ptr... 0x5e964b40, 0x5e964070
Caught exception in looking up space point ptr... 0x388bd990, 0x388bdac0
Caught exception in looking up space point ptr... 0x388bdac0, 0x388bd990
Caught exception in looking up space point ptr... 0x4c56d650, 0x4c56d8e0
Caught exception in looking up space point ptr... 0x4c56d8e0, 0x4c56d650
Caught exception in looking up space point ptr... 0xf4b8040, 0xf4b7d20
Caught exception in looking up space point ptr... 0xf4b7d20, 0xf4b8040
Caught exception in looking up space point ptr... 0x3cb11260, 0x3cb11130
Caught exception in looking up space point ptr... 0x3cb11130, 0x3cb11260
Caught exception in looking up space point ptr... 0x3d9035c0, 0x3d903360
Caught exception in looking up space point ptr... 0x3d903360, 0x3d903060
Caught exception in looking up space point ptr... 0x36127cd0, 0x45ec46a0
Caught exception in looking up space point ptr... 0x45ec46a0, 0x3611cee0
Caught exception in looking up space point ptr... 0x3611cee0, 0x3612b610
Caught exception in looking up space point ptr... 0x3612b610, 0x36127cd0
Caught exception in looking up space point ptr... 0x4f6fd050, 0x4f6fd370
Caught exception in looking up space point ptr... 0x4f6fd370, 0x4f6fd500
Caught exception in looking up space point ptr... 0x5d67b300, 0x5d67bf70
Caught exception in looking up space point ptr... 0x5d67bf70, 0x5d6788d0
Caught exception in looking up space point ptr... 0x1a68ec60, 0x1a691c20
Caught exception in looking up space point ptr... 0x1a691c20, 0x1a68c160
Caught exception in looking up space point ptr... 0x1246bdb0, 0x1246bed0
Caught exception in looking up space point ptr... 0x1246bed0, 0x1246bdb0
Caught exception in looking up space point ptr... 0x384a0090, 0x384a03b0
Caught exception in looking up space point ptr... 0x384a03b0, 0x384a0090
Caught exception in looking up space point ptr... 0x4af04c80, 0x30668470
Caught exception in looking up space point ptr... 0x30668470, 0x12538a90
Caught exception in looking up space point ptr... 0x386ff980, 0x1467c6b0
Caught exception in looking up space point ptr... 0x1467c6b0, 0x386ff980
Caught exception in looking up space point ptr... 0x41ccfa60, 0x41ccf930
Caught exception in looking up space point ptr... 0x41ccf930, 0x41ccbc70
Caught exception in looking up space point ptr... 0x2a81bf90, 0x2a813010
Caught exception in looking up space point ptr... 0x2a813010, 0x2a81bf90
Caught exception in looking up space point ptr... 0x2a81bf90, 0x2a819b70
Caught exception in looking up space point ptr... 0x2a819b70, 0x2a81bf90
Caught exception in looking up space point ptr... 0x2a81bf90, 0x2a81be20
Caught exception in looking up space point ptr... 0x2a81be20, 0x2a81bf90
Caught exception in looking up space point ptr... 0x5d212b20, 0xe3b8270
Caught exception in looking up space point ptr... 0xe3b8270, 0x5d212b20
Caught exception in looking up space point ptr... 0x5d212b20, 0xe3b1120
Caught exception in looking up space point ptr... 0xe3b1120, 0x5d212b20
Caught exception in looking up space point ptr... 0x4f06b850, 0x44cc2700
Caught exception in looking up space point ptr... 0x44cc2700, 0x4f06b850
Caught exception in looking up space point ptr... 0x4ca3b640, 0x423d8460
Caught exception in looking up space point ptr... 0x423d8460, 0x4ca3b640
Caught exception in looking up space point ptr... 0x3c47e2b0, 0x3c47e3f0
Caught exception in looking up space point ptr... 0x3c47e3f0, 0x3c47e4e0
Caught exception in looking up space point ptr... 0x5b42b8b0, 0x5b42b990
Caught exception in looking up space point ptr... 0x5b42b990, 0x5b42ba70
Caught exception in looking up space point ptr... 0x5b42ba70, 0x5b42e070
Caught exception in looking up space point ptr... 0x30cb6dd0, 0x30cb6ae0
Caught exception in looking up space point ptr... 0x30cb6ae0, 0x30cb6dd0
++++>>>> total num hits: 91940, num free: 87781
04-Feb-2026 00:20:35 CET Closed output file "np02vd_raw_run042422_0099_df-s02-d0_dw_0_20260203T160817_reco_stage0_20260203T232035_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 63.8714 69.3568 78.9617 68.0131 3.93674 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.365e-05 7.56911e-05 0.00023042 7.031e-05 3.09695e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.25975 4.09824 4.79675 4.11485 0.317273 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00896892 0.0161109 0.0559926 0.0116449 0.0109103 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.00036121 0.000567388 0.00086687 0.00054757 0.000143745 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00132518 0.00176518 0.00267373 0.0016799 0.000361857 27
produce:beamevent:BeamEvent 6.369e-05 0.000113441 0.00088169 8.156e-05 0.000151388 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.69886 2.0744 2.40011 2.06737 0.165267 27
produce:ophit:OpHitFinder 0.0263219 0.0363698 0.0436421 0.0375226 0.00481664 27
produce:wclsdatavd:WireCellToolkit 44.5012 48.1433 54.3377 47.9192 2.2838 27
produce:gaushit:GausHitFinder 0.370033 0.733865 1.17139 0.750279 0.154018 27
produce:nhitsfilter:NumberOfHitsFilter 0.00013402 0.000201344 0.00054599 0.00018679 7.45503e-05 27
produce:reco3d:SpacePointSolver 5.19134 9.23194 13.9628 9.34134 1.90369 27
produce:hitpdune:DisambigFromSpacePoints 0.0410184 0.0777544 0.132061 0.0734868 0.0207107 27
produce:cluster3d:Cluster3D 0.579693 1.35304 2.81598 1.33493 0.504795 27
[art]:TriggerResults:TriggerResultInserter 2.422e-05 3.28774e-05 7.217e-05 2.976e-05 1.00382e-05 27
end_path:out1:RootOutput 4.63e-06 5.82889e-06 1.725e-05 5.44e-06 2.28528e-06 27
end_path:out1:RootOutput(write) 2.92914 3.56099 4.22538 3.55468 0.330162 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4620.2 MB
Peak resident set size usage (VmHWM): 2642.16 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0099_df-s02-d0_dw_0_20260203T160817_reco_stage0_20260203T232035_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0099_df-s02-d0_dw_0_20260203T160817_reco_stage0_20260203T232035_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0099_df-s02-d0_dw_0_20260203T160817_reco_stage0_20260203T232035_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770158914.0,
"core.end_time": 1770160836.0,
"core.events": [
16056,
16062,
16068,
16074,
16080,
16086,
16092,
16098,
16104,
16110,
16116,
16122,
16128,
16134,
16140,
16146,
16152,
16158,
16164,
16170,
16176,
16182,
16188,
16194,
16200,
16206,
16212
],
"core.event_count": 27,
"core.first_event_number": 16056,
"core.last_event_number": 16212,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0099_df-s02-d0_dw_0_20260203T160817.hdf5"
}
]
} 