Jobsub ID 297917.137@dunegpschedd02.fnal.gov
| Jobsub ID | 297917.137@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:25 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce505 |
| Last heartbeat | 2026-02-04 00:48:17 |
| From worker node | Hostname | b9p35p0031.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:24:04 |
| Input files | vd-protodune:np02vd_raw_run042421_0007_df-s04-d0_dw_0_20260203T133442.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4873s) |
| CPU time | 1h (4760s = 97%) |
| Max RSS bytes | 12225175552 (11658 MiB) |
| Outputting started | 2026-02-04 00:45:20 |
| Output files | |
| Finished | 2026-02-04 00:48:17 |
| Saved logs | justin-logs:297917.137-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ef4120
Caught exception in looking up space point ptr... 0x29ef4120, 0x2284ad80
Caught exception in looking up space point ptr... 0x2284ad80, 0x29ef4120
Caught exception in looking up space point ptr... 0x29ef4120, 0x2284af10
Caught exception in looking up space point ptr... 0x2284af10, 0x29ef4120
Caught exception in looking up space point ptr... 0x29ef4120, 0x29ef42b0
Caught exception in looking up space point ptr... 0x118c80f60, 0x578f3670
Caught exception in looking up space point ptr... 0x578f3670, 0x578f3b10
Caught exception in looking up space point ptr... 0x5a2ddba0, 0x5645ae70
Caught exception in looking up space point ptr... 0x388c6900, 0x5a2ddba0
Caught exception in looking up space point ptr... 0xb0cde7a0, 0xb0cdeb40
Caught exception in looking up space point ptr... 0xb0cdeb40, 0xb0cde370
Caught exception in looking up space point ptr... 0xadf4a7a0, 0xadf39bf0
Caught exception in looking up space point ptr... 0xadf39bf0, 0xadf7b230
Caught exception in looking up space point ptr... 0xadf5d6b0, 0xadf47a90
Caught exception in looking up space point ptr... 0xadf47a90, 0xadf389c0
Caught exception in looking up space point ptr... 0x4a5bf0f0, 0x4a5bf590
Caught exception in looking up space point ptr... 0x4a5bf340, 0x4a5bf0f0
Caught exception in looking up space point ptr... 0x932e7cf0, 0x932b9c90
Caught exception in looking up space point ptr... 0x932b9c90, 0x932e7cf0
Caught exception in looking up space point ptr... 0x932e7cf0, 0x932e7bc0
Caught exception in looking up space point ptr... 0x932e7bc0, 0x932e7cf0
Caught exception in looking up space point ptr... 0x6d329b20, 0x6d22ffb0
Caught exception in looking up space point ptr... 0x6d22ffb0, 0x93181920
Caught exception in looking up space point ptr... 0x93181920, 0x931819c0
Caught exception in looking up space point ptr... 0x931819c0, 0x6d329b20
Caught exception in looking up space point ptr... 0x5cbb4c50, 0xac04f2b0
Caught exception in looking up space point ptr... 0xac04f2b0, 0x5cbb1bc0
Caught exception in looking up space point ptr... 0xa4881a10, 0x4c68ca90
Caught exception in looking up space point ptr... 0x4c68ca90, 0xa4881a10
Caught exception in looking up space point ptr... 0x2ed1ea00, 0xb6f366f0
Caught exception in looking up space point ptr... 0xb6f366f0, 0xac022d30
Caught exception in looking up space point ptr... 0x14bb1610, 0x3b2f9f00
Caught exception in looking up space point ptr... 0x3b2f9f00, 0xb2caacd0
Caught exception in looking up space point ptr... 0x9333cf50, 0x932b3ff0
Caught exception in looking up space point ptr... 0x932b3ff0, 0x9333cf50
Caught exception in looking up space point ptr... 0x4eaacc70, 0x4fc51d10
Caught exception in looking up space point ptr... 0x4fc51d10, 0x4eaacc70
Caught exception in looking up space point ptr... 0xb83edad0, 0x93428590
Caught exception in looking up space point ptr... 0x93428590, 0x5430aff0
Caught exception in looking up space point ptr... 0x178ede0e0, 0x178e726d0
Caught exception in looking up space point ptr... 0x178e726d0, 0x178ede0e0
Caught exception in looking up space point ptr... 0x4c7f3cd0, 0x4c7f3e60
Caught exception in looking up space point ptr... 0x4c7f3e60, 0x4c7f3ff0
Caught exception in looking up space point ptr... 0x53dc44f0, 0xae10eaa0
Caught exception in looking up space point ptr... 0xae10eaa0, 0x53dc44f0
Caught exception in looking up space point ptr... 0x53dc44f0, 0x53dd7000
Caught exception in looking up space point ptr... 0x53dd7000, 0x53dc44f0
Caught exception in looking up space point ptr... 0xa4b28d10, 0x114bba80
Caught exception in looking up space point ptr... 0x114bba80, 0xa4b28d10
Caught exception in looking up space point ptr... 0x354549f0, 0x35454860
Caught exception in looking up space point ptr... 0x29ea6d90, 0x354549f0
Caught exception in looking up space point ptr... 0x15b910fe0, 0x15ba73b60
Caught exception in looking up space point ptr... 0x15ba73b60, 0x15ba73470
Caught exception in looking up space point ptr... 0x251103a0, 0x55c2e260
Caught exception in looking up space point ptr... 0x55c2e260, 0x55c2ea50
Caught exception in looking up space point ptr... 0x11b97510, 0x11b98cc0
Caught exception in looking up space point ptr... 0x11b98cc0, 0x56bd4fa0
Caught exception in looking up space point ptr... 0x932e7960, 0x932bdcb0
Caught exception in looking up space point ptr... 0x932bdcb0, 0x932e7960
Caught exception in looking up space point ptr... 0xb2feec70, 0x1b2ed83d0
Caught exception in looking up space point ptr... 0x1b2ed83d0, 0x1b2f96ed0
Caught exception in looking up space point ptr... 0xb7286f70, 0xb7287070
Caught exception in looking up space point ptr... 0xb7287070, 0xb7286f70
Caught exception in looking up space point ptr... 0x23c865e0, 0x3c174760
Caught exception in looking up space point ptr... 0x3c174760, 0x23c865e0
++++>>>> total num hits: 2739865, num free: 2658390
04-Feb-2026 01:45:09 CET Closed output file "np02vd_raw_run042421_0007_df-s04-d0_dw_0_20260203T133442_reco_stage0_20260204T004509_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 61.1802 178.496 1002.34 67.6949 246.116 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.019e-05 7.50237e-05 0.0001968 7.165e-05 2.54326e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.59643 4.09256 5.78255 3.89349 0.528276 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00769759 0.0150641 0.0600804 0.0111236 0.0119381 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.00038234 0.000560277 0.000910651 0.000527611 0.000153372 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0011535 0.00156292 0.00224556 0.00146726 0.000307913 27
produce:beamevent:BeamEvent 6.542e-05 0.000114275 0.000812961 8.628e-05 0.000137967 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.74496 2.02938 2.36356 2.03332 0.153921 27
produce:ophit:OpHitFinder 0.0204355 0.0329711 0.0419649 0.033859 0.00459435 27
produce:wclsdatavd:WireCellToolkit 42.934 48.2356 54.8838 47.1758 3.29825 27
produce:gaushit:GausHitFinder 0.535226 2.08384 12.5432 0.710307 3.09534 27
produce:nhitsfilter:NumberOfHitsFilter 0.00012707 0.0002411 0.00079861 0.00016965 0.000153527 27
produce:reco3d:SpacePointSolver 5.1099 19.403 127.381 7.89074 27.6016 27
produce:hitpdune:DisambigFromSpacePoints 0.0406536 0.539658 3.36196 0.0721718 1.01301 27
produce:cluster3d:Cluster3D 0.602986 96.592 786.288 1.32511 209.569 27
[art]:TriggerResults:TriggerResultInserter 2.323e-05 3.74389e-05 7.606e-05 3.153e-05 1.50521e-05 27
end_path:out1:RootOutput 4.43e-06 7.23148e-06 1.766e-05 5.86e-06 3.15805e-06 27
end_path:out1:RootOutput(write) 2.76125 5.42805 19.1457 3.55129 4.29971 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 14607.6 MB
Peak resident set size usage (VmHWM): 12225.2 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0007_df-s04-d0_dw_0_20260203T133442_reco_stage0_20260204T004509_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0007_df-s04-d0_dw_0_20260203T133442_reco_stage0_20260204T004509_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0007_df-s04-d0_dw_0_20260203T133442_reco_stage0_20260204T004509_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161052.0,
"core.end_time": 1770165911.0,
"core.events": [
1144,
1150,
1156,
1162,
1168,
1174,
1180,
1186,
1192,
1198,
1204,
1210,
1216,
1222,
1228,
1234,
1240,
1246,
1252,
1258,
1264,
1270,
1276,
1282,
1288,
1294,
1300
],
"core.event_count": 27,
"core.first_event_number": 1144,
"core.last_event_number": 1300,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0007_df-s04-d0_dw_0_20260203T133442.hdf5"
}
]
} 