Jobsub ID 297916.112@dunegpschedd02.fnal.gov
| Jobsub ID | 297916.112@dunegpschedd02.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:46:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce511 |
| Last heartbeat | 2026-02-03 23:47:18 |
| From worker node | Hostname | b9p02p3983.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:53:56 |
| Input files | vd-protodune:np02vd_raw_run042422_0127_df-s04-d0_dw_0_20260203T162326.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 50m (3026s) |
| CPU time | 48m (2924s = 96%) |
| Max RSS bytes | 2711527424 (2585 MiB) |
| Outputting started | 2026-02-03 23:44:25 |
| Output files | |
| Finished | 2026-02-03 23:47:18 |
| Saved logs | justin-logs:297916.112-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Caught exception in looking up space point ptr... 0x57993900, 0x29c09bc0
Caught exception in looking up space point ptr... 0x29c09bc0, 0x29c09d50
Caught exception in looking up space point ptr... 0x108c83d0, 0x33a604b0
Caught exception in looking up space point ptr... 0x5c880b20, 0x108c83d0
Caught exception in looking up space point ptr... 0x2aff2fa0, 0x330398e0
Caught exception in looking up space point ptr... 0x330398e0, 0x547c7050
Caught exception in looking up space point ptr... 0x332c9480, 0x332b7e10
Caught exception in looking up space point ptr... 0x54de4740, 0x332c9480
Caught exception in looking up space point ptr... 0x33dcf520, 0x33dcf790
Caught exception in looking up space point ptr... 0x2cf18e20, 0x33dcf520
Caught exception in looking up space point ptr... 0x890ca00, 0x52fa6c90
Caught exception in looking up space point ptr... 0x52fa6c90, 0x343e4a50
Caught exception in looking up space point ptr... 0x4e3a6920, 0x2d649d00
Caught exception in looking up space point ptr... 0x4e394fe0, 0x4e3a6920
Caught exception in looking up space point ptr... 0x4e3a5ca0, 0x2d649080
Caught exception in looking up space point ptr... 0x4e394360, 0x4e3a5ca0
Caught exception in looking up space point ptr... 0x49e8ddb0, 0x49e8e250
Caught exception in looking up space point ptr... 0x49e8e250, 0x49e8e000
Caught exception in looking up space point ptr... 0x4e3a5020, 0x2d648400
Caught exception in looking up space point ptr... 0x4e3936e0, 0x4e3a5020
Caught exception in looking up space point ptr... 0x4e9b7560, 0x35aa5c80
Caught exception in looking up space point ptr... 0x4e9c94e0, 0x4e9b7560
Caught exception in looking up space point ptr... 0x423e6cc0, 0x423d4890
Caught exception in looking up space point ptr... 0x423d4890, 0x423e6b30
Caught exception in looking up space point ptr... 0xc9be210, 0x298a7550
Caught exception in looking up space point ptr... 0xc9be3a0, 0xc9be210
Caught exception in looking up space point ptr... 0x52635170, 0x572cf210
Caught exception in looking up space point ptr... 0x52635300, 0x52635170
Caught exception in looking up space point ptr... 0x627c7cb0, 0x298654a0
Caught exception in looking up space point ptr... 0x298654a0, 0x2985b810
Caught exception in looking up space point ptr... 0x54a3d3e0, 0x6314b240
Caught exception in looking up space point ptr... 0x616b88a0, 0x54a3d3e0
Caught exception in looking up space point ptr... 0x2a40d250, 0x2a3fd210
Caught exception in looking up space point ptr... 0x487933d0, 0x2a40d250
Caught exception in looking up space point ptr... 0x44b86b00, 0x44b83db0
Caught exception in looking up space point ptr... 0x44b83db0, 0x44b80ed0
Caught exception in looking up space point ptr... 0x502a2c00, 0x8928c20
Caught exception in looking up space point ptr... 0x8928c20, 0x5c278a70
Caught exception in looking up space point ptr... 0x629565d0, 0x62953ba0
Caught exception in looking up space point ptr... 0x62953ba0, 0x62951170
Caught exception in looking up space point ptr... 0x4e643a80, 0xd5a86c0
Caught exception in looking up space point ptr... 0xd5a86c0, 0x4e643a80
Caught exception in looking up space point ptr... 0x69811450, 0x698236f0
Caught exception in looking up space point ptr... 0x698236f0, 0x51b56b10
Caught exception in looking up space point ptr... 0x5748c0a0, 0x4c7897c0
Caught exception in looking up space point ptr... 0x4c7897c0, 0x5748bf10
Caught exception in looking up space point ptr... 0x632a4800, 0x32ee2f60
Caught exception in looking up space point ptr... 0x32ee2f60, 0x632a4800
Caught exception in looking up space point ptr... 0x312f8de0, 0x312f8b80
Caught exception in looking up space point ptr... 0x312f8b80, 0x312f8de0
Caught exception in looking up space point ptr... 0x2d692ac0, 0x2d693010
Caught exception in looking up space point ptr... 0x2d693010, 0x2d692ac0
Caught exception in looking up space point ptr... 0x2ae51250, 0x3f56a240
Caught exception in looking up space point ptr... 0x3f56a240, 0x27012b90
Caught exception in looking up space point ptr... 0x27012b90, 0x3f56a980
Caught exception in looking up space point ptr... 0x3f56a980, 0x2ae51f70
Caught exception in looking up space point ptr... 0x2ae51f70, 0x2ae51250
Caught exception in looking up space point ptr... 0x2cfab070, 0x33243bf0
Caught exception in looking up space point ptr... 0x33243bf0, 0xee639b0
Caught exception in looking up space point ptr... 0x4c8fd830, 0x3e4e5d80
Caught exception in looking up space point ptr... 0x3e4e5d80, 0x4c8fd830
Caught exception in looking up space point ptr... 0x35984570, 0x35985c40
Caught exception in looking up space point ptr... 0x35985c40, 0x35984570
Caught exception in looking up space point ptr... 0x4260f3c0, 0x4260f4c0
Caught exception in looking up space point ptr... 0x4260f4c0, 0x4260d6f0
++++>>>> total num hits: 295206, num free: 288904
04-Feb-2026 00:44:15 CET Closed output file "np02vd_raw_run042422_0127_df-s04-d0_dw_0_20260203T162326_reco_stage0_20260203T234415_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 75.2813 109.799 136.358 114.182 17.2656 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.186e-05 8.67014e-05 0.00020331 6.855e-05 3.96728e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.23104 3.93863 4.45176 3.95996 0.27409 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00952853 0.0166757 0.0617821 0.0124843 0.0113656 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.00038566 0.000493629 0.000809079 0.000468511 8.42622e-05 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00152649 0.00190402 0.00270554 0.00179526 0.000266564 27
produce:beamevent:BeamEvent 6.48e-05 0.000125775 0.0010485 8.236e-05 0.000182557 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.99597 2.72087 3.24664 2.7333 0.303426 27
produce:ophit:OpHitFinder 0.0211206 0.0336648 0.0421329 0.0347389 0.00575365 27
produce:wclsdatavd:WireCellToolkit 56.5139 63.1575 73.6384 62.6828 3.84601 27
produce:gaushit:GausHitFinder 0.771242 1.19855 2.10117 1.12608 0.293515 27
produce:nhitsfilter:NumberOfHitsFilter 0.00019083 0.000275478 0.00050041 0.000254691 7.40423e-05 27
produce:reco3d:SpacePointSolver 3.55819 8.55155 14.6452 8.44206 3.19549 27
produce:hitpdune:DisambigFromSpacePoints 0.0620718 0.176585 0.354694 0.171189 0.078855 27
produce:cluster3d:Cluster3D 1.1166 25.6049 40.9984 31.9616 14.3307 27
[art]:TriggerResults:TriggerResultInserter 2.122e-05 3.30334e-05 9.454e-05 2.773e-05 1.53632e-05 27
end_path:out1:RootOutput 3.26e-06 6.53226e-06 2.829e-05 5.76e-06 4.60862e-06 27
end_path:out1:RootOutput(write) 3.26024 4.37514 5.65372 4.37301 0.564024 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4691.64 MB
Peak resident set size usage (VmHWM): 2711.53 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0127_df-s04-d0_dw_0_20260203T162326_reco_stage0_20260203T234415_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0127_df-s04-d0_dw_0_20260203T162326_reco_stage0_20260203T234415_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0127_df-s04-d0_dw_0_20260203T162326_reco_stage0_20260203T234415_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770159249.0,
"core.end_time": 1770162257.0,
"core.events": [
20596,
20602,
20608,
20614,
20620,
20626,
20632,
20638,
20644,
20650,
20656,
20662,
20668,
20674,
20680,
20686,
20692,
20698,
20704,
20710,
20716,
20722,
20728,
20734,
20740,
20746,
20752
],
"core.event_count": 27,
"core.first_event_number": 20596,
"core.last_event_number": 20752,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0127_df-s04-d0_dw_0_20260203T162326.hdf5"
}
]
} 