Jobsub ID 303653.34@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.34@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce510 |
| Last heartbeat | 2026-02-04 00:24:54 |
| From worker node | Hostname | b9p09p3861.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:39:40 |
| Input files | vd-protodune:np02vd_raw_run042421_0136_df-s02-d1_dw_0_20260203T144431.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 42m (2546s) |
| CPU time | 40m (2455s = 96%) |
| Max RSS bytes | 2784227328 (2655 MiB) |
| Outputting started | 2026-02-04 00:22:07 |
| Output files | |
| Finished | 2026-02-04 00:24:54 |
| Saved logs | justin-logs:303653.34-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
80
Caught exception in looking up space point ptr... 0xb7f6240, 0x3150d3e0
Caught exception in looking up space point ptr... 0x3150d3e0, 0x59505580
Caught exception in looking up space point ptr... 0x54cb7890, 0x8c09080
Caught exception in looking up space point ptr... 0x8c09080, 0x54cb7890
Caught exception in looking up space point ptr... 0x26e6d370, 0x26e6d220
Caught exception in looking up space point ptr... 0x26e6d220, 0x26e6d370
Caught exception in looking up space point ptr... 0x3ea354c0, 0x516ca550
Caught exception in looking up space point ptr... 0x516ca550, 0x3ea354c0
Caught exception in looking up space point ptr... 0x31fb8e70, 0x31fb8d40
Caught exception in looking up space point ptr... 0x31fb8d40, 0x31fb8e70
Caught exception in looking up space point ptr... 0x432f9890, 0x3ee5e790
Caught exception in looking up space point ptr... 0x3ee5da70, 0x432f9890
Caught exception in looking up space point ptr... 0x47298d50, 0x47298c20
Caught exception in looking up space point ptr... 0x47298c20, 0x47298d50
Caught exception in looking up space point ptr... 0x47298d50, 0x472981a0
Caught exception in looking up space point ptr... 0x472981a0, 0x47298d50
Caught exception in looking up space point ptr... 0x60f4fea0, 0xda4dd70
Caught exception in looking up space point ptr... 0xda4dd70, 0x37674b10
Caught exception in looking up space point ptr... 0x37063fa0, 0x56f605f0
Caught exception in looking up space point ptr... 0x16640b50, 0x158b9ca0
Caught exception in looking up space point ptr... 0x158b9ca0, 0x39b08120
Caught exception in looking up space point ptr... 0x5c70ffe0, 0x37063fa0
Caught exception in looking up space point ptr... 0x4289df90, 0x4289de00
Caught exception in looking up space point ptr... 0x4289de00, 0x52c90070
Caught exception in looking up space point ptr... 0x2d7cf5f0, 0x16c004c0
Caught exception in looking up space point ptr... 0x16c004c0, 0x16c00340
Caught exception in looking up space point ptr... 0x31fc13a0, 0x31fc1860
Caught exception in looking up space point ptr... 0x31fc1860, 0x31fb6c20
Caught exception in looking up space point ptr... 0x2d7ccef0, 0x2d7cbc20
Caught exception in looking up space point ptr... 0x2d7cbc20, 0x2d7ccef0
Caught exception in looking up space point ptr... 0x4aecc640, 0xe98a4f0
Caught exception in looking up space point ptr... 0xe98a4f0, 0x4aecc320
Caught exception in looking up space point ptr... 0x4aecc320, 0xe98a310
Caught exception in looking up space point ptr... 0x43265bb0, 0x3a1d54b0
Caught exception in looking up space point ptr... 0x3a1d54b0, 0x43265bb0
Caught exception in looking up space point ptr... 0x517206d0, 0x51720860
Caught exception in looking up space point ptr... 0x51720860, 0x517209f0
Caught exception in looking up space point ptr... 0x4a0ea640, 0x4a0ea7e0
Caught exception in looking up space point ptr... 0x4a0ea910, 0x4a0ea640
Caught exception in looking up space point ptr... 0x37414980, 0x37414880
Caught exception in looking up space point ptr... 0x37414880, 0x2bb65d20
Caught exception in looking up space point ptr... 0x4d3ef3f0, 0x4d3ef4c0
Caught exception in looking up space point ptr... 0x4d3ef4c0, 0x4d3ef3f0
Caught exception in looking up space point ptr... 0x117237c0, 0x393408c0
Caught exception in looking up space point ptr... 0x393408c0, 0x117237c0
Caught exception in looking up space point ptr... 0x5308ecc0, 0x5308cbf0
Caught exception in looking up space point ptr... 0x5308cbf0, 0x5308ecc0
Caught exception in looking up space point ptr... 0x50446890, 0x5ff3a180
Caught exception in looking up space point ptr... 0x5ff3a180, 0x2bb351d0
Caught exception in looking up space point ptr... 0x31fbb090, 0x31fbaf60
Caught exception in looking up space point ptr... 0x31fbaf60, 0x31fbb090
Caught exception in looking up space point ptr... 0x3c7acfd0, 0x3352ff70
Caught exception in looking up space point ptr... 0x15890670, 0x3c7acfd0
Caught exception in looking up space point ptr... 0x26e7b0b0, 0x28e860e0
Caught exception in looking up space point ptr... 0x28e860e0, 0x26e597c0
Caught exception in looking up space point ptr... 0x3b5fe1c0, 0x5ca72150
Caught exception in looking up space point ptr... 0x5ca72150, 0x3b5fe1c0
Caught exception in looking up space point ptr... 0x335ceab0, 0x16641110
Caught exception in looking up space point ptr... 0x335cec70, 0x335ceab0
Caught exception in looking up space point ptr... 0x109eaca0, 0x109eb110
Caught exception in looking up space point ptr... 0x109eb110, 0x441dae20
Caught exception in looking up space point ptr... 0x5c508c10, 0x515b7b50
Caught exception in looking up space point ptr... 0x515b7b50, 0x88f2ac0
Caught exception in looking up space point ptr... 0x26e6f1d0, 0x26e6f080
Caught exception in looking up space point ptr... 0x26e6f080, 0x26e6ef30
++++>>>> total num hits: 84455, num free: 81145
04-Feb-2026 01:21:59 CET Closed output file "np02vd_raw_run042421_0136_df-s02-d1_dw_0_20260203T144431_reco_stage0_20260204T002159_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 77.182 91.8989 114.598 86.9503 11.343 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.9271e-05 8.67273e-05 0.000185583 7.3831e-05 3.53825e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.68165 4.26805 8.10783 4.08878 0.804175 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.0113717 0.0191448 0.0570903 0.0149858 0.0097125 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000440227 0.00205001 0.0148718 0.000619959 0.00372968 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00165708 0.00205543 0.00287115 0.00195536 0.000285569 27
produce:beamevent:BeamEvent 6.1111e-05 0.000121336 0.000863514 8.3611e-05 0.000148272 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.24949 2.87317 3.62894 2.84854 0.317948 27
produce:ophit:OpHitFinder 0.0242263 0.0375251 0.0457342 0.0372458 0.00439146 27
produce:wclsdatavd:WireCellToolkit 52.3397 60.206 73.0966 59.4005 6.03405 27
produce:gaushit:GausHitFinder 0.497166 1.07153 2.18742 0.978153 0.363298 27
produce:nhitsfilter:NumberOfHitsFilter 0.000212614 0.000285024 0.000502628 0.000278054 6.22419e-05 27
produce:reco3d:SpacePointSolver 7.42323 12.8813 21.1956 12.8916 3.12984 27
produce:hitpdune:DisambigFromSpacePoints 0.0555964 0.132848 0.338313 0.110675 0.0637283 27
produce:cluster3d:Cluster3D 0.761421 6.49247 35.3619 1.82786 9.77715 27
[art]:TriggerResults:TriggerResultInserter 2.104e-05 3.30437e-05 9.9301e-05 3.077e-05 1.3878e-05 27
end_path:out1:RootOutput 3.87e-06 7.84933e-06 3.4611e-05 7.16e-06 5.58442e-06 27
end_path:out1:RootOutput(write) 2.83793 3.89246 5.62029 3.62977 0.77327 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4777.89 MB
Peak resident set size usage (VmHWM): 2784.23 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0136_df-s02-d1_dw_0_20260203T144431_reco_stage0_20260204T002159_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0136_df-s02-d1_dw_0_20260203T144431_reco_stage0_20260204T002159_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0136_df-s02-d1_dw_0_20260203T144431_reco_stage0_20260204T002159_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161993.0,
"core.end_time": 1770164521.0,
"core.events": [
22093,
22099,
22105,
22111,
22117,
22123,
22129,
22135,
22141,
22147,
22153,
22159,
22165,
22171,
22177,
22183,
22189,
22195,
22201,
22207,
22213,
22219,
22225,
22231,
22237,
22243,
22249
],
"core.event_count": 27,
"core.first_event_number": 22093,
"core.last_event_number": 22249,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0136_df-s02-d1_dw_0_20260203T144431.hdf5"
}
]
} 