Jobsub ID 303653.28@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.28@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce510 |
| Last heartbeat | 2026-02-04 00:12:41 |
| From worker node | Hostname | b9p34p1010.cern.ch |
| cpuinfo | AMD EPYC 9655 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:38:09 |
| Input files | vd-protodune:np02vd_raw_run042421_0121_df-s02-d0_dw_0_20260203T143628.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 32m (1940s) |
| CPU time | 30m (1859s = 95%) |
| Max RSS bytes | 2569805824 (2450 MiB) |
| Outputting started | 2026-02-04 00:10:31 |
| Output files | |
| Finished | 2026-02-04 00:12:41 |
| Saved logs | justin-logs:303653.28-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
4cd14c0
Caught exception in looking up space point ptr... 0x14cd14c0, 0x4fb66c30
Caught exception in looking up space point ptr... 0x9de0d60, 0x9de0b00
Caught exception in looking up space point ptr... 0x9de0b00, 0x9de0960
Caught exception in looking up space point ptr... 0x6bdef290, 0x42c4a830
Caught exception in looking up space point ptr... 0x6bdeeb20, 0x6bdef290
Caught exception in looking up space point ptr... 0x30c0d800, 0x2caba240
Caught exception in looking up space point ptr... 0x2caba240, 0x30c0d800
Caught exception in looking up space point ptr... 0x2bfa1840, 0x2b903110
Caught exception in looking up space point ptr... 0x2b903110, 0x2bfa1840
Caught exception in looking up space point ptr... 0x32c56700, 0x58fcbaf0
Caught exception in looking up space point ptr... 0x58fcbaf0, 0x32c56700
Caught exception in looking up space point ptr... 0x32c56700, 0x317c8ff0
Caught exception in looking up space point ptr... 0x317c8ff0, 0x32c56700
Caught exception in looking up space point ptr... 0x32c56700, 0x4c5d2470
Caught exception in looking up space point ptr... 0x4c5d2470, 0x32c56700
Caught exception in looking up space point ptr... 0x2fde7d00, 0x2fde8020
Caught exception in looking up space point ptr... 0x2fde8020, 0x2fde7d00
Caught exception in looking up space point ptr... 0xfe9e350, 0xfe9e670
Caught exception in looking up space point ptr... 0xfe9e670, 0xfe9e4e0
Caught exception in looking up space point ptr... 0x6bdf6f20, 0x6bdf6e20
Caught exception in looking up space point ptr... 0x6bdf6e20, 0x6bde5d30
Caught exception in looking up space point ptr... 0x569bdd80, 0x569bda50
Caught exception in looking up space point ptr... 0x569bda50, 0x569bd950
Caught exception in looking up space point ptr... 0x9e046b0, 0x9df80f0
Caught exception in looking up space point ptr... 0x9df80f0, 0x9df8380
Caught exception in looking up space point ptr... 0x56a0c250, 0x46e69dd0
Caught exception in looking up space point ptr... 0x46e69dd0, 0x4769c430
Caught exception in looking up space point ptr... 0x2b7fe850, 0x4d111000
Caught exception in looking up space point ptr... 0x4d111000, 0x36766f10
Caught exception in looking up space point ptr... 0x15f8f200, 0x4d067bb0
Caught exception in looking up space point ptr... 0x4d067bb0, 0x15f8eee0
Caught exception in looking up space point ptr... 0x64cff040, 0x481de270
Caught exception in looking up space point ptr... 0x481de270, 0x64cff040
Caught exception in looking up space point ptr... 0x64cff040, 0x43181c30
Caught exception in looking up space point ptr... 0x43181c30, 0x64cff040
Caught exception in looking up space point ptr... 0x34109fe0, 0x38350c20
Caught exception in looking up space point ptr... 0x38350c20, 0x4d409480
Caught exception in looking up space point ptr... 0x6b64b640, 0x6b64b3e0
Caught exception in looking up space point ptr... 0x6b64b3e0, 0x6b64b510
Caught exception in looking up space point ptr... 0x4eb08cd0, 0x4eb08af0
Caught exception in looking up space point ptr... 0x4eb08af0, 0x4eb08c30
Caught exception in looking up space point ptr... 0x30e23500, 0x316e78c0
Caught exception in looking up space point ptr... 0x316e78c0, 0x2c91fb60
Caught exception in looking up space point ptr... 0x33cf9720, 0x33cf99c0
Caught exception in looking up space point ptr... 0x33cf99c0, 0x33cf9720
Caught exception in looking up space point ptr... 0x4c47e400, 0x4c47e1a0
Caught exception in looking up space point ptr... 0x4c47e1a0, 0x4c47e400
Caught exception in looking up space point ptr... 0x3ef574f0, 0x42f8a870
Caught exception in looking up space point ptr... 0x42f8a870, 0x3ef574f0
Caught exception in looking up space point ptr... 0x9889ec0, 0x3d829960
Caught exception in looking up space point ptr... 0x3d829960, 0x9889ec0
Caught exception in looking up space point ptr... 0x5f2d5910, 0x4b5c6aa0
Caught exception in looking up space point ptr... 0x4b5c6aa0, 0x5f2d5910
Caught exception in looking up space point ptr... 0x157cd350, 0x354044d0
Caught exception in looking up space point ptr... 0x354044d0, 0x157cd350
Caught exception in looking up space point ptr... 0x42db07a0, 0x24ef4570
Caught exception in looking up space point ptr... 0x24ef4570, 0x42db07a0
Caught exception in looking up space point ptr... 0x17c1d550, 0x2e2de580
Caught exception in looking up space point ptr... 0x2e2de580, 0x3843d620
Caught exception in looking up space point ptr... 0x4eafc270, 0x4eafc3b0
Caught exception in looking up space point ptr... 0x4eafc3b0, 0x4eafc450
Caught exception in looking up space point ptr... 0x2e685460, 0x42f8af80
Caught exception in looking up space point ptr... 0x42f8af80, 0x2aa9b980
Caught exception in looking up space point ptr... 0x10c9c100, 0x10c9b860
Caught exception in looking up space point ptr... 0x10c9b860, 0x10c9c100
++++>>>> total num hits: 66060, num free: 63293
04-Feb-2026 01:10:23 CET Closed output file "np02vd_raw_run042421_0121_df-s02-d0_dw_0_20260203T143628_reco_stage0_20260204T001023_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 60.5731 69.754 83.2924 69.1262 4.5826 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.3154e-05 9.03669e-05 0.000256201 8.2102e-05 3.56959e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.56201 4.32987 14.1015 4.00041 1.92566 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00896878 0.0203825 0.18106 0.0110423 0.0325283 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000416471 0.00118805 0.0170335 0.000541747 0.00311047 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00144597 0.0017836 0.00263238 0.00171602 0.000292415 27
produce:beamevent:BeamEvent 7.8757e-05 0.000150762 0.00102857 0.000112628 0.000173678 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.71417 2.13522 2.64344 2.17123 0.173572 27
produce:ophit:OpHitFinder 0.0246702 0.035118 0.0411152 0.0362914 0.00405138 27
produce:wclsdatavd:WireCellToolkit 45.013 49.1206 55.4698 48.4379 2.50477 27
produce:gaushit:GausHitFinder 0.398279 0.720463 1.30396 0.694665 0.215433 27
produce:nhitsfilter:NumberOfHitsFilter 0.000118186 0.000209244 0.00049701 0.000197163 6.63371e-05 27
produce:reco3d:SpacePointSolver 4.08786 8.63444 13.4144 8.73285 2.37829 27
produce:hitpdune:DisambigFromSpacePoints 0.047432 0.0797758 0.151918 0.0706289 0.0265976 27
produce:cluster3d:Cluster3D 0.550442 1.31115 2.27198 1.27176 0.466797 27
[art]:TriggerResults:TriggerResultInserter 2.7211e-05 4.174e-05 0.000110865 3.6855e-05 1.63399e-05 27
end_path:out1:RootOutput 5.438e-06 1.04407e-05 2.9544e-05 9.635e-06 4.96931e-06 27
end_path:out1:RootOutput(write) 2.89745 3.3331 4.46139 3.33944 0.365197 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4732.05 MB
Peak resident set size usage (VmHWM): 2569.81 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0121_df-s02-d0_dw_0_20260203T143628_reco_stage0_20260204T001023_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0121_df-s02-d0_dw_0_20260203T143628_reco_stage0_20260204T001023_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0121_df-s02-d0_dw_0_20260203T143628_reco_stage0_20260204T001023_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161899.0,
"core.end_time": 1770163825.0,
"core.events": [
19668,
19674,
19680,
19686,
19692,
19698,
19704,
19710,
19716,
19722,
19728,
19734,
19740,
19746,
19752,
19758,
19764,
19770,
19776,
19782,
19788,
19794,
19800,
19806,
19812,
19818,
19824
],
"core.event_count": 27,
"core.first_event_number": 19668,
"core.last_event_number": 19824,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0121_df-s02-d0_dw_0_20260203T143628.hdf5"
}
]
} 