Jobsub ID 303653.29@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.29@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce15-multicore |
| Last heartbeat | 2026-02-04 00:32:29 |
| From worker node | Hostname | tdm003.pic.es |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:38:00 |
| Input files | vd-protodune:np02vd_raw_run042421_0015_df-s03-d1_dw_0_20260203T133906.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 52m (3175s) |
| CPU time | 43m (2617s = 82%) |
| Max RSS bytes | 2776899584 (2648 MiB) |
| Outputting started | 2026-02-04 00:30:57 |
| Output files | |
| Finished | 2026-02-04 00:32:29 |
| Saved logs | justin-logs:303653.29-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
x150f61f0, 0x150f6030
Caught exception in looking up space point ptr... 0x150f6030, 0x150f6390
Caught exception in looking up space point ptr... 0x150f6390, 0x2d58b7c0
Caught exception in looking up space point ptr... 0x2d58b7c0, 0x2d58bac0
Caught exception in looking up space point ptr... 0xae97170, 0xae96e50
Caught exception in looking up space point ptr... 0xae96e50, 0x3e2ebfb0
Caught exception in looking up space point ptr... 0x3e2ec320, 0xae97170
Caught exception in looking up space point ptr... 0x115afc60, 0x2f84e400
Caught exception in looking up space point ptr... 0x11f3a0a0, 0x2933ecd0
Caught exception in looking up space point ptr... 0x2933ecd0, 0x115afc60
Caught exception in looking up space point ptr... 0x4013d4b0, 0x3e08aca0
Caught exception in looking up space point ptr... 0x3e08aca0, 0x409a81e0
Caught exception in looking up space point ptr... 0x4b4cac50, 0x45faf420
Caught exception in looking up space point ptr... 0x45faf420, 0x4b4cac50
Caught exception in looking up space point ptr... 0x524c2aa0, 0x524c2950
Caught exception in looking up space point ptr... 0x524c2950, 0x524c2aa0
Caught exception in looking up space point ptr... 0x37bd46e0, 0x37bd4550
Caught exception in looking up space point ptr... 0x37bd4550, 0x37bd46e0
Caught exception in looking up space point ptr... 0x3e31dd30, 0x12c8af80
Caught exception in looking up space point ptr... 0x12c8af80, 0x367e2720
Caught exception in looking up space point ptr... 0x2ee981e0, 0x2b3f65d0
Caught exception in looking up space point ptr... 0x2b3f65d0, 0xad56220
Caught exception in looking up space point ptr... 0x5d8378f0, 0x4a87b2e0
Caught exception in looking up space point ptr... 0x4a87b2e0, 0x5d8378f0
Caught exception in looking up space point ptr... 0x44e05c60, 0x44e04ef0
Caught exception in looking up space point ptr... 0x44e04ef0, 0x44e05c60
Caught exception in looking up space point ptr... 0x14996b60, 0x2d378d20
Caught exception in looking up space point ptr... 0x2d378d20, 0x14996b60
Caught exception in looking up space point ptr... 0x2ac7e1a0, 0x2ac7dcf0
Caught exception in looking up space point ptr... 0x2ac7dcf0, 0x2ac7e1a0
Caught exception in looking up space point ptr... 0x2ac7e1a0, 0x2ac7de80
Caught exception in looking up space point ptr... 0x2ac7de80, 0x2ac7e1a0
Caught exception in looking up space point ptr... 0x18b8e3e0, 0x18b8e140
Caught exception in looking up space point ptr... 0x18b8e140, 0x18b8e3e0
Caught exception in looking up space point ptr... 0x4f2fb200, 0x31beef30
Caught exception in looking up space point ptr... 0x31beef30, 0x5583a2b0
Caught exception in looking up space point ptr... 0x3b883aa0, 0x2ecc89e0
Caught exception in looking up space point ptr... 0x2ecc89e0, 0x446efba0
Caught exception in looking up space point ptr... 0xcfb4740, 0xcfb3740
Caught exception in looking up space point ptr... 0x5c43a110, 0xcfb4740
Caught exception in looking up space point ptr... 0x40810ff0, 0x40811190
Caught exception in looking up space point ptr... 0x40811190, 0x2d61d440
Caught exception in looking up space point ptr... 0x2a544b50, 0x5dcea950
Caught exception in looking up space point ptr... 0x5dcea950, 0x2a544b50
Caught exception in looking up space point ptr... 0x18b8da10, 0x420c70d0
Caught exception in looking up space point ptr... 0x420c70d0, 0x18b8da10
Caught exception in looking up space point ptr... 0x3aae8bb0, 0xcfedd20
Caught exception in looking up space point ptr... 0xcfedd20, 0x3aae8bb0
Caught exception in looking up space point ptr... 0x1bbbc300, 0x19b5c9a0
Caught exception in looking up space point ptr... 0x19b5c9a0, 0x1bbbc300
Caught exception in looking up space point ptr... 0x4dc895d0, 0x18e97fe0
Caught exception in looking up space point ptr... 0x18e97fe0, 0x18e98420
Caught exception in looking up space point ptr... 0x15ca14d0, 0x2993cec0
Caught exception in looking up space point ptr... 0x2993cec0, 0x6645ab10
Caught exception in looking up space point ptr... 0x44053e00, 0x5b4475f0
Caught exception in looking up space point ptr... 0x5b4475f0, 0x31318890
Caught exception in looking up space point ptr... 0x3e3e02e0, 0x44e043e0
Caught exception in looking up space point ptr... 0x44e043e0, 0x3e3e02e0
Caught exception in looking up space point ptr... 0x5c6554f0, 0x523cd9a0
Caught exception in looking up space point ptr... 0x523cd9a0, 0x5c6554f0
Caught exception in looking up space point ptr... 0x36555e30, 0x36555be0
Caught exception in looking up space point ptr... 0x3b8ef460, 0x36555e30
Caught exception in looking up space point ptr... 0x5d78f600, 0x317c8050
Caught exception in looking up space point ptr... 0x317c8050, 0x5d78f600
Caught exception in looking up space point ptr... 0x152ced10, 0x142eee50
Caught exception in looking up space point ptr... 0x142eee50, 0x152ced10
++++>>>> total num hits: 32765, num free: 31512
04-Feb-2026 01:30:50 CET Closed output file "np02vd_raw_run042421_0015_df-s03-d1_dw_0_20260203T133906_reco_stage0_20260204T003050_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 97.0838 110.145 128.598 109.647 7.47997 28
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.3451e-05 0.000128208 0.000289425 0.000110792 5.17892e-05 28
produce:tpcrawdecoder:PDVDTPCReader 16.4128 18.5312 22.6388 17.5325 1.91059 28
produce:triggerrawdecoder:PDVDTriggerReader4 0.888993 0.940381 1.02633 0.936209 0.0348226 28
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0294075 0.0335172 0.0619384 0.0301629 0.00759154 28
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.146523 0.155799 0.17941 0.148697 0.013184 28
produce:beamevent:BeamEvent 6.0861e-05 0.000172176 0.00101272 0.000131442 0.000168532 28
produce:pdvddaphne:DAPHNEReaderPDVD 3.26871 3.63464 3.95687 3.64691 0.200935 28
produce:ophit:OpHitFinder 0.0282414 0.0365504 0.0482449 0.0358436 0.00468938 28
produce:wclsdatavd:WireCellToolkit 61.6537 67.4662 76.7862 66.3161 3.83467 28
produce:gaushit:GausHitFinder 0.71327 2.19263 7.69923 1.09099 2.38081 28
produce:nhitsfilter:NumberOfHitsFilter 0.000218364 0.000683872 0.00290292 0.000424932 0.000617614 28
produce:reco3d:SpacePointSolver 6.11583 13.06 20.3092 13.1632 4.01289 23
produce:hitpdune:DisambigFromSpacePoints 0.0639269 0.125443 0.237974 0.117576 0.0425678 23
produce:cluster3d:Cluster3D 0.789427 2.55072 9.66612 2.00705 1.81456 23
[art]:TriggerResults:TriggerResultInserter 2.31e-05 4.22007e-05 0.000107072 3.23105e-05 2.01527e-05 28
end_path:out1:RootOutput 4.01e-06 1.02137e-05 4.0961e-05 6.835e-06 9.01738e-06 28
end_path:out1:RootOutput(write) 3.56394 4.19086 5.5357 3.98586 0.519917 28
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4751.77 MB
Peak resident set size usage (VmHWM): 2776.9 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0015_df-s03-d1_dw_0_20260203T133906_reco_stage0_20260204T003050_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0015_df-s03-d1_dw_0_20260203T133906_reco_stage0_20260204T003050_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0015_df-s03-d1_dw_0_20260203T133906_reco_stage0_20260204T003050_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161889.0,
"core.end_time": 1770165052.0,
"core.events": [
2463,
2469,
2475,
2481,
2487,
2493,
2499,
2505,
2511,
2517,
2523,
2529,
2535,
2541,
2547,
2553,
2559,
2565,
2571,
2577,
2583,
2589,
2595,
2601,
2607,
2613,
2619,
2625
],
"core.event_count": 28,
"core.first_event_number": 2463,
"core.last_event_number": 2625,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0015_df-s03-d1_dw_0_20260203T133906.hdf5"
}
]
} 