Jobsub ID 303653.99@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.99@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-02-04 03:07:15 |
| From worker node | Hostname | hnode66.pic.es |
| cpuinfo | AMD EPYC 7402P 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:41:50 |
| Input files | vd-protodune:np02vd_raw_run042421_0096_df-s03-d0_dw_0_20260203T142258.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12175s) |
| CPU time | 1h (3696s = 30%) |
| Max RSS bytes | 2704928768 (2579 MiB) |
| Outputting started | 2026-02-04 03:04:47 |
| Output files | |
| Finished | 2026-02-04 03:07:15 |
| Saved logs | justin-logs:303653.99-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x36273d90, 0x36273c00
Caught exception in looking up space point ptr... 0x3ca10850, 0x362e17e0
Caught exception in looking up space point ptr... 0x3ca109e0, 0x3ca10850
Caught exception in looking up space point ptr... 0x2a2b8e40, 0x2a2b8fd0
Caught exception in looking up space point ptr... 0x229e7840, 0x2a2b8e40
Caught exception in looking up space point ptr... 0x2e7e2300, 0x2a540940
Caught exception in looking up space point ptr... 0x2e7e21d0, 0x2e7e2300
Caught exception in looking up space point ptr... 0x3932a430, 0x300bb050
Caught exception in looking up space point ptr... 0x300bb050, 0x300badc0
Caught exception in looking up space point ptr... 0x2dc0cc70, 0x5cb12a30
Caught exception in looking up space point ptr... 0x513dc4b0, 0x2dc0cc70
Caught exception in looking up space point ptr... 0xf167bc0, 0x57ff4cb0
Caught exception in looking up space point ptr... 0x57ff4cb0, 0x21855f10
Caught exception in looking up space point ptr... 0x57ff4ee0, 0x57ff5040
Caught exception in looking up space point ptr... 0x57ff5040, 0x50333600
Caught exception in looking up space point ptr... 0x5033ac40, 0x5033a9f0
Caught exception in looking up space point ptr... 0x5033a7a0, 0x5033ac40
Caught exception in looking up space point ptr... 0x633a8100, 0x633ae850
Caught exception in looking up space point ptr... 0x218647b0, 0x633a8100
Caught exception in looking up space point ptr... 0x50332560, 0x50332430
Caught exception in looking up space point ptr... 0x503327c0, 0x50332560
Caught exception in looking up space point ptr... 0x326f26d0, 0x326e05c0
Caught exception in looking up space point ptr... 0x326e05c0, 0x326ce320
Caught exception in looking up space point ptr... 0x2aaa1d20, 0x378b2230
Caught exception in looking up space point ptr... 0x2aa8f760, 0x2aaa1d20
Caught exception in looking up space point ptr... 0x162e35d0, 0x162e4d60
Caught exception in looking up space point ptr... 0x162e4d60, 0x2e5e1dc0
Caught exception in looking up space point ptr... 0x442e0ea0, 0x482d1490
Caught exception in looking up space point ptr... 0x442ce8e0, 0x442e0ea0
Caught exception in looking up space point ptr... 0x56a77050, 0x51503620
Caught exception in looking up space point ptr... 0xd5e4600, 0x56a77050
Caught exception in looking up space point ptr... 0x2dc85f60, 0x2dc85dd0
Caught exception in looking up space point ptr... 0x2dc85dd0, 0x3f749210
Caught exception in looking up space point ptr... 0x31c6fbc0, 0x144318b0
Caught exception in looking up space point ptr... 0x144318b0, 0x522d2a30
Caught exception in looking up space point ptr... 0x56acfbd0, 0x46b61b00
Caught exception in looking up space point ptr... 0x507e7b20, 0x56acfbd0
Caught exception in looking up space point ptr... 0x37c675c0, 0x37c679b0
Caught exception in looking up space point ptr... 0x37c679b0, 0x37c675c0
Caught exception in looking up space point ptr... 0x2189dae0, 0x22878cf0
Caught exception in looking up space point ptr... 0x22878cf0, 0x3035cca0
Caught exception in looking up space point ptr... 0x14c5a630, 0x14c48980
Caught exception in looking up space point ptr... 0x14c48980, 0x3f66d840
Caught exception in looking up space point ptr... 0x14c591e0, 0x14c47530
Caught exception in looking up space point ptr... 0x14c47530, 0x3f66c3f0
Caught exception in looking up space point ptr... 0x3fd19fb0, 0x3fd1a140
Caught exception in looking up space point ptr... 0x3fd1a140, 0x3fd1a2d0
Caught exception in looking up space point ptr... 0x4854cf90, 0x29ccfab0
Caught exception in looking up space point ptr... 0x29ccfab0, 0x4854cf90
Caught exception in looking up space point ptr... 0x327707a0, 0x32770540
Caught exception in looking up space point ptr... 0x32770540, 0x327707a0
Caught exception in looking up space point ptr... 0x50363ab0, 0x57201bd0
Caught exception in looking up space point ptr... 0x57201bd0, 0x3274d030
Caught exception in looking up space point ptr... 0x41e081c0, 0x41e082e0
Caught exception in looking up space point ptr... 0x41e082e0, 0x41e081c0
Caught exception in looking up space point ptr... 0x4bf81b20, 0x4bf82050
Caught exception in looking up space point ptr... 0x4bf82050, 0x4185e2a0
Caught exception in looking up space point ptr... 0x3359b460, 0x5143b640
Caught exception in looking up space point ptr... 0x3359a880, 0x3359b460
Caught exception in looking up space point ptr... 0x529af440, 0x26b5c680
Caught exception in looking up space point ptr... 0x5cd79280, 0x529af440
Caught exception in looking up space point ptr... 0x5143c5b0, 0x162e4620
Caught exception in looking up space point ptr... 0x162e4620, 0x2e5e2500
Caught exception in looking up space point ptr... 0x2aadb110, 0x2aad9fa0
Caught exception in looking up space point ptr... 0x2aad9fa0, 0x2aadb110
++++>>>> total num hits: 315990, num free: 309338
04-Feb-2026 04:04:37 CET Closed output file "np02vd_raw_run042421_0096_df-s03-d0_dw_0_20260203T142258_reco_stage0_20260204T030437_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 352.254 447.01 580.19 435.664 56.4914 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.1403e-05 9.43306e-05 0.000182617 8.6803e-05 2.54211e-05 27
produce:tpcrawdecoder:PDVDTPCReader 193.793 284.219 395.253 281.705 48.8222 27
produce:triggerrawdecoder:PDVDTriggerReader4 1.18219 1.70604 2.92891 1.63941 0.427593 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0342607 0.0458192 0.104589 0.0434555 0.0149857 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.170161 0.185349 0.238434 0.171273 0.0210589 27
produce:beamevent:BeamEvent 8.5623e-05 0.000184191 0.00147694 0.000135635 0.000256152 27
produce:pdvddaphne:DAPHNEReaderPDVD 21.9608 32.1847 46.5077 32.1193 5.48324 27
produce:ophit:OpHitFinder 0.0245196 0.038519 0.0538289 0.0382571 0.00741704 27
produce:wclsdatavd:WireCellToolkit 63.5058 78.5929 98.4516 77.6937 8.33669 27
produce:gaushit:GausHitFinder 0.72444 1.53548 2.64604 1.52963 0.47525 27
produce:nhitsfilter:NumberOfHitsFilter 0.000249659 0.000548884 0.00111436 0.000480877 0.000230678 27
produce:reco3d:SpacePointSolver 5.97045 8.79301 12.4815 8.84931 1.9525 27
produce:hitpdune:DisambigFromSpacePoints 0.0709629 0.219356 0.36765 0.217177 0.0817496 27
produce:cluster3d:Cluster3D 1.29696 35.0456 56.3444 43.4272 18.185 27
[art]:TriggerResults:TriggerResultInserter 2.067e-05 3.63139e-05 0.000104174 2.8801e-05 1.72314e-05 27
end_path:out1:RootOutput 3.24e-06 5.99941e-06 2.5661e-05 4.08e-06 5.18184e-06 27
end_path:out1:RootOutput(write) 3.18599 4.40204 6.09663 4.47106 0.563207 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4686.66 MB
Peak resident set size usage (VmHWM): 2704.93 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0096_df-s03-d0_dw_0_20260203T142258_reco_stage0_20260204T030437_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0096_df-s03-d0_dw_0_20260203T142258_reco_stage0_20260204T030437_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0096_df-s03-d0_dw_0_20260203T142258_reco_stage0_20260204T030437_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162120.0,
"core.end_time": 1770174279.0,
"core.events": [
15626,
15632,
15638,
15644,
15650,
15656,
15662,
15668,
15674,
15680,
15686,
15692,
15698,
15704,
15710,
15716,
15722,
15728,
15734,
15740,
15746,
15752,
15758,
15764,
15770,
15776,
15782
],
"core.event_count": 27,
"core.first_event_number": 15626,
"core.last_event_number": 15782,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0096_df-s03-d0_dw_0_20260203T142258.hdf5"
}
]
} 