Jobsub ID 303690.0@dunegpschedd01.fnal.gov
| Jobsub ID | 303690.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-04 00:12:27 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce508 |
| Last heartbeat | 2026-02-04 00:49:50 |
| From worker node | Hostname | b9p35p0022.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:18:46 |
| Input files | vd-protodune:np02vd_raw_run042422_0073_df-s04-d0_dw_0_20260203T155416.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 29m (1740s) |
| CPU time | 27m (1650s = 94%) |
| Max RSS bytes | 2648113152 (2525 MiB) |
| Outputting started | 2026-02-04 00:47:47 |
| Output files | |
| Finished | 2026-02-04 00:49:50 |
| Saved logs | justin-logs:303690.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
3d0, 0x4f4a74b0
Caught exception in looking up space point ptr... 0x5561d700, 0xcdb7e80
Caught exception in looking up space point ptr... 0xcdb7e80, 0x28796e90
Caught exception in looking up space point ptr... 0x28796e90, 0x4fa3b4f0
Caught exception in looking up space point ptr... 0x4fa3b4f0, 0x8cf5b00
Caught exception in looking up space point ptr... 0x8cf5b00, 0x1fda4ba0
Caught exception in looking up space point ptr... 0x1fda4ba0, 0x290460a0
Caught exception in looking up space point ptr... 0x290460a0, 0x5561d700
Caught exception in looking up space point ptr... 0x57c476c0, 0x57c49060
Caught exception in looking up space point ptr... 0x57c49060, 0x4aa32fb0
Caught exception in looking up space point ptr... 0x4aa32fb0, 0x57c48430
Caught exception in looking up space point ptr... 0x57c48430, 0x57c48530
Caught exception in looking up space point ptr... 0x57c48530, 0x57c48630
Caught exception in looking up space point ptr... 0x57c48630, 0x57c48730
Caught exception in looking up space point ptr... 0x57c48730, 0x4aa35540
Caught exception in looking up space point ptr... 0x4aa35540, 0x4aa35cf0
Caught exception in looking up space point ptr... 0x4aa35cf0, 0x57c476c0
Caught exception in looking up space point ptr... 0xcca04a0, 0xcca1540
Caught exception in looking up space point ptr... 0xcca1540, 0xcca1790
Caught exception in looking up space point ptr... 0xcca1790, 0x4395bba0
Caught exception in looking up space point ptr... 0x4395bba0, 0xcca02a0
Caught exception in looking up space point ptr... 0x4901e800, 0x23c1a480
Caught exception in looking up space point ptr... 0x23c1a480, 0x23c1a5d0
Caught exception in looking up space point ptr... 0x23c1a5d0, 0x23c1a720
Caught exception in looking up space point ptr... 0x23c1a720, 0x4901f0b0
Caught exception in looking up space point ptr... 0x4901f0b0, 0x4901ea00
Caught exception in looking up space point ptr... 0x1fd624d0, 0x2def9830
Caught exception in looking up space point ptr... 0x2def9830, 0x126972a0
Caught exception in looking up space point ptr... 0x126972a0, 0x22838d90
Caught exception in looking up space point ptr... 0xd49ab50, 0x1fd624d0
Caught exception in looking up space point ptr... 0x4d98d2f0, 0x4d98cf60
Caught exception in looking up space point ptr... 0x4d98d1c0, 0x4d98d800
Caught exception in looking up space point ptr... 0x4d98d800, 0x4d98d2f0
Caught exception in looking up space point ptr... 0xa7f6530, 0x4eef8520
Caught exception in looking up space point ptr... 0x4eef8520, 0xa7f6120
Caught exception in looking up space point ptr... 0x514db3d0, 0x514db960
Caught exception in looking up space point ptr... 0x514db960, 0x514db3d0
Caught exception in looking up space point ptr... 0x26be3590, 0x4fadd730
Caught exception in looking up space point ptr... 0x4fadd730, 0x26be3590
Caught exception in looking up space point ptr... 0x41a7ea00, 0x41a7eca0
Caught exception in looking up space point ptr... 0x41a7eca0, 0x41a7edf0
Caught exception in looking up space point ptr... 0x13e1d000, 0x13e1ced0
Caught exception in looking up space point ptr... 0xd336c20, 0x13e1d000
Caught exception in looking up space point ptr... 0x523b5310, 0x959eb20
Caught exception in looking up space point ptr... 0x959eb20, 0x29be7e10
Caught exception in looking up space point ptr... 0x29be7e10, 0x636953a0
Caught exception in looking up space point ptr... 0x46244f00, 0x13db7830
Caught exception in looking up space point ptr... 0x10239130, 0x46244f00
Caught exception in looking up space point ptr... 0x527c0cf0, 0x514dc020
Caught exception in looking up space point ptr... 0x3d2af000, 0x527c0cf0
Caught exception in looking up space point ptr... 0x4d990b70, 0x4d98f370
Caught exception in looking up space point ptr... 0x4d98f370, 0x4d98f710
Caught exception in looking up space point ptr... 0xd46bcd0, 0xd46bba0
Caught exception in looking up space point ptr... 0xd46bba0, 0xd46bcd0
Caught exception in looking up space point ptr... 0xd46bcd0, 0x233f5c00
Caught exception in looking up space point ptr... 0x233f5c00, 0xd46bcd0
Caught exception in looking up space point ptr... 0x2c0a8510, 0x2c0a83c0
Caught exception in looking up space point ptr... 0x2c0a83c0, 0x2c0a8510
Caught exception in looking up space point ptr... 0x2b758f90, 0x2b758ef0
Caught exception in looking up space point ptr... 0x2b758ef0, 0x2b758f90
Caught exception in looking up space point ptr... 0x4ec89bd0, 0x31558960
Caught exception in looking up space point ptr... 0x31558960, 0x31a2aab0
Caught exception in looking up space point ptr... 0x4eef5d80, 0x4eef68a0
Caught exception in looking up space point ptr... 0x4eef68a0, 0x4b8707c0
Caught exception in looking up space point ptr... 0x13c75c30, 0x2de71310
Caught exception in looking up space point ptr... 0x2de71310, 0x13c75c30
++++>>>> total num hits: 38024, num free: 36685
04-Feb-2026 01:47:41 CET Closed output file "np02vd_raw_run042422_0073_df-s04-d0_dw_0_20260203T155416_reco_stage0_20260204T004741_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 53.0142 62.6269 73.3463 62.5251 4.69622 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.907e-05 6.54923e-05 0.000152221 6.21e-05 1.86792e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.32524 3.97733 5.94744 3.84348 0.62593 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00707731 0.0138527 0.0376479 0.0092022 0.00880807 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000293211 0.000427635 0.000812164 0.000403082 0.000108154 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00103714 0.00162318 0.00891677 0.00126233 0.00145788 27
produce:beamevent:BeamEvent 5.536e-05 9.15899e-05 0.000682383 7.033e-05 0.000116171 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.48955 1.74059 2.21224 1.70566 0.187425 27
produce:ophit:OpHitFinder 0.0175867 0.0274859 0.0347317 0.0280891 0.00458862 27
produce:wclsdatavd:WireCellToolkit 36.263 41.0422 48.4033 40.3654 3.05353 27
produce:gaushit:GausHitFinder 0.419422 0.678441 1.19911 0.666838 0.169061 27
produce:nhitsfilter:NumberOfHitsFilter 0.00013411 0.000197305 0.000329781 0.000186901 4.12039e-05 27
produce:reco3d:SpacePointSolver 5.47016 10.1239 14.5049 10.0763 2.09139 27
produce:hitpdune:DisambigFromSpacePoints 0.0421247 0.0789587 0.147318 0.0788507 0.0230823 27
produce:cluster3d:Cluster3D 0.622493 1.55024 2.56171 1.45192 0.482559 27
[art]:TriggerResults:TriggerResultInserter 2.1241e-05 2.83583e-05 6.977e-05 2.6971e-05 8.96802e-06 27
end_path:out1:RootOutput 4.45e-06 5.50041e-06 1.771e-05 4.91e-06 2.44793e-06 27
end_path:out1:RootOutput(write) 2.68765 3.36865 3.91804 3.37455 0.29009 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4665.54 MB
Peak resident set size usage (VmHWM): 2648.11 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0073_df-s04-d0_dw_0_20260203T155416_reco_stage0_20260204T004741_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0073_df-s04-d0_dw_0_20260203T155416_reco_stage0_20260204T004741_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0073_df-s04-d0_dw_0_20260203T155416_reco_stage0_20260204T004741_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770164333.0,
"core.end_time": 1770166062.0,
"core.events": [
11836,
11842,
11848,
11854,
11860,
11866,
11872,
11878,
11884,
11890,
11896,
11902,
11908,
11914,
11920,
11926,
11932,
11938,
11944,
11950,
11956,
11962,
11968,
11974,
11980,
11986,
11992
],
"core.event_count": 27,
"core.first_event_number": 11836,
"core.last_event_number": 11992,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0073_df-s04-d0_dw_0_20260203T155416.hdf5"
}
]
} 