Jobsub ID 303650.52@dunegpschedd01.fnal.gov
| Jobsub ID | 303650.52@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:28 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk_multicore |
| Last heartbeat | 2026-02-04 01:28:39 |
| From worker node | Hostname | wn-snel-010.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7H12 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:14:40 |
| Input files | vd-protodune:np02vd_raw_run042433_0318_df-s03-d1_dw_0_20260203T204300.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7901s) |
| CPU time | 1h (3610s = 45%) |
| Max RSS bytes | 3406364672 (3248 MiB) |
| Outputting started | 2026-02-04 01:26:22 |
| Output files | |
| Finished | 2026-02-04 01:28:39 |
| Saved logs | justin-logs:303650.52-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x2a7c1860, 0x2a7c1590
Caught exception in looking up space point ptr... 0x2a7c1590, 0x2a7dd2b0
Caught exception in looking up space point ptr... 0x5725f120, 0x8a65b5c0
Caught exception in looking up space point ptr... 0x8a65b5c0, 0x48ccaf80
Caught exception in looking up space point ptr... 0x8b51cb50, 0x4fe03fc0
Caught exception in looking up space point ptr... 0x4fe03fc0, 0x8b51cb50
Caught exception in looking up space point ptr... 0x8b51cb50, 0x2629f690
Caught exception in looking up space point ptr... 0x2629f690, 0x8b51cb50
Caught exception in looking up space point ptr... 0x8b51cb50, 0x8b51cca0
Caught exception in looking up space point ptr... 0x8b51cca0, 0x8b51cb50
Caught exception in looking up space point ptr... 0x93556380, 0x30986910
Caught exception in looking up space point ptr... 0x30986910, 0x5014f300
Caught exception in looking up space point ptr... 0x82416120, 0x4bfec990
Caught exception in looking up space point ptr... 0x4bfec990, 0x20d48e90
Caught exception in looking up space point ptr... 0x64882fe0, 0x64887f60
Caught exception in looking up space point ptr... 0x64887f60, 0x64885d50
Caught exception in looking up space point ptr... 0x56b84c30, 0x1dacca10
Caught exception in looking up space point ptr... 0x1dacca10, 0x56b84c30
Caught exception in looking up space point ptr... 0x8226fbb0, 0x8226fe80
Caught exception in looking up space point ptr... 0x8226fe80, 0x8226fbb0
Caught exception in looking up space point ptr... 0x1c79eb60, 0x2a7e3650
Caught exception in looking up space point ptr... 0x6a4923e0, 0x1c79eb60
Caught exception in looking up space point ptr... 0x83179f80, 0x9a571390
Caught exception in looking up space point ptr... 0x9a571390, 0x428a5e00
Caught exception in looking up space point ptr... 0x28a8b590, 0x28a846c0
Caught exception in looking up space point ptr... 0x28a846c0, 0x28a86710
Caught exception in looking up space point ptr... 0x29e80390, 0x29e7edf0
Caught exception in looking up space point ptr... 0x29e7edf0, 0x29e80390
Caught exception in looking up space point ptr... 0x29e80390, 0x29e7ef40
Caught exception in looking up space point ptr... 0x29e7ef40, 0x29e80390
Caught exception in looking up space point ptr... 0x753112c0, 0x75310fa0
Caught exception in looking up space point ptr... 0x75310fa0, 0x75310430
Caught exception in looking up space point ptr... 0x2b5f8b30, 0x2b5f16f0
Caught exception in looking up space point ptr... 0x2b5f16f0, 0x2b5f8890
Caught exception in looking up space point ptr... 0x2b5f8890, 0x2b5f8dd0
Caught exception in looking up space point ptr... 0x4f973670, 0x483b3b10
Caught exception in looking up space point ptr... 0x483b3b10, 0x949fd270
Caught exception in looking up space point ptr... 0x7a5b1730, 0x7a5b15a0
Caught exception in looking up space point ptr... 0x7a5b15a0, 0x7a5b1410
Caught exception in looking up space point ptr... 0x63199010, 0x631994a0
Caught exception in looking up space point ptr... 0x631994a0, 0x63199010
Caught exception in looking up space point ptr... 0x9ad4ec60, 0x9ad4ea80
Caught exception in looking up space point ptr... 0x9ad4ea80, 0x9ad4ec60
Caught exception in looking up space point ptr... 0x28ab75c0, 0x29e65990
Caught exception in looking up space point ptr... 0x29e65990, 0x28ab75c0
Caught exception in looking up space point ptr... 0x27bcf5c0, 0x27bca980
Caught exception in looking up space point ptr... 0x27bca980, 0x27bc7dd0
Caught exception in looking up space point ptr... 0x89d0e080, 0x89d0e3a0
Caught exception in looking up space point ptr... 0x89d0e3a0, 0x89d0e080
Caught exception in looking up space point ptr... 0x2d14b5e0, 0x81d99190
Caught exception in looking up space point ptr... 0x81d99190, 0x2d14c4e0
Caught exception in looking up space point ptr... 0x41a12d10, 0x41a12bc0
Caught exception in looking up space point ptr... 0x41a12bc0, 0x41a12e80
Caught exception in looking up space point ptr... 0x69414530, 0x69414630
Caught exception in looking up space point ptr... 0x69414630, 0x69414530
Caught exception in looking up space point ptr... 0x553269b0, 0x518179c0
Caught exception in looking up space point ptr... 0x518179c0, 0x553269b0
Caught exception in looking up space point ptr... 0x41a12930, 0x41a12680
Caught exception in looking up space point ptr... 0x41a12680, 0x41a139f0
Caught exception in looking up space point ptr... 0x3065aa90, 0x3065d1b0
Caught exception in looking up space point ptr... 0x3065d1b0, 0x57cd2850
Caught exception in looking up space point ptr... 0x79fc06e0, 0x79fc0810
Caught exception in looking up space point ptr... 0x79fc0810, 0x79fc06e0
Caught exception in looking up space point ptr... 0x30f83170, 0x30f82f20
Caught exception in looking up space point ptr... 0x30f82f20, 0x30f82e80
Caught exception in looking up space point ptr... 0x4fae7900, 0x89cdd110
Caught exception in looking up space point ptr... 0x89cdd110, 0x4fae7900
++++>>>> total num hits: 77627, num free: 74464
04-Feb-2026 02:26:13 CET Closed output file "np02vd_raw_run042433_0318_df-s03-d1_dw_0_20260203T204300_reco_stage0_20260204T012613_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 356.864 410.437 526.459 397.339 45.8548 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.8256e-05 0.000109452 0.000242345 0.000101641 3.19465e-05 19
produce:tpcrawdecoder:PDVDTPCReader 142.301 216.043 318.034 202.386 48.6339 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.620765 1.04516 2.66476 0.981532 0.408012 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0176383 0.0213329 0.0567729 0.0180345 0.0088275 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0175045 0.0196277 0.0516401 0.0178287 0.00754833 19
produce:beamevent:BeamEvent 8.8005e-05 0.000190928 0.00110753 0.000145543 0.000217061 19
produce:pdvddaphne:DAPHNEReaderPDVD 12.5012 18.8421 24.2875 18.7017 3.1087 19
produce:ophit:OpHitFinder 0.0325612 0.0434661 0.050917 0.0450722 0.00527375 19
produce:wclsdatavd:WireCellToolkit 110.521 137.851 159.442 141.026 13.0393 19
produce:gaushit:GausHitFinder 1.12945 1.68855 2.5851 1.53443 0.447343 19
produce:nhitsfilter:NumberOfHitsFilter 0.000352321 0.000620784 0.00129313 0.000580781 0.000223201 19
produce:reco3d:SpacePointSolver 12.8258 23.0313 39.7153 21.047 7.67573 19
produce:hitpdune:DisambigFromSpacePoints 0.166291 0.283187 0.457378 0.277792 0.0869609 19
produce:cluster3d:Cluster3D 2.56483 4.26096 6.7023 3.99173 1.17284 19
[art]:TriggerResults:TriggerResultInserter 2.3173e-05 3.54487e-05 9.8896e-05 3.0057e-05 1.7421e-05 19
end_path:out1:RootOutput 3.887e-06 6.30721e-06 2.3565e-05 4.479e-06 5.0403e-06 19
end_path:out1:RootOutput(write) 6.32772 7.25588 8.03175 7.12147 0.548551 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5342.91 MB
Peak resident set size usage (VmHWM): 3406.36 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0318_df-s03-d1_dw_0_20260203T204300_reco_stage0_20260204T012613_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0318_df-s03-d1_dw_0_20260203T204300_reco_stage0_20260204T012613_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0318_df-s03-d1_dw_0_20260203T204300_reco_stage0_20260204T012613_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160493.0,
"core.end_time": 1770168375.0,
"core.events": [
36261,
36267,
36273,
36279,
36285,
36291,
36297,
36303,
36309,
36315,
36321,
36327,
36333,
36339,
36345,
36351,
36357,
36363,
36369
],
"core.event_count": 19,
"core.first_event_number": 36261,
"core.last_event_number": 36369,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0318_df-s03-d1_dw_0_20260203T204300.hdf5"
}
]
} 