Jobsub ID 298002.1@dunegpschedd02.fnal.gov
| Jobsub ID | 298002.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-04 01:28:30 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_klomp |
| Last heartbeat | 2026-02-04 03:18:44 |
| From worker node | Hostname | wn-pijl-012.farm.nikhef.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 01:29:07 |
| Input files | vd-protodune:np02vd_raw_run042421_0013_df-s02-d1_dw_0_20260203T133759.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6436s) |
| CPU time | 49m (2964s = 46%) |
| Max RSS bytes | 2624245760 (2502 MiB) |
| Outputting started | 2026-02-04 03:16:25 |
| Output files | |
| Finished | 2026-02-04 03:18:44 |
| Saved logs | justin-logs:298002.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
**************
******************************************************************************************************************
****> vertexList containted 0 vertices
Caught exception in looking up space point ptr... 0x86640ab0, 0x8663af00
Caught exception in looking up space point ptr... 0x8663af00, 0x8663c580
Caught exception in looking up space point ptr... 0x8663c580, 0x866461e0
Caught exception in looking up space point ptr... 0x4bb28960, 0x51ee70d0
Caught exception in looking up space point ptr... 0x51ee70d0, 0x3bb624f0
Caught exception in looking up space point ptr... 0x3bb624f0, 0x59e24ba0
Caught exception in looking up space point ptr... 0x59e24ba0, 0x4ff1c370
Caught exception in looking up space point ptr... 0x4ff1c370, 0x3be51710
Caught exception in looking up space point ptr... 0x3be51710, 0x76232790
Caught exception in looking up space point ptr... 0x76232790, 0x4e164960
Caught exception in looking up space point ptr... 0x4e164960, 0x4bb28960
Caught exception in looking up space point ptr... 0x86645ee0, 0x866458e0
Caught exception in looking up space point ptr... 0x866458e0, 0x866452e0
Caught exception in looking up space point ptr... 0x86645760, 0x86645d60
Caught exception in looking up space point ptr... 0x86645d60, 0x86645ee0
Caught exception in looking up space point ptr... 0x53ec24d0, 0x53ec2410
Caught exception in looking up space point ptr... 0x53ec2410, 0x53ec15a0
Caught exception in looking up space point ptr... 0x5f426400, 0x5f4247f0
Caught exception in looking up space point ptr... 0x5f4247f0, 0x5f422d20
Caught exception in looking up space point ptr... 0x5f428160, 0x5f426400
Caught exception in looking up space point ptr... 0x39887c70, 0x39885290
Caught exception in looking up space point ptr... 0x39885290, 0x78bb98d0
Caught exception in looking up space point ptr... 0x78bb98d0, 0x398823a0
Caught exception in looking up space point ptr... 0x398823a0, 0x398880f0
Caught exception in looking up space point ptr... 0x39f11570, 0x51cbf1a0
Caught exception in looking up space point ptr... 0x51cbf1a0, 0x38dbbff0
Caught exception in looking up space point ptr... 0x78bb0aa0, 0x78ba1d20
Caught exception in looking up space point ptr... 0x78ba1d20, 0x78bb0aa0
Caught exception in looking up space point ptr... 0x8a468800, 0x5da24300
Caught exception in looking up space point ptr... 0x5da24300, 0x8a468800
Caught exception in looking up space point ptr... 0x4ec9b4b0, 0x624dcc70
Caught exception in looking up space point ptr... 0x8a594fd0, 0x4ec9b4b0
Caught exception in looking up space point ptr... 0x8663e7e0, 0x86656140
Caught exception in looking up space point ptr... 0x86656140, 0x8663e7e0
Caught exception in looking up space point ptr... 0x83fee450, 0x83fdc730
Caught exception in looking up space point ptr... 0x83fdc730, 0x83fee450
Caught exception in looking up space point ptr... 0x62271160, 0x53351310
Caught exception in looking up space point ptr... 0x53351310, 0x4b381b20
Caught exception in looking up space point ptr... 0x37336530, 0x52cac250
Caught exception in looking up space point ptr... 0x52cac250, 0x37336530
Caught exception in looking up space point ptr... 0x4a92ae20, 0x8665af90
Caught exception in looking up space point ptr... 0x8665af90, 0x4a92ae20
Caught exception in looking up space point ptr... 0x2f44e840, 0x692fc9e0
Caught exception in looking up space point ptr... 0x692fc9e0, 0x2f4556c0
Caught exception in looking up space point ptr... 0x3158f0e0, 0x4eed19b0
Caught exception in looking up space point ptr... 0x4aed0570, 0x3158f0e0
Caught exception in looking up space point ptr... 0x4ecafa50, 0x8a553910
Caught exception in looking up space point ptr... 0x8a552810, 0x572b1480
Caught exception in looking up space point ptr... 0x572b1480, 0x87da12b0
Caught exception in looking up space point ptr... 0x87da12b0, 0x8a59e3d0
Caught exception in looking up space point ptr... 0x8a59e3d0, 0x4ecafa50
Caught exception in looking up space point ptr... 0x866591c0, 0x86658f60
Caught exception in looking up space point ptr... 0x86658f60, 0x866591c0
Caught exception in looking up space point ptr... 0x8739d020, 0x8739cd70
Caught exception in looking up space point ptr... 0x8739cd70, 0x8739d020
Caught exception in looking up space point ptr... 0x677d5210, 0x677cfda0
Caught exception in looking up space point ptr... 0x677cfda0, 0x677d5210
Caught exception in looking up space point ptr... 0x5f426770, 0x5f420b60
Caught exception in looking up space point ptr... 0x5f420b60, 0x5f426770
Caught exception in looking up space point ptr... 0x682defc0, 0x7984e3c0
Caught exception in looking up space point ptr... 0x7984e3c0, 0x629d83c0
Caught exception in looking up space point ptr... 0x6b8a0e70, 0x559667c0
Caught exception in looking up space point ptr... 0x4e2484a0, 0x6b8a0e70
++++>>>> total num hits: 51118, num free: 49937
04-Feb-2026 04:16:15 CET Closed output file "np02vd_raw_run042421_0013_df-s02-d1_dw_0_20260203T133759_reco_stage0_20260204T031615_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 200.107 234.736 278.929 235.442 20.4482 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.4858e-05 0.000106907 0.000326625 9.7317e-05 4.4102e-05 27
produce:tpcrawdecoder:PDVDTPCReader 93.8341 119.035 138.582 120.391 13.6041 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.547544 0.701887 0.927094 0.700769 0.108977 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0177301 0.0267622 0.054587 0.0245987 0.00952259 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.08693 0.0901617 0.112426 0.0881264 0.0062797 27
produce:beamevent:BeamEvent 0.000103767 0.000182815 0.00121987 0.000144539 0.000204377 27
produce:pdvddaphne:DAPHNEReaderPDVD 12.5684 15.9118 20.1642 15.8704 1.67732 27
produce:ophit:OpHitFinder 0.0256519 0.0477348 0.057163 0.049161 0.00679365 27
produce:wclsdatavd:WireCellToolkit 64.9449 77.1448 87.3932 77.2754 6.63177 27
produce:gaushit:GausHitFinder 0.560555 1.1095 1.9735 1.05609 0.336726 27
produce:nhitsfilter:NumberOfHitsFilter 0.000162837 0.000425003 0.00115022 0.000343569 0.000220045 27
produce:reco3d:SpacePointSolver 4.91212 11.7876 23.1441 12.2381 4.41798 27
produce:hitpdune:DisambigFromSpacePoints 0.0637787 0.134292 0.284547 0.122517 0.0550598 27
produce:cluster3d:Cluster3D 1.22383 3.12354 8.83187 2.82631 1.64494 27
[art]:TriggerResults:TriggerResultInserter 2.5488e-05 4.35666e-05 0.000142045 3.5203e-05 2.32628e-05 27
end_path:out1:RootOutput 3.726e-06 6.1587e-06 2.7912e-05 5.158e-06 4.39076e-06 27
end_path:out1:RootOutput(write) 4.17154 5.57757 6.4887 5.58883 0.557749 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4600.16 MB
Peak resident set size usage (VmHWM): 2624.25 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0013_df-s02-d1_dw_0_20260203T133759_reco_stage0_20260204T031615_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0013_df-s02-d1_dw_0_20260203T133759_reco_stage0_20260204T031615_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0013_df-s02-d1_dw_0_20260203T133759_reco_stage0_20260204T031615_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770168561.0,
"core.end_time": 1770174977.0,
"core.events": [
2131,
2137,
2143,
2149,
2155,
2161,
2167,
2173,
2179,
2185,
2191,
2197,
2203,
2209,
2215,
2221,
2227,
2233,
2239,
2245,
2251,
2257,
2263,
2269,
2275,
2281,
2287
],
"core.event_count": 27,
"core.first_event_number": 2131,
"core.last_event_number": 2287,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0013_df-s02-d1_dw_0_20260203T133759.hdf5"
}
]
} 