Jobsub ID 297919.117@dunegpschedd02.fnal.gov
| Jobsub ID | 297919.117@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:54:25 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk_multicore |
| Last heartbeat | 2026-02-04 01:52:16 |
| From worker node | Hostname | wn-pijl-012.farm.nikhef.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:31:37 |
| Input files | vd-protodune:np02vd_raw_run042421_0087_df-s03-d0_dw_0_20260203T141805.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8279s) |
| CPU time | 1h (4200s = 50%) |
| Max RSS bytes | 2725453824 (2599 MiB) |
| Outputting started | 2026-02-04 01:49:37 |
| Output files | |
| Finished | 2026-02-04 01:52:16 |
| Saved logs | justin-logs:297919.117-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
xception in looking up space point ptr... 0x59a815e0, 0x80b3eb10
Caught exception in looking up space point ptr... 0x80b3eb10, 0x80b3e980
Caught exception in looking up space point ptr... 0x54021a20, 0x665b1f50
Caught exception in looking up space point ptr... 0x665b1f50, 0x665b20e0
Caught exception in looking up space point ptr... 0x346e25b0, 0x4c208ff0
Caught exception in looking up space point ptr... 0x4c208ff0, 0x346e25b0
Caught exception in looking up space point ptr... 0x6836bbd0, 0x6836bdb0
Caught exception in looking up space point ptr... 0x6836bdb0, 0x6836bbd0
Caught exception in looking up space point ptr... 0x5141fe40, 0x51421cd0
Caught exception in looking up space point ptr... 0x51421cd0, 0x5141d590
Caught exception in looking up space point ptr... 0x833b9230, 0x833a7440
Caught exception in looking up space point ptr... 0x5171b860, 0x833b9230
Caught exception in looking up space point ptr... 0x6bf33e40, 0x6bf33c40
Caught exception in looking up space point ptr... 0x6bf33c40, 0x6bf33d40
Caught exception in looking up space point ptr... 0x7020b050, 0x701f8720
Caught exception in looking up space point ptr... 0x409faae0, 0x7020b050
Caught exception in looking up space point ptr... 0x40a099f0, 0x409f7430
Caught exception in looking up space point ptr... 0x409f7430, 0x70207630
Caught exception in looking up space point ptr... 0x34fac5a0, 0x53dfc8a0
Caught exception in looking up space point ptr... 0x34fac730, 0x34fac5a0
Caught exception in looking up space point ptr... 0x3ec07440, 0x5b8a6200
Caught exception in looking up space point ptr... 0x3ec075d0, 0x3ec07440
Caught exception in looking up space point ptr... 0x6a3b32f0, 0x5d5cf6c0
Caught exception in looking up space point ptr... 0x385c2cd0, 0x6a3b32f0
Caught exception in looking up space point ptr... 0x68c74960, 0x6eb01dd0
Caught exception in looking up space point ptr... 0x68c74af0, 0x68c74960
Caught exception in looking up space point ptr... 0x8bda2e60, 0x8bd90580
Caught exception in looking up space point ptr... 0x8bd90580, 0x8bda2cd0
Caught exception in looking up space point ptr... 0x76df7490, 0x76de5380
Caught exception in looking up space point ptr... 0x7d4ba450, 0x76df7490
Caught exception in looking up space point ptr... 0x54bee380, 0x72823b50
Caught exception in looking up space point ptr... 0x72823b50, 0x72814790
Caught exception in looking up space point ptr... 0x54bebe00, 0x728215d0
Caught exception in looking up space point ptr... 0x728215d0, 0x72812210
Caught exception in looking up space point ptr... 0x394115d0, 0x3844b640
Caught exception in looking up space point ptr... 0x3844b640, 0x394115d0
Caught exception in looking up space point ptr... 0x50203d40, 0x50204340
Caught exception in looking up space point ptr... 0x50204340, 0x50203d40
Caught exception in looking up space point ptr... 0x51c09e70, 0x350a3210
Caught exception in looking up space point ptr... 0x350a3210, 0x350a3170
Caught exception in looking up space point ptr... 0x7e5c0820, 0x8333ed70
Caught exception in looking up space point ptr... 0x8333ed70, 0x7e5c0820
Caught exception in looking up space point ptr... 0x5b4a0bc0, 0x83506bd0
Caught exception in looking up space point ptr... 0x83506bd0, 0x5b4a0bc0
Caught exception in looking up space point ptr... 0x5b4a0bc0, 0x78cbb3f0
Caught exception in looking up space point ptr... 0x78cbb3f0, 0x5b4a0bc0
Caught exception in looking up space point ptr... 0x808f1fd0, 0x65b5f9c0
Caught exception in looking up space point ptr... 0x65b5f9c0, 0x32c2abf0
Caught exception in looking up space point ptr... 0x7e605400, 0x32d0cf70
Caught exception in looking up space point ptr... 0x32d0cf70, 0x7e605a80
Caught exception in looking up space point ptr... 0x66016060, 0x66016590
Caught exception in looking up space point ptr... 0x7ca1b8b0, 0x66016060
Caught exception in looking up space point ptr... 0x66015c20, 0x7ca1bb30
Caught exception in looking up space point ptr... 0x7ca1bb30, 0x66015c20
Caught exception in looking up space point ptr... 0x3ebf2540, 0x33880ec0
Caught exception in looking up space point ptr... 0x33880ec0, 0x3ebf2540
Caught exception in looking up space point ptr... 0x350a33a0, 0x350a32b0
Caught exception in looking up space point ptr... 0x350a32b0, 0x350a33a0
Caught exception in looking up space point ptr... 0x3f413ce0, 0x3f414320
Caught exception in looking up space point ptr... 0x3f414320, 0x3f414190
Caught exception in looking up space point ptr... 0x3f414190, 0x3f414320
Caught exception in looking up space point ptr... 0x3f414320, 0x3f414000
Caught exception in looking up space point ptr... 0x3f414000, 0x3f414320
Caught exception in looking up space point ptr... 0x3f414320, 0x3f413e70
Caught exception in looking up space point ptr... 0x3f413e70, 0x3f413ce0
++++>>>> total num hits: 341599, num free: 334854
04-Feb-2026 02:49:28 CET Closed output file "np02vd_raw_run042421_0087_df-s03-d0_dw_0_20260203T141805_reco_stage0_20260204T014928_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 215.62 303.174 399.991 292.417 49.9987 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.4859e-05 0.000103925 0.000339834 9.3572e-05 4.6688e-05 27
produce:tpcrawdecoder:PDVDTPCReader 92.943 140 204.445 129 30.5986 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.622016 0.915714 2.15402 0.890266 0.297445 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0176246 0.02279 0.0763286 0.0181762 0.0112113 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.086636 0.0881808 0.104027 0.0875382 0.0032027 27
produce:beamevent:BeamEvent 0.000115516 0.000190919 0.00128622 0.000153212 0.000215252 27
produce:pdvddaphne:DAPHNEReaderPDVD 10.8642 17.787 24.8609 17.6922 3.38599 27
produce:ophit:OpHitFinder 0.0312442 0.0468419 0.0523025 0.0473786 0.00444304 27
produce:wclsdatavd:WireCellToolkit 70.2173 86.495 99.9196 88.9729 8.12021 27
produce:gaushit:GausHitFinder 0.923541 1.75338 2.51228 1.71122 0.416167 27
produce:nhitsfilter:NumberOfHitsFilter 0.000209017 0.000894495 0.00201926 0.000711469 0.000532666 27
produce:reco3d:SpacePointSolver 4.17157 11.5809 23.5028 10.4997 4.7238 27
produce:hitpdune:DisambigFromSpacePoints 0.104867 0.251994 0.41176 0.239783 0.0860701 27
produce:cluster3d:Cluster3D 1.63452 38.1226 61.8327 48.9675 23.312 27
[art]:TriggerResults:TriggerResultInserter 2.8033e-05 4.2142e-05 0.00011969 3.6105e-05 1.78262e-05 27
end_path:out1:RootOutput 4.457e-06 7.05333e-06 2.8854e-05 5.408e-06 5.0861e-06 27
end_path:out1:RootOutput(write) 4.80974 6.04902 7.38185 5.93048 0.793428 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4712.26 MB
Peak resident set size usage (VmHWM): 2725.45 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0087_df-s03-d0_dw_0_20260203T141805_reco_stage0_20260204T014928_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0087_df-s03-d0_dw_0_20260203T141805_reco_stage0_20260204T014928_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0087_df-s03-d0_dw_0_20260203T141805_reco_stage0_20260204T014928_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161509.0,
"core.end_time": 1770169770.0,
"core.events": [
14162,
14168,
14174,
14180,
14186,
14192,
14198,
14204,
14210,
14216,
14222,
14228,
14234,
14240,
14246,
14252,
14258,
14264,
14270,
14276,
14282,
14288,
14294,
14300,
14306,
14312,
14318
],
"core.event_count": 27,
"core.first_event_number": 14162,
"core.last_event_number": 14318,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0087_df-s03-d0_dw_0_20260203T141805.hdf5"
}
]
} 