Jobsub ID 303651.123@dunegpschedd01.fnal.gov
| Jobsub ID | 303651.123@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:50:24 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk_multicore |
| Last heartbeat | 2026-02-04 01:26:13 |
| From worker node | Hostname | wn-snel-015.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7H12 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:22:17 |
| Input files | vd-protodune:np02vd_raw_run042421_0084_df-s03-d1_dw_0_20260203T141629.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7295s) |
| CPU time | 53m (3218s = 44%) |
| Max RSS bytes | 2583375872 (2463 MiB) |
| Outputting started | 2026-02-04 01:23:54 |
| Output files | |
| Finished | 2026-02-04 01:26:13 |
| Saved logs | justin-logs:303651.123-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x951e6270, 0x951e7a80
Caught exception in looking up space point ptr... 0x70f36a00, 0x951e6270
Caught exception in looking up space point ptr... 0x89102820, 0x66c85ba0
Caught exception in looking up space point ptr... 0x66c85ba0, 0x89102820
Caught exception in looking up space point ptr... 0x73f97fd0, 0x73f95690
Caught exception in looking up space point ptr... 0x73f95690, 0x73f95590
Caught exception in looking up space point ptr... 0x734f1980, 0x734f1610
Caught exception in looking up space point ptr... 0x734f1610, 0x7fc129e0
Caught exception in looking up space point ptr... 0x7fc129e0, 0x7fc12b70
Caught exception in looking up space point ptr... 0x4baf59e0, 0x73f50690
Caught exception in looking up space point ptr... 0x73f50690, 0x6aac9310
Caught exception in looking up space point ptr... 0x93532ec0, 0x93533050
Caught exception in looking up space point ptr... 0x93533050, 0x93532ec0
Caught exception in looking up space point ptr... 0x660dbc20, 0x45c5b650
Caught exception in looking up space point ptr... 0x45c5b650, 0x660dbc20
Caught exception in looking up space point ptr... 0x69e91e70, 0x69e8f010
Caught exception in looking up space point ptr... 0x69e8f010, 0x69e91e70
Caught exception in looking up space point ptr... 0x82bdd6c0, 0x82be2ae0
Caught exception in looking up space point ptr... 0x82be2ae0, 0x82be4d30
Caught exception in looking up space point ptr... 0x958c4a30, 0x958c4470
Caught exception in looking up space point ptr... 0x958c4470, 0x958c4a30
Caught exception in looking up space point ptr... 0x958c4a30, 0x958c4710
Caught exception in looking up space point ptr... 0x958c4710, 0x958c4a30
Caught exception in looking up space point ptr... 0x75e4a080, 0x744edbb0
Caught exception in looking up space point ptr... 0x744edbb0, 0x75e4a080
Caught exception in looking up space point ptr... 0x7fbfcbe0, 0x7fbfca50
Caught exception in looking up space point ptr... 0x7fbfcf50, 0x7fbfcbe0
Caught exception in looking up space point ptr... 0x61a67660, 0x61a67980
Caught exception in looking up space point ptr... 0x61a67980, 0x61a677f0
Caught exception in looking up space point ptr... 0x6fa12d80, 0x6fa12c10
Caught exception in looking up space point ptr... 0x6fa12c10, 0x6fa12d80
Caught exception in looking up space point ptr... 0x73509e50, 0x69ea9160
Caught exception in looking up space point ptr... 0x69ea9160, 0x7350a030
Caught exception in looking up space point ptr... 0x69ea36d0, 0x5c235240
Caught exception in looking up space point ptr... 0x5c235240, 0x69ea36d0
Caught exception in looking up space point ptr... 0x69ea36d0, 0x5c234a50
Caught exception in looking up space point ptr... 0x5c234a50, 0x69ea36d0
Caught exception in looking up space point ptr... 0x71452ea0, 0x435e8420
Caught exception in looking up space point ptr... 0x435e8420, 0x71452ea0
Caught exception in looking up space point ptr... 0x7fbfa4e0, 0x7fbfa350
Caught exception in looking up space point ptr... 0x7fbfa350, 0x7fbfa4e0
Caught exception in looking up space point ptr... 0x6f9f5ee0, 0x73503160
Caught exception in looking up space point ptr... 0x73503160, 0x6f9f5ee0
Caught exception in looking up space point ptr... 0x6f9f5ee0, 0x6fa132d0
Caught exception in looking up space point ptr... 0x6fa132d0, 0x6f9f5ee0
Caught exception in looking up space point ptr... 0x89106350, 0x5c751270
Caught exception in looking up space point ptr... 0x5c751270, 0x89106350
Caught exception in looking up space point ptr... 0x734f5230, 0x5c752430
Caught exception in looking up space point ptr... 0x5c752430, 0x734f5230
Caught exception in looking up space point ptr... 0x817608e0, 0x81767bf0
Caught exception in looking up space point ptr... 0x81767bf0, 0x81767ac0
Caught exception in looking up space point ptr... 0x44c1e650, 0x44c1dbc0
Caught exception in looking up space point ptr... 0x44c1e8b0, 0x44c1e650
Caught exception in looking up space point ptr... 0x5c752250, 0x73511eb0
Caught exception in looking up space point ptr... 0x73511eb0, 0x5c752250
Caught exception in looking up space point ptr... 0x9a667a20, 0x9a667b70
Caught exception in looking up space point ptr... 0x9a667b70, 0x9a667920
Caught exception in looking up space point ptr... 0x8c4d97c0, 0x4c485330
Caught exception in looking up space point ptr... 0x4c485330, 0x5c884d90
Caught exception in looking up space point ptr... 0x5be78230, 0x4feaf7b0
Caught exception in looking up space point ptr... 0x4feaf7b0, 0x785577c0
Caught exception in looking up space point ptr... 0x8c8fcf40, 0x8c8fb5b0
Caught exception in looking up space point ptr... 0x8c8fb5b0, 0x8c8fcf40
Caught exception in looking up space point ptr... 0x4e885280, 0x4e885460
Caught exception in looking up space point ptr... 0x4e885460, 0x4e885820
++++>>>> total num hits: 89945, num free: 87342
04-Feb-2026 02:23:44 CET Closed output file "np02vd_raw_run042421_0084_df-s03-d1_dw_0_20260203T141629_reco_stage0_20260204T012344_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 216.507 266.058 345.468 260.881 29.096 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.4008e-05 0.000118966 0.00048533 9.4888e-05 8.1651e-05 27
produce:tpcrawdecoder:PDVDTPCReader 92.9509 140.667 210.652 130.685 30.5165 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.539132 0.819258 1.41025 0.77354 0.181806 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0175665 0.0328391 0.261928 0.0207642 0.0460688 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0860687 0.0903428 0.105307 0.0873207 0.00672802 27
produce:beamevent:BeamEvent 9.3164e-05 0.000166455 0.00132203 0.000122239 0.000227375 27
produce:pdvddaphne:DAPHNEReaderPDVD 11.142 17.0942 24.4627 16.5753 3.64729 27
produce:ophit:OpHitFinder 0.0385727 0.0457409 0.0551154 0.0451648 0.00425686 27
produce:wclsdatavd:WireCellToolkit 66.8086 83.6675 90.8293 86.6571 6.41829 27
produce:gaushit:GausHitFinder 0.563474 1.2304 1.82275 1.24412 0.290668 27
produce:nhitsfilter:NumberOfHitsFilter 0.000230342 0.000442707 0.00125263 0.000386504 0.000199167 27
produce:reco3d:SpacePointSolver 5.40494 14.1088 26.682 12.5852 5.97745 27
produce:hitpdune:DisambigFromSpacePoints 0.0762301 0.13443 0.267567 0.124402 0.047218 27
produce:cluster3d:Cluster3D 1.28117 2.8996 8.62065 2.64149 1.41779 27
[art]:TriggerResults:TriggerResultInserter 2.137e-05 3.28769e-05 0.000120706 2.7592e-05 1.80126e-05 27
end_path:out1:RootOutput 3.637e-06 5.57822e-06 3.1228e-05 4.658e-06 5.05997e-06 27
end_path:out1:RootOutput(write) 3.77505 5.24113 7.61434 5.1879 0.678235 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4553.54 MB
Peak resident set size usage (VmHWM): 2583.38 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0084_df-s03-d1_dw_0_20260203T141629_reco_stage0_20260204T012344_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0084_df-s03-d1_dw_0_20260203T141629_reco_stage0_20260204T012344_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0084_df-s03-d1_dw_0_20260203T141629_reco_stage0_20260204T012344_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160951.0,
"core.end_time": 1770168226.0,
"core.events": [
13671,
13677,
13683,
13689,
13695,
13701,
13707,
13713,
13719,
13725,
13731,
13737,
13743,
13749,
13755,
13761,
13767,
13773,
13779,
13785,
13791,
13797,
13803,
13809,
13815,
13821,
13827
],
"core.event_count": 27,
"core.first_event_number": 13671,
"core.last_event_number": 13827,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0084_df-s03-d1_dw_0_20260203T141629.hdf5"
}
]
} 