Jobsub ID 297919.36@dunegpschedd02.fnal.gov
| Jobsub ID | 297919.36@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:54:25 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_klomp_multicore |
| Last heartbeat | 2026-02-04 00:25:19 |
| From worker node | Hostname | wn-pijl-028.farm.nikhef.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:30:13 |
| Input files | vd-protodune:np02vd_raw_run042421_0133_df-s02-d0_dw_0_20260203T144256.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 52m (3164s) |
| CPU time | 47m (2851s = 90%) |
| Max RSS bytes | 2610941952 (2489 MiB) |
| Outputting started | 2026-02-04 00:22:59 |
| Output files | |
| Finished | 2026-02-04 00:25:19 |
| Saved logs | justin-logs:297919.36-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x4c791010, 0x4c7911a0
Caught exception in looking up space point ptr... 0x46183d70, 0x461805d0
Caught exception in looking up space point ptr... 0x4617ac40, 0x46183d70
Caught exception in looking up space point ptr... 0x8ec22b00, 0x8ec22a00
Caught exception in looking up space point ptr... 0x8ec22a00, 0x8ec22b00
Caught exception in looking up space point ptr... 0x8e4e0570, 0x8e4e0c50
Caught exception in looking up space point ptr... 0x8e4e0c50, 0x8e4e0de0
Caught exception in looking up space point ptr... 0x4c8605b0, 0x4c8606a0
Caught exception in looking up space point ptr... 0x4c8606a0, 0x4c8605b0
Caught exception in looking up space point ptr... 0x877268d0, 0x45693e00
Caught exception in looking up space point ptr... 0x45693e00, 0x87729c00
Caught exception in looking up space point ptr... 0x765d9990, 0x765d9670
Caught exception in looking up space point ptr... 0x765d9670, 0x765d9990
Caught exception in looking up space point ptr... 0x765d9990, 0x765d94e0
Caught exception in looking up space point ptr... 0x765d94e0, 0x765d9990
Caught exception in looking up space point ptr... 0x889487b0, 0x889461f0
Caught exception in looking up space point ptr... 0x889461f0, 0x889487b0
Caught exception in looking up space point ptr... 0x881903b0, 0x7a1e6600
Caught exception in looking up space point ptr... 0x49199590, 0x881903b0
Caught exception in looking up space point ptr... 0x65ff4830, 0x65ff4730
Caught exception in looking up space point ptr... 0x65ff4730, 0x65ff4830
Caught exception in looking up space point ptr... 0x6600e0a0, 0x6600df10
Caught exception in looking up space point ptr... 0x6600df10, 0x6600e0a0
Caught exception in looking up space point ptr... 0x85479070, 0x85478ee0
Caught exception in looking up space point ptr... 0x85478ee0, 0x85479070
Caught exception in looking up space point ptr... 0x890cd890, 0x890c4e10
Caught exception in looking up space point ptr... 0x890c4e10, 0x890cd890
Caught exception in looking up space point ptr... 0x890cd890, 0x4d972480
Caught exception in looking up space point ptr... 0x4d972480, 0x890cd890
Caught exception in looking up space point ptr... 0x908895c0, 0x78c5dbd0
Caught exception in looking up space point ptr... 0x78c5dbd0, 0x908895c0
Caught exception in looking up space point ptr... 0x8e396f60, 0x806ef580
Caught exception in looking up space point ptr... 0x806ef580, 0x8e396f60
Caught exception in looking up space point ptr... 0x8085f330, 0x8085f130
Caught exception in looking up space point ptr... 0x8085f130, 0x8085f330
Caught exception in looking up space point ptr... 0x793e8d30, 0x76b6a8a0
Caught exception in looking up space point ptr... 0x76b6a8a0, 0x76ee1840
Caught exception in looking up space point ptr... 0x80429d40, 0x80430660
Caught exception in looking up space point ptr... 0x80430660, 0x80429d40
Caught exception in looking up space point ptr... 0x5012e840, 0x5012dd90
Caught exception in looking up space point ptr... 0x5012dd90, 0x5012e840
Caught exception in looking up space point ptr... 0x87990980, 0x87990830
Caught exception in looking up space point ptr... 0x87990830, 0x87990980
Caught exception in looking up space point ptr... 0x7cd33f00, 0x7cd33250
Caught exception in looking up space point ptr... 0x7cd33250, 0x7cd3af20
Caught exception in looking up space point ptr... 0x6434fdc0, 0x6434f4a0
Caught exception in looking up space point ptr... 0x6434f4a0, 0x6434fdc0
Caught exception in looking up space point ptr... 0x7ae5a700, 0x7ae5a900
Caught exception in looking up space point ptr... 0x7ae5a900, 0x7ae5aa00
Caught exception in looking up space point ptr... 0x77816650, 0x778165b0
Caught exception in looking up space point ptr... 0x778165b0, 0x77816650
Caught exception in looking up space point ptr... 0x48536b50, 0x485362f0
Caught exception in looking up space point ptr... 0x485362f0, 0x48536b50
Caught exception in looking up space point ptr... 0x48536b50, 0x485364a0
Caught exception in looking up space point ptr... 0x485364a0, 0x48536b50
Caught exception in looking up space point ptr... 0x6f59d810, 0x630a9f40
Caught exception in looking up space point ptr... 0x630a9f40, 0x6f59d810
Caught exception in looking up space point ptr... 0x6f59d810, 0x6f59dd70
Caught exception in looking up space point ptr... 0x6f59dd70, 0x6f59d810
Caught exception in looking up space point ptr... 0x6f59dae0, 0x630aaa50
Caught exception in looking up space point ptr... 0x630aaa50, 0x6f59dae0
Caught exception in looking up space point ptr... 0x77290c00, 0x79238130
Caught exception in looking up space point ptr... 0x79238130, 0x772902c0
Caught exception in looking up space point ptr... 0x74939620, 0x68ef68f0
Caught exception in looking up space point ptr... 0x68ef68f0, 0x826944e0
++++>>>> total num hits: 88911, num free: 84121
04-Feb-2026 01:22:46 CET Closed output file "np02vd_raw_run042421_0133_df-s02-d0_dw_0_20260203T144256_reco_stage0_20260204T002246_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 96.4486 112.881 133.915 110.871 9.87171 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.632e-05 0.000129035 0.000577904 9.9922e-05 9.14078e-05 27
produce:tpcrawdecoder:PDVDTPCReader 12.785 14.0692 16.2745 13.6507 1.01467 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.519791 0.547402 0.63654 0.545159 0.024824 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0176398 0.0181929 0.0187645 0.0181909 0.000354725 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0873683 0.0984042 0.107975 0.104536 0.00824072 27
produce:beamevent:BeamEvent 0.000129176 0.000239742 0.00129796 0.000174083 0.000217689 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.46493 4.11438 4.60356 4.10757 0.282127 27
produce:ophit:OpHitFinder 0.0389003 0.0520937 0.0889453 0.0525077 0.00953396 27
produce:wclsdatavd:WireCellToolkit 63.5406 76.6121 94.5417 74.5663 8.32755 27
produce:gaushit:GausHitFinder 0.517091 0.967369 1.96259 0.869433 0.339913 27
produce:nhitsfilter:NumberOfHitsFilter 0.000213843 0.00102462 0.00243979 0.000871898 0.000601716 27
produce:reco3d:SpacePointSolver 4.73273 9.35789 14.1801 9.77593 2.49583 27
produce:hitpdune:DisambigFromSpacePoints 0.057423 0.119682 0.253925 0.113569 0.0433226 27
produce:cluster3d:Cluster3D 0.929585 2.51062 5.11392 2.08585 1.17704 27
[art]:TriggerResults:TriggerResultInserter 2.7782e-05 5.0161e-05 0.000167994 4.601e-05 2.82247e-05 27
end_path:out1:RootOutput 3.836e-06 7.40048e-06 3.7537e-05 5.809e-06 6.54257e-06 27
end_path:out1:RootOutput(write) 3.44425 4.3577 5.56145 4.12292 0.672438 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4606.28 MB
Peak resident set size usage (VmHWM): 2610.94 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0133_df-s02-d0_dw_0_20260203T144256_reco_stage0_20260204T002246_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0133_df-s02-d0_dw_0_20260203T144256_reco_stage0_20260204T002246_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0133_df-s02-d0_dw_0_20260203T144256_reco_stage0_20260204T002246_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161428.0,
"core.end_time": 1770164568.0,
"core.events": [
21612,
21618,
21624,
21630,
21636,
21642,
21648,
21654,
21660,
21666,
21672,
21678,
21684,
21690,
21696,
21702,
21708,
21714,
21720,
21726,
21732,
21738,
21744,
21750,
21756,
21762,
21768
],
"core.event_count": 27,
"core.first_event_number": 21612,
"core.last_event_number": 21768,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0133_df-s02-d0_dw_0_20260203T144256.hdf5"
}
]
} 